syzbot


INFO: rcu detected stall in tx (2)

Status: auto-closed as invalid on 2022/08/24 07:21
Reported-by: syzbot+da7323ba082560434f17@syzkaller.appspotmail.com
First crash: 362d, last: 225d
similar bugs (4):
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream BUG: soft lockup in tx C 10 2d15h 80d 0/24 upstream: reported C repro on 2022/09/18 05:29
upstream INFO: rcu detected stall in tx C error unreliable 3 459d 597d 22/24 fixed on 2021/11/10 00:50
linux-4.14 BUG: soft lockup in tx C error 2 245d 424d 0/1 upstream: reported C repro on 2021/10/09 08:02
linux-4.19 BUG: soft lockup in tx C done 1 460d 490d 1/1 fixed on 2021/10/04 07:44

Sample crash report:
rcu: INFO: rcu_preempt self-detected stall on CPU
rcu: 	1-....: (1 GPs behind) idle=63d/1/0x4000000000000000 softirq=55789/55793 fqs=5246 
	(t=10502 jiffies g=82001 q=1401)
NMI backtrace for cpu 1
CPU: 1 PID: 1223 Comm: aoe_tx0 Not tainted 5.18.0-rc4-syzkaller-00006-gd615b5416f8a #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Call Trace:
 <IRQ>
 __dump_stack lib/dump_stack.c:88 [inline]
 dump_stack_lvl+0xcd/0x134 lib/dump_stack.c:106
 nmi_cpu_backtrace.cold+0x47/0x144 lib/nmi_backtrace.c:111
 nmi_trigger_cpumask_backtrace+0x1e6/0x230 lib/nmi_backtrace.c:62
 trigger_single_cpu_backtrace include/linux/nmi.h:164 [inline]
 rcu_dump_cpu_stacks+0x262/0x3f0 kernel/rcu/tree_stall.h:343
 print_cpu_stall kernel/rcu/tree_stall.h:639 [inline]
 check_cpu_stall kernel/rcu/tree_stall.h:723 [inline]
 rcu_pending kernel/rcu/tree.c:3923 [inline]
 rcu_sched_clock_irq.cold+0xa1/0x8d6 kernel/rcu/tree.c:2625
 update_process_times+0x16d/0x200 kernel/time/timer.c:1788
 tick_sched_handle+0x9b/0x180 kernel/time/tick-sched.c:243
 tick_sched_timer+0xee/0x120 kernel/time/tick-sched.c:1473
 __run_hrtimer kernel/time/hrtimer.c:1685 [inline]
 __hrtimer_run_queues+0x1c0/0xe50 kernel/time/hrtimer.c:1749
 hrtimer_interrupt+0x31c/0x790 kernel/time/hrtimer.c:1811
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1086 [inline]
 __sysvec_apic_timer_interrupt+0x146/0x530 arch/x86/kernel/apic/apic.c:1103
 sysvec_apic_timer_interrupt+0x8e/0xc0 arch/x86/kernel/apic/apic.c:1097
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x12/0x20 arch/x86/include/asm/idtentry.h:645
RIP: 0010:__raw_spin_unlock_irqrestore include/linux/spinlock_api_smp.h:152 [inline]
RIP: 0010:_raw_spin_unlock_irqrestore+0x38/0x70 kernel/locking/spinlock.c:194
Code: 74 24 10 e8 3a 3f f0 f7 48 89 ef e8 82 be f0 f7 81 e3 00 02 00 00 75 25 9c 58 f6 c4 02 75 2d 48 85 db 74 01 fb bf 01 00 00 00 <e8> 13 de e3 f7 65 8b 05 5c e2 95 76 85 c0 74 0a 5b 5d c3 e8 40 20
RSP: 0018:ffffc900055cfa90 EFLAGS: 00000206
RAX: 0000000000000002 RBX: 0000000000000200 RCX: 1ffffffff2018546
RDX: 0000000000000000 RSI: 0000000000000202 RDI: 0000000000000001
RBP: ffffffff90883678 R08: 0000000000000001 R09: ffffffff9005ba17
R10: 0000000000000001 R11: 0000000000000001 R12: 0000000000000020
R13: ffff88801a07f8b0 R14: ffff88801ba20fe0 R15: 0000000000000001
 spin_unlock_irqrestore include/linux/spinlock.h:404 [inline]
 uart_write+0x423/0x570 drivers/tty/serial/serial_core.c:569
 handle_tx+0x204/0x610 drivers/net/caif/caif_serial.c:236
 __netdev_start_xmit include/linux/netdevice.h:4778 [inline]
 netdev_start_xmit include/linux/netdevice.h:4792 [inline]
 xmit_one net/core/dev.c:3532 [inline]
 dev_hard_start_xmit+0x1eb/0x920 net/core/dev.c:3548
 __dev_queue_xmit+0x2b81/0x39c0 net/core/dev.c:4176
 tx+0x68/0xb0 drivers/block/aoe/aoenet.c:63
 kthread+0x1e7/0x3b0 drivers/block/aoe/aoecmd.c:1229
 kthread+0x2e9/0x3a0 kernel/kthread.c:376
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:298
 </TASK>
----------------
Code disassembly (best guess):
   0:	74 24                	je     0x26
   2:	10 e8                	adc    %ch,%al
   4:	3a 3f                	cmp    (%rdi),%bh
   6:	f0 f7 48 89 ef e8 82 	lock testl $0xbe82e8ef,-0x77(%rax)
   d:	be
   e:	f0 f7 81 e3 00 02 00 	lock testl $0x9c257500,0x200e3(%rcx)
  15:	00 75 25 9c
  19:	58                   	pop    %rax
  1a:	f6 c4 02             	test   $0x2,%ah
  1d:	75 2d                	jne    0x4c
  1f:	48 85 db             	test   %rbx,%rbx
  22:	74 01                	je     0x25
  24:	fb                   	sti
  25:	bf 01 00 00 00       	mov    $0x1,%edi
* 2a:	e8 13 de e3 f7       	callq  0xf7e3de42 <-- trapping instruction
  2f:	65 8b 05 5c e2 95 76 	mov    %gs:0x7695e25c(%rip),%eax        # 0x7695e292
  36:	85 c0                	test   %eax,%eax
  38:	74 0a                	je     0x44
  3a:	5b                   	pop    %rbx
  3b:	5d                   	pop    %rbp
  3c:	c3                   	retq
  3d:	e8                   	.byte 0xe8
  3e:	40                   	rex
  3f:	20                   	.byte 0x20

Crashes (79):
Manager Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Title
ci-upstream-kasan-gce-selinux-root 2022/04/26 07:21 upstream d615b5416f8a 1fa34c1b .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-selinux-root 2022/04/25 21:31 upstream d615b5416f8a 152baedd .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-root 2022/01/18 14:44 upstream e3a8b6a1e70c 731a2d23 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-smack-root 2022/01/12 00:59 upstream 6f38be8f2ccd 44d1319a .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-smack-root 2022/01/11 09:05 upstream fe8152b38d3a 1884f55a .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-root 2022/01/10 21:39 upstream df0cc57e057f ddb0ab8c .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-smack-root 2022/01/10 02:13 upstream df0cc57e057f 2ca0d385 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-smack-root 2022/01/10 00:47 upstream df0cc57e057f 2ca0d385 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-smack-root 2022/01/09 01:59 upstream 21f35d2ca83e 2ca0d385 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-selinux-root 2022/01/08 23:09 upstream 21f35d2ca83e 2ca0d385 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-smack-root 2022/01/07 18:26 upstream ddec8ed2d490 2ca0d385 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-selinux-root 2022/01/05 18:12 upstream c9e6606c7fe9 6acc789a .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-root 2022/01/02 18:54 upstream 1286cc4893cf e1768e9c .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-root 2022/01/02 00:11 upstream 278218f6778b e1768e9c .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-root 2021/12/31 14:49 upstream 4f3d93c6eaff 36bd2e48 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-root 2021/12/31 12:52 upstream 74c78b4291b4 36bd2e48 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-root 2021/12/30 12:05 upstream eec4df26e24e 2e49f10d .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-selinux-root 2021/12/30 10:37 upstream eec4df26e24e 2e49f10d .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-root 2021/12/29 14:11 upstream e7c124bd0463 6cc879d4 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-root 2021/12/29 11:52 upstream e7c124bd0463 76c8cf06 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-selinux-root 2021/12/28 22:40 upstream ecf71de775a0 76c8cf06 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-selinux-root 2021/12/28 17:53 upstream a8ad9a2434dc 76c8cf06 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-root 2021/12/28 02:24 upstream a8ad9a2434dc 6b3c5e64 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-smack-root 2021/12/28 00:20 upstream a8ad9a2434dc 5140bd58 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-root 2021/12/27 17:47 upstream a8ad9a2434dc 5140bd58 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-selinux-root 2021/12/27 00:51 upstream fc74e0a40e4f e4f103c4 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-selinux-root 2021/12/26 23:12 upstream fc74e0a40e4f e4f103c4 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-root 2021/12/26 02:29 upstream e2ae0d4a6b0b 6caa12e4 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-root 2021/12/25 22:57 upstream e2ae0d4a6b0b 6caa12e4 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-root 2021/12/25 02:11 upstream b927dfc67d05 6caa12e4 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-root 2021/12/25 01:12 upstream b927dfc67d05 6caa12e4 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-root 2021/12/25 00:58 upstream b927dfc67d05 6caa12e4 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-root 2021/12/24 12:44 upstream 7a29b11da965 6caa12e4 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-selinux-root 2021/12/24 08:29 upstream 76657eaef4a7 6caa12e4 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-root 2021/12/23 10:45 upstream bc491fb12513 6caa12e4 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-smack-root 2021/12/22 20:50 upstream 3f066e882bf1 6caa12e4 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-smack-root 2021/12/22 04:41 upstream 2f47a9a4dfa3 6caa12e4 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-selinux-root 2021/12/21 05:33 upstream 86085fe79e3c 62bd192b .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-selinux-root 2021/12/20 17:29 upstream a7904a538933 021b36cb .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-smack-root 2021/12/19 00:32 upstream 3f667b5d4053 44068e19 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-smack-root 2021/12/18 03:47 upstream 6441998e2e37 44068e19 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-selinux-root 2021/12/17 02:44 upstream fa36bbe6d43f 44068e19 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-smack-root 2021/12/14 14:47 upstream 5472f14a3742 d018dd31 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-root 2021/12/14 02:19 upstream 5472f14a3742 5d14b1ea .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-selinux-root 2021/12/14 02:04 upstream 5472f14a3742 5d14b1ea .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-root 2021/12/13 22:13 upstream 2585cf9dfaad 49ca1f59 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-smack-root 2021/12/13 10:30 upstream 2585cf9dfaad 49ca1f59 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-selinux-root 2021/12/12 23:30 upstream 90d9fbc16b69 49ca1f59 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-selinux-root 2021/12/12 08:44 upstream a763d5a5abd6 49ca1f59 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-root 2021/12/12 08:43 upstream a763d5a5abd6 49ca1f59 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-root 2021/12/12 08:38 upstream a763d5a5abd6 49ca1f59 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-smack-root 2021/12/12 05:10 upstream 6f513529296f 49ca1f59 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-root 2021/12/11 02:56 upstream b8a98b6bf66a 49ca1f59 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-smack-root 2021/12/10 22:43 upstream b8a98b6bf66a 49ca1f59 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-selinux-root 2021/12/10 21:22 upstream b8a98b6bf66a 49ca1f59 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-selinux-root 2021/12/10 21:11 upstream b8a98b6bf66a 49ca1f59 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-smack-root 2021/12/10 16:43 upstream c741e49150db 49ca1f59 .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-smack-root 2021/12/10 04:03 upstream c741e49150db 4d4ce9bc .config log report info INFO: rcu detected stall in tx
ci-upstream-kasan-gce-smack-root 2021/12/10 01:37 upstream c741e49150db 4d4ce9bc .config log report info INFO: rcu detected stall in tx
ci-upstream-linux-next-kasan-gce-root 2022/02/15 14:14 linux-next ef6b35306dd8 8b9ca619 .config log report info INFO: rcu detected stall in tx
ci-upstream-linux-next-kasan-gce-root 2022/01/30 22:42 linux-next b605fdc54c2b 495e00c5 .config log report info INFO: rcu detected stall in tx
ci-upstream-linux-next-kasan-gce-root 2022/01/22 19:54 linux-next c94951012a74 214351e1 .config log report info INFO: rcu detected stall in tx
ci-upstream-linux-next-kasan-gce-root 2022/01/13 05:13 linux-next 27c9d5b3c24a 44d1319a .config log report info INFO: rcu detected stall in tx
ci-upstream-linux-next-kasan-gce-root 2022/01/11 20:51 linux-next a70bf4a85b43 44d1319a .config log report info INFO: rcu detected stall in tx
ci-upstream-linux-next-kasan-gce-root 2022/01/06 16:27 linux-next 3770333b3f8c 6acc789a .config log report info INFO: rcu detected stall in tx
ci-upstream-linux-next-kasan-gce-root 2022/01/04 04:18 linux-next ea586a076e8a 7f723fbe .config log report info INFO: rcu detected stall in tx
ci-upstream-linux-next-kasan-gce-root 2022/01/03 18:51 linux-next ea586a076e8a 4a3f34f2 .config log report info INFO: rcu detected stall in tx
ci-upstream-linux-next-kasan-gce-root 2022/01/02 09:12 linux-next ea586a076e8a e1768e9c .config log report info INFO: rcu detected stall in tx
ci-upstream-linux-next-kasan-gce-root 2022/01/01 03:19 linux-next ea586a076e8a e1768e9c .config log report info INFO: rcu detected stall in tx
ci-upstream-linux-next-kasan-gce-root 2021/12/29 16:02 linux-next ea586a076e8a 6cc879d4 .config log report info INFO: rcu detected stall in tx
ci-upstream-linux-next-kasan-gce-root 2021/12/27 18:13 linux-next ea586a076e8a 5140bd58 .config log report info INFO: rcu detected stall in tx
ci-upstream-linux-next-kasan-gce-root 2021/12/26 11:21 linux-next ea586a076e8a e4f103c4 .config log report info INFO: rcu detected stall in tx
ci-upstream-linux-next-kasan-gce-root 2021/12/24 18:54 linux-next ea586a076e8a 6caa12e4 .config log report info INFO: rcu detected stall in tx
ci-upstream-linux-next-kasan-gce-root 2021/12/23 12:27 linux-next 79f063d60c8c 6caa12e4 .config log report info INFO: rcu detected stall in tx
ci-upstream-linux-next-kasan-gce-root 2021/12/15 19:42 linux-next ea922272cbe5 572bcb40 .config log report info INFO: rcu detected stall in tx
ci-upstream-linux-next-kasan-gce-root 2021/12/12 23:36 linux-next ea922272cbe5 49ca1f59 .config log report info INFO: rcu detected stall in tx
* Struck through repros no longer work on HEAD.