syzbot

 sign-in | mailing list | source | docs
🐞 Open [979] ≡ Subsystems 🐞 Fixed [5236] 🐞 Invalid [12499] ⬇ Missing Backports [83] 📈 Kernel Health 📈 Bug Lifetimes 📈 Fuzzing 📈 Crashes 💬 Send us feedback

INFO: rcu detected stall in worker_thread (6)

Status: auto-obsoleted due to no activity on 2023/01/12 15:50
Subsystems: kernel
[Documentation on labels]
First crash: 568d, last: 568d
▶ ▼ Similar bugs (9)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: rcu detected stall in worker_thread (3) cgroups mm 1 1568d 1568d 0/26 closed as invalid on 2020/01/08 05:33
upstream INFO: rcu detected stall in worker_thread (4) cgroups mm 28 1568d 1568d 0/26 closed as invalid on 2020/01/09 08:13
linux-5.15 INFO: rcu detected stall in worker_thread 1 208d 208d 0/3 auto-obsoleted due to no activity on 2024/01/09 18:17
upstream INFO: rcu detected stall in worker_thread (8) kernel 1 351d 351d 0/26 auto-obsoleted due to no activity on 2023/08/07 05:14
upstream INFO: rcu detected stall in worker_thread (5) kernel 2 692d 729d 0/26 auto-closed as invalid on 2022/08/31 00:50
upstream INFO: rcu detected stall in worker_thread (9) netfilter C done 110 9h11m 200d 0/26 upstream: reported C repro on 2023/10/07 18:33
upstream INFO: rcu detected stall in worker_thread (2) cgroups mm 12 1568d 1568d 0/26 closed as invalid on 2020/01/08 05:23
upstream INFO: rcu detected stall in worker_thread cgroups mm 150 1603d 1605d 0/26 closed as invalid on 2019/12/04 14:14
upstream INFO: rcu detected stall in worker_thread (7) kernel 1 461d 461d 0/26 auto-obsoleted due to no activity on 2023/04/27 16:37

Sample crash report:
rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
rcu: 	0-...!: (0 ticks this GP) idle=d264/1/0x4000000000000000 softirq=219878/219878 fqs=0
	(detected by 1, t=10505 jiffies, g=330777, q=478 ncpus=2)
Sending NMI from CPU 1 to CPUs 0:
NMI backtrace for cpu 0
CPU: 0 PID: 18423 Comm: kworker/u4:5 Not tainted 6.0.0-syzkaller-00372-ga5088ee7251e #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 09/22/2022
Workqueue:  0x0 (events_unbound)
RIP: 0010:trace_lock_acquire include/trace/events/lock.h:24 [inline]
RIP: 0010:lock_acquire+0xc5/0x570 kernel/locking/lockdep.c:5637
Code: 08 00 00 00 48 89 d0 48 89 54 24 08 48 c1 e8 06 48 8d 3c c5 50 ec de 8d e8 f8 00 69 00 48 8b 54 24 08 48 0f a3 15 4b 6e 7f 0c <0f> 82 83 03 00 00 48 c7 c0 0c 20 df 8d 48 ba 00 00 00 00 00 fc ff
RSP: 0018:ffffc90000007d40 EFLAGS: 00000047
RAX: 0000000000000001 RBX: 1ffff92000000faa RCX: ffffffff815f7df8
RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff8ddeec50
RBP: 0000000000000001 R08: 0000000000000000 R09: ffffffff8ddeec57
R10: fffffbfff1bbdd8a R11: 0000000000000000 R12: 0000000000000000
R13: 0000000000000000 R14: ffff8880b9a2a558 R15: 0000000000000000
FS:  0000000000000000(0000) GS:ffff8880b9a00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f93ad70b800 CR3: 00000000480cf000 CR4: 0000000000350ef0
Call Trace:
 <IRQ>
 __raw_spin_lock_irq include/linux/spinlock_api_smp.h:119 [inline]
 _raw_spin_lock_irq+0x32/0x50 kernel/locking/spinlock.c:170
 __run_hrtimer kernel/time/hrtimer.c:1689 [inline]
 __hrtimer_run_queues+0x23e/0xe40 kernel/time/hrtimer.c:1749
 hrtimer_interrupt+0x31c/0x790 kernel/time/hrtimer.c:1811
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1095 [inline]
 __sysvec_apic_timer_interrupt+0x146/0x530 arch/x86/kernel/apic/apic.c:1112
 sysvec_apic_timer_interrupt+0x8e/0xc0 arch/x86/kernel/apic/apic.c:1106
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:649
RIP: 0010:__raw_spin_unlock_irq include/linux/spinlock_api_smp.h:160 [inline]
RIP: 0010:_raw_spin_unlock_irq+0x25/0x40 kernel/locking/spinlock.c:202
Code: 0f 1f 44 00 00 55 48 8b 74 24 08 48 89 fd 48 83 c7 18 e8 8e 02 dc f7 48 89 ef e8 16 84 dc f7 e8 e1 18 ff f7 fb bf 01 00 00 00 <e8> d6 44 cf f7 65 8b 05 ef fb 7e 76 85 c0 74 02 5d c3 e8 4e 01 7d
RSP: 0018:ffffc9000b1cfe40 EFLAGS: 00000206
RAX: 00000000006ec405 RBX: ffff8880236dd880 RCX: 1ffffffff1bbd791
RDX: 0000000000000000 RSI: 0000000000000001 RDI: 0000000000000001
RBP: ffff888011869800 R08: 0000000000000001 R09: 0000000000000001
R10: ffffed100230d300 R11: 0000000000000000 R12: ffff88807e3bf400
R13: 0000000000000000 R14: ffff888076f67900 R15: ffff888011869800
 worker_thread+0x157/0x1080 kernel/workqueue.c:2456
 kthread+0x2e4/0x3a0 kernel/kthread.c:376
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:306
 </TASK>
rcu: rcu_preempt kthread timer wakeup didn't happen for 10504 jiffies! g330777 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402
rcu: 	Possible timer handling issue on cpu=0 timer-softirq=226671
rcu: rcu_preempt kthread starved for 10505 jiffies! g330777 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0
rcu: 	Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
rcu: RCU grace-period kthread stack dump:
task:rcu_preempt     state:I stack:28280 pid:   17 ppid:     2 flags:0x00004000
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5183 [inline]
 __schedule+0xadf/0x52b0 kernel/sched/core.c:6495
 schedule+0xda/0x1b0 kernel/sched/core.c:6571
 schedule_timeout+0x14a/0x2a0 kernel/time/timer.c:1935
 rcu_gp_fqs_loop+0x190/0x910 kernel/rcu/tree.c:1658
 rcu_gp_kthread+0x236/0x360 kernel/rcu/tree.c:1857
 kthread+0x2e4/0x3a0 kernel/kthread.c:376
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:306
 </TASK>
rcu: Stack dump where RCU GP kthread last ran:
Sending NMI from CPU 1 to CPUs 0:
NMI backtrace for cpu 0
CPU: 0 PID: 18423 Comm: kworker/u4:5 Not tainted 6.0.0-syzkaller-00372-ga5088ee7251e #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 09/22/2022
Workqueue:  0x0 (events_unbound)
RIP: 0010:__lock_acquire+0x344/0x56d0 kernel/locking/lockdep.c:4991
Code: 48 89 f2 0f b6 c0 83 c2 03 01 c0 38 ca 7c 08 84 c9 0f 85 64 12 00 00 41 83 bd 5c 0a 00 00 01 49 8d 7c 24 24 48 89 fa 83 d8 ff <c1> e5 0f c1 e0 0d 41 c1 e7 10 0f b7 ed 09 e8 41 81 e7 00 00 03 00
RSP: 0018:ffffc90000007ab8 EFLAGS: 00000013
RAX: 0000000000000002 RBX: ffff8880236de2f8 RCX: 0000000000000000
RDX: ffff8880236de344 RSI: 0000000000000004 RDI: ffff8880236de344
RBP: 0000000000000000 R08: 1ffff110046dbc63 R09: 0000000000000001
R10: fffffbfff1bbdd8a R11: 0000000000000000 R12: ffff8880236de320
R13: ffff8880236dd880 R14: ffffffff91389748 R15: 0000000000000000
FS:  0000000000000000(0000) GS:ffff8880b9a00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f93ad70b800 CR3: 00000000480cf000 CR4: 0000000000350ef0
Call Trace:
 <IRQ>
 lock_acquire kernel/locking/lockdep.c:5666 [inline]
 lock_acquire+0x1ab/0x570 kernel/locking/lockdep.c:5631
 __raw_spin_lock_irqsave include/linux/spinlock_api_smp.h:110 [inline]
 _raw_spin_lock_irqsave+0x39/0x50 kernel/locking/spinlock.c:162
 debug_object_activate+0x12e/0x3e0 lib/debugobjects.c:658
 debug_hrtimer_activate kernel/time/hrtimer.c:420 [inline]
 debug_activate kernel/time/hrtimer.c:475 [inline]
 enqueue_hrtimer+0x27/0x3e0 kernel/time/hrtimer.c:1084
 __run_hrtimer kernel/time/hrtimer.c:1702 [inline]
 __hrtimer_run_queues+0xaf3/0xe40 kernel/time/hrtimer.c:1749
 hrtimer_interrupt+0x31c/0x790 kernel/time/hrtimer.c:1811
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1095 [inline]
 __sysvec_apic_timer_interrupt+0x146/0x530 arch/x86/kernel/apic/apic.c:1112
 sysvec_apic_timer_interrupt+0x8e/0xc0 arch/x86/kernel/apic/apic.c:1106
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:649
RIP: 0010:__raw_spin_unlock_irq include/linux/spinlock_api_smp.h:160 [inline]
RIP: 0010:_raw_spin_unlock_irq+0x25/0x40 kernel/locking/spinlock.c:202
Code: 0f 1f 44 00 00 55 48 8b 74 24 08 48 89 fd 48 83 c7 18 e8 8e 02 dc f7 48 89 ef e8 16 84 dc f7 e8 e1 18 ff f7 fb bf 01 00 00 00 <e8> d6 44 cf f7 65 8b 05 ef fb 7e 76 85 c0 74 02 5d c3 e8 4e 01 7d
RSP: 0018:ffffc9000b1cfe40 EFLAGS: 00000206
RAX: 00000000006ec405 RBX: ffff8880236dd880 RCX: 1ffffffff1bbd791
RDX: 0000000000000000 RSI: 0000000000000001 RDI: 0000000000000001
RBP: ffff888011869800 R08: 0000000000000001 R09: 0000000000000001
R10: ffffed100230d300 R11: 0000000000000000 R12: ffff88807e3bf400
R13: 0000000000000000 R14: ffff888076f67900 R15: ffff888011869800
 worker_thread+0x157/0x1080 kernel/workqueue.c:2456
 kthread+0x2e4/0x3a0 kernel/kthread.c:376
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:306
 </TASK>

Crashes (1):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2022/10/04 10:17 upstream a5088ee7251e feb56351 .config console log report info ci-upstream-kasan-gce-root INFO: rcu detected stall in worker_thread
* Struck through repros no longer work on HEAD.