syzbot

 sign-in | mailing list | source | docs
🐞 Open [1598]
≡ Subsystems
🐞 Fixed [6144]
🐞 Invalid [15382]
⬇ Missing Backports [172]
≡ Crashes
Kernel Health Bugs/Month Bug Lifetimes Fuzzing
Total Repo Heatmap Subsystems Heatmap
💬 Send us feedback

INFO: rcu detected stall in __run_timers (5)

Status: closed as invalid on 2022/02/08 10:39
Subsystems: kernel
[Documentation on labels]
Reported-by: syzbot+60dac164de3cc11c67dc@syzkaller.appspotmail.com
First crash: 1740d, last: 1156d
Cause bisection: failed (error log, bisect log)
  
Fix bisection: failed (error log, bisect log)
  
▶ ▼ Discussions (1)
Title Replies (including bot) Last reply
INFO: rcu detected stall in __run_timers (5) 0 (1) 2020/09/05 09:59
▶ ▼ Similar bugs (12)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: rcu detected stall in __run_timers (4) tomoyo 4 1882d 1896d 0/28 auto-closed as invalid on 2020/05/06 02:55
linux-5.15 INFO: rcu detected stall in __run_timers 1 715d 715d 0/3 auto-obsoleted due to no activity on 2023/08/15 19:18
upstream INFO: rcu detected stall in __run_timers net 2 2396d 2398d 0/28 closed as invalid on 2018/09/11 10:51
upstream INFO: rcu detected stall in __run_timers (2) block 58 2268d 2392d 0/28 closed as dup on 2019/01/02 16:40
upstream INFO: rcu detected stall in __run_timers (7) kernfs 25 204d 309d 0/28 auto-obsoleted due to no activity on 2024/11/08 17:44
linux-6.1 INFO: rcu detected stall in __run_timers 1 163d 163d 0/3 auto-obsoleted due to no activity on 2025/01/28 16:20
upstream INFO: rcu detected stall in __run_timers (6) kernel 2 1124d 1140d 0/28 auto-closed as invalid on 2022/06/02 21:46
upstream INFO: rcu detected stall in __run_timers (3) mm 4 2008d 2030d 0/28 auto-closed as invalid on 2019/12/31 08:04
android-5-10 BUG: soft lockup in __run_timers 2 224d 293d 0/2 auto-obsoleted due to no activity on 2024/11/18 04:44
android-54 BUG: soft lockup in __run_timers 1 278d 278d 0/2 auto-obsoleted due to no activity on 2024/09/26 00:22
android-5-15 BUG: soft lockup in __run_timers 1 196d 196d 0/2 auto-obsoleted due to no activity on 2024/12/16 23:50
upstream BUG: soft lockup in __run_timers kernel 1 786d 782d 0/28 auto-obsoleted due to no activity on 2023/05/06 12:08

Sample crash report:
rcu: INFO: rcu_preempt self-detected stall on CPU
rcu: 	0-....: (10494 ticks this GP) idle=68e/1/0x4000000000000000 softirq=8763/8763 fqs=5239 
	(t=10501 jiffies g=9913 q=237618)
NMI backtrace for cpu 0
CPU: 0 PID: 17660 Comm: syz-executor686 Not tainted 5.9.0-rc1-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Call Trace:
 <IRQ>
 __dump_stack lib/dump_stack.c:77 [inline]
 dump_stack+0x18f/0x20d lib/dump_stack.c:118
 nmi_cpu_backtrace.cold+0x70/0xb1 lib/nmi_backtrace.c:101
 nmi_trigger_cpumask_backtrace+0x1b3/0x223 lib/nmi_backtrace.c:62
 trigger_single_cpu_backtrace include/linux/nmi.h:164 [inline]
 rcu_dump_cpu_stacks+0x194/0x1cf kernel/rcu/tree_stall.h:318
 print_cpu_stall kernel/rcu/tree_stall.h:551 [inline]
 check_cpu_stall kernel/rcu/tree_stall.h:625 [inline]
 rcu_pending kernel/rcu/tree.c:3637 [inline]
 rcu_sched_clock_irq.cold+0x5b3/0xccd kernel/rcu/tree.c:2519
 update_process_times+0x25/0xa0 kernel/time/timer.c:1710
 tick_sched_handle+0x9b/0x180 kernel/time/tick-sched.c:176
 tick_sched_timer+0x1d1/0x2a0 kernel/time/tick-sched.c:1328
 __run_hrtimer kernel/time/hrtimer.c:1524 [inline]
 __hrtimer_run_queues+0x1d5/0xfc0 kernel/time/hrtimer.c:1588
 hrtimer_interrupt+0x32a/0x930 kernel/time/hrtimer.c:1650
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1080 [inline]
 __sysvec_apic_timer_interrupt+0x142/0x5e0 arch/x86/kernel/apic/apic.c:1097
 run_on_irqstack_cond arch/x86/include/asm/irq_stack.h:50 [inline]
 sysvec_apic_timer_interrupt+0x4c/0xf0 arch/x86/kernel/apic/apic.c:1091
 asm_sysvec_apic_timer_interrupt+0x12/0x20 arch/x86/include/asm/idtentry.h:581
RIP: 0010:__raw_spin_unlock_irq include/linux/spinlock_api_smp.h:169 [inline]
RIP: 0010:_raw_spin_unlock_irq+0x4b/0x80 kernel/locking/spinlock.c:199
Code: c0 58 36 b6 89 48 ba 00 00 00 00 00 fc ff df 48 c1 e8 03 80 3c 10 00 75 31 48 83 3d c6 d0 bf 01 00 74 25 fb 66 0f 1f 44 00 00 <bf> 01 00 00 00 e8 cb 51 59 f9 65 8b 05 d4 98 0b 78 85 c0 74 02 5d
RSP: 0018:ffffc90000007e00 EFLAGS: 00000286
RAX: 1ffffffff136c6cb RBX: ffffffff86acdcf0 RCX: 0000000000000002
RDX: dffffc0000000000 RSI: 0000000000000000 RDI: ffffffff87f6656f
RBP: ffff8880ae625600 R08: 0000000000000001 R09: ffffffff8c5f5a9f
R10: fffffbfff18beb53 R11: 0000000000000001 R12: ffffc90000007e98
R13: 0000000000000000 R14: dffffc0000000000 R15: ffff8880ae625600
 expire_timers kernel/time/timer.c:1457 [inline]
 __run_timers.part.0+0x66c/0xaa0 kernel/time/timer.c:1755
 __run_timers kernel/time/timer.c:1736 [inline]
 run_timer_softirq+0xae/0x1a0 kernel/time/timer.c:1768
 __do_softirq+0x2de/0xa24 kernel/softirq.c:298
 asm_call_on_stack+0xf/0x20 arch/x86/entry/entry_64.S:706
 </IRQ>
 __run_on_irqstack arch/x86/include/asm/irq_stack.h:22 [inline]
 run_on_irqstack_cond arch/x86/include/asm/irq_stack.h:48 [inline]
 do_softirq_own_stack+0x9d/0xd0 arch/x86/kernel/irq_64.c:77
 invoke_softirq kernel/softirq.c:393 [inline]
 __irq_exit_rcu kernel/softirq.c:423 [inline]
 irq_exit_rcu+0x1f3/0x230 kernel/softirq.c:435
 sysvec_apic_timer_interrupt+0x51/0xf0 arch/x86/kernel/apic/apic.c:1091
 asm_sysvec_apic_timer_interrupt+0x12/0x20 arch/x86/include/asm/idtentry.h:581
RIP: 0010:__raw_spin_unlock_irq include/linux/spinlock_api_smp.h:169 [inline]
RIP: 0010:_raw_spin_unlock_irq+0x4b/0x80 kernel/locking/spinlock.c:199
Code: c0 58 36 b6 89 48 ba 00 00 00 00 00 fc ff df 48 c1 e8 03 80 3c 10 00 75 31 48 83 3d c6 d0 bf 01 00 74 25 fb 66 0f 1f 44 00 00 <bf> 01 00 00 00 e8 cb 51 59 f9 65 8b 05 d4 98 0b 78 85 c0 74 02 5d
RSP: 0018:ffffc900059f7978 EFLAGS: 00000286
RAX: 1ffffffff136c6cb RBX: ffff88808333e140 RCX: 0000000000000006
RDX: dffffc0000000000 RSI: 0000000000000000 RDI: ffffffff87f6656f
RBP: ffff8880ae635e40 R08: 0000000000000001 R09: ffffffff8c5f5a9f
R10: fffffbfff18beb53 R11: 0000000000000001 R12: ffff8880ae635e40
R13: ffff8880a9624240 R14: ffff8880a17a7600 R15: 0000000000000001
 finish_lock_switch kernel/sched/core.c:3517 [inline]
 finish_task_switch+0x147/0x750 kernel/sched/core.c:3617
 context_switch kernel/sched/core.c:3781 [inline]
 __schedule+0x8ed/0x21e0 kernel/sched/core.c:4527
 preempt_schedule_common+0x45/0xc0 kernel/sched/core.c:4683
 preempt_schedule_thunk+0x16/0x18 arch/x86/entry/thunk_64.S:40
 smp_call_function_single+0x467/0x4f0 kernel/smp.c:384
 task_function_call+0xd7/0x160 kernel/events/core.c:116
 perf_install_in_context+0x2cb/0x550 kernel/events/core.c:2895
 __do_sys_perf_event_open+0x1c31/0x2cb0 kernel/events/core.c:11992
 do_syscall_64+0x2d/0x70 arch/x86/entry/common.c:46
 entry_SYSCALL_64_after_hwframe+0x44/0xa9
RIP: 0033:0x441519
Code: e8 ac e8 ff ff 48 83 c4 18 c3 0f 1f 80 00 00 00 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 0f 83 6b 08 fc ff c3 66 2e 0f 1f 84 00 00 00 00
RSP: 002b:00007fff66d94e38 EFLAGS: 00000246 ORIG_RAX: 000000000000012a
RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 0000000000441519
RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000020000180
RBP: 0000000000139f03 R08: 0000000000000000 R09: 00000000004002c8
R10: 00000000ffffffff R11: 0000000000000246 R12: 0000000000402210
R13: 00000000004022a0 R14: 0000000000000000 R15: 0000000000000000

Crashes (63):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2020/09/01 09:52 bpf-next 29523c5e6716 d5a3ae1f .config console log report syz C ci-upstream-bpf-next-kasan-gce
2022/01/30 07:19 upstream f8c7e4ede46f 495e00c5 .config console log report info ci-upstream-kasan-gce-selinux-root INFO: rcu detected stall in __run_timers
2022/01/16 19:54 upstream d0a231f01e5b 723cfaf0 .config console log report info ci-upstream-kasan-gce-selinux-root INFO: rcu detected stall in __run_timers
2022/01/10 07:03 upstream e900deb24820 2ca0d385 .config console log report info ci-upstream-kasan-gce-root INFO: rcu detected stall in __run_timers
2022/01/09 19:28 upstream 4634129ad9fd 2ca0d385 .config console log report info ci-upstream-kasan-gce-selinux-root INFO: rcu detected stall in __run_timers
2021/12/31 11:04 upstream 74c78b4291b4 36bd2e48 .config console log report info ci-upstream-kasan-gce-selinux-root INFO: rcu detected stall in __run_timers
2021/12/24 04:08 upstream 76657eaef4a7 6caa12e4 .config console log report info ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in __run_timers
2021/12/18 21:33 upstream 9eaa88c7036e 44068e19 .config console log report info ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in __run_timers
2021/12/15 06:17 upstream 5472f14a3742 f752fb53 .config console log report info ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in __run_timers
2021/12/08 19:23 upstream 2a987e65025e a4a2a501 .config console log report info ci-upstream-kasan-gce-root INFO: rcu detected stall in __run_timers
2021/11/29 08:15 upstream d06c942efea4 63eeac02 .config console log report info ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in __run_timers
2021/11/21 19:14 upstream 923dcc5eb0c1 4eb20a4e .config console log report info ci-upstream-kasan-gce-selinux-root INFO: rcu detected stall in __run_timers
2021/11/11 05:07 upstream 89d714ab6043 75b04091 .config console log report info ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in __run_timers
2021/11/08 11:06 upstream 6b75d88fa81b 4c1be0be .config console log report info ci-upstream-kasan-gce-root INFO: rcu detected stall in __run_timers
2021/11/06 18:37 upstream fe91c4725aee 4c1be0be .config console log report info ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in __run_timers
2021/11/03 01:20 upstream cc0356d6a02e 17f3edd2 .config console log report info ci-upstream-kasan-gce-root INFO: rcu detected stall in __run_timers
2021/11/01 16:07 upstream 8bb7eca972ad 098b5d53 .config console log report info ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in __run_timers
2021/10/15 05:49 upstream 26d657410983 7aa5fe41 .config console log report info ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in __run_timers
2021/10/08 02:39 upstream 4a16df549d23 efe0f24d .config console log report info ci-upstream-kasan-gce-selinux-root INFO: rcu detected stall in __run_timers
2021/09/25 16:29 upstream 7d42e9818258 8cac236e .config console log report info ci-upstream-kasan-gce-root INFO: rcu detected stall in __run_timers
2021/08/18 12:43 upstream 614cb2751d31 a2fe1cb5 .config console log report info ci-upstream-kasan-gce-root INFO: rcu detected stall in __run_timers
2021/08/10 14:05 upstream 9a73fa375d58 6972b106 .config console log report info ci-upstream-kasan-gce-root INFO: rcu detected stall in __run_timers
2021/07/30 02:40 upstream 7e96bf476270 c585c7b0 .config console log report info ci-upstream-kasan-gce INFO: rcu detected stall in __run_timers
2021/07/06 01:09 upstream 3dbdb38e2869 55aa55c2 .config console log report info ci-upstream-kasan-gce-selinux-root INFO: rcu detected stall in __run_timers
2021/04/26 12:48 upstream 9f4ad9e425a1 2a82f1b3 .config console log report info ci-upstream-kasan-gce INFO: rcu detected stall in __run_timers
2021/04/10 12:30 upstream d4961772226d bfeda1b1 .config console log report info ci-upstream-kasan-gce-root INFO: rcu detected stall in __run_timers
2021/02/21 20:44 upstream 55f62bc87347 a659b3f1 .config console log report info ci-upstream-kasan-gce INFO: rcu detected stall in __run_timers
2021/02/08 02:46 upstream b75dba7f472c 2ce644fc .config console log report info ci-upstream-kasan-gce-root INFO: rcu detected stall in __run_timers
2022/01/12 19:36 upstream daadb3bd0e8d 44d1319a .config console log report info ci-upstream-kasan-gce-386 INFO: rcu detected stall in __run_timers
2022/02/01 01:25 bpf e2bcbd7769ee 6b7c57fe .config console log report info ci-upstream-bpf-kasan-gce INFO: rcu detected stall in __run_timers
2022/01/29 02:33 net-old 6449520391df 495e00c5 .config console log report info ci-upstream-net-this-kasan-gce INFO: rcu detected stall in __run_timers
2022/01/19 07:41 linux-next 6f59bc242877 731a2d23 .config console log report info ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in __run_timers
2022/01/18 21:38 linux-next 6f59bc242877 731a2d23 .config console log report info ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in __run_timers
2021/12/12 12:20 linux-next ea922272cbe5 49ca1f59 .config console log report info ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in __run_timers
2021/12/02 22:56 linux-next f81e94e91878 61f86278 .config console log report info ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in __run_timers
2021/09/28 02:03 linux-next bf5b1e621a51 78494d16 .config console log report info ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in __run_timers
2021/09/25 22:50 linux-next 5a5d008887b4 8cac236e .config console log report info ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in __run_timers
2021/08/10 10:10 linux-next da454ebf578f 6972b106 .config console log report info ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in __run_timers
2021/11/21 10:05 upstream 923dcc5eb0c1 4eb20a4e .config console log report info ci-upstream-kasan-gce-selinux-root BUG: soft lockup in __run_timers
2020/12/14 13:50 upstream 2c85ebc57b3e b22a7ec3 .config console log report info ci-upstream-kasan-gce-root
2020/12/11 06:54 upstream 33dc9614dc20 f900b48c .config console log report info ci-upstream-kasan-gce-root
2020/11/20 01:07 upstream 3494d58865ad 0767f13f .config console log report info ci-upstream-kasan-gce
2020/11/14 08:42 upstream f01c30de86f1 1bf9a662 .config console log report info ci-upstream-kasan-gce
2020/08/29 16:33 upstream 4d41ead6ead9 d5a3ae1f .config console log report ci-upstream-kasan-gce-selinux-root
2020/08/25 19:34 upstream 6a9dc5fd6170 344da168 .config console log report ci-upstream-kasan-gce-root
2020/08/23 16:07 upstream c3d8f220d012 cef5ae68 .config console log report ci-upstream-kasan-gce-smack-root
2020/08/21 18:10 upstream da2968ff879b 6436ce4b .config console log report ci-upstream-kasan-gce-smack-root
2020/08/11 19:22 upstream 00e4db51259a bacaf5fa .config console log report ci-upstream-kasan-gce-smack-root
2020/08/04 06:01 upstream bcf876870b95 196277c4 .config console log report ci-upstream-kasan-gce-selinux-root
2020/07/25 05:10 upstream f37e99aca03f 554af388 .config console log report ci-upstream-kasan-gce
2020/07/24 19:00 upstream f37e99aca03f 554af388 .config console log report ci-upstream-kasan-gce
2020/07/18 17:32 upstream 6a70f89cc58f 9c812472 .config console log report ci-upstream-kasan-gce-selinux-root
2020/07/18 13:44 upstream 6a70f89cc58f 9c812472 .config console log report ci-upstream-kasan-gce-smack-root
2020/07/15 13:06 upstream e9919e11e219 f3bec699 .config console log report ci-upstream-kasan-gce
2020/07/14 16:37 upstream 0dc589da873b ce4c95b3 .config console log report ci-upstream-kasan-gce-root
2020/07/14 15:06 upstream 0dc589da873b ce4c95b3 .config console log report ci-upstream-kasan-gce-smack-root
2020/07/13 08:01 upstream 4437dd6e8f71 9ebcc5b1 .config console log report ci-upstream-kasan-gce-root
2020/07/01 08:06 upstream 9ebcfadb0610 917afeaa .config console log report ci-upstream-kasan-gce-selinux-root
2020/06/26 17:12 upstream 4a21185cda0f aea82c00 .config console log report ci-upstream-kasan-gce
2020/08/30 02:35 bpf fa4505675e09 d5a3ae1f .config console log report ci-upstream-bpf-kasan-gce
2020/08/15 12:44 linux-next 4993e4fe12af 424dd8e7 .config console log report ci-upstream-linux-next-kasan-gce-root
2020/07/06 18:01 linux-next 9e50b94b3eb0 51095195 .config console log report ci-upstream-linux-next-kasan-gce-root
* Struck through repros no longer work on HEAD.