syzbot

 sign-in | mailing list | source | docs
🐞 Open [993] ≡ Subsystems 🐞 Fixed [5244] 🐞 Invalid [12515] ⬇ Missing Backports [83] 📈 Kernel Health 📈 Bug Lifetimes 📈 Fuzzing 📈 Crashes 💬 Send us feedback

INFO: rcu detected stall in smp_call_function

Status: fixed on 2021/04/13 06:26
Subsystems: perf
[Documentation on labels]
Reported-by: syzbot+cb3b69ae80afd6535b0e@syzkaller.appspotmail.com
Fix commit: c583bcb8f5ed rcu: Don't invoke try_invoke_on_locked_down_task() with irqs disabled 1b7af295541d sched/core: Allow try_invoke_on_locked_down_task() with irqs disabled
First crash: 1388d, last: 1112d
▶ ▼ Discussions (16)
Title Replies (including bot) Last reply
[PATCH 5.10 000/102] 5.10.21-rc1 review 119 (119) 2021/03/08 13:21
[PATCH 5.11 000/104] 5.11.4-rc1 review 119 (119) 2021/03/07 11:37
[PATCH AUTOSEL 5.11 01/67] ath10k: prevent deinitializing NAPI twice 80 (80) 2021/03/06 17:52
[PATCH AUTOSEL 5.10 01/56] EDAC/amd64: Do not load on family 0x15, model 0x13 59 (59) 2021/03/05 12:40
[tip: core/rcu] sched/core: Allow try_invoke_on_locked_down_task() with irqs disabled 1 (1) 2021/02/12 12:37
[PATCH tip/core/rcu 0/6] Miscellaneous fixes for v5.12 7 (7) 2021/01/06 00:57
RCU stall leading to deadlock warning 4 (4) 2020/12/16 18:10
[PATCH] kfence: Avoid stalling work queue task without allocations 63 (63) 2020/11/25 10:28
[PATCH 5.9 000/252] 5.9.11-rc1 review 259 (259) 2020/11/24 20:28
linux-next: Signed-off-by missing for commit in the rcu tree 6 (6) 2020/11/18 23:40
[PATCH tip/core/rcu 0/16] Miscellaneous fixes for v5.11 17 (17) 2020/11/05 23:09
Re: INFO: rcu detected stall in sys_exit_group (6) 3 (3) 2020/10/30 13:27
Re: INFO: rcu detected stall in sys_exit_group (6) 2 (2) 2020/09/24 22:26
sched/core: Allow try_invoke_on_locked_down_task() with irqs disabled 1 (1) 2020/09/16 15:53
INFO: rcu detected stall in smp_call_function 6 (8) 2020/09/06 18:40
[PATCH v4 00/23] kprobes: Unify kretprobe trampoline handlers and make kretprobe lockless 41 (41) 2020/08/29 17:31
▶ ▼ Similar bugs (10)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream BUG: soft lockup in smp_call_function kernel C done 1010 7h40m 1384d 0/26 upstream: reported C repro on 2020/07/12 23:02
linux-6.1 BUG: soft lockup in smp_call_function 49 20h55m 406d 0/3 upstream: reported on 2023/03/18 00:36
linux-5.15 BUG: soft lockup in smp_call_function origin:upstream missing-backport C error 85 6d11h 404d 0/3 upstream: reported C repro on 2023/03/19 12:10
android-6-1 BUG: soft lockup in smp_call_function origin:upstream C 27 15h00m 24d 0/2 upstream: reported C repro on 2024/04/02 06:05
linux-4.19 BUG: soft lockup in smp_call_function C error 2 606d 734d 0/1 upstream: reported C repro on 2022/04/23 05:26
android-54 BUG: soft lockup in smp_call_function 1 903d 903d 0/2 auto-closed as invalid on 2022/03/05 18:04
linux-4.14 BUG: soft lockup in smp_call_function C 1 432d 735d 0/1 upstream: reported C repro on 2022/04/23 04:43
android-5-15 BUG: soft lockup in smp_call_function origin:upstream C error inconclusive 294 6h13m 418d 0/2 upstream: reported C repro on 2023/03/05 21:20
android-54 BUG: soft lockup in smp_call_function (2) C 15 5d06h 90d 0/2 upstream: reported C repro on 2024/01/28 03:58
android-5-10 BUG: soft lockup in smp_call_function C error 40 3h08m 279d 0/2 upstream: reported C repro on 2023/07/22 22:59

Sample crash report:
rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
rcu: 	0-....: (1 GPs behind) idle=932/1/0x4000000000000002 softirq=9344/9345 fqs=5247 
	(detected by 1, t=10502 jiffies, g=10529, q=124891)
Sending NMI from CPU 1 to CPUs 0:
NMI backtrace for cpu 0
CPU: 0 PID: 8110 Comm: syz-executor267 Not tainted 5.9.0-rc3-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
RIP: 0010:bytes_is_nonzero mm/kasan/generic.c:91 [inline]
RIP: 0010:memory_is_nonzero mm/kasan/generic.c:108 [inline]
RIP: 0010:memory_is_poisoned_n mm/kasan/generic.c:134 [inline]
RIP: 0010:memory_is_poisoned mm/kasan/generic.c:165 [inline]
RIP: 0010:check_memory_region_inline mm/kasan/generic.c:183 [inline]
RIP: 0010:check_memory_region+0xdb/0x180 mm/kasan/generic.c:192
Code: 80 38 00 74 f2 48 89 c2 b8 01 00 00 00 48 85 d2 75 56 5b 5d 41 5c c3 48 85 d2 74 5e 48 01 ea eb 09 48 83 c0 01 48 39 d0 74 50 <80> 38 00 74 f2 eb d4 41 bc 08 00 00 00 48 89 ea 45 29 dc 4d 8d 1c
RSP: 0018:ffffc90000007090 EFLAGS: 00000086
RAX: fffff52000000e30 RBX: fffff52000000e3c RCX: ffffffff81339c7a
RDX: fffff52000000e3c RSI: 0000000000000060 RDI: ffffc90000007180
RBP: fffff52000000e30 R08: 0000000000000001 R09: ffffc900000071df
R10: fffff52000000e3b R11: 0000000000000001 R12: 0000000000000060
R13: 0000000000000000 R14: 000000000000007f R15: ffffc90000007180
FS:  0000000000cf9880(0000) GS:ffff8880ae600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000000008319c CR3: 000000009f579000 CR4: 00000000001506f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <IRQ>
 memset+0x20/0x40 mm/kasan/common.c:84
 memset include/linux/string.h:391 [inline]
 __unwind_start+0x2a/0x800 arch/x86/kernel/unwind_orc.c:630
 unwind_start arch/x86/include/asm/unwind.h:60 [inline]
 perf_callchain_kernel+0x2f0/0x6a0 arch/x86/events/core.c:2447
 get_perf_callchain+0x16e/0x620 kernel/events/callchain.c:200
 perf_callchain+0x165/0x1c0 kernel/events/core.c:6985
 perf_prepare_sample+0x8fd/0x1d40 kernel/events/core.c:7012
 __perf_event_output kernel/events/core.c:7170 [inline]
 perf_event_output_forward+0xf3/0x270 kernel/events/core.c:7190
 __perf_event_overflow+0x13c/0x370 kernel/events/core.c:8845
 perf_swevent_overflow kernel/events/core.c:8921 [inline]
 perf_swevent_event+0x347/0x550 kernel/events/core.c:8949
 perf_tp_event+0x2e4/0xb50 kernel/events/core.c:9377
 perf_trace_run_bpf_submit+0x11c/0x200 kernel/events/core.c:9351
 perf_trace_preemptirq_template+0x289/0x440 include/trace/events/preemptirq.h:14
 trace_irq_enable_rcuidle include/trace/events/preemptirq.h:40 [inline]
 trace_irq_enable_rcuidle include/trace/events/preemptirq.h:40 [inline]
 trace_hardirqs_on+0x18a/0x220 kernel/trace/trace_preemptirq.c:44
 asm_sysvec_irq_work+0x12/0x20 arch/x86/include/asm/idtentry.h:611
RIP: 0010:arch_local_irq_restore arch/x86/include/asm/paravirt.h:770 [inline]
RIP: 0010:rcu_read_unlock_special kernel/rcu/tree_plugin.h:630 [inline]
RIP: 0010:__rcu_read_unlock+0x26e/0x530 kernel/rcu/tree_plugin.h:395
Code: ba 00 00 00 00 00 fc ff df 48 c1 e8 03 80 3c 10 00 0f 85 a3 02 00 00 48 83 3d d5 9c 54 08 00 0f 84 18 02 00 00 4c 89 e7 57 9d <0f> 1f 44 00 00 e9 07 fe ff ff 0f 0b e9 41 fe ff ff e8 5c b1 52 00
RSP: 0018:ffffc90000007b40 EFLAGS: 00000282
RAX: 1ffffffff136c789 RBX: ffffffff89bd9a80 RCX: 0000000000000002
RDX: dffffc0000000000 RSI: 0000000000000101 RDI: 0000000000000282
RBP: 0000000000000001 R08: 0000000000000001 R09: ffffffff8c5f4a97
R10: fffffbfff18be952 R11: 0000000000000001 R12: 0000000000000282
R13: 0000000000000200 R14: ffff8880ae636c00 R15: 0000000000000000
 rcu_read_unlock include/linux/rcupdate.h:687 [inline]
 mld_sendpack+0x742/0xdb0 net/ipv6/mcast.c:1690
 mld_send_initial_cr.part.0+0x106/0x150 net/ipv6/mcast.c:2096
 mld_send_initial_cr net/ipv6/mcast.c:1191 [inline]
 mld_dad_timer_expire+0x1c7/0x6a0 net/ipv6/mcast.c:2115
 call_timer_fn+0x1ac/0x760 kernel/time/timer.c:1413
 expire_timers kernel/time/timer.c:1458 [inline]
 __run_timers.part.0+0x67c/0xaa0 kernel/time/timer.c:1755
 __run_timers kernel/time/timer.c:1736 [inline]
 run_timer_softirq+0xae/0x1a0 kernel/time/timer.c:1768
 __do_softirq+0x1f7/0xa91 kernel/softirq.c:298
 asm_call_on_stack+0xf/0x20 arch/x86/entry/entry_64.S:706
 </IRQ>
 __run_on_irqstack arch/x86/include/asm/irq_stack.h:22 [inline]
 run_on_irqstack_cond arch/x86/include/asm/irq_stack.h:48 [inline]
 do_softirq_own_stack+0x9d/0xd0 arch/x86/kernel/irq_64.c:77
 invoke_softirq kernel/softirq.c:393 [inline]
 __irq_exit_rcu kernel/softirq.c:423 [inline]
 irq_exit_rcu+0x235/0x280 kernel/softirq.c:435
 sysvec_apic_timer_interrupt+0x51/0xf0 arch/x86/kernel/apic/apic.c:1091
 asm_sysvec_apic_timer_interrupt+0x12/0x20 arch/x86/include/asm/idtentry.h:581
RIP: 0010:arch_local_irq_restore arch/x86/include/asm/paravirt.h:770 [inline]
RIP: 0010:generic_exec_single+0x2b6/0x430 kernel/smp.c:172
Code: 00 fc ff df 48 c1 e8 03 80 3c 10 00 0f 85 2d 01 00 00 48 83 3d 82 fd 4c 08 00 0f 84 f3 00 00 00 e8 2f 0c 0b 00 48 89 df 57 9d <0f> 1f 44 00 00 45 31 e4 e9 34 fe ff ff e8 18 0c 0b 00 0f 0b e9 95
RSP: 0018:ffffc90009cbfb08 EFLAGS: 00000293
RAX: 0000000000000000 RBX: 0000000000000293 RCX: 0000000000000006
RDX: ffff88809054a380 RSI: ffffffff81693ed1 RDI: 0000000000000293
RBP: 0000000000000200 R08: 0000000000000001 R09: ffffffff8c5f4ab7
R10: fffffbfff18be956 R11: 0000000000000001 R12: ffffc90009cbfb80
R13: ffffffff818dc1d0 R14: ffffc90009cbfc48 R15: 1ffff92001397f9e
 smp_call_function_single+0x186/0x4f0 kernel/smp.c:379
 task_function_call+0xd7/0x160 kernel/events/core.c:116
 perf_install_in_context+0x2cb/0x550 kernel/events/core.c:2895
 __do_sys_perf_event_open+0x1c31/0x2cb0 kernel/events/core.c:11992
 do_syscall_64+0x2d/0x70 arch/x86/entry/common.c:46
 entry_SYSCALL_64_after_hwframe+0x44/0xa9
RIP: 0033:0x443f79
Code: e8 2c e8 ff ff 48 83 c4 18 c3 0f 1f 80 00 00 00 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 0f 83 0b 09 fc ff c3 66 2e 0f 1f 84 00 00 00 00
RSP: 002b:00007fffe1fb0778 EFLAGS: 00000246 ORIG_RAX: 000000000000012a
RAX: ffffffffffffffda RBX: 0000000000000003 RCX: 0000000000443f79
RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000020000100
RBP: 000000000008319c R08: 0000000000000000 R09: 0000000100000009
R10: 00000000ffffffff R11: 0000000000000246 R12: 0000000000000000
R13: 0000000000404da0 R14: 0000000000000000 R15: 0000000000000000
INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 0.000 msecs

Crashes (107):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2020/09/06 18:40 upstream dd9fb9bb3340 abf9ba4f .config console log report syz C ci-upstream-kasan-gce-root
2021/04/03 04:46 upstream d93a0d43e3d0 6a81331a .config console log report info ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in smp_call_function
2021/02/05 14:01 upstream dd86e7fa07a3 23a562df .config console log report info ci-upstream-kasan-gce-selinux-root INFO: rcu detected stall in smp_call_function
2021/01/28 15:36 upstream 76c057c84d28 7df34f59 .config console log report info ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in smp_call_function
2021/01/23 23:58 upstream e1ae4b0be158 52e37319 .config console log report info ci-upstream-kasan-gce-root INFO: rcu detected stall in smp_call_function
2021/01/22 21:14 upstream 83d09ad4b950 4080af96 .config console log report info ci-upstream-kasan-gce-root INFO: rcu detected stall in smp_call_function
2021/01/17 21:15 upstream a1339d6355ac 813be542 .config console log report info ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in smp_call_function
2021/04/10 09:38 linux-next e99d8a849517 bfeda1b1 .config console log report info ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in smp_call_function
2021/01/23 09:11 linux-next bc085f8fc88f 52e37319 .config console log report info ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in smp_call_function
2021/01/17 02:03 upstream 0da0a8a0a0e1 65a7a854 .config console log report info ci-upstream-kasan-gce-root
2021/01/10 02:09 upstream 996e435fd401 2c1f2513 .config console log report info ci-upstream-kasan-gce-selinux-root
2020/12/21 13:01 upstream e37b12e4bb21 04201c06 .config console log report info ci-upstream-kasan-gce-selinux-root
2020/11/30 09:06 upstream b65054597872 a0092f9d .config console log report info ci-upstream-kasan-gce-root
2020/11/26 13:19 upstream fa02fcd94b0c 1d2b823e .config console log report info ci-upstream-kasan-gce-selinux-root
2020/11/23 10:20 upstream 418baf2c28f3 0d27f508 .config console log report info ci-upstream-kasan-gce-root
2020/11/21 08:28 upstream 27bba9c532a8 68068804 .config console log report info ci-upstream-kasan-gce-selinux-root
2020/11/20 09:42 upstream 4d02da974ea8 0767f13f .config console log report info ci-upstream-kasan-gce-selinux-root
2020/11/17 21:50 upstream 111e91a6df50 bd2a760b .config console log report info ci-upstream-kasan-gce-smack-root
2020/10/06 01:13 upstream 7575fdda569b 1880b4a9 .config console log report info ci-upstream-kasan-gce-selinux-root
2020/10/05 02:14 upstream 549738f15da0 5ef9c291 .config console log report info ci-upstream-kasan-gce-root
2020/10/02 16:37 upstream 472e5b056f00 4969d6ca .config console log report info ci-upstream-kasan-gce-selinux-root
2020/09/29 22:29 upstream ccc1d052eff9 5abc3f1a .config console log report info ci-upstream-kasan-gce-root
2020/09/26 06:33 upstream 7c7ec3226f5f 4a006f63 .config console log report info ci-upstream-kasan-gce-selinux-root
2020/09/19 13:18 upstream eb5f95f1593f 53ce8104 .config console log report info ci-upstream-kasan-gce-selinux-root
2020/09/19 06:08 upstream 10b82d517648 53ce8104 .config console log report info ci-upstream-kasan-gce-selinux-root
2020/09/11 08:56 upstream 581cb3a26baf adfb8b4e .config console log report ci-upstream-kasan-gce-root
2020/09/10 08:16 upstream 34d4ddd359db 409809d8 .config console log report ci-upstream-kasan-gce-root
2020/09/08 18:34 upstream f4d51dffc6c0 abf9ba4f .config console log report ci-upstream-kasan-gce-smack-root
2020/09/07 04:20 upstream f4d51dffc6c0 abf9ba4f .config console log report ci-upstream-kasan-gce-selinux-root
2020/09/07 01:29 upstream f4d51dffc6c0 abf9ba4f .config console log report ci-upstream-kasan-gce-root
2020/09/06 12:58 upstream dd9fb9bb3340 abf9ba4f .config console log report ci-upstream-kasan-gce-root
2020/09/05 13:17 upstream c70672d8d316 abf9ba4f .config console log report ci-upstream-kasan-gce-root
2020/09/05 05:34 upstream c70672d8d316 abf9ba4f .config console log report ci-upstream-kasan-gce-smack-root
2020/09/04 00:22 upstream e28f0104343d abf9ba4f .config console log report ci-upstream-kasan-gce-smack-root
2020/08/30 03:39 upstream 1127b219ce94 d5a3ae1f .config console log report ci-upstream-kasan-gce-smack-root
2020/08/28 22:35 upstream 96d454cd2c16 d5a3ae1f .config console log report ci-upstream-kasan-gce-root
2020/07/28 23:54 upstream 6ba1b005ffc3 cb93dc6a .config console log report ci-upstream-kasan-gce-smack-root
2020/07/25 07:05 upstream 68845a55c31b 1f7cc1ca .config console log report ci-upstream-kasan-gce-selinux-root
2020/07/08 21:49 upstream 0bddd227f3dc bc238812 .config console log report ci-upstream-kasan-gce-selinux-root
2020/09/08 05:52 bpf e6135df45e21 abf9ba4f .config console log report ci-upstream-bpf-kasan-gce
2020/09/03 11:26 bpf 1eb832ac2dee abf9ba4f .config console log report ci-upstream-bpf-kasan-gce
2020/08/31 11:04 net-old c8146fe292a7 d5a3ae1f .config console log report ci-upstream-net-this-kasan-gce
2020/09/01 11:35 bpf-next 29523c5e6716 d5a3ae1f .config console log report ci-upstream-bpf-next-kasan-gce
2020/08/29 21:01 bpf-next 10496f261ed3 d5a3ae1f .config console log report ci-upstream-bpf-next-kasan-gce
2020/08/29 03:47 bpf-next 661b37cd437e d5a3ae1f .config console log report ci-upstream-bpf-next-kasan-gce
2021/01/06 06:26 linux-next 7e4525a4232f b1c228e1 .config console log report info ci-upstream-linux-next-kasan-gce-root
2021/01/04 04:37 linux-next 766eff5a4f6c 79264ae3 .config console log report info ci-upstream-linux-next-kasan-gce-root
2020/12/29 17:24 linux-next d7a03a44a5e9 80910769 .config console log report info ci-upstream-linux-next-kasan-gce-root
2020/12/28 17:25 linux-next d7a03a44a5e9 8259d56c .config console log report info ci-upstream-linux-next-kasan-gce-root
2020/12/16 18:03 linux-next 26aed0ea32c8 04201c06 .config console log report info ci-upstream-linux-next-kasan-gce-root
2020/12/13 07:39 linux-next 14240d4c5b25 bca53db9 .config console log report info ci-upstream-linux-next-kasan-gce-root
2020/12/09 06:45 linux-next a9e26cb5f261 40cc414d .config console log report info ci-upstream-linux-next-kasan-gce-root
2020/12/01 02:56 linux-next c6b11acc5f85 b3a34598 .config console log report info ci-upstream-linux-next-kasan-gce-root
2020/11/23 12:12 linux-next 62918e6fd7b5 0d27f508 .config console log report info ci-upstream-linux-next-kasan-gce-root
2020/10/07 21:46 linux-next 8b787da7ba8c 1880b4a9 .config console log report info ci-upstream-linux-next-kasan-gce-root
2020/10/03 23:47 linux-next 2172e358cd17 1a3f9408 .config console log report info ci-upstream-linux-next-kasan-gce-root
2020/10/01 13:13 linux-next d39294091fee a9767fb2 .config console log report info ci-upstream-linux-next-kasan-gce-root
2020/09/13 23:00 linux-next d5b2251d63b5 2d3cdd63 .config console log report ci-upstream-linux-next-kasan-gce-root
* Struck through repros no longer work on HEAD.