INFO: rcu detected stall in __do_softirq

Status: auto-obsoleted due to no activity on 2023/04/21 04:43
Subsystems: net
[Documentation on labels]
Reported-by: syzbot+6593c6b8c8b66a07cd98@syzkaller.appspotmail.com
First crash: 2642d, last: 1315d
Cause bisection: introduced by (bisect log) :
commit 2aeac95d1a4cc85aae57ab842d5c3340df0f817f
Author: Srinivas Kandagatla <srinivas.kandagatla@linaro.org>
Date: Tue Jun 11 10:40:41 2019 +0000

  soundwire: add module_sdw_driver helper macro

Crash: INFO: rcu detected stall in __do_softirq (log)
Repro: syz .config
  
▶ ▼ Discussions (2)
Title Replies (including bot) Last reply
Reminder: 4 active syzbot reports in kvm subsystem 1 (1) 2019/09/19 05:27
INFO: rcu detected stall in __do_softirq 2 (4) 2019/08/17 07:14
▶ ▼ Similar bugs (8)
Kernel Title Rank 🛈 Repro Cause bisect Fix bisect Count Last Reported Patched Status
linux-6.1 INFO: rcu detected stall in __do_softirq 1 1 782d 782d 0/3 auto-obsoleted due to no activity on 2024/09/14 06:04
linux-5.15 INFO: rcu detected stall in __do_softirq 1 2 1001d 1020d 0/3 auto-obsoleted due to no activity on 2024/02/08 12:45
linux-4.19 INFO: rcu detected stall in __do_softirq (2) 1 9 2144d 2330d 0/1 auto-closed as invalid on 2021/01/10 17:25
upstream INFO: rcu detected stall in __do_softirq (2) mm 1 1 811d 811d 0/29 auto-obsoleted due to no activity on 2024/08/06 06:26
linux-4.14 INFO: rcu detected stall in __do_softirq 1 1 2597d 2597d 0/1 auto-closed as invalid on 2019/10/25 08:47
linux-4.19 INFO: rcu detected stall in __do_softirq 1 2 2532d 2596d 0/1 auto-closed as invalid on 2019/12/20 09:57
linux-4.14 BUG: soft lockup in __do_softirq 1 syz error 3 1910d 1952d 0/1 upstream: reported syz repro on 2021/03/23 20:32
android-5-15 BUG: soft lockup in __do_softirq 1 1 723d 723d 0/2 auto-obsoleted due to no activity on 2024/11/02 12:24
▶ ▼ Last patch testing requests (2)
Created Duration User Patch Repo Result
2023/04/21 04:16 26m retest repro linux-next OK log
2022/10/16 01:30 17m retest repro linux-next error
▶ ▼ Fix bisection attempts (1)
Created Duration User Patch Repo Result
2019/10/15 12:40 34m bisect fix linux-next OK (0) job log log

Sample crash report:
rcu: INFO: rcu_preempt self-detected stall on CPU
rcu: 	1-...!: (1 ticks this GP) idle=b66/1/0x4000000000000004 softirq=28179/28180 fqs=1 
	(t=29639 jiffies g=24749 q=37154)
NMI backtrace for cpu 1
CPU: 1 PID: 16869 Comm: syz-executor.5 Not tainted 5.3.0-rc2-next-20190801 #57
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Call Trace:
 <IRQ>
 __dump_stack lib/dump_stack.c:77 [inline]
 dump_stack+0x172/0x1f0 lib/dump_stack.c:113
 nmi_cpu_backtrace.cold+0x70/0xb2 lib/nmi_backtrace.c:101
 nmi_trigger_cpumask_backtrace+0x23b/0x28b lib/nmi_backtrace.c:62
 arch_trigger_cpumask_backtrace+0x14/0x20 arch/x86/kernel/apic/hw_nmi.c:38
 trigger_single_cpu_backtrace include/linux/nmi.h:164 [inline]
 rcu_dump_cpu_stacks+0x183/0x1cf kernel/rcu/tree_stall.h:254
 print_cpu_stall kernel/rcu/tree_stall.h:455 [inline]
 check_cpu_stall kernel/rcu/tree_stall.h:529 [inline]
 rcu_pending kernel/rcu/tree.c:2736 [inline]
 rcu_sched_clock_irq.cold+0x4dd/0xc13 kernel/rcu/tree.c:2183
 update_process_times+0x32/0x80 kernel/time/timer.c:1724
 tick_sched_handle+0xa2/0x190 kernel/time/tick-sched.c:167
 tick_sched_timer+0x53/0x140 kernel/time/tick-sched.c:1299
 __run_hrtimer kernel/time/hrtimer.c:1493 [inline]
 __hrtimer_run_queues+0x364/0xe40 kernel/time/hrtimer.c:1555
 hrtimer_interrupt+0x314/0x770 kernel/time/hrtimer.c:1617
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1068 [inline]
 smp_apic_timer_interrupt+0x160/0x610 arch/x86/kernel/apic/apic.c:1093
 apic_timer_interrupt+0xf/0x20 arch/x86/entry/entry_64.S:828
RIP: 0010:ffs arch/x86/include/asm/bitops.h:297 [inline]
RIP: 0010:__do_softirq+0x227/0x98c kernel/softirq.c:280
Code: c7 c0 b0 f4 d2 88 48 c1 e8 03 42 80 3c 30 00 0f 85 b1 06 00 00 48 83 3d 96 f2 72 01 00 0f 84 d6 05 00 00 fb 66 0f 1f 44 00 00 <b8> ff ff ff ff 48 c7 45 c8 00 91 c0 88 0f bc 45 d4 83 c0 01 89 45
RSP: 0018:ffff8880ae909f18 EFLAGS: 00000282 ORIG_RAX: ffffffffffffff13
RAX: 1ffffffff11a5e96 RBX: ffff88809aa061c0 RCX: 1ffffffff134c0be
RDX: 0000000000000000 RSI: ffffffff8177a50e RDI: ffffffff876001fc
RBP: ffff8880ae909f98 R08: ffff88809aa061c0 R09: 0000000000000000
R10: ffffffff89e49050 R11: 0000000000000001 R12: ffff888099137938
R13: 0000000000000028 R14: dffffc0000000000 R15: 0000000000000000
 invoke_softirq kernel/softirq.c:373 [inline]
 irq_exit+0x19b/0x1e0 kernel/softirq.c:413
 exiting_irq arch/x86/include/asm/apic.h:536 [inline]
 do_IRQ+0x12c/0x200 arch/x86/kernel/irq.c:259
 common_interrupt+0xf/0xf arch/x86/entry/entry_64.S:605
 </IRQ>
RIP: 0010:variable_test_bit arch/x86/include/asm/bitops.h:214 [inline]
RIP: 0010:test_bit include/asm-generic/bitops-instrumented.h:238 [inline]
RIP: 0010:kvm_test_request include/linux/kvm_host.h:1207 [inline]
RIP: 0010:kvm_check_request+0x30/0x70 include/linux/kvm_host.h:1217
Code: 41 55 41 54 49 89 f4 53 4d 8d 74 24 30 89 fb e8 f6 13 67 00 be 08 00 00 00 4c 89 f7 0f b6 db e8 36 e2 a1 00 49 0f a3 5c 24 30 <41> 0f 92 c5 31 ff 44 89 ee e8 12 15 67 00 45 84 ed 75 11 e8 c8 13
RSP: 0018:ffff8880991379e0 EFLAGS: 00000246 ORIG_RAX: ffffffffffffffd7
RAX: 0000000000000001 RBX: 000000000000001f RCX: ffffffff810b0e4a
RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffff888093c409f0
RBP: ffff888099137a00 R08: 1ffff1101278813e R09: ffffed101278813f
R10: ffffed101278813e R11: ffff888093c409f7 R12: ffff888093c409c0
R13: ffff888093c409c0 R14: ffff888093c409f0 R15: ffff888093c409f0
 vcpu_enter_guest+0x32a6/0x5e90 arch/x86/kvm/x86.c:7866
 vcpu_run arch/x86/kvm/x86.c:8151 [inline]
 kvm_arch_vcpu_ioctl_run+0x464/0x1750 arch/x86/kvm/x86.c:8359
 kvm_vcpu_ioctl+0x4dc/0xfd0 arch/x86/kvm/../../../virt/kvm/kvm_main.c:2754
 vfs_ioctl fs/ioctl.c:46 [inline]
 file_ioctl fs/ioctl.c:509 [inline]
 do_vfs_ioctl+0xdb6/0x13e0 fs/ioctl.c:696
 ksys_ioctl+0xab/0xd0 fs/ioctl.c:713
 __do_sys_ioctl fs/ioctl.c:720 [inline]
 __se_sys_ioctl fs/ioctl.c:718 [inline]
 __x64_sys_ioctl+0x73/0xb0 fs/ioctl.c:718
 do_syscall_64+0xfa/0x760 arch/x86/entry/common.c:290
 entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x459829
Code: fd b7 fb ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 0f 83 cb b7 fb ff c3 66 2e 0f 1f 84 00 00 00 00
RSP: 002b:00007fa754e29c78 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
RAX: ffffffffffffffda RBX: 0000000000000003 RCX: 0000000000459829
RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000005
RBP: 000000000075bf20 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 00007fa754e2a6d4
R13: 00000000004c2bcf R14: 00000000004d6150 R15: 00000000ffffffff

Crashes (35):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2019/08/01 15:14 linux-next 882e8691130b c692b5bd .config console log report syz ci-upstream-linux-next-kasan-gce-root
2021/10/09 05:32 upstream 741668ef7832 efe0f24d .config console log report info ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in __do_softirq
2021/06/04 22:24 upstream 16f0596fc1d7 966a236b .config console log report info ci-upstream-kasan-gce-root INFO: rcu detected stall in __do_softirq
2022/12/21 04:49 linux-next e45fb347b630 d3e76707 .config console log report info ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in __do_softirq
2020/08/04 15:58 upstream c0842fbc1b18 80a06902 .config console log report ci-upstream-kasan-gce-root
2020/04/16 07:36 upstream 00086336a8d9 c743fcb3 .config console log report ci-upstream-kasan-gce
2020/04/10 21:31 upstream c0cc271173b2 a8c6a3f8 .config console log report ci-upstream-kasan-gce
2020/03/28 07:04 upstream 69c5eea3128e 831e9a81 .config console log report ci-upstream-kasan-gce
2020/03/27 20:38 upstream 527630fbf4f1 831e9a81 .config console log report ci-upstream-kasan-gce
2020/03/08 03:17 upstream c20037652700 2e9971bb .config console log report ci-upstream-kasan-gce-root
2020/03/04 19:31 upstream 63623fd44972 c88c7b75 .config console log report ci-upstream-kasan-gce
2020/03/02 00:54 upstream 63623fd44972 c88c7b75 .config console log report ci-upstream-kasan-gce
2020/02/22 15:31 upstream 54dedb5b571d 2c36e7a7 .config console log report ci-upstream-kasan-gce-root
2020/01/24 19:18 upstream 4703d9119972 2e95ab33 .config console log report ci-upstream-kasan-gce-smack-root
2019/11/09 07:56 upstream 6737e7634951 dc438b91 .config console log report ci-upstream-kasan-gce
2019/10/31 20:22 upstream e472c64aa4fa a41ca8fa .config console log report ci-upstream-kasan-gce
2019/10/23 02:38 upstream 3b7c59a1950c 5681358a .config console log report ci-upstream-kasan-gce
2019/10/19 21:40 upstream 998d75510e37 8c88c9c1 .config console log report ci-upstream-kasan-gce-smack-root
2019/09/15 12:40 upstream 1609d7604b84 32d59357 .config console log report ci-upstream-kasan-gce-selinux-root
2019/08/31 09:14 upstream 6525771f58cb fd37b39e .config console log report ci-upstream-kasan-gce
2019/08/28 05:32 upstream 6525771f58cb fd37b39e .config console log report ci-upstream-kasan-gce-smack-root
2019/08/24 21:25 upstream 361469211f87 d21c5d9d .config console log report ci-upstream-kasan-gce-smack-root
2019/08/22 18:53 upstream bb7ba8069de9 d003d6d0 .config console log report ci-upstream-kasan-gce-selinux-root
2019/08/18 07:46 upstream 8fde2832bd0b 55bf8926 .config console log report ci-upstream-kasan-gce-root
2019/08/13 23:58 upstream ee1c7bd33e66 ef801a3e .config console log report ci-upstream-kasan-gce-smack-root
2019/08/03 03:16 upstream 97b00aff2c45 6affd8e8 .config console log report ci-upstream-kasan-gce-selinux-root
2019/07/30 11:23 upstream 2a11c76e5301 f28bf2a5 .config console log report ci-upstream-kasan-gce
2019/07/27 11:58 upstream 3ea54d9b0d65 c85e1c5b .config console log report ci-upstream-kasan-gce-selinux-root
2019/06/30 12:48 upstream 728254541ebc 7509bf36 .config console log report ci-upstream-kasan-gce
2019/06/12 09:38 upstream aa7235483a83 ea2f4006 .config console log report ci-upstream-kasan-gce-root
2019/05/03 17:27 upstream ea9866793d1e 1bfa09b9 .config console log report ci-upstream-kasan-gce-selinux-root
2019/12/04 10:40 upstream 63de37476ebd 0ecb9746 .config console log report ci-qemu-upstream-386
2019/08/08 10:52 linux-next 2ae256317763 e6ebef88 .config console log report ci-upstream-linux-next-kasan-gce-root
2019/07/22 08:52 linux-next 6d21a41b7b1f b3c615f5 .config console log report ci-upstream-linux-next-kasan-gce-root
2019/06/29 01:12 linux-next 48568d8c7f47 7509bf36 .config console log report ci-upstream-linux-next-kasan-gce-root
* Struck through repros no longer work on HEAD.