INFO: rcu detected stall in __do

INFO: rcu detected stall in __do_softirq
Status: upstream: reported syz repro on 2019/08/05 15:28
Reported-by: syzbot+6593c6b8c8b66a07cd98@syzkaller.appspotmail.com
First crash: 944d, last: 55d

Cause bisection: introduced by (bisect log) :
commit 2aeac95d1a4cc85aae57ab842d5c3340df0f817f
Author: Srinivas Kandagatla <srinivas.kandagatla@linaro.org>
Date: Tue Jun 11 10:40:41 2019 +0000

soundwire: add module_sdw_driver helper macro

Crash: INFO: rcu detected stall in __do_softirq (log)
Repro: syz .config

similar bugs (4):
Kernel	Title	Repro	Fix bisect	Count	Last	Reported	Patched	Status
linux-4.19	INFO: rcu detected stall in __do_softirq (2)			9	446d	631d	0/1	auto-closed as invalid on 2021/01/10 17:25
linux-4.14	INFO: rcu detected stall in __do_softirq			1	899d	899d	0/1	auto-closed as invalid on 2019/10/25 08:47
linux-4.19	INFO: rcu detected stall in __do_softirq			2	833d	898d	0/1	auto-closed as invalid on 2019/12/20 09:57
linux-4.14	BUG: soft lockup in __do_softirq	syz	error	3	212d	254d	0/1	upstream: reported syz repro on 2021/03/23 20:32

Sample crash report:

rcu: INFO: rcu_preempt self-detected stall on CPU
rcu: 	1-...!: (1 ticks this GP) idle=b66/1/0x4000000000000004 softirq=28179/28180 fqs=1 
	(t=29639 jiffies g=24749 q=37154)
NMI backtrace for cpu 1
CPU: 1 PID: 16869 Comm: syz-executor.5 Not tainted 5.3.0-rc2-next-20190801 #57
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Call Trace:
 <IRQ>
 __dump_stack lib/dump_stack.c:77 [inline]
 dump_stack+0x172/0x1f0 lib/dump_stack.c:113
 nmi_cpu_backtrace.cold+0x70/0xb2 lib/nmi_backtrace.c:101
 nmi_trigger_cpumask_backtrace+0x23b/0x28b lib/nmi_backtrace.c:62
 arch_trigger_cpumask_backtrace+0x14/0x20 arch/x86/kernel/apic/hw_nmi.c:38
 trigger_single_cpu_backtrace include/linux/nmi.h:164 [inline]
 rcu_dump_cpu_stacks+0x183/0x1cf kernel/rcu/tree_stall.h:254
 print_cpu_stall kernel/rcu/tree_stall.h:455 [inline]
 check_cpu_stall kernel/rcu/tree_stall.h:529 [inline]
 rcu_pending kernel/rcu/tree.c:2736 [inline]
 rcu_sched_clock_irq.cold+0x4dd/0xc13 kernel/rcu/tree.c:2183
 update_process_times+0x32/0x80 kernel/time/timer.c:1724
 tick_sched_handle+0xa2/0x190 kernel/time/tick-sched.c:167
 tick_sched_timer+0x53/0x140 kernel/time/tick-sched.c:1299
 __run_hrtimer kernel/time/hrtimer.c:1493 [inline]
 __hrtimer_run_queues+0x364/0xe40 kernel/time/hrtimer.c:1555
 hrtimer_interrupt+0x314/0x770 kernel/time/hrtimer.c:1617
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1068 [inline]
 smp_apic_timer_interrupt+0x160/0x610 arch/x86/kernel/apic/apic.c:1093
 apic_timer_interrupt+0xf/0x20 arch/x86/entry/entry_64.S:828
RIP: 0010:ffs arch/x86/include/asm/bitops.h:297 [inline]
RIP: 0010:__do_softirq+0x227/0x98c kernel/softirq.c:280
Code: c7 c0 b0 f4 d2 88 48 c1 e8 03 42 80 3c 30 00 0f 85 b1 06 00 00 48 83 3d 96 f2 72 01 00 0f 84 d6 05 00 00 fb 66 0f 1f 44 00 00 <b8> ff ff ff ff 48 c7 45 c8 00 91 c0 88 0f bc 45 d4 83 c0 01 89 45
RSP: 0018:ffff8880ae909f18 EFLAGS: 00000282 ORIG_RAX: ffffffffffffff13
RAX: 1ffffffff11a5e96 RBX: ffff88809aa061c0 RCX: 1ffffffff134c0be
RDX: 0000000000000000 RSI: ffffffff8177a50e RDI: ffffffff876001fc
RBP: ffff8880ae909f98 R08: ffff88809aa061c0 R09: 0000000000000000
R10: ffffffff89e49050 R11: 0000000000000001 R12: ffff888099137938
R13: 0000000000000028 R14: dffffc0000000000 R15: 0000000000000000
 invoke_softirq kernel/softirq.c:373 [inline]
 irq_exit+0x19b/0x1e0 kernel/softirq.c:413
 exiting_irq arch/x86/include/asm/apic.h:536 [inline]
 do_IRQ+0x12c/0x200 arch/x86/kernel/irq.c:259
 common_interrupt+0xf/0xf arch/x86/entry/entry_64.S:605
 </IRQ>
RIP: 0010:variable_test_bit arch/x86/include/asm/bitops.h:214 [inline]
RIP: 0010:test_bit include/asm-generic/bitops-instrumented.h:238 [inline]
RIP: 0010:kvm_test_request include/linux/kvm_host.h:1207 [inline]
RIP: 0010:kvm_check_request+0x30/0x70 include/linux/kvm_host.h:1217
Code: 41 55 41 54 49 89 f4 53 4d 8d 74 24 30 89 fb e8 f6 13 67 00 be 08 00 00 00 4c 89 f7 0f b6 db e8 36 e2 a1 00 49 0f a3 5c 24 30 <41> 0f 92 c5 31 ff 44 89 ee e8 12 15 67 00 45 84 ed 75 11 e8 c8 13
RSP: 0018:ffff8880991379e0 EFLAGS: 00000246 ORIG_RAX: ffffffffffffffd7
RAX: 0000000000000001 RBX: 000000000000001f RCX: ffffffff810b0e4a
RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffff888093c409f0
RBP: ffff888099137a00 R08: 1ffff1101278813e R09: ffffed101278813f
R10: ffffed101278813e R11: ffff888093c409f7 R12: ffff888093c409c0
R13: ffff888093c409c0 R14: ffff888093c409f0 R15: ffff888093c409f0
 vcpu_enter_guest+0x32a6/0x5e90 arch/x86/kvm/x86.c:7866
 vcpu_run arch/x86/kvm/x86.c:8151 [inline]
 kvm_arch_vcpu_ioctl_run+0x464/0x1750 arch/x86/kvm/x86.c:8359
 kvm_vcpu_ioctl+0x4dc/0xfd0 arch/x86/kvm/../../../virt/kvm/kvm_main.c:2754
 vfs_ioctl fs/ioctl.c:46 [inline]
 file_ioctl fs/ioctl.c:509 [inline]
 do_vfs_ioctl+0xdb6/0x13e0 fs/ioctl.c:696
 ksys_ioctl+0xab/0xd0 fs/ioctl.c:713
 __do_sys_ioctl fs/ioctl.c:720 [inline]
 __se_sys_ioctl fs/ioctl.c:718 [inline]
 __x64_sys_ioctl+0x73/0xb0 fs/ioctl.c:718
 do_syscall_64+0xfa/0x760 arch/x86/entry/common.c:290
 entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x459829
Code: fd b7 fb ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 0f 83 cb b7 fb ff c3 66 2e 0f 1f 84 00 00 00 00
RSP: 002b:00007fa754e29c78 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
RAX: ffffffffffffffda RBX: 0000000000000003 RCX: 0000000000459829
RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000005
RBP: 000000000075bf20 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 00007fa754e2a6d4
R13: 00000000004c2bcf R14: 00000000004d6150 R15: 00000000ffffffff

Fix bisection attempts:
Manager	Time	Kernel	Commit	Syzkaller	Config	Log	Report	Syz repro	C repro	VM info	Title
ci-upstream-linux-next-kasan-gce-root	2019/10/15 13:14	linux-next	882e8691130b	c692b5bd	.config	log	report	syz

Crashes (34):
Manager	Time	Kernel	Commit	Syzkaller	Config	Log	Report	Syz repro	VM info	Title
ci-upstream-linux-next-kasan-gce-root	2019/08/01 15:14	linux-next	882e8691130b	c692b5bd	.config	log	report	syz
ci-upstream-kasan-gce-smack-root	2021/10/09 05:32	upstream	741668ef7832	efe0f24d	.config	log	report		info	INFO: rcu detected stall in __do_softirq
ci-upstream-kasan-gce-root	2021/06/04 22:24	upstream	16f0596fc1d7	966a236b	.config	log	report		info	INFO: rcu detected stall in __do_softirq
ci-upstream-kasan-gce-root	2020/08/04 15:58	upstream	c0842fbc1b18	80a06902	.config	log	report
ci-upstream-kasan-gce	2020/04/16 07:36	upstream	00086336a8d9	c743fcb3	.config	log	report
ci-upstream-kasan-gce	2020/04/10 21:31	upstream	c0cc271173b2	a8c6a3f8	.config	log	report
ci-upstream-kasan-gce	2020/03/28 07:04	upstream	69c5eea3128e	831e9a81	.config	log	report
ci-upstream-kasan-gce	2020/03/27 20:38	upstream	527630fbf4f1	831e9a81	.config	log	report
ci-upstream-kasan-gce-root	2020/03/08 03:17	upstream	c20037652700	2e9971bb	.config	log	report
ci-upstream-kasan-gce	2020/03/04 19:31	upstream	63623fd44972	c88c7b75	.config	log	report
ci-upstream-kasan-gce	2020/03/02 00:54	upstream	63623fd44972	c88c7b75	.config	log	report
ci-upstream-kasan-gce-root	2020/02/22 15:31	upstream	54dedb5b571d	2c36e7a7	.config	log	report
ci-upstream-kasan-gce-smack-root	2020/01/24 19:18	upstream	4703d9119972	2e95ab33	.config	log	report
ci-upstream-kasan-gce	2019/11/09 07:56	upstream	6737e7634951	dc438b91	.config	log	report
ci-upstream-kasan-gce	2019/10/31 20:22	upstream	e472c64aa4fa	a41ca8fa	.config	log	report
ci-upstream-kasan-gce	2019/10/23 02:38	upstream	3b7c59a1950c	5681358a	.config	log	report
ci-upstream-kasan-gce-smack-root	2019/10/19 21:40	upstream	998d75510e37	8c88c9c1	.config	log	report
ci-upstream-kasan-gce-selinux-root	2019/09/15 12:40	upstream	1609d7604b84	32d59357	.config	log	report
ci-upstream-kasan-gce	2019/08/31 09:14	upstream	6525771f58cb	fd37b39e	.config	log	report
ci-upstream-kasan-gce-smack-root	2019/08/28 05:32	upstream	6525771f58cb	fd37b39e	.config	log	report
ci-upstream-kasan-gce-smack-root	2019/08/24 21:25	upstream	361469211f87	d21c5d9d	.config	log	report
ci-upstream-kasan-gce-selinux-root	2019/08/22 18:53	upstream	bb7ba8069de9	d003d6d0	.config	log	report
ci-upstream-kasan-gce-root	2019/08/18 07:46	upstream	8fde2832bd0b	55bf8926	.config	log	report
ci-upstream-kasan-gce-smack-root	2019/08/13 23:58	upstream	ee1c7bd33e66	ef801a3e	.config	log	report
ci-upstream-kasan-gce-selinux-root	2019/08/03 03:16	upstream	97b00aff2c45	6affd8e8	.config	log	report
ci-upstream-kasan-gce	2019/07/30 11:23	upstream	2a11c76e5301	f28bf2a5	.config	log	report
ci-upstream-kasan-gce-selinux-root	2019/07/27 11:58	upstream	3ea54d9b0d65	c85e1c5b	.config	log	report
ci-upstream-kasan-gce	2019/06/30 12:48	upstream	728254541ebc	7509bf36	.config	log	report
ci-upstream-kasan-gce-root	2019/06/12 09:38	upstream	aa7235483a83	ea2f4006	.config	log	report
ci-upstream-kasan-gce-selinux-root	2019/05/03 17:27	upstream	ea9866793d1e	1bfa09b9	.config	log	report
ci-qemu-upstream-386	2019/12/04 10:40	upstream	63de37476ebd	0ecb9746	.config	log	report
ci-upstream-linux-next-kasan-gce-root	2019/08/08 10:52	linux-next	2ae256317763	e6ebef88	.config	log	report
ci-upstream-linux-next-kasan-gce-root	2019/07/22 08:52	linux-next	6d21a41b7b1f	b3c615f5	.config	log	report
ci-upstream-linux-next-kasan-gce-root	2019/06/29 01:12	linux-next	48568d8c7f47	7509bf36	.config	log	report