syzbot


INFO: rcu detected stall in netlink_sendmsg (4)

Status: upstream: reported C repro on 2020/03/31 17:43
Subsystems: net (incorrect?)
Reported-by: syzbot+0fb70e87d8e0ac278fe9@syzkaller.appspotmail.com
First crash: 1087d, last: 112d

Cause bisection: introduced by (bisect log) :
commit 5a781ccbd19e4664babcbe4b4ead7aa2b9283d22
Author: Vinicius Costa Gomes <vinicius.gomes@intel.com>
Date: Sat Sep 29 00:59:43 2018 +0000

  tc: Add support for configuring the taprio scheduler

Crash: no output from test machine (log)
Repro: C syz .config

Fix bisection: failed (error log, bisect log)
similar bugs (6):
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: rcu detected stall in netlink_sendmsg (2) C done 11 1283d 1289d 14/24 fixed on 2019/10/09 10:54
linux-4.19 INFO: rcu detected stall in netlink_sendmsg C done 3 1281d 1286d 1/1 fixed on 2019/12/10 03:52
upstream INFO: rcu detected stall in netlink_sendmsg (3) net C done 6 1134d 1187d 16/24 fixed on 2020/02/18 14:31
upstream INFO: rcu detected stall in netlink_sendmsg netfilter syz 83 1492d 1548d 12/24 fixed on 2019/03/06 07:43
linux-4.14 BUG: soft lockup in netlink_sendmsg 1 434d 434d 0/1 auto-closed as invalid on 2022/05/11 11:30
linux-4.19 BUG: soft lockup in netlink_sendmsg C error 8 68d 718d 0/1 upstream: reported C repro on 2021/04/02 18:46
Last patch testing requests:
Created Duration User Patch Repo Result
2023/03/09 16:32 14m retest repro net-next report log
2023/03/09 16:32 14m retest repro upstream report log
2022/11/23 21:30 20m retest repro linux-next error
2022/10/13 07:30 0m retest repro upstream error
2022/09/19 10:29 11m retest repro net-next report log
2022/04/06 08:01 6m k.kahurani@gmail.com upstream error

Sample crash report:
rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
rcu: 	0-...0: (2 ticks this GP) idle=99a/1/0x4000000000000000 softirq=9090/9090 fqs=5249 
	(detected by 1, t=10502 jiffies, g=9037, q=75)
Sending NMI from CPU 1 to CPUs 0:
NMI backtrace for cpu 0
CPU: 0 PID: 6816 Comm: syz-executor148 Not tainted 5.8.0-rc3-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
RIP: 0010:trace_hardirqs_off+0x4/0x210 kernel/trace/trace_preemptirq.c:75
Code: ff ff ff e8 de a6 39 00 e9 33 ff ff ff 48 89 df e8 d1 a6 39 00 e9 fe fe ff ff 66 90 66 2e 0f 1f 84 00 00 00 00 00 41 56 41 55 <41> 54 55 53 e8 33 51 fa ff 48 8b 7c 24 28 e8 c9 36 6b 06 65 8b 1d
RSP: 0018:ffffc90000007c98 EFLAGS: 00000082
RAX: 1ffffffff1369c08 RBX: 0000000000000082 RCX: ffffffff815aff60
RDX: dffffc0000000000 RSI: 0000000000000004 RDI: 0000000000000082
RBP: ffffffff8cace770 R08: 0000000000000000 R09: ffffffff8cace773
R10: fffffbfff1959cee R11: 0000000000000000 R12: ffff88809450c340
R13: dffffc0000000000 R14: 1ffff92000000f9b R15: ffffffff89bd0d00
FS:  000000000161b880(0000) GS:ffff8880ae600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000020000610 CR3: 00000000952f7000 CR4: 00000000001406f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <IRQ>
 __raw_spin_unlock_irqrestore include/linux/spinlock_api_smp.h:160 [inline]
 _raw_spin_unlock_irqrestore+0x5b/0xe0 kernel/locking/spinlock.c:191
 debug_object_activate+0x287/0x3e0 lib/debugobjects.c:664
 debug_hrtimer_activate kernel/time/hrtimer.c:416 [inline]
 debug_activate kernel/time/hrtimer.c:476 [inline]
 enqueue_hrtimer+0x27/0x3f0 kernel/time/hrtimer.c:965
 __run_hrtimer kernel/time/hrtimer.c:1537 [inline]
 __hrtimer_run_queues+0xc1e/0xfc0 kernel/time/hrtimer.c:1584
 hrtimer_interrupt+0x32a/0x930 kernel/time/hrtimer.c:1646
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1080 [inline]
 __sysvec_apic_timer_interrupt+0x142/0x5e0 arch/x86/kernel/apic/apic.c:1097
 asm_call_on_stack+0xf/0x20 arch/x86/entry/entry_64.S:711
 </IRQ>
 __run_on_irqstack arch/x86/include/asm/irq_stack.h:22 [inline]
 run_on_irqstack_cond arch/x86/include/asm/irq_stack.h:48 [inline]
 sysvec_apic_timer_interrupt+0xe0/0x120 arch/x86/kernel/apic/apic.c:1091
 asm_sysvec_apic_timer_interrupt+0x12/0x20 arch/x86/include/asm/idtentry.h:596
RIP: 0010:arch_local_irq_restore arch/x86/include/asm/paravirt.h:765 [inline]
RIP: 0010:__raw_spin_unlock_irqrestore include/linux/spinlock_api_smp.h:160 [inline]
RIP: 0010:_raw_spin_unlock_irqrestore+0x8c/0xe0 kernel/locking/spinlock.c:191
Code: 48 c7 c0 40 e0 b4 89 48 ba 00 00 00 00 00 fc ff df 48 c1 e8 03 80 3c 10 00 75 37 48 83 3d fb a6 cd 01 00 74 22 48 89 df 57 9d <0f> 1f 44 00 00 bf 01 00 00 00 e8 35 39 68 f9 65 8b 05 5e c5 1a 78
RSP: 0018:ffffc900014772c0 EFLAGS: 00000282
RAX: 1ffffffff1369c08 RBX: 0000000000000282 RCX: 0000000000000002
RDX: dffffc0000000000 RSI: 0000000000000000 RDI: 0000000000000282
RBP: ffff88809450c2e8 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000282
R13: 161f22aa3d822141 R14: ffff88809450c000 R15: 0000000000000000
 spin_unlock_irqrestore include/linux/spinlock.h:408 [inline]
 taprio_change+0x1fdc/0x2960 net/sched/sch_taprio.c:1557
 taprio_init+0x52e/0x670 net/sched/sch_taprio.c:1670
 qdisc_create+0x4b6/0x12e0 net/sched/sch_api.c:1246
 tc_modify_qdisc+0x4c8/0x1990 net/sched/sch_api.c:1662
 rtnetlink_rcv_msg+0x44e/0xad0 net/core/rtnetlink.c:5460
 netlink_rcv_skb+0x15a/0x430 net/netlink/af_netlink.c:2469
 netlink_unicast_kernel net/netlink/af_netlink.c:1303 [inline]
 netlink_unicast+0x533/0x7d0 net/netlink/af_netlink.c:1329
 netlink_sendmsg+0x856/0xd90 net/netlink/af_netlink.c:1918
 sock_sendmsg_nosec net/socket.c:652 [inline]
 sock_sendmsg+0xcf/0x120 net/socket.c:672
 ____sys_sendmsg+0x6e8/0x810 net/socket.c:2352
 ___sys_sendmsg+0xf3/0x170 net/socket.c:2406
 __sys_sendmsg+0xe5/0x1b0 net/socket.c:2439
 do_syscall_64+0x60/0xe0 arch/x86/entry/common.c:359
 entry_SYSCALL_64_after_hwframe+0x44/0xa9
RIP: 0033:0x443799
Code: Bad RIP value.
RSP: 002b:00007ffe2227c388 EFLAGS: 00000246 ORIG_RAX: 000000000000002e
RAX: ffffffffffffffda RBX: 0000000000000003 RCX: 0000000000443799
RDX: 0000000000000000 RSI: 00000000200007c0 RDI: 0000000000000004
RBP: 00007ffe2227c390 R08: 0000000001bbbbbb R09: 0000000001bbbbbb
R10: 0000000001bbbbbb R11: 0000000000000246 R12: 00007ffe2227c3a0
R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 0.000 msecs

Crashes (37):
Manager Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets Title
ci-upstream-kasan-gce-root 2020/07/06 10:25 upstream 7cc2a8ea1048 51095195 .config console log report syz C
ci-upstream-net-kasan-gce 2020/07/06 08:15 net-next e44f65fd666c 51095195 .config console log report syz C
ci-upstream-linux-next-kasan-gce-root 2020/07/06 06:09 linux-next 9e50b94b3eb0 51095195 .config console log report syz C
ci-upstream-kasan-gce-root 2022/11/29 16:15 upstream ca57f02295f1 05dc7993 .config console log report info [disk image] [vmlinux] [kernel image] INFO: rcu detected stall in netlink_sendmsg
ci-upstream-kasan-gce-selinux-root 2022/04/30 05:19 upstream 8013d1d3d2e3 ad6b95d8 .config console log report info INFO: rcu detected stall in netlink_sendmsg
ci-upstream-kasan-gce-selinux-root 2022/04/03 06:32 upstream be2d3ecedd99 79a2a8fc .config console log report info INFO: rcu detected stall in netlink_sendmsg
ci-upstream-kasan-gce-selinux-root 2021/08/31 01:23 upstream 7d2a07b76933 8f58a0ef .config console log report info INFO: rcu detected stall in netlink_sendmsg
ci-upstream-net-this-kasan-gce 2021/11/15 18:56 net 10a2308ffb8c 83f5c9b5 .config console log report info INFO: rcu detected stall in netlink_sendmsg
ci-upstream-bpf-kasan-gce 2021/07/24 18:46 bpf d6371c76e20d 4d1b57d4 .config console log report info INFO: rcu detected stall in netlink_sendmsg
ci-upstream-bpf-kasan-gce 2021/07/22 09:37 bpf d6371c76e20d 29c3f20f .config console log report info INFO: rcu detected stall in netlink_sendmsg
ci-upstream-bpf-kasan-gce 2021/07/14 12:54 bpf 5acc7d3e8d34 484502bd .config console log report info INFO: rcu detected stall in netlink_sendmsg
ci-upstream-bpf-kasan-gce 2021/07/14 10:01 bpf 5acc7d3e8d34 484502bd .config console log report info INFO: rcu detected stall in netlink_sendmsg
ci-upstream-net-this-kasan-gce 2021/07/02 04:44 net dbe69e433722 658ebc66 .config console log report info INFO: rcu detected stall in netlink_sendmsg
ci-upstream-bpf-kasan-gce 2021/04/19 20:17 bpf b02265429681 50f523d7 .config console log report info INFO: rcu detected stall in netlink_sendmsg
ci-upstream-net-kasan-gce 2022/01/11 04:27 net-next 8aaaf2f3af2a ddb0ab8c .config console log report info INFO: rcu detected stall in netlink_sendmsg
ci-upstream-bpf-next-kasan-gce 2021/08/15 19:41 bpf-next fa183a86eefd 2489ab88 .config console log report info INFO: rcu detected stall in netlink_sendmsg
ci-upstream-bpf-next-kasan-gce 2021/07/22 18:44 bpf-next 807b8f0e24e6 302e51de .config console log report info INFO: rcu detected stall in netlink_sendmsg
ci-upstream-bpf-next-kasan-gce 2021/07/10 03:46 bpf-next eff94154cc1a 8f5a7b8c .config console log report info INFO: rcu detected stall in netlink_sendmsg
ci-upstream-bpf-next-kasan-gce 2021/07/08 11:33 bpf-next a080cdccc93d 95793bce .config console log report info INFO: rcu detected stall in netlink_sendmsg
ci-upstream-bpf-next-kasan-gce 2021/06/30 05:15 bpf-next 84fe73996c2e a4fccb01 .config console log report info INFO: rcu detected stall in netlink_sendmsg
ci-upstream-bpf-next-kasan-gce 2021/06/26 22:29 bpf-next a196fa78a265 9d2ab5df .config console log report info INFO: rcu detected stall in netlink_sendmsg
ci-upstream-bpf-next-kasan-gce 2021/05/30 01:57 bpf-next e8e0f0f48478 325a8dab .config console log report info INFO: rcu detected stall in netlink_sendmsg
ci-upstream-bpf-next-kasan-gce 2021/05/23 20:25 bpf-next a49e72b3bda7 3c7fef33 .config console log report info INFO: rcu detected stall in netlink_sendmsg
ci-upstream-bpf-next-kasan-gce 2021/05/18 09:30 bpf-next f18ba26da88a a343ba6b .config console log report info INFO: rcu detected stall in netlink_sendmsg
ci-upstream-net-kasan-gce 2021/05/08 16:02 net-next 95aafe911db6 bc5434be .config console log report info INFO: rcu detected stall in netlink_sendmsg
ci-upstream-net-kasan-gce 2021/02/21 14:25 net-next 38b5133ad607 3e5ed8b4 .config console log report info INFO: rcu detected stall in netlink_sendmsg
ci-upstream-linux-next-kasan-gce-root 2022/03/10 02:12 linux-next 91265a6da44d 9e8eaa75 .config console log report info INFO: rcu detected stall in netlink_sendmsg
ci-upstream-linux-next-kasan-gce-root 2021/11/11 19:17 linux-next ad8be4fa6e81 75b04091 .config console log report info INFO: rcu detected stall in netlink_sendmsg
ci-upstream-linux-next-kasan-gce-root 2021/11/07 08:13 linux-next 6a37ebbe07bf 4c1be0be .config console log report info INFO: rcu detected stall in netlink_sendmsg
ci-upstream-kasan-gce-root 2020/07/26 02:00 upstream 23ee3e4e5bd2 1f7cc1ca .config console log report
ci-upstream-kasan-gce 2020/07/08 10:27 upstream 7cc2a8ea1048 51095195 .config console log report
ci-upstream-kasan-gce-root 2020/07/06 17:52 upstream 7cc2a8ea1048 51095195 .config console log report
ci-upstream-kasan-gce-selinux-root 2020/06/26 22:00 upstream 4a21185cda0f aea82c00 .config console log report
ci-upstream-net-this-kasan-gce 2020/05/06 07:04 net 38212bb31fe9 35b8eb30 .config console log report
ci-upstream-net-this-kasan-gce 2020/04/17 13:39 net 2fcd80144b93 18397578 .config console log report
ci-upstream-bpf-next-kasan-gce 2020/03/29 09:57 bpf-next ae661deca7b9 05736b29 .config console log report
ci-upstream-linux-next-kasan-gce-root 2020/07/06 02:41 linux-next 9e50b94b3eb0 51095195 .config console log report
* Struck through repros no longer work on HEAD.