syzbot


BUG: soft lockup in cleanup_net

Status: premoderation: reported syz repro on 2024/05/05 13:03
Bug presence: origin:lts
[Documentation on labels]
Reported-by: syzbot+6f80814b0872efc4121c@syzkaller.appspotmail.com
First crash: 211d, last: 84d
Bug presence (2)
Date Name Commit Repro Result
2024/09/09 lts (merge base) b925f60c6ee7 C [report] BUG: soft lockup in corrupted
2024/09/09 upstream (ToT) da3ea35007d0 C Didn't crash
Similar bugs (7)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
linux-4.19 INFO: rcu detected stall in cleanup_net (2) 4 1254d 1386d 0/1 auto-closed as invalid on 2021/10/25 03:43
linux-4.19 BUG: soft lockup in cleanup_net (2) C 3 638d 750d 0/1 upstream: reported C repro on 2022/11/13 07:04
linux-4.19 BUG: soft lockup in cleanup_net 4 883d 1097d 0/1 auto-obsoleted due to no activity on 2022/10/30 18:15
upstream INFO: rcu detected stall in cleanup_net (6) net 63 451d 694d 0/28 closed as invalid on 2023/10/27 14:39
upstream INFO: rcu detected stall in cleanup_net (5) net 24 1032d 1292d 0/28 closed as invalid on 2022/02/08 10:00
linux-6.1 INFO: rcu detected stall in cleanup_net origin:lts-only syz inconclusive 140 23d 509d 0/3 upstream: reported syz repro on 2023/07/12 14:45
linux-5.15 INFO: rcu detected stall in cleanup_net 72 18d 510d 0/3 upstream: reported on 2023/07/11 05:04
Last patch testing requests (1)
Created Duration User Patch Repo Result
2024/09/23 06:56 18m retest repro android13-5.15-lts OK log

Sample crash report:
watchdog: BUG: soft lockup - CPU#0 stuck for 225s! [kworker/u4:2:45]
Modules linked in:
CPU: 0 PID: 45 Comm: kworker/u4:2 Not tainted 5.15.157-syzkaller-00897-g53be7c8abe11 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 08/06/2024
Workqueue: netns cleanup_net
RIP: 0010:native_safe_halt arch/x86/include/asm/irqflags.h:51 [inline]
RIP: 0010:arch_safe_halt arch/x86/include/asm/irqflags.h:89 [inline]
RIP: 0010:kvm_wait+0x147/0x180 arch/x86/kernel/kvm.c:918
Code: 4c 89 e8 48 c1 e8 03 42 0f b6 04 20 84 c0 44 8b 74 24 1c 75 34 41 0f b6 45 00 44 38 f0 75 10 66 90 0f 00 2d ab ec 12 04 fb f4 <e9> 24 ff ff ff fb e9 1e ff ff ff 44 89 e9 80 e1 07 38 c1 7c a3 4c
RSP: 0018:ffffc900002eee60 EFLAGS: 00000246
RAX: 0000000000000003 RBX: 1ffff9200005ddd0 RCX: ffffffff81552fff
RDX: dffffc0000000000 RSI: 0000000000000003 RDI: ffff88810fb2ed28
RBP: ffffc900002eef10 R08: dffffc0000000000 R09: ffffed1021f65da6
R10: 0000000000000000 R11: dffffc0000000001 R12: dffffc0000000000
R13: ffff88810fb2ed28 R14: 0000000000000003 R15: 1ffff9200005ddd4
FS:  0000000000000000(0000) GS:ffff8881f7000000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000000000 CR3: 000000012c953000 CR4: 00000000003506b0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <IRQ>
 </IRQ>
 <TASK>
 pv_wait arch/x86/include/asm/paravirt.h:597 [inline]
 pv_wait_head_or_lock kernel/locking/qspinlock_paravirt.h:470 [inline]
 __pv_queued_spin_lock_slowpath+0x6bc/0xc40 kernel/locking/qspinlock.c:508
 pv_queued_spin_lock_slowpath arch/x86/include/asm/paravirt.h:585 [inline]
 queued_spin_lock_slowpath arch/x86/include/asm/qspinlock.h:51 [inline]
 queued_spin_lock include/asm-generic/qspinlock.h:85 [inline]
 do_raw_spin_lock include/linux/spinlock.h:187 [inline]
 __raw_spin_lock_bh include/linux/spinlock_api_smp.h:136 [inline]
 _raw_spin_lock_bh+0x139/0x1b0 kernel/locking/spinlock.c:178
 __sock_map_delete net/core/sock_map.c:419 [inline]
 sock_map_delete_elem+0x161/0x230 net/core/sock_map.c:451
 bpf_prog_2c29ac5cdc6b1842+0x3a/0xcb0
 bpf_dispatcher_nop_func include/linux/bpf.h:785 [inline]
 __bpf_prog_run include/linux/filter.h:628 [inline]
 bpf_prog_run include/linux/filter.h:635 [inline]
 __bpf_trace_run kernel/trace/bpf_trace.c:1880 [inline]
 bpf_trace_run2+0xec/0x210 kernel/trace/bpf_trace.c:1917
 __bpf_trace_kfree+0x6f/0x90 include/trace/events/kmem.h:118
 trace_kfree include/trace/events/kmem.h:118 [inline]
 kfree+0x1f3/0x220 mm/slub.c:4569
 sk_psock_free_link include/linux/skmsg.h:420 [inline]
 sock_map_del_link net/core/sock_map.c:160 [inline]
 sock_map_unref+0x352/0x4d0 net/core/sock_map.c:182
 __sock_map_delete net/core/sock_map.c:425 [inline]
 sock_map_delete_elem+0x191/0x230 net/core/sock_map.c:451
 bpf_prog_2c29ac5cdc6b1842+0x3a/0xcb0
 bpf_dispatcher_nop_func include/linux/bpf.h:785 [inline]
 __bpf_prog_run include/linux/filter.h:628 [inline]
 bpf_prog_run include/linux/filter.h:635 [inline]
 __bpf_trace_run kernel/trace/bpf_trace.c:1880 [inline]
 bpf_trace_run2+0xec/0x210 kernel/trace/bpf_trace.c:1917
 __bpf_trace_kfree+0x6f/0x90 include/trace/events/kmem.h:118
 trace_kfree include/trace/events/kmem.h:118 [inline]
 kfree+0x1f3/0x220 mm/slub.c:4569
 skb_free_head net/core/skbuff.c:656 [inline]
 pskb_expand_head+0x37c/0x1240 net/core/skbuff.c:1760
 netlink_trim+0x19b/0x230 net/netlink/af_netlink.c:1312
 netlink_broadcast_filtered+0x66/0x1220 net/netlink/af_netlink.c:1517
 netlink_broadcast net/netlink/af_netlink.c:1562 [inline]
 nlmsg_multicast include/net/netlink.h:1033 [inline]
 nlmsg_notify+0x101/0x1c0 net/netlink/af_netlink.c:2548
 rtnl_notify net/core/rtnetlink.c:730 [inline]
 rtmsg_ifinfo_send net/core/rtnetlink.c:3887 [inline]
 rtmsg_ifinfo_event net/core/rtnetlink.c:3902 [inline]
 rtnetlink_event+0x15a/0x1b0 net/core/rtnetlink.c:5680
 notifier_call_chain kernel/notifier.c:83 [inline]
 raw_notifier_call_chain+0x8c/0xf0 kernel/notifier.c:391
 call_netdevice_notifiers_info net/core/dev.c:2025 [inline]
 __netdev_upper_dev_unlink+0x433/0x8e0 net/core/dev.c:8262
 netdev_upper_dev_unlink+0x8e/0xd0 net/core/dev.c:8289
 del_nbp+0xbae/0xd90 net/bridge/br_if.c:354
 br_dev_delete+0x72/0x110 net/bridge/br_if.c:377
 default_device_exit_batch+0x2e9/0x3f0 net/core/dev.c:11636
 ops_exit_list net/core/net_namespace.c:174 [inline]
 cleanup_net+0x6ce/0xc00 net/core/net_namespace.c:596
 process_one_work+0x6bb/0xc10 kernel/workqueue.c:2325
 worker_thread+0xad5/0x12a0 kernel/workqueue.c:2472
 kthread+0x421/0x510 kernel/kthread.c:337
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:300
 </TASK>
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 385 Comm: syz.1.16 Not tainted 5.15.157-syzkaller-00897-g53be7c8abe11 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 08/06/2024
RIP: 0010:native_safe_halt arch/x86/include/asm/irqflags.h:51 [inline]
RIP: 0010:arch_safe_halt arch/x86/include/asm/irqflags.h:89 [inline]
RIP: 0010:kvm_wait+0x147/0x180 arch/x86/kernel/kvm.c:918
Code: 4c 89 e8 48 c1 e8 03 42 0f b6 04 20 84 c0 44 8b 74 24 1c 75 34 41 0f b6 45 00 44 38 f0 75 10 66 90 0f 00 2d ab ec 12 04 fb f4 <e9> 24 ff ff ff fb e9 1e ff ff ff 44 89 e9 80 e1 07 38 c1 7c a3 4c
RSP: 0018:ffffc90000c27440 EFLAGS: 00000246
RAX: 0000000000000003 RBX: 1ffff92000184e8c RCX: ffffffff81552fff
RDX: dffffc0000000000 RSI: 0000000000000003 RDI: ffff88810fc3d528
RBP: ffffc90000c274f0 R08: dffffc0000000000 R09: ffffed1021f87aa6
R10: 0000000000000000 R11: dffffc0000000001 R12: dffffc0000000000
R13: ffff88810fc3d528 R14: 0000000000000003 R15: 1ffff92000184e90
FS:  0000555555c52500(0000) GS:ffff8881f7100000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000002000d000 CR3: 000000012a92e000 CR4: 00000000003506a0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <NMI>
 </NMI>
 <TASK>
 pv_wait arch/x86/include/asm/paravirt.h:597 [inline]
 pv_wait_head_or_lock kernel/locking/qspinlock_paravirt.h:470 [inline]
 __pv_queued_spin_lock_slowpath+0x6bc/0xc40 kernel/locking/qspinlock.c:508
 pv_queued_spin_lock_slowpath arch/x86/include/asm/paravirt.h:585 [inline]
 queued_spin_lock_slowpath arch/x86/include/asm/qspinlock.h:51 [inline]
 queued_spin_lock include/asm-generic/qspinlock.h:85 [inline]
 do_raw_spin_lock include/linux/spinlock.h:187 [inline]
 __raw_spin_lock_bh include/linux/spinlock_api_smp.h:136 [inline]
 _raw_spin_lock_bh+0x139/0x1b0 kernel/locking/spinlock.c:178
 __sock_map_delete net/core/sock_map.c:419 [inline]
 sock_map_delete_elem+0x161/0x230 net/core/sock_map.c:451
 bpf_prog_2c29ac5cdc6b1842+0x3a/0x58
 bpf_dispatcher_nop_func include/linux/bpf.h:785 [inline]
 __bpf_prog_run include/linux/filter.h:628 [inline]
 bpf_prog_run include/linux/filter.h:635 [inline]
 __bpf_trace_run kernel/trace/bpf_trace.c:1880 [inline]
 bpf_trace_run2+0xec/0x210 kernel/trace/bpf_trace.c:1917
 __bpf_trace_kfree+0x6f/0x90 include/trace/events/kmem.h:118
 __traceiter_kfree+0x2a/0x40 include/trace/events/kmem.h:118
 trace_kfree include/trace/events/kmem.h:118 [inline]
 kfree+0x1f3/0x220 mm/slub.c:4569
 sk_psock_free_link include/linux/skmsg.h:420 [inline]
 sock_map_del_link net/core/sock_map.c:160 [inline]
 sock_map_unref+0x352/0x4d0 net/core/sock_map.c:182
 __sock_map_delete net/core/sock_map.c:425 [inline]
 sock_map_delete_elem+0x191/0x230 net/core/sock_map.c:451
 bpf_prog_2c29ac5cdc6b1842+0x3a/0x58
 bpf_dispatcher_nop_func include/linux/bpf.h:785 [inline]
 __bpf_prog_run include/linux/filter.h:628 [inline]
 bpf_prog_run include/linux/filter.h:635 [inline]
 __bpf_trace_run kernel/trace/bpf_trace.c:1880 [inline]
 bpf_trace_run2+0xec/0x210 kernel/trace/bpf_trace.c:1917
 __bpf_trace_kfree+0x6f/0x90 include/trace/events/kmem.h:118
 __traceiter_kfree+0x2a/0x40 include/trace/events/kmem.h:118
 trace_kfree include/trace/events/kmem.h:118 [inline]
 kfree+0x1f3/0x220 mm/slub.c:4569
 kvfree+0x35/0x40 mm/util.c:664
 __bpf_prog_put_noref+0xa1/0x2c0 kernel/bpf/syscall.c:1776
 bpf_prog_put_deferred+0x2ee/0x3e0 kernel/bpf/syscall.c:1802
 __bpf_prog_put kernel/bpf/syscall.c:1814 [inline]
 bpf_prog_put kernel/bpf/syscall.c:1821 [inline]
 bpf_prog_release+0x27d/0x290 kernel/bpf/syscall.c:1829
 __fput+0x3fe/0x910 fs/file_table.c:280
 ____fput+0x15/0x20 fs/file_table.c:308
 task_work_run+0x129/0x190 kernel/task_work.c:164
 tracehook_notify_resume include/linux/tracehook.h:189 [inline]
 exit_to_user_mode_loop+0xc4/0xe0 kernel/entry/common.c:181
 exit_to_user_mode_prepare+0x5a/0xa0 kernel/entry/common.c:214
 __syscall_exit_to_user_mode_work kernel/entry/common.c:296 [inline]
 syscall_exit_to_user_mode+0x26/0x160 kernel/entry/common.c:307
 do_syscall_64+0x47/0xb0 arch/x86/entry/common.c:86
 entry_SYSCALL_64_after_hwframe+0x66/0xd0
RIP: 0033:0x7efe98823ef9
Code: ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 a8 ff ff ff f7 d8 64 89 01 48
RSP: 002b:00007ffd3952bd28 EFLAGS: 00000246 ORIG_RAX: 00000000000001b4
RAX: 0000000000000000 RBX: 00007efe989dea80 RCX: 00007efe98823ef9
RDX: 0000000000000000 RSI: 000000000000001e RDI: 0000000000000003
RBP: 00007efe989dea80 R08: 0000000000000000 R09: 00007ffd3952c01f
R10: 000000000003fd84 R11: 0000000000000246 R12: 0000000000006309
R13: 00007ffd3952be30 R14: 0000000000000226 R15: ffffffffffffffff
 </TASK>

Crashes (6):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2024/09/09 05:49 android13-5.15-lts 53be7c8abe11 9750182a .config console log report syz / log [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: soft lockup in cleanup_net
2024/07/25 06:14 android13-5.15-lts 5356d2f17edf d1a1b0ca .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: soft lockup in cleanup_net
2024/06/02 15:05 android13-5.15-lts 424f92bcbe8f 3113787f .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15 BUG: soft lockup in cleanup_net
2024/05/19 16:03 android13-5.15-lts 5d96939590c0 c0f1611a .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15 BUG: soft lockup in cleanup_net
2024/05/05 15:22 android13-5.15-lts 5d96939590c0 610f2a54 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15 BUG: soft lockup in cleanup_net
2024/05/05 13:02 android13-5.15-lts 5d96939590c0 610f2a54 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15 BUG: soft lockup in cleanup_net
* Struck through repros no longer work on HEAD.