BUG: soft lockup in wg_packet_handshake_receive_worker

Status: auto-obsoleted due to no activity on 2024/12/08 09:12
Bug presence: origin:lts
[Documentation on labels]
Reported-by: syzbot+93eb68d93667279582cc@syzkaller.appspotmail.com
First crash: 687d, last: 687d
▶ ▼ Bug presence (2)
Date Name Commit Repro Result
2024/09/09 lts (merge base) 284087d4f7d5 syz [report] BUG: soft lockup in sock_close
2024/09/09 upstream (ToT) da3ea35007d0 syz Didn't crash
▶ ▼ Similar bugs (7)
Kernel Title Rank 🛈 Repro Cause bisect Fix bisect Count Last Reported Patched Status
linux-6.1 BUG: soft lockup in wg_packet_handshake_receive_worker origin:upstream 1 C error 7 687d 1155d 0/3 upstream: reported C repro on 2023/05/29 21:30
upstream BUG: soft lockup in wg_packet_handshake_receive_worker wireguard 1 1 759d 755d 0/29 auto-obsoleted due to no activity on 2024/09/26 23:05
upstream INFO: rcu detected stall in wg_packet_handshake_receive_worker (3) prio:normal mm 1 syz error error 18 46d 449d 0/29 upstream: reported syz repro on 2025/05/04 19:10
linux-5.15 INFO: rcu detected stall in wg_packet_handshake_receive_worker 1 1 747d 747d 0/3 auto-obsoleted due to no activity on 2024/10/19 08:12
linux-5.15 INFO: rcu detected stall in wg_packet_handshake_receive_worker (2) 1 1 569d 569d 0/3 auto-obsoleted due to no activity on 2025/04/14 22:49
upstream INFO: rcu detected stall in wg_packet_handshake_receive_worker (2) wireguard 1 1 1007d 1007d 0/29 auto-obsoleted due to no activity on 2024/01/22 15:31
upstream INFO: rcu detected stall in wg_packet_handshake_receive_worker wireguard 1 C error inconclusive 3 1110d 2006d 0/29 auto-obsoleted due to no activity on 2023/10/21 23:48
▶ ▼ Last patch testing requests (1)
Created Duration User Patch Repo Result
2024/09/23 19:28 1h04m retest repro android13-5.15-lts OK log

Sample crash report:
 kthread+0x421/0x510 kernel/kthread.c:337
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:300
 </TASK>
watchdog: BUG: soft lockup - CPU#1 stuck for 225s! [kworker/1:5:403]
Modules linked in:
CPU: 1 PID: 403 Comm: kworker/1:5 Not tainted 5.15.157-syzkaller-00897-g53be7c8abe11 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 08/06/2024
Workqueue: wg-kex-wg0 wg_packet_handshake_receive_worker
RIP: 0010:native_safe_halt arch/x86/include/asm/irqflags.h:51 [inline]
RIP: 0010:arch_safe_halt arch/x86/include/asm/irqflags.h:89 [inline]
RIP: 0010:kvm_wait+0x147/0x180 arch/x86/kernel/kvm.c:918
Code: 4c 89 e8 48 c1 e8 03 42 0f b6 04 20 84 c0 44 8b 74 24 1c 75 34 41 0f b6 45 00 44 38 f0 75 10 66 90 0f 00 2d ab ec 12 04 fb f4 <e9> 24 ff ff ff fb e9 1e ff ff ff 44 89 e9 80 e1 07 38 c1 7c a3 4c
RSP: 0018:ffffc90000b876e0 EFLAGS: 00000246
RAX: 0000000000000001 RBX: 1ffff92000170ee0 RCX: 1ffffffff0d5ab14
RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff8881f7138ad4
RBP: ffffc90000b87790 R08: dffffc0000000000 R09: ffffed103ee2715b
R10: 0000000000000000 R11: dffffc0000000001 R12: dffffc0000000000
R13: ffff8881f7138ad4 R14: 0000000000000001 R15: 1ffff92000170ee4
FS:  0000000000000000(0000) GS:ffff8881f7100000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00005566aaf2ede0 CR3: 000000011e42c000 CR4: 00000000003506a0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <IRQ>
 </IRQ>
 <TASK>
 pv_wait arch/x86/include/asm/paravirt.h:597 [inline]
 pv_wait_node kernel/locking/qspinlock_paravirt.h:325 [inline]
 __pv_queued_spin_lock_slowpath+0x41b/0xc40 kernel/locking/qspinlock.c:473
 pv_queued_spin_lock_slowpath arch/x86/include/asm/paravirt.h:585 [inline]
 queued_spin_lock_slowpath arch/x86/include/asm/qspinlock.h:51 [inline]
 queued_spin_lock include/asm-generic/qspinlock.h:85 [inline]
 do_raw_spin_lock include/linux/spinlock.h:187 [inline]
 __raw_spin_lock_bh include/linux/spinlock_api_smp.h:136 [inline]
 _raw_spin_lock_bh+0x139/0x1b0 kernel/locking/spinlock.c:178
 __sock_map_delete net/core/sock_map.c:419 [inline]
 sock_map_delete_elem+0x161/0x230 net/core/sock_map.c:451
 bpf_prog_8a405b5ced52e191+0x42/0x6f8
 bpf_dispatcher_nop_func include/linux/bpf.h:785 [inline]
 __bpf_prog_run include/linux/filter.h:628 [inline]
 bpf_prog_run include/linux/filter.h:635 [inline]
 __bpf_trace_run kernel/trace/bpf_trace.c:1880 [inline]
 bpf_trace_run2+0xec/0x210 kernel/trace/bpf_trace.c:1917
 __bpf_trace_kfree+0x6f/0x90 include/trace/events/kmem.h:118
 __traceiter_kfree+0x2a/0x40 include/trace/events/kmem.h:118
 trace_kfree include/trace/events/kmem.h:118 [inline]
 kfree+0x1f3/0x220 mm/slub.c:4569
 skb_free_head net/core/skbuff.c:656 [inline]
 skb_release_data+0x8a9/0xa80 net/core/skbuff.c:678
 skb_release_all net/core/skbuff.c:743 [inline]
 __kfree_skb net/core/skbuff.c:757 [inline]
 consume_skb+0xac/0x250 net/core/skbuff.c:930
 wg_packet_handshake_receive_worker+0x2b7/0x930 drivers/net/wireguard/receive.c:221
 process_one_work+0x6bb/0xc10 kernel/workqueue.c:2325
 worker_thread+0xad5/0x12a0 kernel/workqueue.c:2472
 kthread+0x421/0x510 kernel/kthread.c:337
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:300
 </TASK>
Sending NMI from CPU 1 to CPUs 0:
NMI backtrace for cpu 0
CPU: 0 PID: 363 Comm: syz-executor Not tainted 5.15.157-syzkaller-00897-g53be7c8abe11 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 08/06/2024
RIP: 0010:native_safe_halt arch/x86/include/asm/irqflags.h:51 [inline]
RIP: 0010:arch_safe_halt arch/x86/include/asm/irqflags.h:89 [inline]
RIP: 0010:kvm_wait+0x147/0x180 arch/x86/kernel/kvm.c:918
Code: 4c 89 e8 48 c1 e8 03 42 0f b6 04 20 84 c0 44 8b 74 24 1c 75 34 41 0f b6 45 00 44 38 f0 75 10 66 90 0f 00 2d ab ec 12 04 fb f4 <e9> 24 ff ff ff fb e9 1e ff ff ff 44 89 e9 80 e1 07 38 c1 7c a3 4c
RSP: 0018:ffffc9000236e060 EFLAGS: 00000246
RAX: 0000000000000003 RBX: 1ffff9200046dc10 RCX: ffffffff81552fff
RDX: dffffc0000000000 RSI: 0000000000000003 RDI: ffff88810f092528
RBP: ffffc9000236e110 R08: dffffc0000000000 R09: ffffed1021e124a6
R10: 0000000000000000 R11: dffffc0000000001 R12: dffffc0000000000
R13: ffff88810f092528 R14: 0000000000000003 R15: 1ffff9200046dc14
FS:  0000555556c74500(0000) GS:ffff8881f7000000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000000000 CR3: 0000000119ec1000 CR4: 00000000003506b0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <NMI>
 </NMI>
 <TASK>
 pv_wait arch/x86/include/asm/paravirt.h:597 [inline]
 pv_wait_head_or_lock kernel/locking/qspinlock_paravirt.h:470 [inline]
 __pv_queued_spin_lock_slowpath+0x6bc/0xc40 kernel/locking/qspinlock.c:508
 pv_queued_spin_lock_slowpath arch/x86/include/asm/paravirt.h:585 [inline]
 queued_spin_lock_slowpath arch/x86/include/asm/qspinlock.h:51 [inline]
 queued_spin_lock include/asm-generic/qspinlock.h:85 [inline]
 do_raw_spin_lock include/linux/spinlock.h:187 [inline]
 __raw_spin_lock_bh include/linux/spinlock_api_smp.h:136 [inline]
 _raw_spin_lock_bh+0x139/0x1b0 kernel/locking/spinlock.c:178
 __sock_map_delete net/core/sock_map.c:419 [inline]
 sock_map_delete_elem+0x161/0x230 net/core/sock_map.c:451
 bpf_prog_8a405b5ced52e191+0x42/0x6f8
 bpf_dispatcher_nop_func include/linux/bpf.h:785 [inline]
 __bpf_prog_run include/linux/filter.h:628 [inline]
 bpf_prog_run include/linux/filter.h:635 [inline]
 __bpf_trace_run kernel/trace/bpf_trace.c:1880 [inline]
 bpf_trace_run2+0xec/0x210 kernel/trace/bpf_trace.c:1917
 __bpf_trace_kfree+0x6f/0x90 include/trace/events/kmem.h:118
 __traceiter_kfree+0x2a/0x40 include/trace/events/kmem.h:118
 trace_kfree include/trace/events/kmem.h:118 [inline]
 kfree+0x1f3/0x220 mm/slub.c:4569
 sk_psock_free_link include/linux/skmsg.h:420 [inline]
 sock_map_del_link net/core/sock_map.c:160 [inline]
 sock_map_unref+0x352/0x4d0 net/core/sock_map.c:182
 __sock_map_delete net/core/sock_map.c:425 [inline]
 sock_map_delete_elem+0x191/0x230 net/core/sock_map.c:451
 bpf_prog_8a405b5ced52e191+0x42/0x6f8
 bpf_dispatcher_nop_func include/linux/bpf.h:785 [inline]
 __bpf_prog_run include/linux/filter.h:628 [inline]
 bpf_prog_run include/linux/filter.h:635 [inline]
 __bpf_trace_run kernel/trace/bpf_trace.c:1880 [inline]
 bpf_trace_run2+0xec/0x210 kernel/trace/bpf_trace.c:1917
 __bpf_trace_kfree+0x6f/0x90 include/trace/events/kmem.h:118
 __traceiter_kfree+0x2a/0x40 include/trace/events/kmem.h:118
 trace_kfree include/trace/events/kmem.h:118 [inline]
 kfree+0x1f3/0x220 mm/slub.c:4569
 skb_free_head net/core/skbuff.c:656 [inline]
 pskb_expand_head+0x37c/0x1240 net/core/skbuff.c:1760
 netlink_trim+0x19b/0x230 net/netlink/af_netlink.c:1312
 netlink_broadcast_filtered+0x66/0x1220 net/netlink/af_netlink.c:1517
 netlink_broadcast net/netlink/af_netlink.c:1562 [inline]
 nlmsg_multicast include/net/netlink.h:1033 [inline]
 nlmsg_notify+0x101/0x1c0 net/netlink/af_netlink.c:2548
 rtnl_notify net/core/rtnetlink.c:730 [inline]
 rtmsg_ifinfo_send net/core/rtnetlink.c:3887 [inline]
 rtmsg_ifinfo_event net/core/rtnetlink.c:3902 [inline]
 rtmsg_ifinfo+0xe7/0x120 net/core/rtnetlink.c:3908
 __dev_notify_flags+0xdd/0x610 net/core/dev.c:8854
 dev_change_flags+0xf0/0x1a0 net/core/dev.c:8896
 do_setlink+0xcd1/0x3ae0 net/core/rtnetlink.c:2741
 __rtnl_newlink net/core/rtnetlink.c:3429 [inline]
 rtnl_newlink+0x1779/0x2050 net/core/rtnetlink.c:3549
 rtnetlink_rcv_msg+0x951/0xc40 net/core/rtnetlink.c:5629
 netlink_rcv_skb+0x1cf/0x410 net/netlink/af_netlink.c:2505
 rtnetlink_rcv+0x1c/0x20 net/core/rtnetlink.c:5647
 netlink_unicast_kernel net/netlink/af_netlink.c:1330 [inline]
 netlink_unicast+0x8df/0xac0 net/netlink/af_netlink.c:1356
 netlink_sendmsg+0xa0a/0xd20 net/netlink/af_netlink.c:1924
 sock_sendmsg_nosec net/socket.c:704 [inline]
 __sock_sendmsg net/socket.c:716 [inline]
 __sys_sendto+0x564/0x720 net/socket.c:2058
 __do_sys_sendto net/socket.c:2070 [inline]
 __se_sys_sendto net/socket.c:2066 [inline]
 __x64_sys_sendto+0xe5/0x100 net/socket.c:2066
 x64_sys_call+0x15c/0x9a0 arch/x86/include/generated/asm/syscalls_64.h:45
 do_syscall_x64 arch/x86/entry/common.c:50 [inline]
 do_syscall_64+0x3b/0xb0 arch/x86/entry/common.c:80
 entry_SYSCALL_64_after_hwframe+0x66/0xd0
RIP: 0033:0x7febc08e0d33
Code: 64 89 02 48 c7 c0 ff ff ff ff eb b7 66 2e 0f 1f 84 00 00 00 00 00 90 80 3d 11 18 18 00 00 41 89 ca 74 14 b8 2c 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 75 c3 0f 1f 40 00 55 48 83 ec 30 44 89 4c 24
RSP: 002b:00007ffc92871c28 EFLAGS: 00000202 ORIG_RAX: 000000000000002c
RAX: ffffffffffffffda RBX: 00007febc15c6620 RCX: 00007febc08e0d33
RDX: 0000000000000020 RSI: 00007febc15c6670 RDI: 0000000000000003
RBP: 0000000000000001 R08: 00007ffc92871c44 R09: 000000000000000c
R10: 0000000000000000 R11: 0000000000000202 R12: 0000000000000003
R13: 0000000000000000 R14: 00007febc15c6670 R15: 0000000000000000
 </TASK>

Crashes (1):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2024/09/09 09:08 android13-5.15-lts 53be7c8abe11 9750182a .config console log report syz / log [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: soft lockup in wg_packet_handshake_receive_worker
* Struck through repros no longer work on HEAD.