BUG: soft lockup in wg_packet_handshake_receive_worker

Status: upstream: reported C repro on 2023/05/29 21:30
Bug presence: origin:upstream
[Documentation on labels]
Reported-by: syzbot+401ae27e931883f2256a@syzkaller.appspotmail.com
First crash: 1153d, last: 685d
Fix bisection: failed (error log, bisect log)
  
▶ ▼ Bug presence (2)
Date Name Commit Repro Result
2023/05/29 upstream (ToT) 8b817fded42d C [report] INFO: rcu detected stall in corrupted
2026/07/17 upstream (ToT) 94515f3a7d42 C Failed due to an error; will retry later
▶ ▼ Similar bugs (7)
Kernel Title Rank 🛈 Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream BUG: soft lockup in wg_packet_handshake_receive_worker wireguard 1 1 757d 753d 0/29 auto-obsoleted due to no activity on 2024/09/26 23:05
upstream INFO: rcu detected stall in wg_packet_handshake_receive_worker (3) prio:normal mm 1 syz error error 18 43d 447d 0/29 upstream: reported syz repro on 2025/05/04 19:10
android-5-15 BUG: soft lockup in wg_packet_handshake_receive_worker origin:lts 1 syz 1 684d 684d 0/2 auto-obsoleted due to no activity on 2024/12/08 09:12
linux-5.15 INFO: rcu detected stall in wg_packet_handshake_receive_worker 1 1 744d 744d 0/3 auto-obsoleted due to no activity on 2024/10/19 08:12
linux-5.15 INFO: rcu detected stall in wg_packet_handshake_receive_worker (2) 1 1 567d 567d 0/3 auto-obsoleted due to no activity on 2025/04/14 22:49
upstream INFO: rcu detected stall in wg_packet_handshake_receive_worker (2) wireguard 1 1 1005d 1005d 0/29 auto-obsoleted due to no activity on 2024/01/22 15:31
upstream INFO: rcu detected stall in wg_packet_handshake_receive_worker wireguard 1 C error inconclusive 3 1108d 2004d 0/29 auto-obsoleted due to no activity on 2023/10/21 23:48
▶ ▼ Fix bisection attempts (11)
Created Duration User Patch Repo Result
2024/08/26 18:38 2h12m bisect fix linux-6.1.y error job log
2024/07/16 22:41 2h50m bisect fix linux-6.1.y OK (0) job log log
2024/04/29 07:12 3h11m bisect fix linux-6.1.y OK (0) job log log
2024/03/29 04:39 4h44m bisect fix linux-6.1.y OK (0) job log log
2024/02/27 22:57 2h28m bisect fix linux-6.1.y OK (0) job log log
2024/01/19 07:07 2h20m bisect fix linux-6.1.y OK (0) job log log
2023/12/18 20:30 2h26m bisect fix linux-6.1.y OK (0) job log log
2023/11/18 10:50 2h26m bisect fix linux-6.1.y OK (0) job log log
2023/10/17 06:54 2h17m bisect fix linux-6.1.y OK (0) job log log
2023/09/13 03:12 2h17m bisect fix linux-6.1.y OK (0) job log log
2023/06/29 06:06 2h08m bisect fix linux-6.1.y OK (0) job log log

Sample crash report:
watchdog: BUG: soft lockup - CPU#0 stuck for 23s! [kworker/0:5:4288]
Modules linked in:
irq event stamp: 50733
hardirqs last  enabled at (50732): [<ffff800008215474>] queue_work_on+0xec/0x16c kernel/workqueue.c:1549
hardirqs last disabled at (50733): [<ffff8000120f85dc>] __el1_irq arch/arm64/kernel/entry-common.c:468 [inline]
hardirqs last disabled at (50733): [<ffff8000120f85dc>] el1_interrupt+0x24/0x68 arch/arm64/kernel/entry-common.c:486
softirqs last  enabled at (50724): [<ffff80000ca938e0>] local_bh_enable+0x10/0x34 include/linux/bottom_half.h:32
softirqs last disabled at (50728): [<ffff80000ca93828>] local_bh_disable+0x10/0x34 include/linux/bottom_half.h:19
CPU: 0 PID: 4288 Comm: kworker/0:5 Not tainted 6.1.30-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 04/28/2023
Workqueue: wg-kex-wg1 wg_packet_handshake_receive_worker
pstate: 80400005 (Nzcv daif +PAN -UAO -TCO -DIT -SSBS BTYPE=--)
pc : test_and_set_bit include/asm-generic/bitops/instrumented-atomic.h:72 [inline]
pc : queue_work_on+0x10c/0x16c kernel/workqueue.c:1544
lr : queue_work_on+0x108/0x16c kernel/workqueue.c:1549
sp : ffff80001ddf7660
x29: ffff80001ddf7660 x28: dfff800000000000 x27: 000000000000000b
x26: 0000000000000400 x25: ffff0000ce462b40 x24: 0000000000000000
x23: 0000000000000000 x22: 0000000000000000 x21: 0000000000000000
x20: ffff0000cc4bf800 x19: 0000000000000080 x18: ffff80001ddf7000
x17: ffff8000155ad000 x16: ffff800008305074 x15: 00000000000129f0
x14: 1ffff00002ab60b0 x13: 1fffe000368b6176 x12: 0000000000000003
x11: ff80800008215490 x10: 0000000000000000 x9 : ffff800008215490
x8 : ffff0000d476d340 x7 : 0000000000000000 x6 : 0000000000000000
x5 : 0000000000000080 x4 : 0000000000000000 x3 : 0000000000000000
x2 : 0000000000000002 x1 : 0000000000000080 x0 : 0000000000000000
Call trace:
 arch_local_irq_restore arch/arm64/include/asm/irqflags.h:122 [inline]
 queue_work_on+0x10c/0x16c kernel/workqueue.c:1549
 wg_queue_enqueue_per_device_and_peer drivers/net/wireguard/queueing.h:179 [inline]
 wg_packet_create_data drivers/net/wireguard/send.c:320 [inline]
 wg_packet_send_staged_packets+0xe8c/0x1510 drivers/net/wireguard/send.c:387
 wg_packet_send_keepalive+0x140/0x240 drivers/net/wireguard/send.c:239
 wg_receive_handshake_packet drivers/net/wireguard/receive.c:186 [inline]
 wg_packet_handshake_receive_worker+0x594/0xc58 drivers/net/wireguard/receive.c:213
 process_one_work+0x7ac/0x1404 kernel/workqueue.c:2289
 worker_thread+0x8e4/0xfec kernel/workqueue.c:2436
 kthread+0x250/0x2d8 kernel/kthread.c:376
 ret_from_fork+0x10/0x20 arch/arm64/kernel/entry.S:860

Crashes (7):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2023/05/29 21:29 linux-6.1.y a343b0dd87b4 cf184559 .config console log report syz C [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan-arm64 BUG: soft lockup in wg_packet_handshake_receive_worker
2024/09/08 22:33 linux-6.1.y 5ca5b389fddf 9750182a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in wg_packet_handshake_receive_worker
2024/06/05 00:08 linux-6.1.y 88690811da69 e1e2c66e .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in wg_packet_handshake_receive_worker
2024/06/04 14:31 linux-6.1.y 88690811da69 11f2afa5 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in wg_packet_handshake_receive_worker
2024/05/28 21:25 linux-6.1.y 88690811da69 34889ee3 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in wg_packet_handshake_receive_worker
2024/05/28 05:28 linux-6.1.y 88690811da69 f550015e .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in wg_packet_handshake_receive_worker
2024/05/27 17:52 linux-6.1.y 88690811da69 761766e6 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in wg_packet_handshake_receive_worker
* Struck through repros no longer work on HEAD.