syzbot


BUG: soft lockup in wg_packet_tx_worker

Status: auto-obsoleted due to no activity on 2023/11/22 23:32
Reported-by: syzbot+452cc297dc9d3eec0836@syzkaller.appspotmail.com
First crash: 504d, last: 454d
Similar bugs (8)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream BUG: soft lockup in wg_packet_tx_worker kvm 1 1660d 1660d 15/28 fixed on 2020/07/17 17:58
linux-5.15 BUG: soft lockup in wg_packet_tx_worker origin:lts-only C 1 4d21h 4d23h 0/3 upstream: reported C repro on 2024/11/16 16:23
android-6-1 BUG: soft lockup in wg_packet_tx_worker 3 369d 391d 0/2 auto-obsoleted due to no activity on 2024/02/16 07:09
android-5-15 BUG: soft lockup in wg_packet_tx_worker 1 463d 463d 0/2 auto-obsoleted due to no activity on 2023/11/14 01:23
upstream INFO: rcu detected stall in wg_packet_tx_worker (3) net C inconclusive 5 1193d 1175d 20/28 fixed on 2021/11/10 00:50
android-5-15 BUG: soft lockup in wg_packet_tx_worker (2) 1 219d 219d 0/2 auto-obsoleted due to no activity on 2024/07/15 09:44
linux-5.15 INFO: rcu detected stall in wg_packet_tx_worker 1 168d 168d 0/3 auto-obsoleted due to no activity on 2024/09/14 07:48
upstream INFO: rcu detected stall in wg_packet_tx_worker (4) net 1 1091d 1091d 0/28 closed as invalid on 2022/02/08 10:10

Sample crash report:
watchdog: BUG: soft lockup - CPU#0 stuck for 123s! [kworker/0:12:1067]
Modules linked in:
CPU: 0 PID: 1067 Comm: kworker/0:12 Not tainted 5.10.188-syzkaller-00574-gd96fc5f29172 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 07/26/2023
Workqueue: wg-crypt-wg0 wg_packet_tx_worker
RIP: 0010:native_restore_fl arch/x86/include/asm/irqflags.h:41 [inline]
RIP: 0010:arch_local_irq_restore arch/x86/include/asm/irqflags.h:84 [inline]
RIP: 0010:kvm_wait+0xfc/0x150 arch/x86/kernel/kvm.c:926
Code: 38 f0 75 26 41 f7 c7 00 02 00 00 75 0f 0f 1f 44 00 00 0f 00 2d 85 46 d5 03 f4 eb 0e 0f 1f 44 00 00 0f 00 2d 76 46 d5 03 fb f4 <4c> 89 7c 24 18 ff 74 24 18 9d 48 c7 44 24 20 0e 36 e0 45 49 c7 04
RSP: 0018:ffffc90000ef7180 EFLAGS: 00000246
RAX: 0000000000000001 RBX: 1ffff920001dee34 RCX: 1ffffffff0cd8ddf
RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffc90000ef71c0
RBP: ffffc90000ef7230 R08: dffffc0000000000 R09: ffffed103ee0ae53
R10: 0000000000000000 R11: dffffc0000000001 R12: dffffc0000000000
R13: ffff8881f7057294 R14: 0000000000000001 R15: 0000000000000246
FS:  0000000000000000(0000) GS:ffff8881f7000000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000001b2d526000 CR3: 0000000154b37000 CR4: 00000000003506b0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <IRQ>
 </IRQ>
 pv_wait arch/x86/include/asm/paravirt.h:564 [inline]
 pv_wait_node kernel/locking/qspinlock_paravirt.h:325 [inline]
 __pv_queued_spin_lock_slowpath+0x407/0xc70 kernel/locking/qspinlock.c:473
 pv_queued_spin_lock_slowpath arch/x86/include/asm/paravirt.h:554 [inline]
 queued_spin_lock_slowpath arch/x86/include/asm/qspinlock.h:51 [inline]
 queued_spin_lock include/asm-generic/qspinlock.h:85 [inline]
 do_raw_spin_lock include/linux/spinlock.h:183 [inline]
 __raw_spin_lock include/linux/spinlock_api_smp.h:143 [inline]
 _raw_spin_lock+0x139/0x1b0 kernel/locking/spinlock.c:151
 spin_lock include/linux/spinlock.h:354 [inline]
 __dev_xmit_skb net/core/dev.c:3808 [inline]
 __dev_queue_xmit+0xbc0/0x28e0 net/core/dev.c:4147
 dev_queue_xmit+0x17/0x20 net/core/dev.c:4215
 neigh_hh_output include/net/neighbour.h:501 [inline]
 neigh_output include/net/neighbour.h:515 [inline]
 ip6_finish_output2+0xeec/0x1850 net/ipv6/ip6_output.c:145
 __ip6_finish_output+0x658/0x820 net/ipv6/ip6_output.c:210
 ip6_finish_output+0x34/0x1e0 net/ipv6/ip6_output.c:220
 NF_HOOK_COND include/linux/netfilter.h:288 [inline]
 ip6_output+0x1f7/0x4d0 net/ipv6/ip6_output.c:243
 dst_output include/net/dst.h:437 [inline]
 ip6_local_out+0x1ff/0x480 net/ipv6/output_core.c:161
 ip6tunnel_xmit include/net/ip6_tunnel.h:160 [inline]
 udp_tunnel6_xmit_skb+0x422/0x7f0 net/ipv6/ip6_udp_tunnel.c:109
 send6+0x563/0x840 drivers/net/wireguard/socket.c:152
 wg_socket_send_skb_to_peer+0x116/0x1d0 drivers/net/wireguard/socket.c:178
 wg_packet_create_data_done drivers/net/wireguard/send.c:251 [inline]
 wg_packet_tx_worker+0x1df/0x4f0 drivers/net/wireguard/send.c:276
 process_one_work+0x6dc/0xbd0 kernel/workqueue.c:2301
 worker_thread+0xaea/0x1510 kernel/workqueue.c:2447
 kthread+0x34b/0x3d0 kernel/kthread.c:313
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:299
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 16474 Comm: syz-executor.4 Not tainted 5.10.188-syzkaller-00574-gd96fc5f29172 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 07/26/2023
RIP: 0010:native_restore_fl arch/x86/include/asm/irqflags.h:41 [inline]
RIP: 0010:arch_local_irq_restore arch/x86/include/asm/irqflags.h:84 [inline]
RIP: 0010:kvm_wait+0xfc/0x150 arch/x86/kernel/kvm.c:926
Code: 38 f0 75 26 41 f7 c7 00 02 00 00 75 0f 0f 1f 44 00 00 0f 00 2d 85 46 d5 03 f4 eb 0e 0f 1f 44 00 00 0f 00 2d 76 46 d5 03 fb f4 <4c> 89 7c 24 18 ff 74 24 18 9d 48 c7 44 24 20 0e 36 e0 45 49 c7 04
RSP: 0018:ffffc9000857eb00 EFLAGS: 00000246
RAX: 0000000000000003 RBX: 1ffff920010afd64 RCX: ffffffff8150aa64
RDX: 0000000000000001 RSI: 0000000000000003 RDI: ffffc9000857eb40
RBP: ffffc9000857ebb0 R08: dffffc0000000000 R09: ffffed1021ad5e16
R10: 0000000000000000 R11: dffffc0000000001 R12: dffffc0000000000
R13: ffff88810d6af0ac R14: 0000000000000003 R15: 0000000000000246
FS:  00007f63214976c0(0000) GS:ffff8881f7100000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000020000080 CR3: 000000011d4b6000 CR4: 00000000003506a0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <NMI>
 </NMI>
 pv_wait arch/x86/include/asm/paravirt.h:564 [inline]
 pv_wait_head_or_lock kernel/locking/qspinlock_paravirt.h:470 [inline]
 __pv_queued_spin_lock_slowpath+0x72f/0xc70 kernel/locking/qspinlock.c:508
 pv_queued_spin_lock_slowpath arch/x86/include/asm/paravirt.h:554 [inline]
 queued_spin_lock_slowpath arch/x86/include/asm/qspinlock.h:51 [inline]
 queued_spin_lock include/asm-generic/qspinlock.h:85 [inline]
 do_raw_spin_lock include/linux/spinlock.h:183 [inline]
 __raw_spin_lock_bh include/linux/spinlock_api_smp.h:136 [inline]
 _raw_spin_lock_bh+0x139/0x1b0 kernel/locking/spinlock.c:175
 spin_lock_bh include/linux/spinlock.h:359 [inline]
 get_dist_table+0x207/0x2e0 net/sched/sch_netem.c:798
 netem_change+0x974/0x1fb0 net/sched/sch_netem.c:988
 netem_init+0x5b/0xb0 net/sched/sch_netem.c:1075
 qdisc_create+0x879/0x12d0 net/sched/sch_api.c:1264
 tc_modify_qdisc+0x8a4/0x13f0
 rtnetlink_rcv_msg+0x955/0xc50 net/core/rtnetlink.c:5577
 netlink_rcv_skb+0x1cf/0x410 net/netlink/af_netlink.c:2497
 rtnetlink_rcv+0x1c/0x20 net/core/rtnetlink.c:5595
 netlink_unicast_kernel net/netlink/af_netlink.c:1322 [inline]
 netlink_unicast+0x8df/0xac0 net/netlink/af_netlink.c:1348
 netlink_sendmsg+0xa46/0xd00 net/netlink/af_netlink.c:1916
 sock_sendmsg_nosec net/socket.c:652 [inline]
 sock_sendmsg net/socket.c:672 [inline]
 ____sys_sendmsg+0x59e/0x8f0 net/socket.c:2357
 ___sys_sendmsg+0x252/0x2e0 net/socket.c:2411
 __sys_sendmsg net/socket.c:2440 [inline]
 __do_sys_sendmsg net/socket.c:2449 [inline]
 __se_sys_sendmsg+0x1b1/0x280 net/socket.c:2447
 __x64_sys_sendmsg+0x7b/0x90 net/socket.c:2447
 do_syscall_64+0x34/0x70
 entry_SYSCALL_64_after_hwframe+0x61/0xc6
RIP: 0033:0x7f6322714ae9
Code: 28 00 00 00 75 05 48 83 c4 28 c3 e8 e1 20 00 00 90 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 b0 ff ff ff f7 d8 64 89 01 48
RSP: 002b:00007f63214970c8 EFLAGS: 00000246 ORIG_RAX: 000000000000002e
RAX: ffffffffffffffda RBX: 00007f6322833f80 RCX: 00007f6322714ae9
RDX: 0000000000000000 RSI: 0000000020000040 RDI: 0000000000000003
RBP: 00007f632276047a R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
R13: 000000000000000b R14: 00007f6322833f80 R15: 00007fff4d4985d8

Crashes (5):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2023/08/24 23:31 android13-5.10-lts d96fc5f29172 49be837e .config console log report info ci2-android-5-10 BUG: soft lockup in wg_packet_tx_worker
2023/08/17 22:09 android13-5.10-lts 8a427269c016 74b106b6 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-10 BUG: soft lockup in wg_packet_tx_worker
2023/07/24 15:49 android13-5.10-lts 59b65efafe20 b03242d7 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-10 BUG: soft lockup in wg_packet_tx_worker
2023/07/16 12:58 android13-5.10-lts 59b65efafe20 35d9ecc5 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-10 BUG: soft lockup in wg_packet_tx_worker
2023/07/06 12:17 android13-5.10-lts 59b65efafe20 ba5dba36 .config console log report info ci2-android-5-10 BUG: soft lockup in wg_packet_tx_worker
* Struck through repros no longer work on HEAD.