syzbot

 sign-in | mailing list | source | docs
🐞 Open [167]
🐞 Fixed [23]
🐞 Invalid [196]
Kernel Health Bugs/Month Bug Lifetimes Fuzzing Crashes
💬 Send us feedback

BUG: soft lockup in net_rx_action (2)

Status: premoderation: reported on 2024/08/13 18:45
Reported-by: syzbot+3289ed8be186878ca2aa@syzkaller.appspotmail.com
First crash: 34d, last: 34d
▶ ▼ Similar bugs (11)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: rcu detected stall in net_rx_action (3) kvm 67 874d 874d 0/28 auto-closed as invalid on 2022/06/05 10:21
android-5-15 BUG: soft lockup in net_rx_action 1 152d 152d 0/2 auto-obsoleted due to no activity on 2024/07/16 07:14
android-5-10 BUG: soft lockup in net_rx_action 2 27d 39d 0/2 premoderation: reported on 2024/08/08 17:54
android-6-1 BUG: soft lockup in net_rx_action 2 45d 88d 0/2 premoderation: reported on 2024/06/20 11:23
upstream INFO: rcu detected stall in net_rx_action (5) virt wireguard wireless 3 143d 181d 0/28 auto-obsoleted due to no activity on 2024/07/25 01:10
android-54 BUG: soft lockup in net_rx_action 1 92d 92d 0/2 auto-obsoleted due to no activity on 2024/09/14 14:52
linux-4.19 BUG: soft lockup in net_rx_action (2) 1 710d 710d 0/1 auto-obsoleted due to no activity on 2023/02/03 20:26
linux-4.19 BUG: soft lockup in net_rx_action 1 974d 974d 0/1 auto-closed as invalid on 2022/05/16 12:13
linux-5.15 INFO: rcu detected stall in net_rx_action 1 362d 362d 0/3 auto-obsoleted due to no activity on 2023/12/28 19:24
upstream INFO: rcu detected stall in net_rx_action (2) batman 1 1027d 1027d 0/28 closed as invalid on 2022/02/08 10:10
upstream INFO: rcu detected stall in net_rx_action (4) kernel 1 590d 590d 0/28 auto-obsoleted due to no activity on 2023/05/05 00:12

Sample crash report:
RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000
R10: 000055555566b7d0 R11: 0000000000000246 R12: 0000000000000001
R13: 00000000000bf933 R14: 00000000000bf2f5 R15: 00007ffc0cc90770
 </TASK>
watchdog: BUG: soft lockup - CPU#0 stuck for 246s! [syz-executor:12286]
Modules linked in:
CPU: 0 PID: 12286 Comm: syz-executor Tainted: G        W         5.15.153-syzkaller-00453-ge787d6ac4af0 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 06/27/2024
RIP: 0010:native_safe_halt arch/x86/include/asm/irqflags.h:51 [inline]
RIP: 0010:arch_safe_halt arch/x86/include/asm/irqflags.h:89 [inline]
RIP: 0010:kvm_wait+0x147/0x180 arch/x86/kernel/kvm.c:918
Code: 4c 89 e8 48 c1 e8 03 42 0f b6 04 20 84 c0 44 8b 74 24 1c 75 34 41 0f b6 45 00 44 38 f0 75 10 66 90 0f 00 2d 2b 02 13 04 fb f4 <e9> 24 ff ff ff fb e9 1e ff ff ff 44 89 e9 80 e1 07 38 c1 7c a3 4c
RSP: 0018:ffffc90000007ac0 EFLAGS: 00000246
RAX: 0000000000000003 RBX: 1ffff92000000f5c RCX: ffffffff8155067f
RDX: dffffc0000000000 RSI: 0000000000000003 RDI: ffff88810a9810c0
RBP: ffffc90000007b70 R08: dffffc0000000000 R09: ffffed1021530219
R10: 0000000000000000 R11: dffffc0000000001 R12: dffffc0000000000
R13: ffff88810a9810c0 R14: 0000000000000003 R15: 1ffff92000000f60
FS:  000055555566b500(0000) GS:ffff8881f7000000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f498f3886c0 CR3: 000000010c735000 CR4: 00000000003506b0
DR0: 000000000000004e DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Call Trace:
 <IRQ>
 pv_wait arch/x86/include/asm/paravirt.h:597 [inline]
 pv_wait_head_or_lock kernel/locking/qspinlock_paravirt.h:470 [inline]
 __pv_queued_spin_lock_slowpath+0x6bc/0xc40 kernel/locking/qspinlock.c:508
 pv_queued_spin_lock_slowpath arch/x86/include/asm/paravirt.h:585 [inline]
 queued_spin_lock_slowpath arch/x86/include/asm/qspinlock.h:51 [inline]
 queued_spin_lock include/asm-generic/qspinlock.h:85 [inline]
 do_raw_spin_lock include/linux/spinlock.h:187 [inline]
 __raw_spin_lock include/linux/spinlock_api_smp.h:143 [inline]
 _raw_spin_lock+0x139/0x1b0 kernel/locking/spinlock.c:154
 spin_lock include/linux/spinlock.h:363 [inline]
 __netif_tx_lock include/linux/netdevice.h:4469 [inline]
 virtnet_poll_tx+0x176/0x500 drivers/net/virtio_net.c:1684
 __napi_poll+0xc4/0x5a0 net/core/dev.c:7042
 napi_poll net/core/dev.c:7109 [inline]
 net_rx_action+0x47d/0xc50 net/core/dev.c:7199
 __do_softirq+0x26d/0x5bf kernel/softirq.c:565
 invoke_softirq kernel/softirq.c:425 [inline]
 __irq_exit_rcu+0x50/0xf0 kernel/softirq.c:648
 irq_exit_rcu+0x9/0x10 kernel/softirq.c:660
 common_interrupt+0xb4/0xd0 arch/x86/kernel/irq.c:240
 </IRQ>
 <TASK>
 asm_common_interrupt+0x27/0x40 arch/x86/include/asm/idtentry.h:629
RIP: 0010:user_mode arch/x86/include/asm/ptrace.h:136 [inline]
RIP: 0010:unwind_next_frame+0x27b/0x700 arch/x86/kernel/unwind_frame.c:280
Code: 00 74 1a 48 89 df 48 89 4d c8 e8 00 aa 7d 00 48 8b 4d c8 48 ba 00 00 00 00 00 fc ff df 48 3b 0b 0f 85 a2 00 00 00 49 8d 5d e0 <48> 89 d8 48 c1 e8 03 80 3c 10 00 74 12 48 89 df e8 d0 a9 7d 00 48
RSP: 0018:ffffc90000947498 EFLAGS: 00000246
RAX: 1ffff110253c54f4 RBX: ffffc90000947fe0 RCX: 0000000000947501
RDX: dffffc0000000000 RSI: ffffffff85000085 RDI: ffffc90000947f48
RBP: ffffc90000947510 R08: ffffc90000947608 R09: 0000000000000009
R10: ffffc90000947610 R11: dffffc0000000001 R12: 0000000000000000
R13: ffffc90000948000 R14: ffffc90000947520 R15: 1ffff92000128ea4
 arch_stack_walk+0x10d/0x140 arch/x86/kernel/stacktrace.c:25
 stack_trace_save+0x113/0x1c0 kernel/stacktrace.c:122
 kasan_save_stack mm/kasan/common.c:38 [inline]
 kasan_set_track mm/kasan/common.c:45 [inline]
 set_alloc_info mm/kasan/common.c:433 [inline]
 __kasan_slab_alloc+0xb1/0xe0 mm/kasan/common.c:466
 kasan_slab_alloc include/linux/kasan.h:217 [inline]
 slab_post_alloc_hook+0x53/0x2c0 mm/slab.h:550
 slab_alloc_node mm/slub.c:3240 [inline]
 slab_alloc mm/slub.c:3248 [inline]
 kmem_cache_alloc+0xf5/0x200 mm/slub.c:3253
 vm_area_dup+0x26/0x230 kernel/fork.c:367
 dup_mmap kernel/fork.c:601 [inline]
 dup_mm kernel/fork.c:1521 [inline]
 copy_mm+0x9a1/0x13e0 kernel/fork.c:1573
 copy_process+0x1149/0x3290 kernel/fork.c:2264
 kernel_clone+0x21e/0x9e0 kernel/fork.c:2662
 __do_sys_clone kernel/fork.c:2788 [inline]
 __se_sys_clone kernel/fork.c:2772 [inline]
 __x64_sys_clone+0x23f/0x290 kernel/fork.c:2772
 do_syscall_x64 arch/x86/entry/common.c:50 [inline]
 do_syscall_64+0x3d/0xb0 arch/x86/entry/common.c:80
 entry_SYSCALL_64_after_hwframe+0x61/0xcb
RIP: 0033:0x7f498e6b3253
Code: 1f 84 00 00 00 00 00 64 48 8b 04 25 10 00 00 00 45 31 c0 31 d2 31 f6 bf 11 00 20 01 4c 8d 90 d0 02 00 00 b8 38 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 35 89 c2 85 c0 75 2c 64 48 8b 04 25 10 00 00
RSP: 002b:00007ffc0cc905e8 EFLAGS: 00000246 ORIG_RAX: 0000000000000038
RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f498e6b3253
RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000001200011
RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000
R10: 000055555566b7d0 R11: 0000000000000246 R12: 0000000000000001
R13: 00000000000bf933 R14: 00000000000bf2f5 R15: 00007ffc0cc90770
 </TASK>
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 14407 Comm: syz.1.4242 Tainted: G        W         5.15.153-syzkaller-00453-ge787d6ac4af0 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 06/27/2024
RIP: 0010:native_halt arch/x86/include/asm/irqflags.h:57 [inline]
RIP: 0010:halt arch/x86/include/asm/irqflags.h:98 [inline]
RIP: 0010:kvm_wait+0x117/0x180 arch/x86/kernel/kvm.c:912
Code: 48 c1 e8 03 42 0f b6 04 20 84 c0 44 8b 74 24 1c 75 53 41 0f b6 45 00 44 38 f0 0f 85 63 ff ff ff 66 90 0f 00 2d 5a 02 13 04 f4 <e9> 54 ff ff ff fa 4c 89 e8 48 c1 e8 03 42 0f b6 04 20 84 c0 44 8b
RSP: 0000:ffffc900001ce7a0 EFLAGS: 00000046
RAX: 0000000000000003 RBX: 1ffff92000039cf8 RCX: ffffffff8155067f
RDX: dffffc0000000000 RSI: 0000000000000003 RDI: ffff8881f71378c0
RBP: ffffc900001ce850 R08: dffffc0000000000 R09: ffffed103ee26f19
R10: 0000000000000000 R11: dffffc0000000001 R12: dffffc0000000000
R13: ffff8881f71378c0 R14: 0000000000000003 R15: 1ffff92000039cfc
FS:  0000555556696500(0000) GS:ffff8881f7100000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000001b2f41cff8 CR3: 00000001237a6000 CR4: 00000000003506a0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000003ef1 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <NMI>
 </NMI>
 <IRQ>
 pv_wait arch/x86/include/asm/paravirt.h:597 [inline]
 pv_wait_head_or_lock kernel/locking/qspinlock_paravirt.h:470 [inline]
 __pv_queued_spin_lock_slowpath+0x6bc/0xc40 kernel/locking/qspinlock.c:508
 pv_queued_spin_lock_slowpath arch/x86/include/asm/paravirt.h:585 [inline]
 queued_spin_lock_slowpath arch/x86/include/asm/qspinlock.h:51 [inline]
 queued_spin_lock include/asm-generic/qspinlock.h:85 [inline]
 do_raw_spin_lock include/linux/spinlock.h:187 [inline]
 __raw_spin_lock include/linux/spinlock_api_smp.h:143 [inline]
 _raw_spin_lock+0x139/0x1b0 kernel/locking/spinlock.c:154
 raw_spin_rq_lock_nested kernel/sched/core.c:489 [inline]
 raw_spin_rq_lock kernel/sched/sched.h:1352 [inline]
 rq_lock kernel/sched/sched.h:1660 [inline]
 scheduler_tick+0xa2/0x470 kernel/sched/core.c:5425
 update_process_times+0x1cc/0x200 kernel/time/timer.c:1799
 tick_sched_handle kernel/time/tick-sched.c:257 [inline]
 tick_sched_timer+0x188/0x240 kernel/time/tick-sched.c:1478
 __run_hrtimer kernel/time/hrtimer.c:1685 [inline]
 __hrtimer_run_queues+0x41a/0xad0 kernel/time/hrtimer.c:1749
 hrtimer_interrupt+0x40c/0xaa0 kernel/time/hrtimer.c:1811
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1085 [inline]
 __sysvec_apic_timer_interrupt+0xfd/0x3c0 arch/x86/kernel/apic/apic.c:1102
 sysvec_apic_timer_interrupt+0x44/0xc0 arch/x86/kernel/apic/apic.c:1096
 asm_sysvec_apic_timer_interrupt+0x1b/0x20 arch/x86/include/asm/idtentry.h:638
RIP: 0010:get_stack_info+0x8/0x100 arch/x86/kernel/dumpstack_64.c:193
Code: 48 8d 04 c5 80 15 45 85 55 48 89 e5 48 8b 00 5d c3 31 c0 c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 55 48 89 e5 41 57 41 56 <41> 55 41 54 53 50 49 89 ce 49 89 d4 48 89 f3 48 85 f6 74 07 48 85
RSP: 0000:ffffc900001cee20 EFLAGS: 00000246
RAX: ffff88811e4f3b40 RBX: ffffc900001ceeb0 RCX: ffffc900001ceee0
RDX: ffffc900001ceec0 RSI: ffff88811e4f3b40 RDI: ffffc900001ceeb0
RBP: ffffc900001cee30 R08: dffffc0000000000 R09: ffffc900001ceec0
R10: 0000000000000000 R11: dffffc0000000001 R12: 0000000000000000
R13: ffff88811e4f3b40 R14: ffffc900001cef00 R15: ffffc900001ceec0
 __unwind_start+0x1e9/0x3a0 arch/x86/kernel/unwind_frame.c:395
 unwind_start arch/x86/include/asm/unwind.h:60 [inline]
 arch_stack_walk+0xdb/0x140 arch/x86/kernel/stacktrace.c:24
 stack_trace_save+0x113/0x1c0 kernel/stacktrace.c:122
 kasan_save_stack mm/kasan/common.c:38 [inline]
 kasan_set_track mm/kasan/common.c:45 [inline]
 set_alloc_info mm/kasan/common.c:433 [inline]
 __kasan_slab_alloc+0xb1/0xe0 mm/kasan/common.c:466
 kasan_slab_alloc include/linux/kasan.h:217 [inline]
 slab_post_alloc_hook+0x53/0x2c0 mm/slab.h:550
 slab_alloc_node mm/slub.c:3240 [inline]
 slab_alloc mm/slub.c:3248 [inline]
 kmem_cache_alloc+0xf5/0x200 mm/slub.c:3253
 skb_clone+0x1d1/0x360 net/core/skbuff.c:1547
 dev_queue_xmit_nit+0x25b/0xa40 net/core/dev.c:2317
 xmit_one net/core/dev.c:3619 [inline]
 dev_hard_start_xmit+0x149/0x620 net/core/dev.c:3640
 sch_direct_xmit+0x298/0x9b0 net/sched/sch_generic.c:342
 __dev_xmit_skb net/core/dev.c:3851 [inline]
 __dev_queue_xmit+0x161e/0x2e70 net/core/dev.c:4220
 dev_queue_xmit+0x17/0x20 net/core/dev.c:4288
 neigh_hh_output include/net/neighbour.h:501 [inline]
 neigh_output include/net/neighbour.h:515 [inline]
 ip_finish_output2+0xb9f/0xf60 net/ipv4/ip_output.c:228
 __ip_finish_output+0x162/0x360
 ip_finish_output+0x31/0x210 net/ipv4/ip_output.c:316
 NF_HOOK_COND include/linux/netfilter.h:294 [inline]
 ip_output+0x1d6/0x420 net/ipv4/ip_output.c:430
 dst_output include/net/dst.h:444 [inline]
 ip_local_out net/ipv4/ip_output.c:126 [inline]
 __ip_queue_xmit+0x1105/0x1c20 net/ipv4/ip_output.c:532
 ip_queue_xmit+0x4c/0x70 net/ipv4/ip_output.c:546
 __tcp_transmit_skb+0x1e84/0x3920 net/ipv4/tcp_output.c:1402
 tcp_transmit_skb net/ipv4/tcp_output.c:1420 [inline]
 tcp_write_xmit+0x144a/0x5e80 net/ipv4/tcp_output.c:2705
 __tcp_push_pending_frames+0x98/0x2f0 net/ipv4/tcp_output.c:2890
 tcp_push_pending_frames include/net/tcp.h:1915 [inline]
 tcp_data_snd_check net/ipv4/tcp_input.c:5495 [inline]
 tcp_rcv_established+0x97b/0x1ac0 net/ipv4/tcp_input.c:5991
 tcp_v4_do_rcv+0x3d7/0xa00 net/ipv4/tcp_ipv4.c:1722
 tcp_v4_rcv+0x23dd/0x2a70 net/ipv4/tcp_ipv4.c:2125
 ip_protocol_deliver_rcu+0x32f/0x710 net/ipv4/ip_input.c:204
 ip_local_deliver_finish net/ipv4/ip_input.c:231 [inline]
 NF_HOOK include/linux/netfilter.h:305 [inline]
 ip_local_deliver+0x2c6/0x590 net/ipv4/ip_input.c:252
 dst_input include/net/dst.h:454 [inline]
 ip_sublist_rcv_finish net/ipv4/ip_input.c:577 [inline]
 ip_list_rcv_finish net/ipv4/ip_input.c:628 [inline]
 ip_sublist_rcv+0x7e2/0x980 net/ipv4/ip_input.c:636
 ip_list_rcv+0x422/0x470 net/ipv4/ip_input.c:671
 __netif_receive_skb_list_ptype net/core/dev.c:5535 [inline]
 __netif_receive_skb_list_core+0x6b1/0x890 net/core/dev.c:5583
 __netif_receive_skb_list net/core/dev.c:5635 [inline]
 netif_receive_skb_list_internal+0x967/0xcc0 net/core/dev.c:5726
 gro_normal_list net/core/dev.c:5880 [inline]
 napi_complete_done+0x344/0x770 net/core/dev.c:6618
 virtqueue_napi_complete drivers/net/virtio_net.c:357 [inline]
 virtnet_poll+0xbee/0x1260 drivers/net/virtio_net.c:1592
 __napi_poll+0xc4/0x5a0 net/core/dev.c:7042
 napi_poll net/core/dev.c:7109 [inline]
 net_rx_action+0x47d/0xc50 net/core/dev.c:7199
 __do_softirq+0x26d/0x5bf kernel/softirq.c:565
 do_softirq+0xf6/0x150 kernel/softirq.c:452
 </IRQ>
 <TASK>
 __local_bh_enable_ip+0x75/0x80 kernel/softirq.c:379
 __raw_spin_unlock_bh include/linux/spinlock_api_smp.h:176 [inline]
 _raw_spin_unlock_bh+0x51/0x60 kernel/locking/spinlock.c:210
 __sock_map_delete net/core/sock_map.c:426 [inline]
 sock_map_delete_elem+0xcb/0x130 net/core/sock_map.c:448
 bpf_prog_2c29ac5cdc6b1842+0x3a/0xc18
 bpf_dispatcher_nop_func include/linux/bpf.h:785 [inline]
 __bpf_prog_run include/linux/filter.h:628 [inline]
 bpf_prog_run include/linux/filter.h:635 [inline]
 __bpf_trace_run kernel/trace/bpf_trace.c:1880 [inline]
 bpf_trace_run2+0xec/0x210 kernel/trace/bpf_trace.c:1917
 __bpf_trace_tlb_flush+0x23/0x30 include/trace/events/tlb.h:38
 trace_tlb_flush include/trace/events/tlb.h:38 [inline]
 switch_mm_irqs_off+0x616/0x9b0 arch/x86/mm/tlb.c:629
 context_switch kernel/sched/core.c:5137 [inline]
 __schedule+0xb2b/0x1590 kernel/sched/core.c:6512
 schedule+0x11f/0x1e0 kernel/sched/core.c:6595
 exit_to_user_mode_loop+0x4d/0xe0 kernel/entry/common.c:163
 exit_to_user_mode_prepare+0x5a/0xa0 kernel/entry/common.c:208
 irqentry_exit_to_user_mode+0x9/0x20 kernel/entry/common.c:314
 irqentry_exit+0x12/0x40 kernel/entry/common.c:405
 common_interrupt+0x65/0xd0 arch/x86/kernel/irq.c:240
 asm_common_interrupt+0x27/0x40 arch/x86/include/asm/idtentry.h:629
RIP: 0033:0x7f50924f3fc8
Code: Unable to access opcode bytes at RIP 0x7f50924f3f9e.
RSP: 002b:00007ffeda200c00 EFLAGS: 00000297
RAX: 00007f5091e9a058 RBX: 00007f50932e0720 RCX: ffffffff817e5f42
RDX: 00007f5091e9a090 RSI: ffffffff81407f25 RDI: 00007f5091e9a010
RBP: 00007f5091e9a8b8 R08: 00007f5091e9a090 R09: 00007f509279d000
R10: 00000000812e7a6a R11: 0000000000000004 R12: 00007f5091e9a8b8
R13: 00007f50927b1018 R14: 00007f5091e9a008 R15: 00000000000bfa03
 </TASK>

Crashes (1):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2024/08/13 18:44 android13-5.15-lts e787d6ac4af0 f21a18ca .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15 BUG: soft lockup in net_rx_action
* Struck through repros no longer work on HEAD.