rcu: INFO: rcu_preempt self-detected stall on CPU
rcu: 0-...!: (10500 ticks this GP) idle=d57/1/0x4000000000000000 softirq=28268/28268 fqs=0
(t=10501 jiffies g=33877 q=2398 ncpus=2)
rcu: rcu_preempt kthread timer wakeup didn't happen for 10501 jiffies! g33877 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402
rcu: Possible timer handling issue on cpu=0 timer-softirq=16906
rcu: rcu_preempt kthread starved for 10504 jiffies! g33877 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0
rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
rcu: RCU grace-period kthread stack dump:
task:rcu_preempt state:I stack:29264 pid: 16 ppid: 2 flags:0x00004000
Call Trace:
context_switch kernel/sched/core.c:5106 [inline]
__schedule+0xa9a/0x4cc0 kernel/sched/core.c:6421
schedule+0xd2/0x1f0 kernel/sched/core.c:6493
schedule_timeout+0x14a/0x2a0 kernel/time/timer.c:1907
rcu_gp_fqs_loop+0x1c0/0x840 kernel/rcu/tree.c:2078
rcu_gp_kthread+0x1de/0x320 kernel/rcu/tree.c:2267
kthread+0x2e9/0x3a0 kernel/kthread.c:376
ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:298
rcu: Stack dump where RCU GP kthread last ran:
NMI backtrace for cpu 0
CPU: 0 PID: 3589 Comm: syz-fuzzer Not tainted 5.18.0-rc3-next-20220422-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Call Trace:
__dump_stack lib/dump_stack.c:88 [inline]
dump_stack_lvl+0xcd/0x134 lib/dump_stack.c:106
nmi_cpu_backtrace.cold+0x47/0x144 lib/nmi_backtrace.c:111
nmi_trigger_cpumask_backtrace+0x1e6/0x230 lib/nmi_backtrace.c:62
trigger_single_cpu_backtrace include/linux/nmi.h:164 [inline]
rcu_check_gp_kthread_starvation.cold+0x1fb/0x200 kernel/rcu/tree_stall.h:516
print_cpu_stall kernel/rcu/tree_stall.h:660 [inline]
check_cpu_stall kernel/rcu/tree_stall.h:749 [inline]
rcu_pending kernel/rcu/tree.c:4068 [inline]
rcu_sched_clock_irq.cold+0xfa/0x8fc kernel/rcu/tree.c:2755
update_process_times+0x16d/0x200 kernel/time/timer.c:1811
tick_sched_handle+0x9b/0x180 kernel/time/tick-sched.c:243
tick_sched_timer+0xee/0x120 kernel/time/tick-sched.c:1473
__run_hrtimer kernel/time/hrtimer.c:1685 [inline]
__hrtimer_run_queues+0x1c0/0xe50 kernel/time/hrtimer.c:1749
hrtimer_interrupt+0x31c/0x790 kernel/time/hrtimer.c:1811
local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1095 [inline]
__sysvec_apic_timer_interrupt+0x146/0x530 arch/x86/kernel/apic/apic.c:1112
sysvec_apic_timer_interrupt+0x40/0xc0 arch/x86/kernel/apic/apic.c:1106
asm_sysvec_apic_timer_interrupt+0x12/0x20 arch/x86/include/asm/idtentry.h:649
RIP: 0010:kvm_wait+0x98/0x100 arch/x86/kernel/kvm.c:1058
Code: fa 83 e2 07 38 d0 7f 04 84 c0 75 63 0f b6 07 40 38 c6 74 35 48 83 c4 10 c3 c3 e8 23 91 4b 00 eb 07 0f 00 2d da b1 94 08 fb f4 <48> 83 c4 10 c3 89 74 24 0c 48 89 3c 24 e8 56 8f 4b 00 8b 74 24 0c
RSP: 0018:ffffc900000076e8 EFLAGS: 00000246
RAX: 0000000000000007 RBX: 0000000000000000 RCX: 1ffffffff1b73199
RDX: 0000000000000000 RSI: ffffffff81807171 RDI: ffffffff8134dffd
RBP: ffff88801db40948 R08: 0000000000000000 R09: 0000000000000000
R10: ffffffff81807158 R11: 0000000000000001 R12: 0000000000000000
R13: ffffed1003b68129 R14: 0000000000000001 R15: ffff8880b9c3ae40
pv_wait arch/x86/include/asm/paravirt.h:603 [inline]
pv_wait_head_or_lock kernel/locking/qspinlock_paravirt.h:470 [inline]
__pv_queued_spin_lock_slowpath+0x8c7/0xb50 kernel/locking/qspinlock.c:511
pv_queued_spin_lock_slowpath arch/x86/include/asm/paravirt.h:591 [inline]
queued_spin_lock_slowpath arch/x86/include/asm/qspinlock.h:51 [inline]
queued_spin_lock include/asm-generic/qspinlock.h:85 [inline]
do_raw_spin_lock+0x200/0x2a0 kernel/locking/spinlock_debug.c:115
spin_lock include/linux/spinlock.h:354 [inline]
task_lock include/linux/sched/task.h:170 [inline]
__get_task_comm+0x23/0x50 fs/exec.c:1219
__set_page_owner_handle mm/page_owner.c:174 [inline]
__set_page_owner+0x253/0x380 mm/page_owner.c:192
prep_new_page mm/page_alloc.c:2394 [inline]
get_page_from_freelist+0xba2/0x3e00 mm/page_alloc.c:4135
__alloc_pages+0x1b2/0x500 mm/page_alloc.c:5356
alloc_pages+0x1aa/0x310 mm/mempolicy.c:2273
skb_page_frag_refill net/core/sock.c:2751 [inline]
skb_page_frag_refill+0x191/0x360 net/core/sock.c:2735
add_recvbuf_mergeable drivers/net/virtio_net.c:1357 [inline]
try_fill_recv+0x747/0x1960 drivers/net/virtio_net.c:1398
virtnet_receive drivers/net/virtio_net.c:1512 [inline]
virtnet_poll+0x95a/0x11a0 drivers/net/virtio_net.c:1609
__napi_poll+0xb3/0x6e0 net/core/dev.c:6443
napi_poll net/core/dev.c:6510 [inline]
net_rx_action+0x8ec/0xc60 net/core/dev.c:6597
__do_softirq+0x29b/0x9c2 kernel/softirq.c:558
invoke_softirq kernel/softirq.c:432 [inline]
__irq_exit_rcu+0x123/0x180 kernel/softirq.c:637
irq_exit_rcu+0x5/0x20 kernel/softirq.c:649
common_interrupt+0xa9/0xc0 arch/x86/kernel/irq.c:240
asm_common_interrupt+0x1e/0x40 arch/x86/include/asm/idtentry.h:640
RIP: 0010:memory_is_nonzero mm/kasan/generic.c:101 [inline]
RIP: 0010:memory_is_poisoned_n mm/kasan/generic.c:128 [inline]
RIP: 0010:memory_is_poisoned mm/kasan/generic.c:159 [inline]
RIP: 0010:check_region_inline mm/kasan/generic.c:180 [inline]
RIP: 0010:kasan_check_range+0x59/0x180 mm/kasan/generic.c:189
Code: 00 49 83 e9 01 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 ca 48 c1 ed 03 49 c1 ea 03 48 01 c5 49 01 c2 48 89 e8 49 8d 5a 01 <48> 89 da 48 29 ea 48 83 fa 10 7e 63 41 89 eb 41 83 e3 07 75 74 4c
RSP: 0018:ffffc90002e3f418 EFLAGS: 00000282
RAX: ffffed1003b68129 RBX: ffffed1003b6812a RCX: ffffffff815ea4d0
RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88801db40948
RBP: ffffed1003b68129 R08: 0000000000000000 R09: ffff88801db4094b
R10: ffffed1003b68129 R11: 0000000000000001 R12: ffff8880139276a8
R13: 0000000000000010 R14: ffff888013927688 R15: 0000000000000007
instrument_atomic_read include/linux/instrumented.h:71 [inline]
atomic_read include/linux/atomic/atomic-instrumented.h:27 [inline]
queued_spin_is_locked include/asm-generic/qspinlock.h:28 [inline]
debug_spin_unlock kernel/locking/spinlock_debug.c:100 [inline]
do_raw_spin_unlock+0x50/0x230 kernel/locking/spinlock_debug.c:140
__raw_spin_unlock include/linux/spinlock_api_smp.h:142 [inline]
_raw_spin_unlock+0x1a/0x40 kernel/locking/spinlock.c:186
spin_unlock include/linux/spinlock.h:394 [inline]
task_unlock include/linux/sched/task.h:175 [inline]
__get_task_comm+0x3d/0x50 fs/exec.c:1222
__set_page_owner_handle mm/page_owner.c:174 [inline]
__set_page_owner+0x253/0x380 mm/page_owner.c:192
prep_new_page mm/page_alloc.c:2394 [inline]
get_page_from_freelist+0xba2/0x3e00 mm/page_alloc.c:4135
__alloc_pages+0x1b2/0x500 mm/page_alloc.c:5356
alloc_pages+0x1aa/0x310 mm/mempolicy.c:2273
alloc_slab_page mm/slub.c:1797 [inline]
allocate_slab+0x26c/0x3c0 mm/slub.c:1942
new_slab mm/slub.c:2002 [inline]
___slab_alloc+0x985/0xd90 mm/slub.c:3002
__slab_alloc.constprop.0+0x4d/0xa0 mm/slub.c:3089
slab_alloc_node mm/slub.c:3180 [inline]
kmem_cache_alloc_node+0x122/0x3f0 mm/slub.c:3264
__alloc_skb+0x215/0x340 net/core/skbuff.c:414
alloc_skb_fclone include/linux/skbuff.h:1387 [inline]
tcp_stream_alloc_skb+0x66/0x900 net/ipv4/tcp.c:863
tcp_sendmsg_locked+0xac8/0x2fb0 net/ipv4/tcp.c:1298
tcp_sendmsg+0x2b/0x40 net/ipv4/tcp.c:1449
inet_sendmsg+0x99/0xe0 net/ipv4/af_inet.c:819
sock_sendmsg_nosec net/socket.c:705 [inline]
sock_sendmsg+0xcf/0x120 net/socket.c:725
sock_write_iter+0x283/0x3c0 net/socket.c:1061
call_write_iter include/linux/fs.h:2059 [inline]
new_sync_write+0x38a/0x560 fs/read_write.c:504
vfs_write+0x7c0/0xac0 fs/read_write.c:591
ksys_write+0x1e8/0x250 fs/read_write.c:644
do_syscall_x64 arch/x86/entry/common.c:50 [inline]
do_syscall_64+0x35/0xb0 arch/x86/entry/common.c:80
entry_SYSCALL_64_after_hwframe+0x44/0xae
RIP: 0033:0x49dfbb
Code: e8 aa 4b fc ff eb 88 cc cc cc cc cc cc cc cc e8 bb 8f fc ff 48 8b 7c 24 10 48 8b 74 24 18 48 8b 54 24 20 48 8b 44 24 08 0f 05 <48> 3d 01 f0 ff ff 76 20 48 c7 44 24 28 ff ff ff ff 48 c7 44 24 30
RSP: 002b:000000c00d8972d0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
RAX: ffffffffffffffda RBX: 000000c00001e000 RCX: 000000000049dfbb
RDX: 0000000000000004 RSI: 000000c00000a200 RDI: 0000000000000006
RBP: 000000c00d897320 R08: 0000000000000001 R09: 000000c00045c300
R10: 0000000000000004 R11: 0000000000000202 R12: 000000c00d8973b0
R13: 0000000000000000 R14: 000000c0000001a0 R15: 000000000000007f
NMI backtrace for cpu 0
CPU: 0 PID: 3589 Comm: syz-fuzzer Not tainted 5.18.0-rc3-next-20220422-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Call Trace:
__dump_stack lib/dump_stack.c:88 [inline]
dump_stack_lvl+0xcd/0x134 lib/dump_stack.c:106
nmi_cpu_backtrace.cold+0x47/0x144 lib/nmi_backtrace.c:111
nmi_trigger_cpumask_backtrace+0x1e6/0x230 lib/nmi_backtrace.c:62
trigger_single_cpu_backtrace include/linux/nmi.h:164 [inline]
rcu_dump_cpu_stacks+0x262/0x3f0 kernel/rcu/tree_stall.h:369
print_cpu_stall kernel/rcu/tree_stall.h:665 [inline]
check_cpu_stall kernel/rcu/tree_stall.h:749 [inline]
rcu_pending kernel/rcu/tree.c:4068 [inline]
rcu_sched_clock_irq.cold+0x144/0x8fc kernel/rcu/tree.c:2755
update_process_times+0x16d/0x200 kernel/time/timer.c:1811
tick_sched_handle+0x9b/0x180 kernel/time/tick-sched.c:243
tick_sched_timer+0xee/0x120 kernel/time/tick-sched.c:1473
__run_hrtimer kernel/time/hrtimer.c:1685 [inline]
__hrtimer_run_queues+0x1c0/0xe50 kernel/time/hrtimer.c:1749
hrtimer_interrupt+0x31c/0x790 kernel/time/hrtimer.c:1811
local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1095 [inline]
__sysvec_apic_timer_interrupt+0x146/0x530 arch/x86/kernel/apic/apic.c:1112
sysvec_apic_timer_interrupt+0x40/0xc0 arch/x86/kernel/apic/apic.c:1106
asm_sysvec_apic_timer_interrupt+0x12/0x20 arch/x86/include/asm/idtentry.h:649
RIP: 0010:kvm_wait+0x98/0x100 arch/x86/kernel/kvm.c:1058
Code: fa 83 e2 07 38 d0 7f 04 84 c0 75 63 0f b6 07 40 38 c6 74 35 48 83 c4 10 c3 c3 e8 23 91 4b 00 eb 07 0f 00 2d da b1 94 08 fb f4 <48> 83 c4 10 c3 89 74 24 0c 48 89 3c 24 e8 56 8f 4b 00 8b 74 24 0c
RSP: 0018:ffffc900000076e8 EFLAGS: 00000246
RAX: 0000000000000007 RBX: 0000000000000000 RCX: 1ffffffff1b73199
RDX: 0000000000000000 RSI: ffffffff81807171 RDI: ffffffff8134dffd
RBP: ffff88801db40948 R08: 0000000000000000 R09: 0000000000000000
R10: ffffffff81807158 R11: 0000000000000001 R12: 0000000000000000
R13: ffffed1003b68129 R14: 0000000000000001 R15: ffff8880b9c3ae40
pv_wait arch/x86/include/asm/paravirt.h:603 [inline]
pv_wait_head_or_lock kernel/locking/qspinlock_paravirt.h:470 [inline]
__pv_queued_spin_lock_slowpath+0x8c7/0xb50 kernel/locking/qspinlock.c:511
pv_queued_spin_lock_slowpath arch/x86/include/asm/paravirt.h:591 [inline]
queued_spin_lock_slowpath arch/x86/include/asm/qspinlock.h:51 [inline]
queued_spin_lock include/asm-generic/qspinlock.h:85 [inline]
do_raw_spin_lock+0x200/0x2a0 kernel/locking/spinlock_debug.c:115
spin_lock include/linux/spinlock.h:354 [inline]
task_lock include/linux/sched/task.h:170 [inline]
__get_task_comm+0x23/0x50 fs/exec.c:1219
__set_page_owner_handle mm/page_owner.c:174 [inline]
__set_page_owner+0x253/0x380 mm/page_owner.c:192
prep_new_page mm/page_alloc.c:2394 [inline]
get_page_from_freelist+0xba2/0x3e00 mm/page_alloc.c:4135
__alloc_pages+0x1b2/0x500 mm/page_alloc.c:5356
alloc_pages+0x1aa/0x310 mm/mempolicy.c:2273
skb_page_frag_refill net/core/sock.c:2751 [inline]
skb_page_frag_refill+0x191/0x360 net/core/sock.c:2735
add_recvbuf_mergeable drivers/net/virtio_net.c:1357 [inline]
try_fill_recv+0x747/0x1960 drivers/net/virtio_net.c:1398
virtnet_receive drivers/net/virtio_net.c:1512 [inline]
virtnet_poll+0x95a/0x11a0 drivers/net/virtio_net.c:1609
__napi_poll+0xb3/0x6e0 net/core/dev.c:6443
napi_poll net/core/dev.c:6510 [inline]
net_rx_action+0x8ec/0xc60 net/core/dev.c:6597
__do_softirq+0x29b/0x9c2 kernel/softirq.c:558
invoke_softirq kernel/softirq.c:432 [inline]
__irq_exit_rcu+0x123/0x180 kernel/softirq.c:637
irq_exit_rcu+0x5/0x20 kernel/softirq.c:649
common_interrupt+0xa9/0xc0 arch/x86/kernel/irq.c:240
asm_common_interrupt+0x1e/0x40 arch/x86/include/asm/idtentry.h:640
RIP: 0010:memory_is_nonzero mm/kasan/generic.c:101 [inline]
RIP: 0010:memory_is_poisoned_n mm/kasan/generic.c:128 [inline]
RIP: 0010:memory_is_poisoned mm/kasan/generic.c:159 [inline]
RIP: 0010:check_region_inline mm/kasan/generic.c:180 [inline]
RIP: 0010:kasan_check_range+0x59/0x180 mm/kasan/generic.c:189
Code: 00 49 83 e9 01 48 89 fd 48 b8 00 00 00 00 00 fc ff df 4d 89 ca 48 c1 ed 03 49 c1 ea 03 48 01 c5 49 01 c2 48 89 e8 49 8d 5a 01 <48> 89 da 48 29 ea 48 83 fa 10 7e 63 41 89 eb 41 83 e3 07 75 74 4c
RSP: 0018:ffffc90002e3f418 EFLAGS: 00000282
RAX: ffffed1003b68129 RBX: ffffed1003b6812a RCX: ffffffff815ea4d0
RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88801db40948
RBP: ffffed1003b68129 R08: 0000000000000000 R09: ffff88801db4094b
R10: ffffed1003b68129 R11: 0000000000000001 R12: ffff8880139276a8
R13: 0000000000000010 R14: ffff888013927688 R15: 0000000000000007
instrument_atomic_read include/linux/instrumented.h:71 [inline]
atomic_read include/linux/atomic/atomic-instrumented.h:27 [inline]
queued_spin_is_locked include/asm-generic/qspinlock.h:28 [inline]
debug_spin_unlock kernel/locking/spinlock_debug.c:100 [inline]
do_raw_spin_unlock+0x50/0x230 kernel/locking/spinlock_debug.c:140
__raw_spin_unlock include/linux/spinlock_api_smp.h:142 [inline]
_raw_spin_unlock+0x1a/0x40 kernel/locking/spinlock.c:186
spin_unlock include/linux/spinlock.h:394 [inline]
task_unlock include/linux/sched/task.h:175 [inline]
__get_task_comm+0x3d/0x50 fs/exec.c:1222
__set_page_owner_handle mm/page_owner.c:174 [inline]
__set_page_owner+0x253/0x380 mm/page_owner.c:192
prep_new_page mm/page_alloc.c:2394 [inline]
get_page_from_freelist+0xba2/0x3e00 mm/page_alloc.c:4135
__alloc_pages+0x1b2/0x500 mm/page_alloc.c:5356
alloc_pages+0x1aa/0x310 mm/mempolicy.c:2273
alloc_slab_page mm/slub.c:1797 [inline]
allocate_slab+0x26c/0x3c0 mm/slub.c:1942
new_slab mm/slub.c:2002 [inline]
___slab_alloc+0x985/0xd90 mm/slub.c:3002
__slab_alloc.constprop.0+0x4d/0xa0 mm/slub.c:3089
slab_alloc_node mm/slub.c:3180 [inline]
kmem_cache_alloc_node+0x122/0x3f0 mm/slub.c:3264
__alloc_skb+0x215/0x340 net/core/skbuff.c:414
alloc_skb_fclone include/linux/skbuff.h:1387 [inline]
tcp_stream_alloc_skb+0x66/0x900 net/ipv4/tcp.c:863
tcp_sendmsg_locked+0xac8/0x2fb0 net/ipv4/tcp.c:1298
tcp_sendmsg+0x2b/0x40 net/ipv4/tcp.c:1449
inet_sendmsg+0x99/0xe0 net/ipv4/af_inet.c:819
sock_sendmsg_nosec net/socket.c:705 [inline]
sock_sendmsg+0xcf/0x120 net/socket.c:725
sock_write_iter+0x283/0x3c0 net/socket.c:1061
call_write_iter include/linux/fs.h:2059 [inline]
new_sync_write+0x38a/0x560 fs/read_write.c:504
vfs_write+0x7c0/0xac0 fs/read_write.c:591
ksys_write+0x1e8/0x250 fs/read_write.c:644
do_syscall_x64 arch/x86/entry/common.c:50 [inline]
do_syscall_64+0x35/0xb0 arch/x86/entry/common.c:80
entry_SYSCALL_64_after_hwframe+0x44/0xae
RIP: 0033:0x49dfbb
Code: e8 aa 4b fc ff eb 88 cc cc cc cc cc cc cc cc e8 bb 8f fc ff 48 8b 7c 24 10 48 8b 74 24 18 48 8b 54 24 20 48 8b 44 24 08 0f 05 <48> 3d 01 f0 ff ff 76 20 48 c7 44 24 28 ff ff ff ff 48 c7 44 24 30
RSP: 002b:000000c00d8972d0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
RAX: ffffffffffffffda RBX: 000000c00001e000 RCX: 000000000049dfbb
RDX: 0000000000000004 RSI: 000000c00000a200 RDI: 0000000000000006
RBP: 000000c00d897320 R08: 0000000000000001 R09: 000000c00045c300
R10: 0000000000000004 R11: 0000000000000202 R12: 000000c00d8973b0
R13: 0000000000000000 R14: 000000c0000001a0 R15: 000000000000007f
----------------
Code disassembly (best guess):
0: fa cli
1: 83 e2 07 and $0x7,%edx
4: 38 d0 cmp %dl,%al
6: 7f 04 jg 0xc
8: 84 c0 test %al,%al
a: 75 63 jne 0x6f
c: 0f b6 07 movzbl (%rdi),%eax
f: 40 38 c6 cmp %al,%sil
12: 74 35 je 0x49
14: 48 83 c4 10 add $0x10,%rsp
18: c3 retq
19: c3 retq
1a: e8 23 91 4b 00 callq 0x4b9142
1f: eb 07 jmp 0x28
21: 0f 00 2d da b1 94 08 verw 0x894b1da(%rip) # 0x894b202
28: fb sti
29: f4 hlt
* 2a: 48 83 c4 10 add $0x10,%rsp <-- trapping instruction
2e: c3 retq
2f: 89 74 24 0c mov %esi,0xc(%rsp)
33: 48 89 3c 24 mov %rdi,(%rsp)
37: e8 56 8f 4b 00 callq 0x4b8f92
3c: 8b 74 24 0c mov 0xc(%rsp),%esi