rcu: INFO: rcu_preempt self-detected stall on CPU rcu: 1-...!: (10501 ticks this GP) idle=225/1/0x4000000000000000 softirq=79015/79015 fqs=0 (t=10502 jiffies g=113169 q=2209) rcu: rcu_preempt kthread timer wakeup didn't happen for 10502 jiffies! g113169 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 rcu: Possible timer handling issue on cpu=1 timer-softirq=64903 rcu: rcu_preempt kthread starved for 10505 jiffies! g113169 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=1 rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. rcu: RCU grace-period kthread stack dump: task:rcu_preempt state:I stack:28720 pid: 14 ppid: 2 flags:0x00004000 Call Trace: context_switch kernel/sched/core.c:4986 [inline] __schedule+0xab2/0x4e90 kernel/sched/core.c:6296 schedule+0xd2/0x260 kernel/sched/core.c:6369 schedule_timeout+0x14a/0x2a0 kernel/time/timer.c:1881 rcu_gp_fqs_loop+0x186/0x810 kernel/rcu/tree.c:1971 rcu_gp_kthread+0x1de/0x320 kernel/rcu/tree.c:2144 kthread+0x2e9/0x3a0 kernel/kthread.c:377 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:295 rcu: Stack dump where RCU GP kthread last ran: NMI backtrace for cpu 1 CPU: 1 PID: 1236 Comm: aoe_tx0 Not tainted 5.16.0-rc6-next-20211224-syzkaller #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011 Call Trace: __dump_stack lib/dump_stack.c:88 [inline] dump_stack_lvl+0xcd/0x134 lib/dump_stack.c:106 nmi_cpu_backtrace.cold+0x47/0x144 lib/nmi_backtrace.c:111 nmi_trigger_cpumask_backtrace+0x1b3/0x230 lib/nmi_backtrace.c:62 trigger_single_cpu_backtrace include/linux/nmi.h:164 [inline] rcu_check_gp_kthread_starvation.cold+0x1fb/0x200 kernel/rcu/tree_stall.h:458 print_cpu_stall kernel/rcu/tree_stall.h:602 [inline] check_cpu_stall kernel/rcu/tree_stall.h:688 [inline] rcu_pending kernel/rcu/tree.c:3920 [inline] rcu_sched_clock_irq.cold+0x57/0x759 kernel/rcu/tree.c:2625 update_process_times+0x16d/0x200 kernel/time/timer.c:1785 tick_sched_handle+0x9b/0x180 kernel/time/tick-sched.c:226 tick_sched_timer+0x1b0/0x2d0 kernel/time/tick-sched.c:1428 __run_hrtimer kernel/time/hrtimer.c:1685 [inline] __hrtimer_run_queues+0x1c0/0xe50 kernel/time/hrtimer.c:1749 hrtimer_interrupt+0x31c/0x790 kernel/time/hrtimer.c:1811 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1086 [inline] __sysvec_apic_timer_interrupt+0x146/0x530 arch/x86/kernel/apic/apic.c:1103 sysvec_apic_timer_interrupt+0x8e/0xc0 arch/x86/kernel/apic/apic.c:1097 asm_sysvec_apic_timer_interrupt+0x12/0x20 arch/x86/include/asm/idtentry.h:638 RIP: 0010:handle_tx+0x18a/0x610 drivers/net/caif/caif_serial.c:236 Code: e8 4b 71 86 fc 45 85 f6 0f 84 43 02 00 00 e8 1d 6f 86 fc 44 39 3d 76 99 96 07 49 8d bc 24 d0 00 00 00 44 0f 4e 3d 66 99 96 07 <48> 89 fa 45 39 f7 45 0f 4e f7 48 c1 ea 03 44 0f b6 3d 10 f9 8d 0b RSP: 0018:ffffc90005e2fb28 EFLAGS: 00000202 RAX: 0000000000000000 RBX: ffff88802f81ecc0 RCX: 0000000000000000 RDX: ffff88801d3a0000 RSI: ffffffff84f19563 RDI: ffff8880790f2990 RBP: dffffc0000000000 R08: 0000000000000000 R09: 000000001a880b00 R10: ffffffff84f19555 R11: 0000000000000000 R12: ffff8880790f28c0 R13: ffff88807cd92000 R14: 0000000000000fff R15: 0000000000000020 __netdev_start_xmit include/linux/netdevice.h:4678 [inline] netdev_start_xmit include/linux/netdevice.h:4692 [inline] xmit_one net/core/dev.c:3473 [inline] dev_hard_start_xmit+0x1eb/0x920 net/core/dev.c:3489 __dev_queue_xmit+0x2983/0x3640 net/core/dev.c:4116 tx+0x68/0xb0 drivers/block/aoe/aoenet.c:63 kthread+0x1e7/0x3b0 drivers/block/aoe/aoecmd.c:1230 kthread+0x2e9/0x3a0 kernel/kthread.c:377 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:295 NMI backtrace for cpu 1 CPU: 1 PID: 1236 Comm: aoe_tx0 Not tainted 5.16.0-rc6-next-20211224-syzkaller #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011 Call Trace: __dump_stack lib/dump_stack.c:88 [inline] dump_stack_lvl+0xcd/0x134 lib/dump_stack.c:106 nmi_cpu_backtrace.cold+0x47/0x144 lib/nmi_backtrace.c:111 nmi_trigger_cpumask_backtrace+0x1b3/0x230 lib/nmi_backtrace.c:62 trigger_single_cpu_backtrace include/linux/nmi.h:164 [inline] rcu_dump_cpu_stacks+0x262/0x3f0 kernel/rcu/tree_stall.h:343 print_cpu_stall kernel/rcu/tree_stall.h:604 [inline] check_cpu_stall kernel/rcu/tree_stall.h:688 [inline] rcu_pending kernel/rcu/tree.c:3920 [inline] rcu_sched_clock_irq.cold+0x5c/0x759 kernel/rcu/tree.c:2625 update_process_times+0x16d/0x200 kernel/time/timer.c:1785 tick_sched_handle+0x9b/0x180 kernel/time/tick-sched.c:226 tick_sched_timer+0x1b0/0x2d0 kernel/time/tick-sched.c:1428 __run_hrtimer kernel/time/hrtimer.c:1685 [inline] __hrtimer_run_queues+0x1c0/0xe50 kernel/time/hrtimer.c:1749 hrtimer_interrupt+0x31c/0x790 kernel/time/hrtimer.c:1811 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1086 [inline] __sysvec_apic_timer_interrupt+0x146/0x530 arch/x86/kernel/apic/apic.c:1103 sysvec_apic_timer_interrupt+0x8e/0xc0 arch/x86/kernel/apic/apic.c:1097 asm_sysvec_apic_timer_interrupt+0x12/0x20 arch/x86/include/asm/idtentry.h:638 RIP: 0010:handle_tx+0x18a/0x610 drivers/net/caif/caif_serial.c:236 Code: e8 4b 71 86 fc 45 85 f6 0f 84 43 02 00 00 e8 1d 6f 86 fc 44 39 3d 76 99 96 07 49 8d bc 24 d0 00 00 00 44 0f 4e 3d 66 99 96 07 <48> 89 fa 45 39 f7 45 0f 4e f7 48 c1 ea 03 44 0f b6 3d 10 f9 8d 0b RSP: 0018:ffffc90005e2fb28 EFLAGS: 00000202 RAX: 0000000000000000 RBX: ffff88802f81ecc0 RCX: 0000000000000000 RDX: ffff88801d3a0000 RSI: ffffffff84f19563 RDI: ffff8880790f2990 RBP: dffffc0000000000 R08: 0000000000000000 R09: 000000001a880b00 R10: ffffffff84f19555 R11: 0000000000000000 R12: ffff8880790f28c0 R13: ffff88807cd92000 R14: 0000000000000fff R15: 0000000000000020 __netdev_start_xmit include/linux/netdevice.h:4678 [inline] netdev_start_xmit include/linux/netdevice.h:4692 [inline] xmit_one net/core/dev.c:3473 [inline] dev_hard_start_xmit+0x1eb/0x920 net/core/dev.c:3489 __dev_queue_xmit+0x2983/0x3640 net/core/dev.c:4116 tx+0x68/0xb0 drivers/block/aoe/aoenet.c:63 kthread+0x1e7/0x3b0 drivers/block/aoe/aoecmd.c:1230 kthread+0x2e9/0x3a0 kernel/kthread.c:377 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:295 ---------------- Code disassembly (best guess): 0: e8 4b 71 86 fc callq 0xfc867150 5: 45 85 f6 test %r14d,%r14d 8: 0f 84 43 02 00 00 je 0x251 e: e8 1d 6f 86 fc callq 0xfc866f30 13: 44 39 3d 76 99 96 07 cmp %r15d,0x7969976(%rip) # 0x7969990 1a: 49 8d bc 24 d0 00 00 lea 0xd0(%r12),%rdi 21: 00 22: 44 0f 4e 3d 66 99 96 cmovle 0x7969966(%rip),%r15d # 0x7969990 29: 07 * 2a: 48 89 fa mov %rdi,%rdx <-- trapping instruction 2d: 45 39 f7 cmp %r14d,%r15d 30: 45 0f 4e f7 cmovle %r15d,%r14d 34: 48 c1 ea 03 shr $0x3,%rdx 38: 44 0f b6 3d 10 f9 8d movzbl 0xb8df910(%rip),%r15d # 0xb8df950 3f: 0b