rcu: INFO: rcu_preempt detected stalls on CPUs/tasks: rcu: 0-...!: (1 GPs behind) idle=1694/1/0x4000000000000000 softirq=146933/146934 fqs=3 rcu: (detected by 1, t=10503 jiffies, g=197409, q=267 ncpus=2) Sending NMI from CPU 1 to CPUs 0: NMI backtrace for cpu 0 CPU: 0 PID: 28 Comm: kauditd Not tainted 6.9.0-rc7-syzkaller-00008-gee5b455b0ada #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 03/27/2024 RIP: 0010:_raw_spin_lock_irq+0xe7/0x120 kernel/locking/spinlock.c:171 Code: f6 31 d2 31 c9 41 b8 01 00 00 00 45 31 c9 ff 75 08 e8 1d 8b e7 f5 48 83 c4 08 4c 89 e7 e8 41 ec e8 f5 48 c7 04 24 0e 36 e0 45 <4b> c7 04 2f 00 00 00 00 65 48 8b 04 25 28 00 00 00 48 3b 44 24 40 RSP: 0018:ffffc90000007cc0 EFLAGS: 00000046 RAX: 2258e12dd14c2900 RBX: 1ffff92000000f9c RCX: 0000000000000001 RDX: dffffc0000000000 RSI: 0000000000000004 RDI: ffffc90000007c40 RBP: ffffc90000007d50 R08: 0000000000000003 R09: fffff52000000f88 R10: dffffc0000000000 R11: fffff52000000f88 R12: ffff8880b942c880 R13: 1ffff92000000f98 R14: ffffc90000007ce0 R15: dffffc0000000000 FS: 0000000000000000(0000) GS:ffff8880b9400000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 0000001b30827000 CR3: 00000000297e4000 CR4: 0000000000350ef0 Call Trace: __run_hrtimer kernel/time/hrtimer.c:1696 [inline] __hrtimer_run_queues+0x67a/0xd50 kernel/time/hrtimer.c:1756 hrtimer_interrupt+0x396/0x990 kernel/time/hrtimer.c:1818 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1032 [inline] __sysvec_apic_timer_interrupt+0x112/0x3f0 arch/x86/kernel/apic/apic.c:1049 instr_sysvec_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1043 [inline] sysvec_apic_timer_interrupt+0xa1/0xc0 arch/x86/kernel/apic/apic.c:1043 asm_sysvec_apic_timer_interrupt+0x1a/0x20 arch/x86/include/asm/idtentry.h:702 RIP: 0010:console_flush_all+0xaad/0xfd0 kernel/printk/printk.c:2985 Code: ff ff e8 a6 94 1f 00 90 0f 0b 90 e9 d8 f8 ff ff e8 98 94 1f 00 e8 d3 b9 09 0a 4d 85 f6 74 b6 e8 89 94 1f 00 fb 48 8b 44 24 70 <42> 0f b6 04 38 84 c0 48 8b 7c 24 30 0f 85 22 02 00 00 0f b6 1f 31 RSP: 0018:ffffc90000a477e0 EFLAGS: 00000293 RAX: 1ffff92000148f48 RBX: 0000000000000000 RCX: ffff8880176b5a00 RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000 RBP: ffffc90000a47990 R08: ffffffff81767394 R09: 1ffffffff25e6aa0 R10: dffffc0000000000 R11: fffffbfff25e6aa1 R12: ffffffff8eb15c58 R13: ffffffff8eb15c00 R14: 0000000000000200 R15: dffffc0000000000 console_unlock+0x13b/0x4d0 kernel/printk/printk.c:3048 vprintk_emit+0x5a6/0x770 kernel/printk/printk.c:2348 _printk+0xd5/0x120 kernel/printk/printk.c:2373 kauditd_printk_skb kernel/audit.c:546 [inline] kauditd_hold_skb+0x1bc/0x210 kernel/audit.c:581 kauditd_send_queue+0x2b3/0x310 kernel/audit.c:766 kauditd_thread+0x75c/0x990 kernel/audit.c:890 kthread+0x2f2/0x390 kernel/kthread.c:388 ret_from_fork+0x4d/0x80 arch/x86/kernel/process.c:147 ret_from_fork_asm+0x1a/0x30 arch/x86/entry/entry_64.S:244 rcu: rcu_preempt kthread starved for 10490 jiffies! g197409 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=1 rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. rcu: RCU grace-period kthread stack dump: task:rcu_preempt state:R running task stack:26256 pid:16 tgid:16 ppid:2 flags:0x00004000 Call Trace: context_switch kernel/sched/core.c:5409 [inline] __schedule+0x17e8/0x4a50 kernel/sched/core.c:6746 __schedule_loop kernel/sched/core.c:6823 [inline] schedule+0x14b/0x320 kernel/sched/core.c:6838 schedule_timeout+0x1be/0x310 kernel/time/timer.c:2582 rcu_gp_fqs_loop+0x2df/0x1370 kernel/rcu/tree.c:1663 rcu_gp_kthread+0xa7/0x3b0 kernel/rcu/tree.c:1862 kthread+0x2f2/0x390 kernel/kthread.c:388 ret_from_fork+0x4d/0x80 arch/x86/kernel/process.c:147 ret_from_fork_asm+0x1a/0x30 arch/x86/entry/entry_64.S:244 rcu: Stack dump where RCU GP kthread last ran: CPU: 1 PID: 11359 Comm: kworker/u8:19 Not tainted 6.9.0-rc7-syzkaller-00008-gee5b455b0ada #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 03/27/2024 Workqueue: events_unbound toggle_allocation_gate RIP: 0010:csd_lock_wait kernel/smp.c:311 [inline] RIP: 0010:smp_call_function_many_cond+0x18a5/0x2a00 kernel/smp.c:855 Code: 41 83 e4 01 49 bc 00 00 00 00 00 fc ff df 75 07 e8 c0 d6 0b 00 eb 38 f3 90 42 0f b6 04 23 84 c0 75 11 41 f7 45 00 01 00 00 00 <74> 1e e8 a4 d6 0b 00 eb e4 44 89 e9 80 e1 07 80 c1 03 38 c1 7c e2 RSP: 0018:ffffc90003ff76e0 EFLAGS: 00000202 RAX: 0000000000000000 RBX: 1ffff11017288c6d RCX: ffff88802191bc00 RDX: 0000000000000000 RSI: 0000000000000001 RDI: 0000000000000000 RBP: ffffc90003ff78e0 R08: ffffffff818a31ab R09: 1ffffffff25e6aa0 R10: dffffc0000000000 R11: fffffbfff25e6aa1 R12: dffffc0000000000 R13: ffff8880b9446368 R14: ffff8880b953f7c0 R15: 0000000000000000 FS: 0000000000000000(0000) GS:ffff8880b9500000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 000055558a0fa938 CR3: 000000000e134000 CR4: 0000000000350ef0 Call Trace: on_each_cpu_cond_mask+0x3f/0x80 kernel/smp.c:1023 on_each_cpu include/linux/smp.h:71 [inline] text_poke_sync arch/x86/kernel/alternative.c:2086 [inline] text_poke_bp_batch+0x352/0xb30 arch/x86/kernel/alternative.c:2296 text_poke_flush arch/x86/kernel/alternative.c:2487 [inline] text_poke_finish+0x30/0x50 arch/x86/kernel/alternative.c:2494 arch_jump_label_transform_apply+0x1c/0x30 arch/x86/kernel/jump_label.c:146 static_key_enable_cpuslocked+0x136/0x260 kernel/jump_label.c:205 static_key_enable+0x1a/0x20 kernel/jump_label.c:218 toggle_allocation_gate+0xb5/0x250 mm/kfence/core.c:826 process_one_work kernel/workqueue.c:3267 [inline] process_scheduled_works+0xa12/0x17c0 kernel/workqueue.c:3348 worker_thread+0x86d/0xd70 kernel/workqueue.c:3429 kthread+0x2f2/0x390 kernel/kthread.c:388 ret_from_fork+0x4d/0x80 arch/x86/kernel/process.c:147 ret_from_fork_asm+0x1a/0x30 arch/x86/entry/entry_64.S:244 watchdog: BUG: soft lockup - CPU#1 stuck for 225s! [kworker/u8:19:11359] Modules linked in: irq event stamp: 29811006 hardirqs last enabled at (29811005): [] irqentry_exit+0x63/0x90 kernel/entry/common.c:357 hardirqs last disabled at (29811006): [] sysvec_apic_timer_interrupt+0xe/0xc0 arch/x86/kernel/apic/apic.c:1043 softirqs last enabled at (29811000): [] __do_softirq kernel/softirq.c:588 [inline] softirqs last enabled at (29811000): [] invoke_softirq kernel/softirq.c:428 [inline] softirqs last enabled at (29811000): [] __irq_exit_rcu+0xf4/0x1c0 kernel/softirq.c:637 softirqs last disabled at (29810969): [] __do_softirq kernel/softirq.c:588 [inline] softirqs last disabled at (29810969): [] invoke_softirq kernel/softirq.c:428 [inline] softirqs last disabled at (29810969): [] __irq_exit_rcu+0xf4/0x1c0 kernel/softirq.c:637 CPU: 1 PID: 11359 Comm: kworker/u8:19 Not tainted 6.9.0-rc7-syzkaller-00008-gee5b455b0ada #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 03/27/2024 Workqueue: events_unbound toggle_allocation_gate RIP: 0010:csd_lock_wait kernel/smp.c:311 [inline] RIP: 0010:smp_call_function_many_cond+0x1899/0x2a00 kernel/smp.c:855 Code: 89 e6 83 e6 01 31 ff e8 15 db 0b 00 41 83 e4 01 49 bc 00 00 00 00 00 fc ff df 75 07 e8 c0 d6 0b 00 eb 38 f3 90 42 0f b6 04 23 <84> c0 75 11 41 f7 45 00 01 00 00 00 74 1e e8 a4 d6 0b 00 eb e4 44 RSP: 0018:ffffc90003ff76e0 EFLAGS: 00000293 RAX: 0000000000000000 RBX: 1ffff11017288c6d RCX: ffff88802191bc00 RDX: 0000000000000000 RSI: 0000000000000001 RDI: 0000000000000000 RBP: ffffc90003ff78e0 R08: ffffffff818a31ab R09: 1ffffffff25e6aa0 R10: dffffc0000000000 R11: fffffbfff25e6aa1 R12: dffffc0000000000 R13: ffff8880b9446368 R14: ffff8880b953f7c0 R15: 0000000000000000 FS: 0000000000000000(0000) GS:ffff8880b9500000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 000055558a0fa938 CR3: 000000000e134000 CR4: 0000000000350ef0 Call Trace: on_each_cpu_cond_mask+0x3f/0x80 kernel/smp.c:1023 on_each_cpu include/linux/smp.h:71 [inline] text_poke_sync arch/x86/kernel/alternative.c:2086 [inline] text_poke_bp_batch+0x352/0xb30 arch/x86/kernel/alternative.c:2296 text_poke_flush arch/x86/kernel/alternative.c:2487 [inline] text_poke_finish+0x30/0x50 arch/x86/kernel/alternative.c:2494 arch_jump_label_transform_apply+0x1c/0x30 arch/x86/kernel/jump_label.c:146 static_key_enable_cpuslocked+0x136/0x260 kernel/jump_label.c:205 static_key_enable+0x1a/0x20 kernel/jump_label.c:218 toggle_allocation_gate+0xb5/0x250 mm/kfence/core.c:826 process_one_work kernel/workqueue.c:3267 [inline] process_scheduled_works+0xa12/0x17c0 kernel/workqueue.c:3348 worker_thread+0x86d/0xd70 kernel/workqueue.c:3429 kthread+0x2f2/0x390 kernel/kthread.c:388 ret_from_fork+0x4d/0x80 arch/x86/kernel/process.c:147 ret_from_fork_asm+0x1a/0x30 arch/x86/entry/entry_64.S:244 Sending NMI from CPU 1 to CPUs 0: NMI backtrace for cpu 0 CPU: 0 PID: 28 Comm: kauditd Not tainted 6.9.0-rc7-syzkaller-00008-gee5b455b0ada #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 03/27/2024 RIP: 0010:native_irq_disable arch/x86/include/asm/irqflags.h:37 [inline] RIP: 0010:arch_local_irq_disable arch/x86/include/asm/irqflags.h:72 [inline] RIP: 0010:arch_local_irq_save arch/x86/include/asm/irqflags.h:104 [inline] RIP: 0010:lock_release+0x184/0x9f0 kernel/locking/lockdep.c:5770 Code: c7 84 24 b0 00 00 00 00 00 00 00 9c 8f 84 24 b0 00 00 00 42 80 3c 3b 00 74 08 4c 89 f7 e8 94 07 88 00 48 8b 9c 24 b0 00 00 00 48 c7 c7 80 c5 ca 8b e8 cf 9f 0d 0a 65 ff 05 e8 dd 8f 7e 48 8d RSP: 0018:ffffc90000007a20 EFLAGS: 00000046 RAX: 0000000000000000 RBX: 0000000000000046 RCX: ffffffff8172abb0 RDX: 0000000000000000 RSI: ffffffff8c1f8000 RDI: ffffffff8c1f7fc0 RBP: ffffc90000007b50 R08: ffffffff8fa8f72f R09: 1ffffffff1f51ee5 R10: dffffc0000000000 R11: fffffbfff1f51ee6 R12: 1ffff92000000f50 R13: ffffffff84b73984 R14: ffffc90000007ad0 R15: dffffc0000000000 FS: 0000000000000000(0000) GS:ffff8880b9400000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 0000001b30827000 CR3: 00000000297e4000 CR4: 0000000000350ef0 Call Trace: __raw_spin_unlock_irqrestore include/linux/spinlock_api_smp.h:149 [inline] _raw_spin_unlock_irqrestore+0x79/0x140 kernel/locking/spinlock.c:194 debug_object_activate+0x3e4/0x510 lib/debugobjects.c:726 debug_hrtimer_activate kernel/time/hrtimer.c:423 [inline] debug_activate kernel/time/hrtimer.c:478 [inline] enqueue_hrtimer+0x30/0x3c0 kernel/time/hrtimer.c:1090 __run_hrtimer kernel/time/hrtimer.c:1709 [inline] __hrtimer_run_queues+0x6d5/0xd50 kernel/time/hrtimer.c:1756 hrtimer_interrupt+0x396/0x990 kernel/time/hrtimer.c:1818 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1032 [inline] __sysvec_apic_timer_interrupt+0x112/0x3f0 arch/x86/kernel/apic/apic.c:1049 instr_sysvec_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1043 [inline] sysvec_apic_timer_interrupt+0xa1/0xc0 arch/x86/kernel/apic/apic.c:1043 asm_sysvec_apic_timer_interrupt+0x1a/0x20 arch/x86/include/asm/idtentry.h:702 RIP: 0010:console_flush_all+0xaad/0xfd0 kernel/printk/printk.c:2985 Code: ff ff e8 a6 94 1f 00 90 0f 0b 90 e9 d8 f8 ff ff e8 98 94 1f 00 e8 d3 b9 09 0a 4d 85 f6 74 b6 e8 89 94 1f 00 fb 48 8b 44 24 70 <42> 0f b6 04 38 84 c0 48 8b 7c 24 30 0f 85 22 02 00 00 0f b6 1f 31 RSP: 0018:ffffc90000a477e0 EFLAGS: 00000293 RAX: 1ffff92000148f48 RBX: 0000000000000000 RCX: ffff8880176b5a00 RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000 RBP: ffffc90000a47990 R08: ffffffff81767394 R09: 1ffffffff25e6aa0 R10: dffffc0000000000 R11: fffffbfff25e6aa1 R12: ffffffff8eb15c58 R13: ffffffff8eb15c00 R14: 0000000000000200 R15: dffffc0000000000 console_unlock+0x13b/0x4d0 kernel/printk/printk.c:3048 vprintk_emit+0x5a6/0x770 kernel/printk/printk.c:2348 _printk+0xd5/0x120 kernel/printk/printk.c:2373 kauditd_printk_skb kernel/audit.c:546 [inline] kauditd_hold_skb+0x1bc/0x210 kernel/audit.c:581 kauditd_send_queue+0x2b3/0x310 kernel/audit.c:766 kauditd_thread+0x75c/0x990 kernel/audit.c:890 kthread+0x2f2/0x390 kernel/kthread.c:388 ret_from_fork+0x4d/0x80 arch/x86/kernel/process.c:147 ret_from_fork_asm+0x1a/0x30 arch/x86/entry/entry_64.S:244