rcu: INFO: rcu_preempt detected stalls on CPUs/tasks: rcu: 0-...!: (1 GPs behind) idle=a5f/1/0x4000000000000000 softirq=75406/75407 fqs=3 (detected by 1, t=10502 jiffies, g=111277, q=162 ncpus=2) Sending NMI from CPU 1 to CPUs 0: NMI backtrace for cpu 0 CPU: 0 PID: 3600 Comm: sshd Not tainted 5.19.0-rc2-syzkaller #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011 RIP: 0010:variable_test_bit arch/x86/include/asm/bitops.h:214 [inline] RIP: 0010:test_bit include/asm-generic/bitops/instrumented-non-atomic.h:135 [inline] RIP: 0010:hlock_class kernel/locking/lockdep.c:227 [inline] RIP: 0010:mark_lock.part.0+0xee/0x1910 kernel/locking/lockdep.c:4610 Code: 00 00 41 0f b7 54 24 20 66 81 e2 ff 1f 44 0f b7 f2 be 08 00 00 00 4c 89 f0 48 c1 f8 06 48 8d 3c c5 00 99 67 90 e8 d2 ca 68 00 <4c> 0f a3 35 6a 9a 0a 0f 0f 83 cd 00 00 00 4b 8d 04 76 48 c1 e0 06 RSP: 0018:ffffc90000007a00 EFLAGS: 00000046 RAX: 0000000000000001 RBX: 1ffff92000000f47 RCX: ffffffff815cfe8e RDX: fffffbfff20cf354 RSI: 0000000000000008 RDI: ffffffff90679a98 RBP: 0000000000000100 R08: 0000000000000000 R09: ffffffff90679a9f R10: fffffbfff20cf353 R11: 0000000000000001 R12: ffff888018102bc8 R13: 0000000000000008 R14: 0000000000000cf2 R15: ffff888018102be8 FS: 00007ff5fe736800(0000) GS:ffff8880b9a00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 0000000020000040 CR3: 000000007d62f000 CR4: 00000000003506f0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Call Trace: mark_lock kernel/locking/lockdep.c:4596 [inline] mark_usage kernel/locking/lockdep.c:4553 [inline] __lock_acquire+0x8ab/0x5660 kernel/locking/lockdep.c:5007 lock_acquire kernel/locking/lockdep.c:5665 [inline] lock_acquire+0x1ab/0x570 kernel/locking/lockdep.c:5630 __raw_spin_lock include/linux/spinlock_api_smp.h:133 [inline] _raw_spin_lock+0x2a/0x40 kernel/locking/spinlock.c:154 spin_lock include/linux/spinlock.h:349 [inline] advance_sched+0x53/0x9a0 net/sched/sch_taprio.c:715 __run_hrtimer kernel/time/hrtimer.c:1685 [inline] __hrtimer_run_queues+0x609/0xe50 kernel/time/hrtimer.c:1749 hrtimer_interrupt+0x31c/0x790 kernel/time/hrtimer.c:1811 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1095 [inline] __sysvec_apic_timer_interrupt+0x146/0x530 arch/x86/kernel/apic/apic.c:1112 sysvec_apic_timer_interrupt+0x8e/0xc0 arch/x86/kernel/apic/apic.c:1106 asm_sysvec_apic_timer_interrupt+0x1b/0x20 arch/x86/include/asm/idtentry.h:649 RIP: 0010:__orc_find+0x94/0xf0 arch/x86/kernel/unwind_orc.c:59 Code: 42 0f b6 14 38 48 89 d8 83 e0 07 83 c0 03 38 d0 7c 04 84 d2 75 48 48 63 03 48 01 d8 48 39 c1 73 b0 4c 8d 63 fc 49 39 ec 73 b3 <4d> 29 ee 49 c1 fe 02 4b 8d 04 76 48 8d 04 46 48 83 c4 10 5b 5d 41 RSP: 0018:ffffc900030c7760 EFLAGS: 00000287 RAX: ffffffff81ba2347 RBX: ffffffff8dcf31dc RCX: ffffffff81ba24f8 RDX: 0000000000000000 RSI: ffffffff8e4336b8 RDI: ffffffff8dcf31dc RBP: ffffffff8dcf31e0 R08: ffffffff8bbff4e0 R09: ffffc900030c784c R10: fffff52000618f0e R11: 000000000008a07a R12: ffffffff8dcf31dc R13: ffffffff8dcf31dc R14: ffffffff8dcf31dc R15: dffffc0000000000 orc_find arch/x86/kernel/unwind_orc.c:173 [inline] unwind_next_frame+0x2a3/0x1cc0 arch/x86/kernel/unwind_orc.c:443 arch_stack_walk+0x7d/0xe0 arch/x86/kernel/stacktrace.c:25 stack_trace_save+0x8c/0xc0 kernel/stacktrace.c:122 save_stack+0x151/0x1e0 mm/page_owner.c:127 __reset_page_owner+0x5d/0x180 mm/page_owner.c:148 reset_page_owner include/linux/page_owner.h:24 [inline] free_pages_prepare mm/page_alloc.c:1371 [inline] free_pcp_prepare+0x549/0xd20 mm/page_alloc.c:1421 free_unref_page_prepare mm/page_alloc.c:3343 [inline] free_unref_page+0x19/0x6a0 mm/page_alloc.c:3438 __put_single_page mm/swap.c:106 [inline] __put_page+0x145/0x280 mm/swap.c:129 folio_put include/linux/mm.h:1200 [inline] put_page include/linux/mm.h:1233 [inline] anon_pipe_buf_release+0x362/0x4b0 fs/pipe.c:138 pipe_buf_release include/linux/pipe_fs_i.h:203 [inline] pipe_read+0x610/0x1100 fs/pipe.c:324 call_read_iter include/linux/fs.h:2052 [inline] new_sync_read+0x4f9/0x5f0 fs/read_write.c:401 vfs_read+0x492/0x5d0 fs/read_write.c:482 ksys_read+0x1e8/0x250 fs/read_write.c:620 do_syscall_x64 arch/x86/entry/common.c:50 [inline] do_syscall_64+0x35/0xb0 arch/x86/entry/common.c:80 entry_SYSCALL_64_after_hwframe+0x46/0xb0 RIP: 0033:0x7ff5fe87c8fe Code: c0 e9 e6 fe ff ff 50 48 8d 3d 0e c7 09 00 e8 c9 cf 01 00 66 0f 1f 84 00 00 00 00 00 64 8b 04 25 18 00 00 00 85 c0 75 14 0f 05 <48> 3d 00 f0 ff ff 77 5a c3 66 0f 1f 84 00 00 00 00 00 48 83 ec 28 RSP: 002b:00007ffe7c7dcab8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007ff5fe87c8fe RDX: 0000000000004000 RSI: 00007ffe7c7dcad8 RDI: 0000000000000007 RBP: 00005620e918c3e0 R08: 00005620e9177c60 R09: 00007ffe7c7e3080 R10: 00007ffe7c7e30f0 R11: 0000000000000246 R12: 00005620e918b0d0 R13: 00007ff5fe7366a0 R14: 00005620e9177c60 R15: 00005620e91786d0 rcu: rcu_preempt kthread starved for 10496 jiffies! g111277 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=1 rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. rcu: RCU grace-period kthread stack dump: task:rcu_preempt state:R running task stack:28864 pid: 17 ppid: 2 flags:0x00004000 Call Trace: context_switch kernel/sched/core.c:5116 [inline] __schedule+0xa00/0x4b30 kernel/sched/core.c:6428 schedule+0xd2/0x1f0 kernel/sched/core.c:6500 schedule_timeout+0x14a/0x2a0 kernel/time/timer.c:1935 rcu_gp_fqs_loop+0x186/0x810 kernel/rcu/tree.c:1999 rcu_gp_kthread+0x1de/0x320 kernel/rcu/tree.c:2187 kthread+0x2e9/0x3a0 kernel/kthread.c:376 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:302 rcu: Stack dump where RCU GP kthread last ran: NMI backtrace for cpu 1 CPU: 1 PID: 21516 Comm: kworker/u4:23 Not tainted 5.19.0-rc2-syzkaller #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011 Workqueue: events_unbound toggle_allocation_gate Call Trace: __dump_stack lib/dump_stack.c:88 [inline] dump_stack_lvl+0xcd/0x134 lib/dump_stack.c:106 nmi_cpu_backtrace.cold+0x47/0x144 lib/nmi_backtrace.c:111 nmi_trigger_cpumask_backtrace+0x1e6/0x230 lib/nmi_backtrace.c:62 trigger_single_cpu_backtrace include/linux/nmi.h:164 [inline] rcu_check_gp_kthread_starvation.cold+0x1fb/0x200 kernel/rcu/tree_stall.h:518 print_other_cpu_stall kernel/rcu/tree_stall.h:623 [inline] check_cpu_stall kernel/rcu/tree_stall.h:771 [inline] rcu_pending kernel/rcu/tree.c:3977 [inline] rcu_sched_clock_irq+0x2316/0x2370 kernel/rcu/tree.c:2675 update_process_times+0x11a/0x1a0 kernel/time/timer.c:1839 tick_sched_handle+0x9b/0x180 kernel/time/tick-sched.c:243 tick_sched_timer+0xee/0x120 kernel/time/tick-sched.c:1481 __run_hrtimer kernel/time/hrtimer.c:1685 [inline] __hrtimer_run_queues+0x1c0/0xe50 kernel/time/hrtimer.c:1749 hrtimer_interrupt+0x31c/0x790 kernel/time/hrtimer.c:1811 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1095 [inline] __sysvec_apic_timer_interrupt+0x146/0x530 arch/x86/kernel/apic/apic.c:1112 sysvec_apic_timer_interrupt+0x8e/0xc0 arch/x86/kernel/apic/apic.c:1106 asm_sysvec_apic_timer_interrupt+0x1b/0x20 arch/x86/include/asm/idtentry.h:649 RIP: 0010:csd_lock_wait kernel/smp.c:414 [inline] RIP: 0010:smp_call_function_many_cond+0x49e/0x1110 kernel/smp.c:988 Code: 97 0a 00 85 ed 74 47 48 8b 04 24 49 89 c4 83 e0 07 49 c1 ec 03 48 89 c5 4d 01 fc 83 c5 03 e8 39 9b 0a 00 f3 90 41 0f b6 04 24 <40> 38 c5 7c 08 84 c0 0f 85 21 0a 00 00 8b 43 08 31 ff 83 e0 01 41 RSP: 0018:ffffc90005fc7950 EFLAGS: 00000293 RAX: 0000000000000000 RBX: ffff8880b9a44fc0 RCX: 0000000000000000 RDX: ffff888075aba200 RSI: ffffffff816f07a7 RDI: 0000000000000005 RBP: 0000000000000003 R08: 0000000000000005 R09: 0000000000000000 R10: 0000000000000001 R11: 0000000000000001 R12: ffffed10173489f9 R13: 0000000000000000 R14: 0000000000000001 R15: dffffc0000000000 on_each_cpu_cond_mask+0x56/0xa0 kernel/smp.c:1154 on_each_cpu include/linux/smp.h:71 [inline] text_poke_sync arch/x86/kernel/alternative.c:1231 [inline] text_poke_bp_batch+0x233/0x6c0 arch/x86/kernel/alternative.c:1419 text_poke_flush arch/x86/kernel/alternative.c:1589 [inline] text_poke_flush arch/x86/kernel/alternative.c:1586 [inline] text_poke_finish+0x16/0x30 arch/x86/kernel/alternative.c:1596 arch_jump_label_transform_apply+0x13/0x20 arch/x86/kernel/jump_label.c:146 jump_label_update+0x32f/0x410 kernel/jump_label.c:830 static_key_enable_cpuslocked+0x1b1/0x260 kernel/jump_label.c:177 static_key_enable+0x16/0x20 kernel/jump_label.c:190 toggle_allocation_gate mm/kfence/core.c:808 [inline] toggle_allocation_gate+0x100/0x390 mm/kfence/core.c:800 process_one_work+0x996/0x1610 kernel/workqueue.c:2289 worker_thread+0x665/0x1080 kernel/workqueue.c:2436 kthread+0x2e9/0x3a0 kernel/kthread.c:376 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:302 watchdog: BUG: soft lockup - CPU#1 stuck for 246s! [kworker/u4:23:21516] Modules linked in: irq event stamp: 1838280 hardirqs last enabled at (1838279): [] asm_sysvec_apic_timer_interrupt+0x1b/0x20 arch/x86/include/asm/idtentry.h:649 hardirqs last disabled at (1838280): [] sysvec_apic_timer_interrupt+0xb/0xc0 arch/x86/kernel/apic/apic.c:1106 softirqs last enabled at (1787880): [] spin_unlock_bh include/linux/spinlock.h:394 [inline] softirqs last enabled at (1787880): [] ieee80211_ibss_work+0x353/0xe80 net/mac80211/ibss.c:1702 softirqs last disabled at (1787878): [] spin_lock_bh include/linux/spinlock.h:354 [inline] softirqs last disabled at (1787878): [] ieee80211_ibss_work+0x133/0xe80 net/mac80211/ibss.c:1691 CPU: 1 PID: 21516 Comm: kworker/u4:23 Not tainted 5.19.0-rc2-syzkaller #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011 Workqueue: events_unbound toggle_allocation_gate RIP: 0010:csd_lock_wait kernel/smp.c:414 [inline] RIP: 0010:smp_call_function_many_cond+0x499/0x1110 kernel/smp.c:988 Code: 01 89 ee e8 99 97 0a 00 85 ed 74 47 48 8b 04 24 49 89 c4 83 e0 07 49 c1 ec 03 48 89 c5 4d 01 fc 83 c5 03 e8 39 9b 0a 00 f3 90 <41> 0f b6 04 24 40 38 c5 7c 08 84 c0 0f 85 21 0a 00 00 8b 43 08 31 RSP: 0018:ffffc90005fc7950 EFLAGS: 00000293 RAX: 0000000000000000 RBX: ffff8880b9a44fc0 RCX: 0000000000000000 RDX: ffff888075aba200 RSI: ffffffff816f07a7 RDI: 0000000000000005 RBP: 0000000000000003 R08: 0000000000000005 R09: 0000000000000000 R10: 0000000000000001 R11: 0000000000000001 R12: ffffed10173489f9 R13: 0000000000000000 R14: 0000000000000001 R15: dffffc0000000000 FS: 0000000000000000(0000) GS:ffff8880b9b00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f006d708a02 CR3: 000000000ba8e000 CR4: 00000000003506e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Call Trace: on_each_cpu_cond_mask+0x56/0xa0 kernel/smp.c:1154 on_each_cpu include/linux/smp.h:71 [inline] text_poke_sync arch/x86/kernel/alternative.c:1231 [inline] text_poke_bp_batch+0x233/0x6c0 arch/x86/kernel/alternative.c:1419 text_poke_flush arch/x86/kernel/alternative.c:1589 [inline] text_poke_flush arch/x86/kernel/alternative.c:1586 [inline] text_poke_finish+0x16/0x30 arch/x86/kernel/alternative.c:1596 arch_jump_label_transform_apply+0x13/0x20 arch/x86/kernel/jump_label.c:146 jump_label_update+0x32f/0x410 kernel/jump_label.c:830 static_key_enable_cpuslocked+0x1b1/0x260 kernel/jump_label.c:177 static_key_enable+0x16/0x20 kernel/jump_label.c:190 toggle_allocation_gate mm/kfence/core.c:808 [inline] toggle_allocation_gate+0x100/0x390 mm/kfence/core.c:800 process_one_work+0x996/0x1610 kernel/workqueue.c:2289 worker_thread+0x665/0x1080 kernel/workqueue.c:2436 kthread+0x2e9/0x3a0 kernel/kthread.c:376 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:302 Sending NMI from CPU 1 to CPUs 0: NMI backtrace for cpu 0 CPU: 0 PID: 3600 Comm: sshd Not tainted 5.19.0-rc2-syzkaller #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011 RIP: 0010:kasan_check_range+0x17/0x180 mm/kasan/generic.c:188 Code: ff 89 43 08 5b 5d c3 66 66 2e 0f 1f 84 00 00 00 00 00 90 48 85 f6 0f 84 3c 01 00 00 49 89 f9 41 54 44 0f b6 c2 49 01 f1 55 53 <0f> 82 18 01 00 00 48 b8 ff ff ff ff ff 7f ff ff 48 39 c7 0f 86 05 RSP: 0018:ffffc90000007db0 EFLAGS: 00000086 RAX: dffffc0000000000 RBX: ffff8880509ea340 RCX: ffffffff878893b2 RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffff8880509ea2e0 RBP: ffff8880509ea2e0 R08: 0000000000000000 R09: ffff8880509ea2e8 R10: 0000000000000000 R11: 0000000000000001 R12: ffff88807456b380 R13: 18ec10b7b1d8216f R14: 0000000000000000 R15: 18ec10b7b1d8216f FS: 00007ff5fe736800(0000) GS:ffff8880b9a00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 0000000020000040 CR3: 000000007d62f000 CR4: 00000000003506f0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Call Trace: instrument_atomic_read include/linux/instrumented.h:71 [inline] atomic64_read include/linux/atomic/atomic-instrumented.h:646 [inline] taprio_set_budget net/sched/sch_taprio.c:555 [inline] advance_sched+0x362/0x9a0 net/sched/sch_taprio.c:760 __run_hrtimer kernel/time/hrtimer.c:1685 [inline] __hrtimer_run_queues+0x609/0xe50 kernel/time/hrtimer.c:1749 hrtimer_interrupt+0x31c/0x790 kernel/time/hrtimer.c:1811 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1095 [inline] __sysvec_apic_timer_interrupt+0x146/0x530 arch/x86/kernel/apic/apic.c:1112 sysvec_apic_timer_interrupt+0x8e/0xc0 arch/x86/kernel/apic/apic.c:1106 asm_sysvec_apic_timer_interrupt+0x1b/0x20 arch/x86/include/asm/idtentry.h:649 RIP: 0010:__orc_find+0x94/0xf0 arch/x86/kernel/unwind_orc.c:59 Code: 42 0f b6 14 38 48 89 d8 83 e0 07 83 c0 03 38 d0 7c 04 84 d2 75 48 48 63 03 48 01 d8 48 39 c1 73 b0 4c 8d 63 fc 49 39 ec 73 b3 <4d> 29 ee 49 c1 fe 02 4b 8d 04 76 48 8d 04 46 48 83 c4 10 5b 5d 41 RSP: 0018:ffffc900030c7760 EFLAGS: 00000287 RAX: ffffffff81ba2347 RBX: ffffffff8dcf31dc RCX: ffffffff81ba24f8 RDX: 0000000000000000 RSI: ffffffff8e4336b8 RDI: ffffffff8dcf31dc RBP: ffffffff8dcf31e0 R08: ffffffff8bbff4e0 R09: ffffc900030c784c R10: fffff52000618f0e R11: 000000000008a07a R12: ffffffff8dcf31dc R13: ffffffff8dcf31dc R14: ffffffff8dcf31dc R15: dffffc0000000000 orc_find arch/x86/kernel/unwind_orc.c:173 [inline] unwind_next_frame+0x2a3/0x1cc0 arch/x86/kernel/unwind_orc.c:443 arch_stack_walk+0x7d/0xe0 arch/x86/kernel/stacktrace.c:25 stack_trace_save+0x8c/0xc0 kernel/stacktrace.c:122 save_stack+0x151/0x1e0 mm/page_owner.c:127 __reset_page_owner+0x5d/0x180 mm/page_owner.c:148 reset_page_owner include/linux/page_owner.h:24 [inline] free_pages_prepare mm/page_alloc.c:1371 [inline] free_pcp_prepare+0x549/0xd20 mm/page_alloc.c:1421 free_unref_page_prepare mm/page_alloc.c:3343 [inline] free_unref_page+0x19/0x6a0 mm/page_alloc.c:3438 __put_single_page mm/swap.c:106 [inline] __put_page+0x145/0x280 mm/swap.c:129 folio_put include/linux/mm.h:1200 [inline] put_page include/linux/mm.h:1233 [inline] anon_pipe_buf_release+0x362/0x4b0 fs/pipe.c:138 pipe_buf_release include/linux/pipe_fs_i.h:203 [inline] pipe_read+0x610/0x1100 fs/pipe.c:324 call_read_iter include/linux/fs.h:2052 [inline] new_sync_read+0x4f9/0x5f0 fs/read_write.c:401 vfs_read+0x492/0x5d0 fs/read_write.c:482 ksys_read+0x1e8/0x250 fs/read_write.c:620 do_syscall_x64 arch/x86/entry/common.c:50 [inline] do_syscall_64+0x35/0xb0 arch/x86/entry/common.c:80 entry_SYSCALL_64_after_hwframe+0x46/0xb0 RIP: 0033:0x7ff5fe87c8fe Code: c0 e9 e6 fe ff ff 50 48 8d 3d 0e c7 09 00 e8 c9 cf 01 00 66 0f 1f 84 00 00 00 00 00 64 8b 04 25 18 00 00 00 85 c0 75 14 0f 05 <48> 3d 00 f0 ff ff 77 5a c3 66 0f 1f 84 00 00 00 00 00 48 83 ec 28 RSP: 002b:00007ffe7c7dcab8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007ff5fe87c8fe RDX: 0000000000004000 RSI: 00007ffe7c7dcad8 RDI: 0000000000000007 RBP: 00005620e918c3e0 R08: 00005620e9177c60 R09: 00007ffe7c7e3080 R10: 00007ffe7c7e30f0 R11: 0000000000000246 R12: 00005620e918b0d0 R13: 00007ff5fe7366a0 R14: 00005620e9177c60 R15: 00005620e91786d0 ---------------- Code disassembly (best guess): 0: 00 00 add %al,(%rax) 2: 41 0f b7 54 24 20 movzwl 0x20(%r12),%edx 8: 66 81 e2 ff 1f and $0x1fff,%dx d: 44 0f b7 f2 movzwl %dx,%r14d 11: be 08 00 00 00 mov $0x8,%esi 16: 4c 89 f0 mov %r14,%rax 19: 48 c1 f8 06 sar $0x6,%rax 1d: 48 8d 3c c5 00 99 67 lea -0x6f986700(,%rax,8),%rdi 24: 90 25: e8 d2 ca 68 00 callq 0x68cafc * 2a: 4c 0f a3 35 6a 9a 0a bt %r14,0xf0a9a6a(%rip) # 0xf0a9a9c <-- trapping instruction 31: 0f 32: 0f 83 cd 00 00 00 jae 0x105 38: 4b 8d 04 76 lea (%r14,%r14,2),%rax 3c: 48 c1 e0 06 shl $0x6,%rax