rcu: INFO: rcu_preempt self-detected stall on CPU
rcu: 1-...!: (1 GPs behind) idle=8e64/1/0x4000000000000000 softirq=7191/7192 fqs=9
(t=10501 jiffies g=8177 q=1066 ncpus=2)
rcu: rcu_preempt kthread starved for 10448 jiffies! g8177 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=0
rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
rcu: RCU grace-period kthread stack dump:
task:rcu_preempt state:R running task stack:28728 pid: 16 ppid: 2 flags:0x00004000
Call Trace:
context_switch kernel/sched/core.c:5182 [inline]
__schedule+0xadf/0x52b0 kernel/sched/core.c:6494
schedule+0xda/0x1b0 kernel/sched/core.c:6570
schedule_timeout+0x14a/0x2a0 kernel/time/timer.c:1935
rcu_gp_fqs_loop+0x190/0x910 kernel/rcu/tree.c:1657
rcu_gp_kthread+0x236/0x360 kernel/rcu/tree.c:1854
kthread+0x2e4/0x3a0 kernel/kthread.c:376
ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:306
rcu: Stack dump where RCU GP kthread last ran:
Sending NMI from CPU 1 to CPUs 0:
NMI backtrace for cpu 0
CPU: 0 PID: 41 Comm: kworker/u4:2 Not tainted 6.0.0-rc3-syzkaller-00143-gc90714017cb3 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 08/26/2022
Workqueue: events_unbound toggle_allocation_gate
RIP: 0010:csd_lock_wait kernel/smp.c:414 [inline]
RIP: 0010:smp_call_function_many_cond+0x5c3/0x1430 kernel/smp.c:988
Code: 89 ee e8 30 ad 0a 00 85 ed 74 48 48 8b 44 24 08 49 89 c4 83 e0 07 49 c1 ec 03 48 89 c5 4d 01 f4 83 c5 03 e8 4f b0 0a 00 f3 90 <41> 0f b6 04 24 40 38 c5 7c 08 84 c0 0f 85 b5 0b 00 00 8b 43 08 31
RSP: 0018:ffffc90000b27948 EFLAGS: 00000293
RAX: 0000000000000000 RBX: ffff8880b9b3edc0 RCX: 0000000000000000
RDX: ffff888011bb0000 RSI: ffffffff817159e1 RDI: 0000000000000005
RBP: 0000000000000003 R08: 0000000000000005 R09: 0000000000000000
R10: 0000000000000001 R11: 0000000000000000 R12: ffffed1017367db9
R13: 0000000000000001 R14: dffffc0000000000 R15: 0000000000000001
FS: 0000000000000000(0000) GS:ffff8880b9a00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000000000 CR3: 000000000bc8e000 CR4: 00000000003506f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
on_each_cpu_cond_mask+0x56/0xa0 kernel/smp.c:1154
on_each_cpu include/linux/smp.h:71 [inline]
text_poke_sync arch/x86/kernel/alternative.c:1302 [inline]
text_poke_bp_batch+0x233/0x6c0 arch/x86/kernel/alternative.c:1490
text_poke_flush arch/x86/kernel/alternative.c:1660 [inline]
text_poke_flush arch/x86/kernel/alternative.c:1657 [inline]
text_poke_finish+0x16/0x30 arch/x86/kernel/alternative.c:1667
arch_jump_label_transform_apply+0x13/0x20 arch/x86/kernel/jump_label.c:146
jump_label_update+0x32f/0x410 kernel/jump_label.c:801
static_key_enable_cpuslocked+0x1b1/0x260 kernel/jump_label.c:177
static_key_enable+0x16/0x20 kernel/jump_label.c:190
toggle_allocation_gate mm/kfence/core.c:811 [inline]
toggle_allocation_gate+0x100/0x390 mm/kfence/core.c:803
process_one_work+0x991/0x1610 kernel/workqueue.c:2289
worker_thread+0x665/0x1080 kernel/workqueue.c:2436
kthread+0x2e4/0x3a0 kernel/kthread.c:376
ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:306
NMI backtrace for cpu 1
CPU: 1 PID: 3601 Comm: sshd Not tainted 6.0.0-rc3-syzkaller-00143-gc90714017cb3 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 08/26/2022
Call Trace:
__dump_stack lib/dump_stack.c:88 [inline]
dump_stack_lvl+0xcd/0x134 lib/dump_stack.c:106
nmi_cpu_backtrace.cold+0x46/0x14f lib/nmi_backtrace.c:111
nmi_trigger_cpumask_backtrace+0x206/0x250 lib/nmi_backtrace.c:62
trigger_single_cpu_backtrace include/linux/nmi.h:166 [inline]
rcu_dump_cpu_stacks+0x2c7/0x4d0 kernel/rcu/tree_stall.h:371
print_cpu_stall kernel/rcu/tree_stall.h:660 [inline]
check_cpu_stall kernel/rcu/tree_stall.h:744 [inline]
rcu_pending kernel/rcu/tree.c:3660 [inline]
rcu_sched_clock_irq.cold+0x9f/0x79c kernel/rcu/tree.c:2342
update_process_times+0x11a/0x1a0 kernel/time/timer.c:1839
tick_sched_handle+0x9b/0x180 kernel/time/tick-sched.c:243
tick_sched_timer+0xee/0x120 kernel/time/tick-sched.c:1480
__run_hrtimer kernel/time/hrtimer.c:1685 [inline]
__hrtimer_run_queues+0x1c0/0xe40 kernel/time/hrtimer.c:1749
hrtimer_interrupt+0x31c/0x790 kernel/time/hrtimer.c:1811
local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1095 [inline]
__sysvec_apic_timer_interrupt+0x146/0x530 arch/x86/kernel/apic/apic.c:1112
sysvec_apic_timer_interrupt+0x40/0xc0 arch/x86/kernel/apic/apic.c:1106
asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:649
RIP: 0010:__sanitizer_cov_trace_cmp4+0x4/0x20 kernel/kcov.c:271
Code: 00 00 00 00 66 90 48 8b 0c 24 0f b7 d6 0f b7 f7 bf 02 00 00 00 e9 3c ff ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 90 48 8b 0c 24 <89> f2 89 fe bf 04 00 00 00 e9 1e ff ff ff 66 66 2e 0f 1f 84 00 00
RSP: 0018:ffffc900001e0cc8 EFLAGS: 00000246
RAX: 0000000000000000 RBX: 00000000000001e4 RCX: ffffffff878afa25
RDX: ffff88807d525880 RSI: 00000000000001e4 RDI: 0000000000000400
RBP: ffff888076f7b350 R08: 0000000000000001 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000001 R12: dffffc0000000000
R13: 0000000000000007 R14: 0000000000000400 R15: ffff888076f7b300
fq_pie_timer+0x195/0x2a0 net/sched/sch_fq_pie.c:382
call_timer_fn+0x1a0/0x6b0 kernel/time/timer.c:1474
expire_timers kernel/time/timer.c:1519 [inline]
__run_timers.part.0+0x674/0xa80 kernel/time/timer.c:1790
__run_timers kernel/time/timer.c:1768 [inline]
run_timer_softirq+0xb3/0x1d0 kernel/time/timer.c:1803
__do_softirq+0x1d3/0x9c6 kernel/softirq.c:571
invoke_softirq kernel/softirq.c:445 [inline]
__irq_exit_rcu+0x123/0x180 kernel/softirq.c:650
irq_exit_rcu+0x5/0x20 kernel/softirq.c:662
sysvec_apic_timer_interrupt+0x93/0xc0 arch/x86/kernel/apic/apic.c:1106
asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:649
RIP: 0010:check_kcov_mode kernel/kcov.c:166 [inline]
RIP: 0010:write_comp_data+0x21/0x90 kernel/kcov.c:229
Code: 84 00 00 00 00 00 0f 1f 00 65 8b 05 99 69 86 7e 49 89 f1 89 c6 49 89 d2 81 e6 00 01 00 00 49 89 f8 65 48 8b 14 25 80 6f 02 00 00 01 ff 00 74 0e 85 f6 74 59 8b 82 bc 15 00 00 85 c0 74 4f 8b
RSP: 0018:ffffc9000365fea0 EFLAGS: 00000246
RAX: 0000000080000000 RBX: ffff888078712f00 RCX: ffffffff81d63c3a
RDX: ffff88807d525880 RSI: 0000000000000000 RDI: 0000000000000005
RBP: ffff888078712f00 R08: 0000000000000005 R09: 0000000000000000
R10: 0000000000200000 R11: 0000000000000001 R12: 1ffff920006cbfd5
R13: 00007ffee4486bb8 R14: 0000000000200000 R15: 0000000000004000
file_ppos fs/read_write.c:593 [inline]
ksys_read+0xca/0x250 fs/read_write.c:602
do_syscall_x64 arch/x86/entry/common.c:50 [inline]
do_syscall_64+0x35/0xb0 arch/x86/entry/common.c:80
entry_SYSCALL_64_after_hwframe+0x63/0xcd
RIP: 0033:0x7fabbfb258fe
================================
WARNING: inconsistent lock state
6.0.0-rc3-syzkaller-00143-gc90714017cb3 #0 Not tainted
--------------------------------
inconsistent {HARDIRQ-ON-W} -> {IN-HARDIRQ-W} usage.
sshd/3601 [HC1[1]:SC1[1]:HE0:SE0] takes:
ffffffff8c0bf2f8 (vmap_area_lock){?.+.}-{2:2}, at: spin_lock include/linux/spinlock.h:349 [inline]
ffffffff8c0bf2f8 (vmap_area_lock){?.+.}-{2:2}, at: find_vmap_area+0x1c/0x130 mm/vmalloc.c:1836
{HARDIRQ-ON-W} state was registered at:
lock_acquire kernel/locking/lockdep.c:5666 [inline]
lock_acquire+0x1ab/0x570 kernel/locking/lockdep.c:5631
__raw_spin_lock include/linux/spinlock_api_smp.h:133 [inline]
_raw_spin_lock+0x2a/0x40 kernel/locking/spinlock.c:154
spin_lock include/linux/spinlock.h:349 [inline]
alloc_vmap_area+0xa0b/0x1d50 mm/vmalloc.c:1617
__get_vm_area_node+0x142/0x3f0 mm/vmalloc.c:2484
get_vm_area_caller+0x43/0x50 mm/vmalloc.c:2537
__ioremap_caller.constprop.0+0x292/0x600 arch/x86/mm/ioremap.c:280
acpi_os_ioremap include/acpi/acpi_io.h:13 [inline]
acpi_map drivers/acpi/osl.c:296 [inline]
acpi_os_map_iomem+0x463/0x550 drivers/acpi/osl.c:355
acpi_tb_acquire_table+0xd8/0x209 drivers/acpi/acpica/tbdata.c:142
acpi_tb_validate_table drivers/acpi/acpica/tbdata.c:317 [inline]
acpi_tb_validate_table+0x50/0x8c drivers/acpi/acpica/tbdata.c:308
acpi_tb_verify_temp_table+0x84/0x674 drivers/acpi/acpica/tbdata.c:504
acpi_reallocate_root_table+0x374/0x3e0 drivers/acpi/acpica/tbxface.c:180
acpi_early_init+0x13a/0x438 drivers/acpi/bus.c:1214
start_kernel+0x3cf/0x48f init/main.c:1099
secondary_startup_64_no_verify+0xce/0xdb
irq event stamp: 2880723
hardirqs last enabled at (2880722): [] __raw_spin_unlock_irq include/linux/spinlock_api_smp.h:159 [inline]
hardirqs last enabled at (2880722): [] _raw_spin_unlock_irq+0x1f/0x40 kernel/locking/spinlock.c:202
hardirqs last disabled at (2880723): [] sysvec_apic_timer_interrupt+0xb/0xc0 arch/x86/kernel/apic/apic.c:1106
softirqs last enabled at (1943130): [] tcp_sendmsg+0x36/0x40 net/ipv4/tcp.c:1484
softirqs last disabled at (1943193): [] invoke_softirq kernel/softirq.c:445 [inline]
softirqs last disabled at (1943193): [] __irq_exit_rcu+0x123/0x180 kernel/softirq.c:650
other info that might help us debug this:
Possible unsafe locking scenario:
CPU0
----
lock(vmap_area_lock);
lock(vmap_area_lock);
*** DEADLOCK ***
3 locks held by sshd/3601:
#0: ffffc900001e0d70 ((&q->adapt_timer)){+.-.}-{0:0}, at: lockdep_copy_map include/linux/lockdep.h:31 [inline]
#0: ffffc900001e0d70 ((&q->adapt_timer)){+.-.}-{0:0}, at: call_timer_fn+0xd5/0x6b0 kernel/time/timer.c:1464
#1: ffff888076f7b108 (&sch->q.lock){+.-.}-{2:2}, at: spin_lock include/linux/spinlock.h:349 [inline]
#1: ffff888076f7b108 (&sch->q.lock){+.-.}-{2:2}, at: fq_pie_timer+0x92/0x2a0 net/sched/sch_fq_pie.c:380
#2: ffffffff8bf938d8 (rcu_node_0){-.-.}-{2:2}, at: rcu_dump_cpu_stacks+0xc1/0x4d0 kernel/rcu/tree_stall.h:366
stack backtrace:
CPU: 1 PID: 3601 Comm: sshd Not tainted 6.0.0-rc3-syzkaller-00143-gc90714017cb3 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 08/26/2022
Call Trace:
__dump_stack lib/dump_stack.c:88 [inline]
dump_stack_lvl+0xcd/0x134 lib/dump_stack.c:106
print_usage_bug kernel/locking/lockdep.c:3961 [inline]
valid_state kernel/locking/lockdep.c:3973 [inline]
mark_lock_irq kernel/locking/lockdep.c:4176 [inline]
mark_lock.part.0.cold+0x18/0xd8 kernel/locking/lockdep.c:4632
mark_lock kernel/locking/lockdep.c:4596 [inline]
mark_usage kernel/locking/lockdep.c:4524 [inline]
__lock_acquire+0x14a2/0x56d0 kernel/locking/lockdep.c:5007
lock_acquire kernel/locking/lockdep.c:5666 [inline]
lock_acquire+0x1ab/0x570 kernel/locking/lockdep.c:5631
__raw_spin_lock include/linux/spinlock_api_smp.h:133 [inline]
_raw_spin_lock+0x2a/0x40 kernel/locking/spinlock.c:154
spin_lock include/linux/spinlock.h:349 [inline]
find_vmap_area+0x1c/0x130 mm/vmalloc.c:1836
check_heap_object mm/usercopy.c:176 [inline]
__check_object_size mm/usercopy.c:250 [inline]
__check_object_size+0x1f8/0x700 mm/usercopy.c:212
check_object_size include/linux/thread_info.h:199 [inline]
__copy_from_user_inatomic include/linux/uaccess.h:62 [inline]
copy_from_user_nmi arch/x86/lib/usercopy.c:47 [inline]
copy_from_user_nmi+0xcb/0x130 arch/x86/lib/usercopy.c:31
copy_code arch/x86/kernel/dumpstack.c:91 [inline]
show_opcodes+0x59/0xb0 arch/x86/kernel/dumpstack.c:121
show_iret_regs+0xd/0x33 arch/x86/kernel/dumpstack.c:149
__show_regs+0x1e/0x60 arch/x86/kernel/process_64.c:74
show_trace_log_lvl+0x25b/0x2ba arch/x86/kernel/dumpstack.c:292
__dump_stack lib/dump_stack.c:88 [inline]
dump_stack_lvl+0xcd/0x134 lib/dump_stack.c:106
nmi_cpu_backtrace.cold+0x46/0x14f lib/nmi_backtrace.c:111
nmi_trigger_cpumask_backtrace+0x206/0x250 lib/nmi_backtrace.c:62
trigger_single_cpu_backtrace include/linux/nmi.h:166 [inline]
rcu_dump_cpu_stacks+0x2c7/0x4d0 kernel/rcu/tree_stall.h:371
print_cpu_stall kernel/rcu/tree_stall.h:660 [inline]
check_cpu_stall kernel/rcu/tree_stall.h:744 [inline]
rcu_pending kernel/rcu/tree.c:3660 [inline]
rcu_sched_clock_irq.cold+0x9f/0x79c kernel/rcu/tree.c:2342
update_process_times+0x11a/0x1a0 kernel/time/timer.c:1839
tick_sched_handle+0x9b/0x180 kernel/time/tick-sched.c:243
tick_sched_timer+0xee/0x120 kernel/time/tick-sched.c:1480
__run_hrtimer kernel/time/hrtimer.c:1685 [inline]
__hrtimer_run_queues+0x1c0/0xe40 kernel/time/hrtimer.c:1749
hrtimer_interrupt+0x31c/0x790 kernel/time/hrtimer.c:1811
local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1095 [inline]
__sysvec_apic_timer_interrupt+0x146/0x530 arch/x86/kernel/apic/apic.c:1112
sysvec_apic_timer_interrupt+0x40/0xc0 arch/x86/kernel/apic/apic.c:1106
asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:649
RIP: 0010:__sanitizer_cov_trace_cmp4+0x4/0x20 kernel/kcov.c:271
Code: 00 00 00 00 66 90 48 8b 0c 24 0f b7 d6 0f b7 f7 bf 02 00 00 00 e9 3c ff ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 90 48 8b 0c 24 <89> f2 89 fe bf 04 00 00 00 e9 1e ff ff ff 66 66 2e 0f 1f 84 00 00
RSP: 0018:ffffc900001e0cc8 EFLAGS: 00000246
RAX: 0000000000000000 RBX: 00000000000001e4 RCX: ffffffff878afa25
RDX: ffff88807d525880 RSI: 00000000000001e4 RDI: 0000000000000400
RBP: ffff888076f7b350 R08: 0000000000000001 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000001 R12: dffffc0000000000
R13: 0000000000000007 R14: 0000000000000400 R15: ffff888076f7b300
fq_pie_timer+0x195/0x2a0 net/sched/sch_fq_pie.c:382
call_timer_fn+0x1a0/0x6b0 kernel/time/timer.c:1474
expire_timers kernel/time/timer.c:1519 [inline]
__run_timers.part.0+0x674/0xa80 kernel/time/timer.c:1790
__run_timers kernel/time/timer.c:1768 [inline]
run_timer_softirq+0xb3/0x1d0 kernel/time/timer.c:1803
__do_softirq+0x1d3/0x9c6 kernel/softirq.c:571
invoke_softirq kernel/softirq.c:445 [inline]
__irq_exit_rcu+0x123/0x180 kernel/softirq.c:650
irq_exit_rcu+0x5/0x20 kernel/softirq.c:662
sysvec_apic_timer_interrupt+0x93/0xc0 arch/x86/kernel/apic/apic.c:1106
asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:649
RIP: 0010:check_kcov_mode kernel/kcov.c:166 [inline]
RIP: 0010:write_comp_data+0x21/0x90 kernel/kcov.c:229
Code: 84 00 00 00 00 00 0f 1f 00 65 8b 05 99 69 86 7e 49 89 f1 89 c6 49 89 d2 81 e6 00 01 00 00 49 89 f8 65 48 8b 14 25 80 6f 02 00 00 01 ff 00 74 0e 85 f6 74 59 8b 82 bc 15 00 00 85 c0 74 4f 8b
RSP: 0018:ffffc9000365fea0 EFLAGS: 00000246
RAX: 0000000080000000 RBX: ffff888078712f00 RCX: ffffffff81d63c3a
RDX: ffff88807d525880 RSI: 0000000000000000 RDI: 0000000000000005
RBP: ffff888078712f00 R08: 0000000000000005 R09: 0000000000000000
R10: 0000000000200000 R11: 0000000000000001 R12: 1ffff920006cbfd5
R13: 00007ffee4486bb8 R14: 0000000000200000 R15: 0000000000004000
file_ppos fs/read_write.c:593 [inline]
ksys_read+0xca/0x250 fs/read_write.c:602
do_syscall_x64 arch/x86/entry/common.c:50 [inline]
do_syscall_64+0x35/0xb0 arch/x86/entry/common.c:80
entry_SYSCALL_64_after_hwframe+0x63/0xcd
RIP: 0033:0x7fabbfb258fe
Code: c0 e9 e6 fe ff ff 50 48 8d 3d 0e c7 09 00 e8 c9 cf 01 00 66 0f 1f 84 00 00 00 00 00 64 8b 04 25 18 00 00 00 85 c0 75 14 0f 05 <48> 3d 00 f0 ff ff 77 5a c3 66 0f 1f 84 00 00 00 00 00 48 83 ec 28
RSP: 002b:00007ffee4486ba8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000
RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007fabbfb258fe
RDX: 0000000000004000 RSI: 00007ffee4486bb8 RDI: 0000000000000009
RBP: 000055cc0dfe1190 R08: 000055cc0dfddf40 R09: 00007ffee45b5080
R10: 00007ffee45b50f0 R11: 0000000000000246 R12: 0000000000000043
R13: 000055cc0dff1120 R14: 00007ffee4486bb8 R15: 000055cc0dff3bc0
Code: c0 e9 e6 fe ff ff 50 48 8d 3d 0e c7 09 00 e8 c9 cf 01 00 66 0f 1f 84 00 00 00 00 00 64 8b 04 25 18 00 00 00 85 c0 75 14 0f 05 <48> 3d 00 f0 ff ff 77 5a c3 66 0f 1f 84 00 00 00 00 00 48 83 ec 28
RSP: 002b:00007ffee4486ba8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000
RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007fabbfb258fe
RDX: 0000000000004000 RSI: 00007ffee4486bb8 RDI: 0000000000000009
RBP: 000055cc0dfe1190 R08: 000055cc0dfddf40 R09: 00007ffee45b5080
R10: 00007ffee45b50f0 R11: 0000000000000246 R12: 0000000000000043
R13: 000055cc0dff1120 R14: 00007ffee4486bb8 R15: 000055cc0dff3bc0