rcu: INFO: rcu_preempt detected stalls on CPUs/tasks: rcu: 1-...!: (1 GPs behind) idle=529/1/0x4000000000000000 softirq=76344/76345 fqs=21 (detected by 0, t=10502 jiffies, g=112757, q=301 ncpus=2) Sending NMI from CPU 0 to CPUs 1: NMI backtrace for cpu 1 CPU: 1 PID: 20484 Comm: syz-executor.5 Not tainted 5.19.0-rc1-syzkaller-00095-g874c8ca1e60b #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011 RIP: 0010:__sanitizer_cov_trace_const_cmp4+0x8/0x20 kernel/kcov.c:297 Code: 00 00 48 8b 0c 24 0f b7 d6 0f b7 f7 bf 03 00 00 00 e9 bc fe ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 90 48 8b 0c 24 89 f2 89 fe 05 00 00 00 e9 9e fe ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 0f RSP: 0018:ffffc900003f8e38 EFLAGS: 00000046 RAX: 0000000000000007 RBX: ffff88801cd0b340 RCX: ffffffff8169e42c RDX: 0000000000000001 RSI: 0000000000000000 RDI: 0000000000000000 RBP: 0000000000000001 R08: 0000000000000006 R09: 188a72d4796b1768 R10: 1bc16d674ec92fa4 R11: 0000000000000001 R12: 188a72d4796b1768 R13: ffff8880b9b2a600 R14: ffff8880b9b2a500 R15: 0000000000000001 FS: 00007f432b9cc700(0000) GS:ffff8880b9b00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 0000000020000140 CR3: 0000000020466000 CR4: 00000000003506e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Call Trace: __run_hrtimer kernel/time/hrtimer.c:1651 [inline] __hrtimer_run_queues+0x3dc/0xe50 kernel/time/hrtimer.c:1749 hrtimer_interrupt+0x31c/0x790 kernel/time/hrtimer.c:1811 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1095 [inline] __sysvec_apic_timer_interrupt+0x146/0x530 arch/x86/kernel/apic/apic.c:1112 sysvec_apic_timer_interrupt+0x8e/0xc0 arch/x86/kernel/apic/apic.c:1106 asm_sysvec_apic_timer_interrupt+0x1b/0x20 arch/x86/include/asm/idtentry.h:649 RIP: 0010:__raw_spin_unlock_irqrestore include/linux/spinlock_api_smp.h:152 [inline] RIP: 0010:_raw_spin_unlock_irqrestore+0x38/0x70 kernel/locking/spinlock.c:194 Code: 74 24 10 e8 9a b0 e3 f7 48 89 ef e8 a2 31 e4 f7 81 e3 00 02 00 00 75 25 9c 58 f6 c4 02 75 2d 48 85 db 74 01 fb bf 01 00 00 00 03 3b d7 f7 65 8b 05 dc 9e 88 76 85 c0 74 0a 5b 5d c3 e8 20 27 RSP: 0018:ffffc90004327b98 EFLAGS: 00000206 RAX: 0000000000000006 RBX: 0000000000000200 RCX: 1ffffffff1b75391 RDX: 0000000000000000 RSI: 0000000000000002 RDI: 0000000000000001 RBP: ffff888020ec2ac0 R08: 0000000000000001 R09: 0000000000000001 R10: ffffed10041d8558 R11: 0000000000000000 R12: ffff888020ec2140 R13: 0000000000000287 R14: ffff888020ec2154 R15: ffff888020ec2ac0 try_to_wake_up+0x5ae/0x1800 kernel/sched/core.c:4197 wake_up_process kernel/sched/core.c:4279 [inline] wake_up_q+0x7e/0xf0 kernel/sched/core.c:1019 futex_wake+0x3e9/0x490 kernel/futex/waitwake.c:184 do_futex+0x266/0x300 kernel/futex/syscalls.c:111 __do_sys_futex kernel/futex/syscalls.c:183 [inline] __se_sys_futex kernel/futex/syscalls.c:164 [inline] __x64_sys_futex+0x1b0/0x4a0 kernel/futex/syscalls.c:164 do_syscall_x64 arch/x86/entry/common.c:50 [inline] do_syscall_64+0x35/0xb0 arch/x86/entry/common.c:80 entry_SYSCALL_64_after_hwframe+0x46/0xb0 RIP: 0033:0x7f432a889109 Code: ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 b8 ff ff ff f7 d8 64 89 01 48 RSP: 002b:00007f432b9cc218 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca RAX: ffffffffffffffda RBX: 00007f432a99bf68 RCX: 00007f432a889109 RDX: 00000000000f4240 RSI: 0000000000000081 RDI: 00007f432a99bf6c RBP: 00007f432a99bf60 R08: 00007ffcd7493080 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000246 R12: 00007f432a99bf6c R13: 00007ffcd742507f R14: 00007f432b9cc300 R15: 0000000000022000 rcu: rcu_preempt kthread starved for 10460 jiffies! g112757 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=0 rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. rcu: RCU grace-period kthread stack dump: task:rcu_preempt state:R running task stack:28344 pid: 17 ppid: 2 flags:0x00004000 Call Trace: context_switch kernel/sched/core.c:5116 [inline] __schedule+0xa00/0x4b30 kernel/sched/core.c:6428 schedule+0xd2/0x1f0 kernel/sched/core.c:6500 schedule_timeout+0x14a/0x2a0 kernel/time/timer.c:1935 rcu_gp_fqs_loop+0x186/0x810 kernel/rcu/tree.c:1999 rcu_gp_kthread+0x1de/0x320 kernel/rcu/tree.c:2187 kthread+0x2e9/0x3a0 kernel/kthread.c:376 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:302 rcu: Stack dump where RCU GP kthread last ran: NMI backtrace for cpu 0 CPU: 0 PID: 20510 Comm: syz-executor.0 Not tainted 5.19.0-rc1-syzkaller-00095-g874c8ca1e60b #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011 Call Trace: __dump_stack lib/dump_stack.c:88 [inline] dump_stack_lvl+0xcd/0x134 lib/dump_stack.c:106 nmi_cpu_backtrace.cold+0x47/0x144 lib/nmi_backtrace.c:111 nmi_trigger_cpumask_backtrace+0x1e6/0x230 lib/nmi_backtrace.c:62 trigger_single_cpu_backtrace include/linux/nmi.h:164 [inline] rcu_check_gp_kthread_starvation.cold+0x1fb/0x200 kernel/rcu/tree_stall.h:518 print_other_cpu_stall kernel/rcu/tree_stall.h:623 [inline] check_cpu_stall kernel/rcu/tree_stall.h:771 [inline] rcu_pending kernel/rcu/tree.c:3977 [inline] rcu_sched_clock_irq+0x2316/0x2370 kernel/rcu/tree.c:2675 update_process_times+0x11a/0x1a0 kernel/time/timer.c:1839 tick_sched_handle+0x9b/0x180 kernel/time/tick-sched.c:243 tick_sched_timer+0xee/0x120 kernel/time/tick-sched.c:1481 __run_hrtimer kernel/time/hrtimer.c:1685 [inline] __hrtimer_run_queues+0x1c0/0xe50 kernel/time/hrtimer.c:1749 hrtimer_interrupt+0x31c/0x790 kernel/time/hrtimer.c:1811 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1095 [inline] __sysvec_apic_timer_interrupt+0x146/0x530 arch/x86/kernel/apic/apic.c:1112 sysvec_apic_timer_interrupt+0x8e/0xc0 arch/x86/kernel/apic/apic.c:1106 asm_sysvec_apic_timer_interrupt+0x1b/0x20 arch/x86/include/asm/idtentry.h:649 RIP: 0010:__sanitizer_cov_trace_const_cmp4+0x0/0x20 kernel/kcov.c:297 Code: 66 2e 0f 1f 84 00 00 00 00 00 48 8b 0c 24 0f b7 d6 0f b7 f7 bf 03 00 00 00 e9 bc fe ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 90 <48> 8b 0c 24 89 f2 89 fe bf 05 00 00 00 e9 9e fe ff ff 66 66 2e 0f RSP: 0018:ffffc90003caf5d8 EFLAGS: 00000202 RAX: 0000000000000001 RBX: ffff8880b9b3f760 RCX: ffffc90003481000 RDX: 0000000000040000 RSI: 0000000000000001 RDI: 0000000000000000 RBP: 0000000000000003 R08: 0000000000000005 R09: 0000000000000000 R10: 0000000000000001 R11: 0000000000000001 R12: ffffed1017367eed R13: 0000000000000001 R14: 0000000000000001 R15: dffffc0000000000 csd_lock_wait kernel/smp.c:414 [inline] smp_call_function_many_cond+0x4bd/0x1110 kernel/smp.c:988 on_each_cpu_cond_mask+0x56/0xa0 kernel/smp.c:1154 __purge_vmap_area_lazy+0x1f6/0x1c50 mm/vmalloc.c:1701 _vm_unmap_aliases.part.0+0x3f0/0x500 mm/vmalloc.c:2125 _vm_unmap_aliases mm/vmalloc.c:2099 [inline] vm_unmap_aliases+0x45/0x50 mm/vmalloc.c:2148 change_page_attr_set_clr+0x241/0x500 arch/x86/mm/pat/set_memory.c:1732 change_page_attr_clear arch/x86/mm/pat/set_memory.c:1789 [inline] set_memory_ro+0x78/0xa0 arch/x86/mm/pat/set_memory.c:1980 bpf_prog_lock_ro include/linux/filter.h:883 [inline] bpf_prog_select_runtime+0x504/0x640 kernel/bpf/core.c:2232 bpf_prog_load+0xfe6/0x2250 kernel/bpf/syscall.c:2579 __sys_bpf+0x11a1/0x5700 kernel/bpf/syscall.c:4917 __do_sys_bpf kernel/bpf/syscall.c:5021 [inline] __se_sys_bpf kernel/bpf/syscall.c:5019 [inline] __x64_sys_bpf+0x75/0xb0 kernel/bpf/syscall.c:5019 do_syscall_x64 arch/x86/entry/common.c:50 [inline] do_syscall_64+0x35/0xb0 arch/x86/entry/common.c:80 entry_SYSCALL_64_after_hwframe+0x46/0xb0 RIP: 0033:0x7fb38d289109 ================================ WARNING: inconsistent lock state 5.19.0-rc1-syzkaller-00095-g874c8ca1e60b #0 Not tainted -------------------------------- inconsistent {HARDIRQ-ON-W} -> {IN-HARDIRQ-W} usage. syz-executor.0/20510 [HC1[1]:SC0[0]:HE0:SE1] takes: ffffffff8beb2fd8 (vmap_area_lock){?.+.}-{2:2}, at: spin_lock include/linux/spinlock.h:349 [inline] ffffffff8beb2fd8 (vmap_area_lock){?.+.}-{2:2}, at: find_vmap_area mm/vmalloc.c:1805 [inline] ffffffff8beb2fd8 (vmap_area_lock){?.+.}-{2:2}, at: find_vm_area+0x1c/0x190 mm/vmalloc.c:2525 {HARDIRQ-ON-W} state was registered at: lock_acquire kernel/locking/lockdep.c:5665 [inline] lock_acquire+0x1ab/0x570 kernel/locking/lockdep.c:5630 __raw_spin_lock include/linux/spinlock_api_smp.h:133 [inline] _raw_spin_lock+0x2a/0x40 kernel/locking/spinlock.c:154 spin_lock include/linux/spinlock.h:349 [inline] alloc_vmap_area+0xa49/0x1f00 mm/vmalloc.c:1586 __get_vm_area_node+0x142/0x3f0 mm/vmalloc.c:2453 __vmalloc_node_range+0x250/0x13e0 mm/vmalloc.c:3125 __vmalloc_node mm/vmalloc.c:3230 [inline] __vmalloc+0x69/0x80 mm/vmalloc.c:3244 pcpu_mem_zalloc mm/percpu.c:516 [inline] pcpu_mem_zalloc+0x51/0xa0 mm/percpu.c:508 pcpu_alloc_chunk mm/percpu.c:1454 [inline] pcpu_create_chunk+0xd7/0x930 mm/percpu-vm.c:338 pcpu_alloc+0x1012/0x13d0 mm/percpu.c:1834 alloc_kmem_cache_cpus.constprop.0+0x29/0xc0 mm/slab.c:1729 do_tune_cpucache+0x37/0x230 mm/slab.c:3844 enable_cpucache+0x3c/0xa0 mm/slab.c:3938 kmem_cache_init_late+0x33/0x66 mm/slab.c:1276 start_kernel+0x2f5/0x48f init/main.c:1058 secondary_startup_64_no_verify+0xce/0xdb irq event stamp: 21446 hardirqs last enabled at (21445): [] asm_sysvec_apic_timer_interrupt+0x1b/0x20 arch/x86/include/asm/idtentry.h:649 hardirqs last disabled at (21446): [] sysvec_apic_timer_interrupt+0xb/0xc0 arch/x86/kernel/apic/apic.c:1106 softirqs last enabled at (520): [] invoke_softirq kernel/softirq.c:445 [inline] softirqs last enabled at (520): [] __irq_exit_rcu+0x123/0x180 kernel/softirq.c:650 softirqs last disabled at (427): [] invoke_softirq kernel/softirq.c:445 [inline] softirqs last disabled at (427): [] __irq_exit_rcu+0x123/0x180 kernel/softirq.c:650 other info that might help us debug this: Possible unsafe locking scenario: CPU0 ---- lock(vmap_area_lock); lock(vmap_area_lock); *** DEADLOCK *** 1 lock held by syz-executor.0/20510: #0: ffffffff8beb2ca8 (vmap_purge_lock){+.+.}-{3:3}, at: _vm_unmap_aliases.part.0+0x382/0x500 mm/vmalloc.c:2123 stack backtrace: CPU: 0 PID: 20510 Comm: syz-executor.0 Not tainted 5.19.0-rc1-syzkaller-00095-g874c8ca1e60b #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011 Call Trace: __dump_stack lib/dump_stack.c:88 [inline] dump_stack_lvl+0xcd/0x134 lib/dump_stack.c:106 print_usage_bug kernel/locking/lockdep.c:3961 [inline] valid_state kernel/locking/lockdep.c:3973 [inline] mark_lock_irq kernel/locking/lockdep.c:4176 [inline] mark_lock.part.0.cold+0x18/0xd8 kernel/locking/lockdep.c:4632 mark_lock kernel/locking/lockdep.c:4596 [inline] mark_usage kernel/locking/lockdep.c:4524 [inline] __lock_acquire+0x14ad/0x5660 kernel/locking/lockdep.c:5007 lock_acquire kernel/locking/lockdep.c:5665 [inline] lock_acquire+0x1ab/0x570 kernel/locking/lockdep.c:5630 __raw_spin_lock include/linux/spinlock_api_smp.h:133 [inline] _raw_spin_lock+0x2a/0x40 kernel/locking/spinlock.c:154 spin_lock include/linux/spinlock.h:349 [inline] find_vmap_area mm/vmalloc.c:1805 [inline] find_vm_area+0x1c/0x190 mm/vmalloc.c:2525 check_heap_object mm/usercopy.c:176 [inline] __check_object_size mm/usercopy.c:252 [inline] __check_object_size+0x1fb/0x7a0 mm/usercopy.c:214 check_object_size include/linux/thread_info.h:199 [inline] __copy_from_user_inatomic include/linux/uaccess.h:62 [inline] copy_from_user_nmi arch/x86/lib/usercopy.c:47 [inline] copy_from_user_nmi+0xcb/0x130 arch/x86/lib/usercopy.c:31 copy_code arch/x86/kernel/dumpstack.c:91 [inline] show_opcodes+0x59/0xb0 arch/x86/kernel/dumpstack.c:121 show_iret_regs+0xd/0x33 arch/x86/kernel/dumpstack.c:149 __show_regs+0x1e/0x60 arch/x86/kernel/process_64.c:74 show_trace_log_lvl+0x25b/0x2ba arch/x86/kernel/dumpstack.c:292 __dump_stack lib/dump_stack.c:88 [inline] dump_stack_lvl+0xcd/0x134 lib/dump_stack.c:106 nmi_cpu_backtrace.cold+0x47/0x144 lib/nmi_backtrace.c:111 nmi_trigger_cpumask_backtrace+0x1e6/0x230 lib/nmi_backtrace.c:62 trigger_single_cpu_backtrace include/linux/nmi.h:164 [inline] rcu_check_gp_kthread_starvation.cold+0x1fb/0x200 kernel/rcu/tree_stall.h:518 print_other_cpu_stall kernel/rcu/tree_stall.h:623 [inline] check_cpu_stall kernel/rcu/tree_stall.h:771 [inline] rcu_pending kernel/rcu/tree.c:3977 [inline] rcu_sched_clock_irq+0x2316/0x2370 kernel/rcu/tree.c:2675 update_process_times+0x11a/0x1a0 kernel/time/timer.c:1839 tick_sched_handle+0x9b/0x180 kernel/time/tick-sched.c:243 tick_sched_timer+0xee/0x120 kernel/time/tick-sched.c:1481 __run_hrtimer kernel/time/hrtimer.c:1685 [inline] __hrtimer_run_queues+0x1c0/0xe50 kernel/time/hrtimer.c:1749 hrtimer_interrupt+0x31c/0x790 kernel/time/hrtimer.c:1811 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1095 [inline] __sysvec_apic_timer_interrupt+0x146/0x530 arch/x86/kernel/apic/apic.c:1112 sysvec_apic_timer_interrupt+0x8e/0xc0 arch/x86/kernel/apic/apic.c:1106 asm_sysvec_apic_timer_interrupt+0x1b/0x20 arch/x86/include/asm/idtentry.h:649 RIP: 0010:__sanitizer_cov_trace_const_cmp4+0x0/0x20 kernel/kcov.c:297 Code: 66 2e 0f 1f 84 00 00 00 00 00 48 8b 0c 24 0f b7 d6 0f b7 f7 bf 03 00 00 00 e9 bc fe ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 90 <48> 8b 0c 24 89 f2 89 fe bf 05 00 00 00 e9 9e fe ff ff 66 66 2e 0f RSP: 0018:ffffc90003caf5d8 EFLAGS: 00000202 RAX: 0000000000000001 RBX: ffff8880b9b3f760 RCX: ffffc90003481000 RDX: 0000000000040000 RSI: 0000000000000001 RDI: 0000000000000000 RBP: 0000000000000003 R08: 0000000000000005 R09: 0000000000000000 R10: 0000000000000001 R11: 0000000000000001 R12: ffffed1017367eed R13: 0000000000000001 R14: 0000000000000001 R15: dffffc0000000000 csd_lock_wait kernel/smp.c:414 [inline] smp_call_function_many_cond+0x4bd/0x1110 kernel/smp.c:988 on_each_cpu_cond_mask+0x56/0xa0 kernel/smp.c:1154 __purge_vmap_area_lazy+0x1f6/0x1c50 mm/vmalloc.c:1701 _vm_unmap_aliases.part.0+0x3f0/0x500 mm/vmalloc.c:2125 _vm_unmap_aliases mm/vmalloc.c:2099 [inline] vm_unmap_aliases+0x45/0x50 mm/vmalloc.c:2148 change_page_attr_set_clr+0x241/0x500 arch/x86/mm/pat/set_memory.c:1732 change_page_attr_clear arch/x86/mm/pat/set_memory.c:1789 [inline] set_memory_ro+0x78/0xa0 arch/x86/mm/pat/set_memory.c:1980 bpf_prog_lock_ro include/linux/filter.h:883 [inline] bpf_prog_select_runtime+0x504/0x640 kernel/bpf/core.c:2232 bpf_prog_load+0xfe6/0x2250 kernel/bpf/syscall.c:2579 __sys_bpf+0x11a1/0x5700 kernel/bpf/syscall.c:4917 __do_sys_bpf kernel/bpf/syscall.c:5021 [inline] __se_sys_bpf kernel/bpf/syscall.c:5019 [inline] __x64_sys_bpf+0x75/0xb0 kernel/bpf/syscall.c:5019 do_syscall_x64 arch/x86/entry/common.c:50 [inline] do_syscall_64+0x35/0xb0 arch/x86/entry/common.c:80 entry_SYSCALL_64_after_hwframe+0x46/0xb0 RIP: 0033:0x7fb38d289109 Code: ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 b8 ff ff ff f7 d8 64 89 01 48 RSP: 002b:00007fb38e392168 EFLAGS: 00000246 ORIG_RAX: 0000000000000141 RAX: ffffffffffffffda RBX: 00007fb38d39bf60 RCX: 00007fb38d289109 RDX: 0000000000000078 RSI: 0000000020000200 RDI: 0000000000000005 RBP: 00007fb38d2e30ad R08: 0000000000000000 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 R13: 00007ffc4ada884f R14: 00007fb38e392300 R15: 0000000000022000 Code: ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 b8 ff ff ff f7 d8 64 89 01 48 RSP: 002b:00007fb38e392168 EFLAGS: 00000246 ORIG_RAX: 0000000000000141 RAX: ffffffffffffffda RBX: 00007fb38d39bf60 RCX: 00007fb38d289109 RDX: 0000000000000078 RSI: 0000000020000200 RDI: 0000000000000005 RBP: 00007fb38d2e30ad R08: 0000000000000000 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 R13: 00007ffc4ada884f R14: 00007fb38e392300 R15: 0000000000022000 ---------------- Code disassembly (best guess): 0: 00 00 add %al,(%rax) 2: 48 8b 0c 24 mov (%rsp),%rcx 6: 0f b7 d6 movzwl %si,%edx 9: 0f b7 f7 movzwl %di,%esi c: bf 03 00 00 00 mov $0x3,%edi 11: e9 bc fe ff ff jmpq 0xfffffed2 16: 66 66 2e 0f 1f 84 00 data16 nopw %cs:0x0(%rax,%rax,1) 1d: 00 00 00 00 21: 90 nop 22: 48 8b 0c 24 mov (%rsp),%rcx 26: 89 f2 mov %esi,%edx 28: 89 fe mov %edi,%esi * 2a: bf 05 00 00 00 mov $0x5,%edi <-- trapping instruction 2f: e9 9e fe ff ff jmpq 0xfffffed2 34: 66 66 2e 0f 1f 84 00 data16 nopw %cs:0x0(%rax,%rax,1) 3b: 00 00 00 00 3f: 0f .byte 0xf