bisecting fixing commit since 7b6ae471e5415bc2bf4384a83ccb4c21de7824c0
building syzkaller on 29c3f20f99b6befe0395fe8e474b1e24240cac95
testing commit 7b6ae471e5415bc2bf4384a83ccb4c21de7824c0
compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2
kernel signature: 5988f4234514afa725ad165bcc1a226ff36ef6524eb814d30e9c7c52ee589afd
run #0: crashed: INFO: rcu detected stall in mac80211_hwsim_beacon
run #1: crashed: INFO: rcu detected stall in mac80211_hwsim_beacon
run #2: crashed: INFO: rcu detected stall in smp_call_function
run #3: crashed: INFO: rcu detected stall in corrupted
run #4: crashed: INFO: rcu detected stall in mac80211_hwsim_beacon
run #5: crashed: INFO: rcu detected stall in smp_call_function
run #6: crashed: INFO: rcu detected stall in smp_call_function
run #7: crashed: INFO: rcu detected stall in mac80211_hwsim_beacon
run #8: crashed: INFO: rcu detected stall in mac80211_hwsim_beacon
run #9: crashed: INFO: rcu detected stall in addrconf_rs_timer
run #10: crashed: INFO: rcu detected stall in ieee80211_iface_work
run #11: crashed: INFO: rcu detected stall in mac80211_hwsim_beacon
run #12: crashed: INFO: rcu detected stall in ieee80211_iface_work
run #13: crashed: INFO: rcu detected stall in addrconf_rs_timer
run #14: crashed: INFO: rcu detected stall in mac80211_hwsim_beacon
run #15: crashed: INFO: rcu detected stall in syscall_exit_to_user_mode
run #16: crashed: INFO: task hung in rtnetlink_rcv_msg
run #17: crashed: INFO: rcu detected stall in addrconf_rs_timer
run #18: crashed: INFO: rcu detected stall in do_mkdirat
run #19: crashed: INFO: rcu detected stall in mac80211_hwsim_beacon
testing current HEAD 2f111a6fd5b5297b4e92f53798ca086f7c7d33a4
testing commit 2f111a6fd5b5297b4e92f53798ca086f7c7d33a4
compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2
kernel signature: 777b479fb7e4d6904cb66d56e9fcd10cd29350f2d56842793a30ef7be7b3fea5
run #0: crashed: INFO: rcu detected stall in gc_worker
run #1: crashed: INFO: rcu detected stall in smp_call_function
run #2: crashed: INFO: rcu detected stall in corrupted
run #3: crashed: INFO: rcu detected stall in corrupted
run #4: crashed: INFO: rcu detected stall in corrupted
run #5: crashed: INFO: rcu detected stall in corrupted
run #6: crashed: INFO: rcu detected stall in corrupted
run #7: crashed: INFO: rcu detected stall in cache_reap
run #8: crashed: INFO: rcu detected stall in gc_worker
run #9: crashed: INFO: rcu detected stall in do_faccessat
revisions tested: 2, total time: 29m16.631184874s (build: 13m5.813606361s, test: 15m29.962556944s)
the crash still happens on HEAD
commit msg: Merge tag 'ceph-for-5.15-rc7' of git://github.com/ceph/ceph-client
crash: INFO: rcu detected stall in do_faccessat
rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
rcu: 1-...0: (3 ticks this GP) idle=15b/1/0x4000000000000000 softirq=11233/11233 fqs=5
(detected by 0, t=10514 jiffies, g=9629, q=1080)
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 9206 Comm: systemd-cgroups Not tainted 5.15.0-rc6-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
RIP: 0010:__lock_acquire+0x3a1/0x5410 kernel/locking/lockdep.c:4963
Code: 00 41 09 c6 41 8b 44 24 20 45 09 f7 45 09 cf 25 ff 1f 00 00 41 09 c7 48 b8 00 00 00 00 00 fc ff df 45 89 7c 24 20 0f b6 14 02 <48> 89 f8 83 e0 07 83 c0 03 38 d0 7c 08 84 d2 0f 85 80 11 00 00 8b
RSP: 0018:ffffc90000fd8b10 EFLAGS: 00000006
RAX: dffffc0000000000 RBX: ffffffff8f50a0b8 RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff88806e87ec6c
RBP: 0000000000000000 R08: 1ffff1100dd0fd88 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000001 R12: ffff88806e87ec48
R13: ffff88806e87e200 R14: 0000000000044000 R15: 00000000000c4000
FS: 0000000000000000(0000) GS:ffff8880b9f00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f9dabf06228 CR3: 000000007972f000 CR4: 00000000003506e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
lock_acquire kernel/locking/lockdep.c:5625 [inline]
lock_acquire+0x1ab/0x510 kernel/locking/lockdep.c:5590
__raw_spin_lock_irqsave include/linux/spinlock_api_smp.h:110 [inline]
_raw_spin_lock_irqsave+0x39/0x50 kernel/locking/spinlock.c:162
debug_object_deactivate lib/debugobjects.c:735 [inline]
debug_object_deactivate+0x101/0x300 lib/debugobjects.c:723
debug_hrtimer_deactivate kernel/time/hrtimer.c:425 [inline]
debug_deactivate kernel/time/hrtimer.c:481 [inline]
__run_hrtimer kernel/time/hrtimer.c:1653 [inline]
__hrtimer_run_queues+0x337/0xb00 kernel/time/hrtimer.c:1749
hrtimer_interrupt+0x2f5/0x780 kernel/time/hrtimer.c:1811
local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1086 [inline]
__sysvec_apic_timer_interrupt+0x146/0x530 arch/x86/kernel/apic/apic.c:1103
sysvec_apic_timer_interrupt+0x8e/0xc0 arch/x86/kernel/apic/apic.c:1097
asm_sysvec_apic_timer_interrupt+0x12/0x20 arch/x86/include/asm/idtentry.h:638
RIP: 0010:selinux_inode_permission+0xe3/0x430 security/selinux/hooks.c:3179
Code: e0 5b 5d 41 5c 41 5d 41 5e 41 5f c3 49 89 fd 89 f5 49 8d bc 24 b8 07 00 00 48 89 f8 48 c1 e8 03 80 3c 10 00 0f 85 d3 02 00 00 <4d> 8b b4 24 b8 07 00 00 4c 89 f7 e8 dd 49 f3 fd 84 c0 0f 85 7a 02
RSP: 0018:ffffc9000d0cfa80 EFLAGS: 00000246
RAX: 1ffff1100dd0fd37 RBX: 1ffff92001a19f53 RCX: 0000000000000000
RDX: dffffc0000000000 RSI: 0000000000000081 RDI: ffff88806e87e9b8
RBP: 0000000000000081 R08: 0000000000000000 R09: 0000000000000002
R10: ffffed100401ea0e R11: ffffc9000d0cfd20 R12: ffff88806e87e200
R13: ffff88802010a560 R14: 00000003ca10ce8c R15: 0000000000000003
security_inode_permission+0x6e/0xb0 security/security.c:1313
inode_permission fs/namei.c:505 [inline]
may_lookup fs/namei.c:1683 [inline]
link_path_walk.part.0+0x212/0x9d0 fs/namei.c:2239
link_path_walk fs/namei.c:2220 [inline]
path_lookupat+0x74/0x6b0 fs/namei.c:2448
filename_lookup+0x192/0x510 fs/namei.c:2478
user_path_at_empty+0x35/0x50 fs/namei.c:2801
user_path_at include/linux/namei.h:57 [inline]
do_faccessat+0xc0/0x660 fs/open.c:421
do_syscall_x64 arch/x86/entry/common.c:50 [inline]
do_syscall_64+0x35/0xb0 arch/x86/entry/common.c:80
entry_SYSCALL_64_after_hwframe+0x44/0xae
RIP: 0033:0x7f9dac922217
Code: c8 ff c3 b8 01 00 00 00 0f 05 48 3d 01 f0 ff ff 73 01 c3 48 8d 0d 19 bf 20 00 f7 d8 89 01 48 83 c8 ff c3 b8 15 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8d 0d f9 be 20 00 f7 d8 89 01 48 83
RSP: 002b:00007ffe5731d298 EFLAGS: 00000206 ORIG_RAX: 0000000000000015
RAX: ffffffffffffffda RBX: 00007f9dac709631 RCX: 00007f9dac922217
RDX: 0000000000000800 RSI: 0000000000000000 RDI: 00007f9dac9264e7
RBP: 00007ffe5731d300 R08: 0000000000000000 R09: 0000000000000007
R10: 00007f9dacb2a3a8 R11: 0000000000000206 R12: 00007f9dacb27628
R13: 00000000000027b2 R14: 0000000000002dda R15: 0000000000000000
rcu: rcu_preempt kthread starved for 5131 jiffies! g9629 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=0
rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
rcu: RCU grace-period kthread stack dump:
task:rcu_preempt state:R running task stack:28960 pid: 14 ppid: 2 flags:0x00004000
Call Trace:
context_switch kernel/sched/core.c:4940 [inline]
__schedule+0x90d/0x26c0 kernel/sched/core.c:6287
schedule+0xd3/0x270 kernel/sched/core.c:6366
schedule_timeout+0x11d/0x250 kernel/time/timer.c:1881
rcu_gp_fqs_loop+0x186/0x800 kernel/rcu/tree.c:1957
rcu_gp_kthread+0x1de/0x320 kernel/rcu/tree.c:2130
kthread+0x38b/0x460 kernel/kthread.c:319
ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:295
rcu: Stack dump where RCU GP kthread last ran:
NMI backtrace for cpu 0
CPU: 0 PID: 149 Comm: kworker/u4:2 Not tainted 5.15.0-rc6-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Workqueue: events_unbound toggle_allocation_gate
Call Trace:
__dump_stack lib/dump_stack.c:88 [inline]
dump_stack_lvl+0x57/0x7d lib/dump_stack.c:106
nmi_cpu_backtrace.cold+0x30/0xc0 lib/nmi_backtrace.c:105
nmi_trigger_cpumask_backtrace+0x11a/0x160 lib/nmi_backtrace.c:62
trigger_single_cpu_backtrace include/linux/nmi.h:164 [inline]
rcu_check_gp_kthread_starvation.cold+0x1fb/0x200 kernel/rcu/tree_stall.h:481
print_other_cpu_stall kernel/rcu/tree_stall.h:586 [inline]
check_cpu_stall kernel/rcu/tree_stall.h:729 [inline]
rcu_pending kernel/rcu/tree.c:3880 [inline]
rcu_sched_clock_irq+0x2125/0x2200 kernel/rcu/tree.c:2599
update_process_times+0x13b/0x1c0 kernel/time/timer.c:1785
tick_sched_handle+0x6f/0x130 kernel/time/tick-sched.c:226
tick_sched_timer+0x132/0x210 kernel/time/tick-sched.c:1421
__run_hrtimer kernel/time/hrtimer.c:1685 [inline]
__hrtimer_run_queues+0x18a/0xb00 kernel/time/hrtimer.c:1749
hrtimer_interrupt+0x2f5/0x780 kernel/time/hrtimer.c:1811
local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1086 [inline]
__sysvec_apic_timer_interrupt+0x146/0x530 arch/x86/kernel/apic/apic.c:1103
sysvec_apic_timer_interrupt+0x8e/0xc0 arch/x86/kernel/apic/apic.c:1097
asm_sysvec_apic_timer_interrupt+0x12/0x20 arch/x86/include/asm/idtentry.h:638
RIP: 0010:csd_lock_wait kernel/smp.c:440 [inline]
RIP: 0010:smp_call_function_many_cond+0x22e/0x9d0 kernel/smp.c:969
Code: 38 d0 7c 08 84 d2 0f 85 2b 05 00 00 8b 43 08 a8 01 74 2e 48 89 ca 49 89 cf 48 c1 ea 03 41 83 e7 07 4c 01 e2 41 83 c7 03 f3 90 <0f> b6 02 41 38 c7 7c 08 84 c0 0f 85 d4 04 00 00 8b 43 08 a8 01 75
RSP: 0018:ffffc900014b7a58 EFLAGS: 00000202
RAX: 0000000000000011 RBX: ffff8880b9f37140 RCX: ffff8880b9f37148
RDX: ffffed10173e6e29 RSI: ffff8880b9e32b88 RDI: ffffffff8a60e888
RBP: ffff8880b9e32b80 R08: 0000000000000001 R09: ffffffff8ee06927
R10: 0000000000000001 R11: 000000000007a089 R12: dffffc0000000000
R13: ffff8880b9e32b88 R14: ffffed10173c6570 R15: 0000000000000003
on_each_cpu_cond_mask+0x3f/0x70 kernel/smp.c:1135
on_each_cpu include/linux/smp.h:71 [inline]
text_poke_sync arch/x86/kernel/alternative.c:929 [inline]
text_poke_bp_batch+0x1b3/0x560 arch/x86/kernel/alternative.c:1114
text_poke_flush arch/x86/kernel/alternative.c:1268 [inline]
text_poke_flush arch/x86/kernel/alternative.c:1265 [inline]
text_poke_finish+0x16/0x30 arch/x86/kernel/alternative.c:1275
arch_jump_label_transform_apply+0x13/0x20 arch/x86/kernel/jump_label.c:146
static_key_disable_cpuslocked+0x100/0x160 kernel/jump_label.c:207
static_key_disable+0x11/0x20 kernel/jump_label.c:215
toggle_allocation_gate mm/kfence/core.c:640 [inline]
toggle_allocation_gate+0x156/0x310 mm/kfence/core.c:618
process_one_work+0x87f/0x1450 kernel/workqueue.c:2297
worker_thread+0x598/0x1040 kernel/workqueue.c:2444
kthread+0x38b/0x460 kernel/kthread.c:319
ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:295
----------------
Code disassembly (best guess):
0: 00 41 09 add %al,0x9(%rcx)
3: c6 41 8b 44 movb $0x44,-0x75(%rcx)
7: 24 20 and $0x20,%al
9: 45 09 f7 or %r14d,%r15d
c: 45 09 cf or %r9d,%r15d
f: 25 ff 1f 00 00 and $0x1fff,%eax
14: 41 09 c7 or %eax,%r15d
17: 48 b8 00 00 00 00 00 movabs $0xdffffc0000000000,%rax
1e: fc ff df
21: 45 89 7c 24 20 mov %r15d,0x20(%r12)
26: 0f b6 14 02 movzbl (%rdx,%rax,1),%edx
* 2a: 48 89 f8 mov %rdi,%rax <-- trapping instruction
2d: 83 e0 07 and $0x7,%eax
30: 83 c0 03 add $0x3,%eax
33: 38 d0 cmp %dl,%al
35: 7c 08 jl 0x3f
37: 84 d2 test %dl,%dl
39: 0f 85 80 11 00 00 jne 0x11bf
3f: 8b .byte 0x8b