ci starts bisection 2023-04-03 14:55:46.395944788 +0000 UTC m=+33296.718687325
bisecting fixing commit since 72a85e2b0a1e1e6fb4ee51ae902730212b2de25c
building syzkaller on 9da18ae8fa827d046ef8da48cc23c97418553c23
ensuring issue is reproducible on original commit 72a85e2b0a1e1e6fb4ee51ae902730212b2de25c
testing commit 72a85e2b0a1e1e6fb4ee51ae902730212b2de25c gcc
compiler: gcc (Debian 10.2.1-6) 10.2.1 20210110, GNU ld (GNU Binutils for Debian) 2.35.2
kernel signature: c5a9585b75b92f605c4f69feef55aba82367c0c805c3bd377707df48a158a944
run #0: crashed: INFO: rcu detected stall in corrupted
run #1: crashed: INFO: rcu detected stall in corrupted
run #2: crashed: INFO: rcu detected stall in corrupted
run #3: crashed: INFO: rcu detected stall in corrupted
run #4: crashed: INFO: rcu detected stall in corrupted
run #5: crashed: INFO: rcu detected stall in corrupted
run #6: crashed: INFO: rcu detected stall in corrupted
run #7: crashed: KASAN: use-after-free Read in net_tx_action
run #8: crashed: INFO: rcu detected stall in tc_modify_qdisc
run #9: crashed: KASAN: use-after-free Read in net_tx_action
run #10: crashed: KASAN: use-after-free Read in net_tx_action
run #11: crashed: KASAN: use-after-free Read in net_tx_action
run #12: crashed: KASAN: use-after-free Read in net_tx_action
run #13: crashed: KASAN: use-after-free Read in net_tx_action
run #14: crashed: KASAN: use-after-free Read in net_tx_action
run #15: crashed: INFO: rcu detected stall in sys_exit_group
run #16: crashed: INFO: rcu detected stall in corrupted
run #17: crashed: INFO: rcu detected stall in gc_worker
run #18: crashed: INFO: rcu detected stall in do_mas_munmap
run #19: crashed: KASAN: use-after-free Read in net_tx_action
testing current HEAD 7e364e56293bb98cae1b55fd835f5991c4e96e7d
testing commit 7e364e56293bb98cae1b55fd835f5991c4e96e7d gcc
compiler: gcc (Debian 10.2.1-6) 10.2.1 20210110, GNU ld (GNU Binutils for Debian) 2.35.2
kernel signature: db903357cb4e6a8f686f54da667712a852ced51e30393eca2959fe047511637a
run #0: crashed: INFO: rcu detected stall in sys_socket
run #1: crashed: INFO: rcu detected stall in sys_chdir
run #2: crashed: INFO: rcu detected stall in sys_openat
run #3: crashed: INFO: rcu detected stall in do_vmi_munmap
run #4: crashed: INFO: rcu detected stall in sys_openat
run #5: crashed: INFO: rcu detected stall in do_vmi_munmap
run #6: crashed: INFO: rcu detected stall in gc_worker
run #7: crashed: INFO: rcu detected stall in gc_worker
run #8: crashed: INFO: rcu detected stall in sys_execve
run #9: OK
revisions tested: 2, total time: 37m30.366962556s (build: 19m12.090073691s, test: 17m38.479334566s)
the crash still happens on HEAD
commit msg: Linux 6.3-rc5
crash: INFO: rcu detected stall in sys_execve
rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
rcu: 1-...!: (1 GPs behind) idle=8f74/1/0x4000000000000000 softirq=30569/30570 fqs=5
rcu: (detected by 0, t=10503 jiffies, g=18493, q=160 ncpus=2)
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 13485 Comm: rm Not tainted 6.3.0-rc5-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 03/02/2023
RIP: 0010:lock_acquire+0x225/0x520 kernel/locking/lockdep.c:5673
Code: 00 00 48 c7 43 08 00 00 00 00 48 8b 84 24 a8 00 00 00 65 48 2b 04 25 28 00 00 00 0f 85 a8 02 00 00 48 81 c4 b0 00 00 00 5b 5d <41> 5c 41 5d 41 5e 41 5f c3 65 8b 05 eb 3d a7 7e 85 c0 75 b0 65 8b
RSP: 0018:ffffc900003e8d10 EFLAGS: 00000086
RAX: 0000000000000000 RBX: 000000000009f8a0 RCX: ffffffff815af2bc
RDX: 1ffff1100e66654e RSI: ffffffff896b8a80 RDI: ffffffff89c218a0
RBP: ffffffff90e896a8 R08: 0000000000000000 R09: ffffffff90383b87
R10: fffffbfff2070770 R11: 0000000000000000 R12: 0000000000000000
R13: 0000000000000000 R14: ffffffff90e896c0 R15: 0000000000000000
FS: 0000000000000000(0000) GS:ffff8880b9b00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007ffd518ede90 CR3: 000000007b757000 CR4: 00000000003506e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
__raw_spin_lock_irqsave include/linux/spinlock_api_smp.h:110 [inline]
_raw_spin_lock_irqsave+0x3d/0x60 kernel/locking/spinlock.c:162
debug_object_deactivate lib/debugobjects.c:739 [inline]
debug_object_deactivate+0x105/0x300 lib/debugobjects.c:727
debug_hrtimer_deactivate kernel/time/hrtimer.c:425 [inline]
debug_deactivate kernel/time/hrtimer.c:481 [inline]
__run_hrtimer kernel/time/hrtimer.c:1653 [inline]
__hrtimer_run_queues+0x337/0x960 kernel/time/hrtimer.c:1749
hrtimer_interrupt+0x2f9/0x7a0 kernel/time/hrtimer.c:1811
local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1096 [inline]
__sysvec_apic_timer_interrupt+0x14a/0x430 arch/x86/kernel/apic/apic.c:1113
sysvec_apic_timer_interrupt+0x92/0xc0 arch/x86/kernel/apic/apic.c:1107
asm_sysvec_apic_timer_interrupt+0x1a/0x20 arch/x86/include/asm/idtentry.h:645
RIP: 0010:__seqprop_spinlock_sequence include/linux/seqlock.h:275 [inline]
RIP: 0010:read_seqbegin include/linux/seqlock.h:836 [inline]
RIP: 0010:zone_span_seqbegin include/linux/memory_hotplug.h:132 [inline]
RIP: 0010:page_outside_zone_boundaries mm/page_alloc.c:629 [inline]
RIP: 0010:bad_range+0xd3/0x3e0 mm/page_alloc.c:656
Code: 24 70 4c 89 ff e8 ed cf ab ff 58 48 b8 00 00 00 00 00 fc ff df 9c 5a 80 e6 02 0f 85 0c 02 00 00 4d 85 ed 74 01 fb 0f b6 55 00 <84> d2 74 09 80 fa 03 0f 8e 1a 02 00 00 44 8b ab c0 00 00 00 41 f6
RSP: 0018:ffffc9000359f4c0 EFLAGS: 00000206
RAX: dffffc0000000000 RBX: ffff88813fffa700 RCX: 1ffffffff2072e56
RDX: 0000000000000000 RSI: ffffffff896b8880 RDI: ffffffff89c218a0
RBP: ffffed1027fff4f8 R08: 0000000000000001 R09: ffffffff90383bb7
R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000000
R13: 0000000000000200 R14: ffffed1027fff4f0 R15: ffff88813fffa7c8
rmqueue mm/page_alloc.c:3884 [inline]
get_page_from_freelist+0x1170/0x2e20 mm/page_alloc.c:4323
__alloc_pages+0x1cb/0x4a0 mm/page_alloc.c:5592
__folio_alloc+0x16/0x40 mm/page_alloc.c:5624
vma_alloc_folio+0x11a/0x690 mm/mempolicy.c:2244
do_anonymous_page mm/memory.c:4052 [inline]
handle_pte_fault mm/memory.c:4907 [inline]
__handle_mm_fault+0x107b/0x2ee0 mm/memory.c:5051
handle_mm_fault+0x17b/0x640 mm/memory.c:5197
do_user_addr_fault+0x2da/0xd00 arch/x86/mm/fault.c:1407
handle_page_fault arch/x86/mm/fault.c:1498 [inline]
exc_page_fault+0x5e/0xc0 arch/x86/mm/fault.c:1554
asm_exc_page_fault+0x26/0x30 arch/x86/include/asm/idtentry.h:570
RIP: 0010:__put_user_8+0x16/0x20 arch/x86/lib/putuser.S:117
Code: 01 31 c9 0f 01 ca c3 66 66 2e 0f 1f 84 00 00 00 00 00 66 90 f3 0f 1e fa 48 bb f9 ef ff ff ff 7f 00 00 48 39 d9 73 30 0f 01 cb <48> 89 01 31 c9 0f 01 ca c3 90 f3 0f 1e fa f3 0f 1e fa 0f 01 cb 48
RSP: 0018:ffffc9000359fb98 EFLAGS: 00050293
RAX: 0000000000000003 RBX: 00007fffffffeff9 RCX: 00007ffd518ede90
RDX: 1ffff1100e66654d RSI: ffffffff896b8a80 RDI: ffffffff89c218a0
RBP: ffff888026d9cdc0 R08: 0000000000000001 R09: ffffffff8d647797
R10: fffffbfff1ac8ef2 R11: 00000000cd245de9 R12: ffff888026d9cee8
R13: 00007f366ebe5050 R14: ffff88806a973000 R15: ffff88806a973018
create_elf_tables fs/binfmt_elf.c:331 [inline]
load_elf_binary+0x24c6/0x4430 fs/binfmt_elf.c:1291
search_binary_handler fs/exec.c:1736 [inline]
exec_binprm fs/exec.c:1778 [inline]
bprm_execve fs/exec.c:1853 [inline]
bprm_execve+0x677/0x14f0 fs/exec.c:1809
do_execveat_common+0x602/0x800 fs/exec.c:1960
do_execve fs/exec.c:2034 [inline]
__do_sys_execve fs/exec.c:2110 [inline]
__se_sys_execve fs/exec.c:2105 [inline]
__x64_sys_execve+0x8e/0xc0 fs/exec.c:2105
do_syscall_x64 arch/x86/entry/common.c:50 [inline]
do_syscall_64+0x39/0xb0 arch/x86/entry/common.c:80
entry_SYSCALL_64_after_hwframe+0x63/0xcd
RIP: 0033:0x7f37b9513337
Code: Unable to access opcode bytes at 0x7f37b951330d.
RSP: 002b:00007ffed16bb138 EFLAGS: 00000246 ORIG_RAX: 000000000000003b
RAX: ffffffffffffffda RBX: 000055dd83158bc8 RCX: 00007f37b9513337
RDX: 000055dd83158c28 RSI: 000055dd83158bc8 RDI: 000055dd83158cb0
RBP: 000055dd83158cb0 R08: 000055dd83158cb5 R09: 0000000000000000
R10: 0000000000000008 R11: 0000000000000246 R12: 000055dd83158c28
R13: 00007f37b96b8ff4 R14: 000055dd83158c28 R15: 0000000000000000
rcu: rcu_preempt kthread starved for 10478 jiffies! g18493 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=0
rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
rcu: RCU grace-period kthread stack dump:
task:rcu_preempt state:R running task stack:28784 pid:15 ppid:2 flags:0x00004000
Call Trace:
context_switch kernel/sched/core.c:5307 [inline]
__schedule+0xc01/0x56c0 kernel/sched/core.c:6625
schedule+0xde/0x1a0 kernel/sched/core.c:6701
schedule_timeout+0x121/0x270 kernel/time/timer.c:2167
rcu_gp_fqs_loop+0x190/0x910 kernel/rcu/tree.c:1608
rcu_gp_kthread+0x23a/0x360 kernel/rcu/tree.c:1807
kthread+0x298/0x340 kernel/kthread.c:376
ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:308
rcu: Stack dump where RCU GP kthread last ran:
CPU: 0 PID: 8 Comm: kworker/u4:0 Not tainted 6.3.0-rc5-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 03/02/2023
Workqueue: events_unbound toggle_allocation_gate
RIP: 0010:csd_lock_wait kernel/smp.c:413 [inline]
RIP: 0010:smp_call_function_many_cond+0x46e/0xf20 kernel/smp.c:987
Code: c8 7c 08 84 c9 0f 85 6f 08 00 00 41 8b 47 08 a8 01 74 30 49 89 d6 49 89 d5 49 c1 ee 03 41 83 e5 07 49 01 ee 41 83 c5 03 f3 90 <41> 0f b6 06 41 38 c5 7c 08 84 c0 0f 85 cd 07 00 00 41 8b 47 08 a8
RSP: 0018:ffffc900002ef9b0 EFLAGS: 00000202
RAX: 0000000000000011 RBX: 0000000000000001 RCX: 0000000000000000
RDX: ffff8880b9b41fa8 RSI: ffffffff896b8880 RDI: ffffffff8b1ac9c8
RBP: dffffc0000000000 R08: 0000000000000001 R09: ffffffff90383b87
R10: 0000000000000001 R11: 0000000000000000 R12: ffff8880b9a3d400
R13: 0000000000000003 R14: ffffed10173683f5 R15: ffff8880b9b41fa0
FS: 0000000000000000(0000) GS:ffff8880b9a00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f37b95c69ee CR3: 000000000b56c000 CR4: 00000000003506f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
on_each_cpu_cond_mask+0x43/0x70 kernel/smp.c:1155
on_each_cpu include/linux/smp.h:71 [inline]
text_poke_sync arch/x86/kernel/alternative.c:1770 [inline]
text_poke_bp_batch+0x423/0x770 arch/x86/kernel/alternative.c:2032
text_poke_flush arch/x86/kernel/alternative.c:2161 [inline]
text_poke_flush arch/x86/kernel/alternative.c:2158 [inline]
text_poke_finish+0x1a/0x30 arch/x86/kernel/alternative.c:2168
arch_jump_label_transform_apply+0x17/0x30 arch/x86/kernel/jump_label.c:146
static_key_enable_cpuslocked+0x163/0x220 kernel/jump_label.c:205
static_key_enable+0x15/0x20 kernel/jump_label.c:218
toggle_allocation_gate mm/kfence/core.c:803 [inline]
toggle_allocation_gate+0xdb/0x1e0 mm/kfence/core.c:795
process_one_work+0x865/0x1400 kernel/workqueue.c:2390
worker_thread+0x59c/0xec0 kernel/workqueue.c:2537
kthread+0x298/0x340 kernel/kthread.c:376
ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:308