syzbot


INFO: rcu detected stall in sys_newfstatat (2)

Status: auto-closed as invalid on 2022/05/13 02:53
Reported-by: syzbot+@syzkaller.appspotmail.com
First crash: 353d, last: 353d
similar bugs (3):
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: rcu detected stall in sys_newfstatat (4) C error 1 2d11h 98d 0/24 upstream: reported C repro on 2022/10/25 00:38
upstream INFO: rcu detected stall in sys_newfstatat 1 1154d 1154d 0/24 closed as invalid on 2019/12/04 14:04
upstream INFO: rcu detected stall in sys_newfstatat (3) 1 239d 239d 0/24 auto-closed as invalid on 2022/09/03 09:55

Sample crash report:
rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
rcu: 	1-...!: (1 GPs behind) idle=0f5/1/0x4000000000000000 softirq=18507/18513 fqs=0 
	(detected by 0, t=10502 jiffies, g=22845, q=173)
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 2963 Comm: udevd Not tainted 5.17.0-rc3-syzkaller-00188-g1d41d2e82623 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
RIP: 0010:lookup_chain_cache_add kernel/locking/lockdep.c:3714 [inline]
RIP: 0010:validate_chain+0x18b/0x8240 kernel/locking/lockdep.c:3769
Code: 0f af c6 48 c1 e8 30 48 8d 1c c5 20 db ae 8f 48 89 d8 48 c1 e8 03 48 89 44 24 40 42 80 3c 20 00 74 08 48 89 df e8 25 8b 69 00 <48> 89 5c 24 20 48 8b 1b 48 85 db 74 62 48 83 c3 f8 75 15 eb 5a 48
RSP: 0018:ffffc90000dc0600 EFLAGS: 00000046
RAX: 1ffffffff1f672ac RBX: ffffffff8fb39560 RCX: ffffffff8167c608
RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff8ffe1e20
RBP: ffffc90000dc0910 R08: dffffc0000000000 R09: fffffbfff1ffc3c5
R10: fffffbfff1ffc3c5 R11: 0000000000000000 R12: dffffc0000000000
R13: 1ffff920001b80e0 R14: 66be3427081b2437 R15: 66be3427081b2437
FS:  00007f5be36a3840(0000) GS:ffff8880b9b00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000001b2dd21000 CR3: 0000000023525000 CR4: 00000000003506e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <IRQ>
 __lock_acquire+0x1382/0x2b00 kernel/locking/lockdep.c:5027
 lock_acquire+0x19f/0x4d0 kernel/locking/lockdep.c:5639
 __raw_spin_lock_irqsave include/linux/spinlock_api_smp.h:110 [inline]
 _raw_spin_lock_irqsave+0xd1/0x120 kernel/locking/spinlock.c:162
 debug_object_activate+0x97/0x6a0 lib/debugobjects.c:661
 debug_hrtimer_activate kernel/time/hrtimer.c:420 [inline]
 debug_activate kernel/time/hrtimer.c:475 [inline]
 enqueue_hrtimer kernel/time/hrtimer.c:1084 [inline]
 __run_hrtimer kernel/time/hrtimer.c:1702 [inline]
 __hrtimer_run_queues+0x594/0xa60 kernel/time/hrtimer.c:1749
 hrtimer_interrupt+0x3b3/0x1040 kernel/time/hrtimer.c:1811
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1086 [inline]
 __sysvec_apic_timer_interrupt+0xf9/0x270 arch/x86/kernel/apic/apic.c:1103
 sysvec_apic_timer_interrupt+0x8c/0xb0 arch/x86/kernel/apic/apic.c:1097
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x12/0x20
RIP: 0010:rcu_lockdep_current_cpu_online+0xfd/0x130 kernel/rcu/tree.c:1180
Code: f0 48 c1 e8 03 42 80 3c 38 00 74 08 4c 89 f7 e8 99 42 61 00 49 f7 06 01 00 00 00 75 04 31 c0 eb 02 b0 01 65 ff 0d 7b 60 92 7e <74> 08 5b 41 5c 41 5e 41 5f c3 e8 34 4a 90 ff eb f1 48 c7 c7 a0 2d
RSP: 0018:ffffc9000c3e7538 EFLAGS: 00000282
RAX: 1ffffffff1964401 RBX: ffffffff8cb22570 RCX: 0000000080000002
RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffff8880b9b3a658
RBP: ffffc9000c3e75f0 R08: dffffc0000000000 R09: fffffbfff1c0165e
R10: fffffbfff1c0165e R11: 0000000000000000 R12: 0000000000000002
R13: 1ffff9200187ced0 R14: ffffffff8cb22500 R15: dffffc0000000000
 rcu_read_lock_held_common kernel/rcu/update.c:112 [inline]
 rcu_read_lock_sched_held+0x74/0x130 kernel/rcu/update.c:123
 trace_lock_release+0x4f/0x150 include/trace/events/lock.h:58
 lock_release+0x82/0x810 kernel/locking/lockdep.c:5650
 __raw_spin_unlock include/linux/spinlock_api_smp.h:141 [inline]
 _raw_spin_unlock+0x12/0x40 kernel/locking/spinlock.c:186
 spin_unlock include/linux/spinlock.h:389 [inline]
 kernfs_iop_permission+0x270/0x360 fs/kernfs/inode.c:294
 do_inode_permission fs/namei.c:457 [inline]
 inode_permission+0x2b6/0x6b0 fs/namei.c:524
 may_lookup fs/namei.c:1737 [inline]
 link_path_walk+0x2d2/0xde0 fs/namei.c:2289
 path_lookupat+0xab/0x6c0 fs/namei.c:2498
 filename_lookup+0x270/0x640 fs/namei.c:2528
 user_path_at_empty+0x40/0x1a0 fs/namei.c:2851
 user_path_at include/linux/namei.h:57 [inline]
 vfs_statx+0x10f/0x3b0 fs/stat.c:221
 vfs_fstatat fs/stat.c:243 [inline]
 __do_sys_newfstatat fs/stat.c:412 [inline]
 __se_sys_newfstatat+0xc8/0x760 fs/stat.c:406
 do_syscall_x64 arch/x86/entry/common.c:50 [inline]
 do_syscall_64+0x44/0xd0 arch/x86/entry/common.c:80
 entry_SYSCALL_64_after_hwframe+0x44/0xae
RIP: 0033:0x7f5be37fa1da
Code: 48 89 f2 b9 00 01 00 00 48 89 fe bf 9c ff ff ff e9 0b 00 00 00 66 2e 0f 1f 84 00 00 00 00 00 90 41 89 ca b8 06 01 00 00 0f 05 <3d> 00 f0 ff ff 77 07 31 c0 c3 0f 1f 40 00 48 8b 15 69 fc 0c 00 f7
RSP: 002b:00007ffde0669248 EFLAGS: 00000246 ORIG_RAX: 0000000000000106
RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f5be37fa1da
RDX: 00007ffde0669258 RSI: 00007ffde06696e8 RDI: 00000000ffffff9c
RBP: 00007ffde06692e8 R08: 0000000000000000 R09: 00007f5be4848010
R10: 0000000000000000 R11: 0000000000000246 R12: 00007ffde06696e8
R13: 00007ffde0669258 R14: 00007f5be4848910 R15: 0000000000000000
 </TASK>
rcu: rcu_preempt kthread starved for 10502 jiffies! g22845 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=0
rcu: 	Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
rcu: RCU grace-period kthread stack dump:
task:rcu_preempt     state:R  running task     stack:26480 pid:   14 ppid:     2 flags:0x00004000
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:4986 [inline]
 __schedule+0x926/0x1080 kernel/sched/core.c:6295
 schedule+0x12b/0x1f0 kernel/sched/core.c:6368
 schedule_timeout+0x1b9/0x300 kernel/time/timer.c:1881
 rcu_gp_fqs_loop+0x1fd/0x770 kernel/rcu/tree.c:1963
 rcu_gp_kthread+0xa5/0x350 kernel/rcu/tree.c:2136
 kthread+0x2a3/0x2d0 kernel/kthread.c:377
 ret_from_fork+0x1f/0x30
 </TASK>
rcu: Stack dump where RCU GP kthread last ran:
NMI backtrace for cpu 0
CPU: 0 PID: 9122 Comm: syz-executor.0 Not tainted 5.17.0-rc3-syzkaller-00188-g1d41d2e82623 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Call Trace:
 <IRQ>
 __dump_stack lib/dump_stack.c:88 [inline]
 dump_stack_lvl+0x1dc/0x2d8 lib/dump_stack.c:106
 nmi_cpu_backtrace+0x45f/0x490 lib/nmi_backtrace.c:111
 nmi_trigger_cpumask_backtrace+0x16a/0x280 lib/nmi_backtrace.c:62
 trigger_single_cpu_backtrace include/linux/nmi.h:164 [inline]
 rcu_check_gp_kthread_starvation+0x1ff/0x270 kernel/rcu/tree_stall.h:458
 print_other_cpu_stall kernel/rcu/tree_stall.h:563 [inline]
 check_cpu_stall kernel/rcu/tree_stall.h:706 [inline]
 rcu_pending kernel/rcu/tree.c:3919 [inline]
 rcu_sched_clock_irq+0x23d5/0x2bc0 kernel/rcu/tree.c:2617
 update_process_times+0x197/0x200 kernel/time/timer.c:1785
 tick_sched_handle kernel/time/tick-sched.c:226 [inline]
 tick_sched_timer+0x27d/0x420 kernel/time/tick-sched.c:1428
 __run_hrtimer kernel/time/hrtimer.c:1685 [inline]
 __hrtimer_run_queues+0x4cb/0xa60 kernel/time/hrtimer.c:1749
 hrtimer_interrupt+0x3b3/0x1040 kernel/time/hrtimer.c:1811
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1086 [inline]
 __sysvec_apic_timer_interrupt+0xf9/0x270 arch/x86/kernel/apic/apic.c:1103
 sysvec_apic_timer_interrupt+0x8c/0xb0 arch/x86/kernel/apic/apic.c:1097
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x12/0x20
RIP: 0010:__sanitizer_cov_trace_pc+0x42/0x60 kernel/kcov.c:205
Code: ff 00 74 11 f7 c2 00 01 00 00 74 35 83 b9 a4 15 00 00 00 74 2c 8b 91 80 15 00 00 83 fa 02 75 21 48 8b 91 88 15 00 00 48 8b 32 <48> 8d 7e 01 8b 89 84 15 00 00 48 39 cf 73 08 48 89 44 f2 08 48 89
RSP: 0018:ffffc90002c2ef18 EFLAGS: 00000246
RAX: ffffffff8179f1fa RBX: 1ffff11017367f3d RCX: ffff88801f84d700
RDX: ffffc90002d11000 RSI: 000000000003ffff RDI: 0000000000040000
RBP: ffffc90002c2f060 R08: ffffffff8179f1c2 R09: ffffffff8447f6b0
R10: 0000000000000009 R11: ffff88801f84d700 R12: 0000000000000001
R13: ffff8880b9b3f9e8 R14: ffff8880b9a3a840 R15: dffffc0000000000
 csd_lock_wait kernel/smp.c:440 [inline]
 smp_call_function_many_cond+0xc3a/0xe10 kernel/smp.c:969
 on_each_cpu_cond_mask+0x3b/0x80 kernel/smp.c:1135
 __purge_vmap_area_lazy+0x2bf/0x18e0 mm/vmalloc.c:1689
 _vm_unmap_aliases+0x474/0x500 mm/vmalloc.c:2113
 change_page_attr_set_clr+0x2ae/0x6a0 arch/x86/mm/pat/set_memory.c:1743
 change_page_attr_clear arch/x86/mm/pat/set_memory.c:1800 [inline]
 set_memory_ro+0xa4/0xe0 arch/x86/mm/pat/set_memory.c:1946
 bpf_jit_binary_lock_ro include/linux/filter.h:889 [inline]
 bpf_int_jit_compile+0xa89e/0xae70 arch/x86/net/bpf_jit_comp.c:2382
 bpf_prog_select_runtime+0x6de/0x9f0 kernel/bpf/core.c:1931
 bpf_prog_load kernel/bpf/syscall.c:2348 [inline]
 __sys_bpf+0x1187d/0x12db0 kernel/bpf/syscall.c:4634
 __do_sys_bpf kernel/bpf/syscall.c:4738 [inline]
 __se_sys_bpf kernel/bpf/syscall.c:4736 [inline]
 __x64_sys_bpf+0x78/0x90 kernel/bpf/syscall.c:4736
 do_syscall_x64 arch/x86/entry/common.c:50 [inline]
 do_syscall_64+0x44/0xd0 arch/x86/entry/common.c:80
 entry_SYSCALL_64_after_hwframe+0x44/0xae
RIP: 0033:0x7faf4f263059
Code: ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 b8 ff ff ff f7 d8 64 89 01 48
RSP: 002b:00007faf4dbd8168 EFLAGS: 00000246 ORIG_RAX: 0000000000000141
RAX: ffffffffffffffda RBX: 00007faf4f375f60 RCX: 00007faf4f263059
RDX: 0000000000000048 RSI: 0000000020000200 RDI: 0000000000000005
RBP: 00007faf4f2bd08d R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
R13: 00007fff5ef459bf R14: 00007faf4dbd8300 R15: 0000000000022000
 </TASK>
----------------
Code disassembly (best guess):
   0:	0f af c6             	imul   %esi,%eax
   3:	48 c1 e8 30          	shr    $0x30,%rax
   7:	48 8d 1c c5 20 db ae 	lea    -0x705124e0(,%rax,8),%rbx
   e:	8f
   f:	48 89 d8             	mov    %rbx,%rax
  12:	48 c1 e8 03          	shr    $0x3,%rax
  16:	48 89 44 24 40       	mov    %rax,0x40(%rsp)
  1b:	42 80 3c 20 00       	cmpb   $0x0,(%rax,%r12,1)
  20:	74 08                	je     0x2a
  22:	48 89 df             	mov    %rbx,%rdi
  25:	e8 25 8b 69 00       	callq  0x698b4f
* 2a:	48 89 5c 24 20       	mov    %rbx,0x20(%rsp) <-- trapping instruction
  2f:	48 8b 1b             	mov    (%rbx),%rbx
  32:	48 85 db             	test   %rbx,%rbx
  35:	74 62                	je     0x99
  37:	48 83 c3 f8          	add    $0xfffffffffffffff8,%rbx
  3b:	75 15                	jne    0x52
  3d:	eb 5a                	jmp    0x99
  3f:	48                   	rex.W

Crashes (1):
Manager Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets Title
ci-upstream-kasan-gce-smack-root 2022/02/12 02:45 upstream 1d41d2e82623 8b9ca619 .config console log report info INFO: rcu detected stall in sys_newfstatat
* Struck through repros no longer work on HEAD.