syzbot


INFO: rcu detected stall in sys_newfstatat

Status: upstream: reported on 2024/04/08 00:26
Reported-by: syzbot+b4da8777e5518ae24a0d@syzkaller.appspotmail.com
First crash: 162d, last: 16d
Similar bugs (5)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: rcu detected stall in sys_newfstatat (4) fs C error 38 1d12h 693d 0/28 upstream: reported C repro on 2022/10/25 00:38
linux-6.1 INFO: rcu detected stall in sys_newfstatat origin:upstream C 6 24d 457d 0/3 upstream: reported C repro on 2023/06/18 16:04
upstream INFO: rcu detected stall in sys_newfstatat cgroups mm 1 1749d 1749d 0/28 closed as invalid on 2019/12/04 14:04
upstream INFO: rcu detected stall in sys_newfstatat (2) kernfs 1 948d 948d 0/28 auto-closed as invalid on 2022/05/13 02:53
upstream INFO: rcu detected stall in sys_newfstatat (3) tomoyo 1 835d 835d 0/28 auto-closed as invalid on 2022/09/03 09:55

Sample crash report:
rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
rcu: 	1-...!: (1 ticks this GP) idle=d31/1/0x4000000000000000 softirq=27586/27586 fqs=0 
	(detected by 0, t=10506 jiffies, g=34361, q=97)
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 4476 Comm: syz-executor Not tainted 5.15.164-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 06/27/2024
RIP: 0010:lockdep_enabled kernel/locking/lockdep.c:85 [inline]
RIP: 0010:lock_release+0xd1/0x9a0 kernel/locking/lockdep.c:5636
Code: 00 89 d8 48 0f a3 05 16 79 86 0c 73 0d e8 17 45 08 00 84 c0 0f 84 d8 05 00 00 48 c7 c0 c4 7f e9 8d 48 c1 e8 03 42 0f b6 04 38 <84> c0 0f 85 e0 05 00 00 83 3d 84 ac 86 0c 00 0f 84 3e 05 00 00 65
RSP: 0018:ffffc90000dd0b60 EFLAGS: 00000803
RAX: 0000000000000000 RBX: 0000000000000001 RCX: ffffffff8162d308
RDX: 0000000000000000 RSI: ffffffff8ad8f7e0 RDI: ffffffff8ad8f7a0
RBP: ffffc90000dd0ca0 R08: dffffc0000000000 R09: fffffbfff1bd2986
R10: 0000000000000000 R11: dffffc0000000001 R12: 1ffff920001ba178
R13: ffffffff888109db R14: dffffc0000000000 R15: dffffc0000000000
FS:  000055555657e500(0000) GS:ffff8880b9b00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00005555565a1608 CR3: 000000001ff0e000 CR4: 00000000003506e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <NMI>
 </NMI>
 <IRQ>
 __raw_spin_unlock include/linux/spinlock_api_smp.h:150 [inline]
 _raw_spin_unlock+0x12/0x40 kernel/locking/spinlock.c:186
 spin_unlock include/linux/spinlock.h:403 [inline]
 advance_sched+0x68b/0x940 net/sched/sch_taprio.c:765
 __run_hrtimer kernel/time/hrtimer.c:1686 [inline]
 __hrtimer_run_queues+0x598/0xcf0 kernel/time/hrtimer.c:1750
 hrtimer_interrupt+0x392/0x980 kernel/time/hrtimer.c:1812
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1085 [inline]
 __sysvec_apic_timer_interrupt+0x139/0x470 arch/x86/kernel/apic/apic.c:1102
 sysvec_apic_timer_interrupt+0x8c/0xb0 arch/x86/kernel/apic/apic.c:1096
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:638
RIP: 0010:__unwind_start+0x64/0x720 arch/x86/kernel/unwind_orc.c:635
Code: 89 ef 49 c1 ef 03 41 80 3c 2f 00 74 12 4c 89 ef e8 d1 8c 91 00 48 ba 00 00 00 00 00 fc ff df 49 89 5d 00 80 3d 1d 86 02 0b 01 <75> 2e 65 48 8b 05 b2 c6 c9 7e 48 39 d8 74 64 48 8d 6b 34 48 89 e8
RSP: 0018:ffffc900032274c0 EFLAGS: 00000246
RAX: ffffc90003227520 RBX: ffff8880133dbb80 RCX: 0000000000000000
RDX: dffffc0000000000 RSI: 0000000000000000 RDI: ffffc90003227580
RBP: dffffc0000000000 R08: dffffc0000000000 R09: ffffc90003227520
R10: 0000000000000000 R11: dffffc0000000001 R12: 0000000000000000
R13: ffffc90003227548 R14: ffffc90003227520 R15: 1ffff92000644ea9
 unwind_start arch/x86/include/asm/unwind.h:60 [inline]
 arch_stack_walk+0xdb/0x140 arch/x86/kernel/stacktrace.c:24
 stack_trace_save+0x113/0x1c0 kernel/stacktrace.c:122
 kasan_save_stack mm/kasan/common.c:38 [inline]
 kasan_set_track+0x4b/0x80 mm/kasan/common.c:46
 kasan_set_free_info+0x1f/0x40 mm/kasan/generic.c:360
 ____kasan_slab_free+0xd8/0x120 mm/kasan/common.c:366
 kasan_slab_free include/linux/kasan.h:230 [inline]
 slab_free_hook mm/slub.c:1705 [inline]
 slab_free_freelist_hook+0xdd/0x160 mm/slub.c:1731
 slab_free mm/slub.c:3499 [inline]
 kfree+0xf1/0x270 mm/slub.c:4559
 tomoyo_path_perm+0x555/0x6b0 security/tomoyo/file.c:842
 security_inode_getattr+0xcf/0x120 security/security.c:1348
 vfs_getattr+0x26/0x360 fs/stat.c:157
 vfs_statx+0x18f/0x3b0 fs/stat.c:225
 vfs_fstatat fs/stat.c:243 [inline]
 __do_sys_newfstatat fs/stat.c:411 [inline]
 __se_sys_newfstatat fs/stat.c:405 [inline]
 __x64_sys_newfstatat+0x12c/0x1b0 fs/stat.c:405
 do_syscall_x64 arch/x86/entry/common.c:50 [inline]
 do_syscall_64+0x3b/0xb0 arch/x86/entry/common.c:80
 entry_SYSCALL_64_after_hwframe+0x66/0xd0
RIP: 0033:0x7f924688220a
Code: 48 89 f2 b9 00 01 00 00 48 89 fe bf 9c ff ff ff e9 0b 00 00 00 66 2e 0f 1f 84 00 00 00 00 00 90 41 89 ca b8 06 01 00 00 0f 05 <3d> 00 f0 ff ff 77 07 31 c0 c3 0f 1f 40 00 48 c7 c2 a8 ff ff ff f7
RSP: 002b:00007ffdeea1b5a8 EFLAGS: 00000286 ORIG_RAX: 0000000000000106
RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f924688220a
RDX: 00007ffdeea1b5d0 RSI: 00007ffdeea1b660 RDI: 00000000ffffff9c
RBP: 00007ffdeea1b660 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000100 R11: 0000000000000286 R12: 00007ffdeea1c6e0
R13: 00007f92468f178c R14: 00000000000456d6 R15: 00007ffdeea1c720
 </TASK>
rcu: rcu_preempt kthread timer wakeup didn't happen for 10505 jiffies! g34361 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402
rcu: 	Possible timer handling issue on cpu=1 timer-softirq=15133
rcu: rcu_preempt kthread starved for 10506 jiffies! g34361 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=1
rcu: 	Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
rcu: RCU grace-period kthread stack dump:
task:rcu_preempt     state:I stack:26432 pid:   15 ppid:     2 flags:0x00004000
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5030 [inline]
 __schedule+0x12c4/0x45b0 kernel/sched/core.c:6376
 schedule+0x11b/0x1f0 kernel/sched/core.c:6459
 schedule_timeout+0x1b9/0x300 kernel/time/timer.c:1914
 rcu_gp_fqs_loop+0x2bf/0x1080 kernel/rcu/tree.c:1972
 rcu_gp_kthread+0xa4/0x360 kernel/rcu/tree.c:2145
 kthread+0x3f6/0x4f0 kernel/kthread.c:334
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:287
 </TASK>
rcu: Stack dump where RCU GP kthread last ran:
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 4476 Comm: syz-executor Not tainted 5.15.164-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 06/27/2024
RIP: 0010:lock_release+0x6d/0x9a0 kernel/locking/lockdep.c:5631
Code: 41 48 c7 44 24 68 94 d8 19 8c 48 c7 44 24 70 60 d2 62 81 4c 8d 64 24 60 49 c1 ec 03 48 b8 f1 f1 f1 f1 04 f2 00 f2 4b 89 04 3c <48> b8 f2 f2 00 f3 f3 f3 f3 f3 4b 89 44 3c 08 0f 1f 44 00 00 65 8b
RSP: 0018:ffffc90000dd0b80 EFLAGS: 00000802
RAX: f200f204f1f1f1f1 RBX: 0000000000000001 RCX: ffff8880133dbb80
RDX: 0000000080010000 RSI: ffffffff88810195 RDI: ffffffff8c91fb20
RBP: ffffc90000dd0cb0 R08: ffffffff88810ab0 R09: ffffed100ed83d32
R10: 0000000000000000 R11: dffffc0000000001 R12: 1ffff920001ba17c
R13: ffffffff88810195 R14: dffffc0000000000 R15: dffffc0000000000
FS:  000055555657e500(0000) GS:ffff8880b9b00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00005555565a1608 CR3: 000000001ff0e000 CR4: 00000000003506e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <NMI>
 </NMI>
 <IRQ>
 rcu_read_unlock include/linux/rcupdate.h:772 [inline]
 advance_sched+0x7d4/0x940 net/sched/sch_taprio.c:771
 __run_hrtimer kernel/time/hrtimer.c:1686 [inline]
 __hrtimer_run_queues+0x598/0xcf0 kernel/time/hrtimer.c:1750
 hrtimer_interrupt+0x392/0x980 kernel/time/hrtimer.c:1812
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1085 [inline]
 __sysvec_apic_timer_interrupt+0x139/0x470 arch/x86/kernel/apic/apic.c:1102
 sysvec_apic_timer_interrupt+0x8c/0xb0 arch/x86/kernel/apic/apic.c:1096
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:638
RIP: 0010:__unwind_start+0x64/0x720 arch/x86/kernel/unwind_orc.c:635
Code: 89 ef 49 c1 ef 03 41 80 3c 2f 00 74 12 4c 89 ef e8 d1 8c 91 00 48 ba 00 00 00 00 00 fc ff df 49 89 5d 00 80 3d 1d 86 02 0b 01 <75> 2e 65 48 8b 05 b2 c6 c9 7e 48 39 d8 74 64 48 8d 6b 34 48 89 e8
RSP: 0018:ffffc900032274c0 EFLAGS: 00000246
RAX: ffffc90003227520 RBX: ffff8880133dbb80 RCX: 0000000000000000
RDX: dffffc0000000000 RSI: 0000000000000000 RDI: ffffc90003227580
RBP: dffffc0000000000 R08: dffffc0000000000 R09: ffffc90003227520
R10: 0000000000000000 R11: dffffc0000000001 R12: 0000000000000000
R13: ffffc90003227548 R14: ffffc90003227520 R15: 1ffff92000644ea9
 unwind_start arch/x86/include/asm/unwind.h:60 [inline]
 arch_stack_walk+0xdb/0x140 arch/x86/kernel/stacktrace.c:24
 stack_trace_save+0x113/0x1c0 kernel/stacktrace.c:122
 kasan_save_stack mm/kasan/common.c:38 [inline]
 kasan_set_track+0x4b/0x80 mm/kasan/common.c:46
 kasan_set_free_info+0x1f/0x40 mm/kasan/generic.c:360
 ____kasan_slab_free+0xd8/0x120 mm/kasan/common.c:366
 kasan_slab_free include/linux/kasan.h:230 [inline]
 slab_free_hook mm/slub.c:1705 [inline]
 slab_free_freelist_hook+0xdd/0x160 mm/slub.c:1731
 slab_free mm/slub.c:3499 [inline]
 kfree+0xf1/0x270 mm/slub.c:4559
 tomoyo_path_perm+0x555/0x6b0 security/tomoyo/file.c:842
 security_inode_getattr+0xcf/0x120 security/security.c:1348
 vfs_getattr+0x26/0x360 fs/stat.c:157
 vfs_statx+0x18f/0x3b0 fs/stat.c:225
 vfs_fstatat fs/stat.c:243 [inline]
 __do_sys_newfstatat fs/stat.c:411 [inline]
 __se_sys_newfstatat fs/stat.c:405 [inline]
 __x64_sys_newfstatat+0x12c/0x1b0 fs/stat.c:405
 do_syscall_x64 arch/x86/entry/common.c:50 [inline]
 do_syscall_64+0x3b/0xb0 arch/x86/entry/common.c:80
 entry_SYSCALL_64_after_hwframe+0x66/0xd0
RIP: 0033:0x7f924688220a
Code: 48 89 f2 b9 00 01 00 00 48 89 fe bf 9c ff ff ff e9 0b 00 00 00 66 2e 0f 1f 84 00 00 00 00 00 90 41 89 ca b8 06 01 00 00 0f 05 <3d> 00 f0 ff ff 77 07 31 c0 c3 0f 1f 40 00 48 c7 c2 a8 ff ff ff f7
RSP: 002b:00007ffdeea1b5a8 EFLAGS: 00000286 ORIG_RAX: 0000000000000106
RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f924688220a
RDX: 00007ffdeea1b5d0 RSI: 00007ffdeea1b660 RDI: 00000000ffffff9c
RBP: 00007ffdeea1b660 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000100 R11: 0000000000000286 R12: 00007ffdeea1c6e0
R13: 00007f92468f178c R14: 00000000000456d6 R15: 00007ffdeea1c720
 </TASK>

Crashes (10):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2024/08/13 05:05 linux-5.15.y 7e89efd3ae1c 7b0f4b46 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in sys_newfstatat
2024/07/26 07:21 linux-5.15.y 7c6d66f0266f 3f86dfed .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in sys_newfstatat
2024/07/13 04:24 linux-5.15.y f45bea23c39c eaeb5c15 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in sys_newfstatat
2024/06/24 23:15 linux-5.15.y 4878aadf2d15 215eef4a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in sys_newfstatat
2024/06/23 03:45 linux-5.15.y 4878aadf2d15 edc5149a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in sys_newfstatat
2024/06/21 18:22 linux-5.15.y 4878aadf2d15 edc5149a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in sys_newfstatat
2024/06/17 01:10 linux-5.15.y 4878aadf2d15 f429ab00 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in sys_newfstatat
2024/04/18 04:52 linux-5.15.y c52b9710c83d acc528cb .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in sys_newfstatat
2024/04/08 00:25 linux-5.15.y 9465fef4ae35 ca620dd8 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in sys_newfstatat
2024/09/01 07:17 linux-5.15.y fa93fa65db6e 1eda0d14 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan-arm64 INFO: rcu detected stall in sys_newfstatat
* Struck through repros no longer work on HEAD.