syzbot


INFO: rcu detected stall in sys_clone (2)

Status: upstream: reported C repro on 2024/03/27 00:16
Bug presence: origin:upstream
Labels: missing-backport
[Documentation on labels]
Reported-by: syzbot+a871499fe9cf68fa0d04@syzkaller.appspotmail.com
First crash: 192d, last: 51d
Fix commit to backport (bisect log) :
tree: upstream
commit e634134180885574d1fe7aa162777ba41e7fcd5b
Author: Vladimir Oltean <vladimir.oltean@nxp.com>
Date: Mon May 27 15:39:54 2024 +0000

  net/sched: taprio: make q->picos_per_byte available to fill_sched_entry()

  
Fix bisection: the issue occurs on the latest tested release (bisect log)
Crash: INFO: rcu detected stall in newfstatat (log)
Repro: C syz .config
  
Bug presence (3)
Date Name Commit Repro Result
2024/06/05 linux-5.15.y (ToT) c61bd26ae81a C [report] INFO: rcu detected stall in security_file_open
2024/04/20 upstream (ToT) 977b1ef51866 C [report] INFO: rcu detected stall in worker_thread
2024/06/05 upstream (ToT) 32f88d65f01b C Didn't crash
Similar bugs (14)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
linux-5.15 INFO: rcu detected stall in sys_clone 1 303d 303d 0/3 auto-obsoleted due to no activity on 2024/03/15 18:08
linux-6.1 INFO: rcu detected stall in sys_clone 3 450d 522d 0/3 auto-obsoleted due to no activity on 2023/10/20 18:18
upstream INFO: rcu detected stall in sys_clone (2) mm 49 1676d 1793d 0/28 auto-closed as invalid on 2020/06/01 05:26
upstream INFO: rcu detected stall in sys_clone (4) kernel 1 1193d 1193d 0/28 auto-closed as invalid on 2021/09/27 17:49
upstream INFO: rcu detected stall in sys_clone (3) kernel 2 1529d 1551d 0/28 auto-closed as invalid on 2020/10/26 22:48
upstream INFO: rcu detected stall in sys_clone (6) kasan mm 1 863d 863d 0/28 auto-closed as invalid on 2022/08/23 03:28
upstream INFO: rcu detected stall in sys_clone kernel 1 1849d 1849d 13/28 fixed on 2019/10/09 10:54
upstream INFO: rcu detected stall in sys_clone (8) mm C error 71 5h02m 190d 0/28 upstream: reported C repro on 2024/03/29 00:16
linux-4.19 INFO: rcu detected stall in sys_clone 2 1747d 1766d 0/1 auto-closed as invalid on 2020/04/21 05:46
upstream INFO: rcu detected stall in sys_clone (5) kernfs 5 998d 1097d 0/28 closed as invalid on 2022/02/08 10:00
upstream INFO: rcu detected stall in sys_clone (7) fs 1 599d 599d 0/28 auto-obsoleted due to no activity on 2023/05/14 17:18
linux-6.1 INFO: rcu detected stall in sys_clone (2) 7 6d09h 198d 0/3 upstream: reported on 2024/03/20 15:17
android-5-10 BUG: soft lockup in sys_clone 1 88d 88d 0/2 premoderation: reported on 2024/07/08 12:52
android-5-15 BUG: soft lockup in sys_clone origin:lts C 18 24d 167d 0/2 upstream: reported C repro on 2024/04/20 04:17
Fix bisection attempts (2)
Created Duration User Patch Repo Result
2024/09/12 19:45 5h35m fix candidate upstream OK (1) job log
2024/06/03 14:27 1h11m bisect fix linux-5.15.y OK (0) job log log

Sample crash report:
rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
rcu: 	1-...0: (1 GPs behind) idle=d2f/1/0x4000000000000000 softirq=4869/4873 fqs=2100 
	(detected by 0, t=10505 jiffies, g=3637, q=348)
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 3518 Comm: syz-executor155 Not tainted 5.15.156-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 03/27/2024
RIP: 0010:debug_deactivate+0x3/0x1e0 kernel/time/hrtimer.c:480
Code: 43 c9 10 00 0f 0b e9 0b ff ff ff e8 37 c9 10 00 e8 aa fa 90 ff e9 b7 fc ff ff 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 00 55 41 56 <53> 48 89 fb e8 14 c9 10 00 48 89 df 48 c7 c6 20 bc 8c 8a e8 45 de
RSP: 0018:ffffc90000dd0d48 EFLAGS: 00000046
RAX: ffffffff816f6369 RBX: ffff8880b9b2a2c8 RCX: ffff888022c80000
RDX: 0000000000010002 RSI: 0000000000000001 RDI: ffff88807915db40
RBP: ffffc90000dd0eb0 R08: ffffffff816f635c R09: ffff88807915db48
R10: 0000000000000000 R11: dffffc0000000001 R12: ffff8880b9b2a200
R13: ffff8880b9b2a280 R14: ffff88807915db40 R15: dffffc0000000000
FS:  00005555570d4380(0000) GS:ffff8880b9b00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00005555570d4ca8 CR3: 0000000019cb3000 CR4: 00000000003506e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <NMI>
 </NMI>
 <IRQ>
 __run_hrtimer kernel/time/hrtimer.c:1654 [inline]
 __hrtimer_run_queues+0x31d/0xcf0 kernel/time/hrtimer.c:1750
 hrtimer_interrupt+0x392/0x980 kernel/time/hrtimer.c:1812
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1085 [inline]
 __sysvec_apic_timer_interrupt+0x139/0x470 arch/x86/kernel/apic/apic.c:1102
 sysvec_apic_timer_interrupt+0x8c/0xb0 arch/x86/kernel/apic/apic.c:1096
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:638
RIP: 0010:unwind_next_frame+0x14f/0x1fa0
Code: 83 15 00 00 49 8d 6f 35 49 89 ec 49 c1 ec 03 41 0f b6 04 14 84 c0 0f 85 f1 16 00 00 4c 0f be 6d 00 48 8b 44 24 28 80 3c 10 00 <48> 8b 5c 24 08 74 12 48 89 df e8 c2 98 91 00 48 ba 00 00 00 00 00
RSP: 0018:ffffc90002c97488 EFLAGS: 00000246
RAX: 1ffff92000592ebd RBX: 0000000000000000 RCX: ffffffff8a272900
RDX: dffffc0000000000 RSI: ffffc90002c98000 RDI: ffffffff8138883b
RBP: ffffc90002c975d5 R08: dffffc0000000001 R09: ffffc90002c975a0
R10: 0000000000000000 R11: dffffc0000000001 R12: 1ffff92000592eba
R13: 0000000000000000 R14: ffffffff8138a91f R15: ffffc90002c975a0
 __unwind_start+0x59d/0x720 arch/x86/kernel/unwind_orc.c:704
 unwind_start arch/x86/include/asm/unwind.h:60 [inline]
 arch_stack_walk+0xdb/0x140 arch/x86/kernel/stacktrace.c:24
 stack_trace_save+0x113/0x1c0 kernel/stacktrace.c:122
 kasan_save_stack mm/kasan/common.c:38 [inline]
 kasan_set_track mm/kasan/common.c:46 [inline]
 set_alloc_info mm/kasan/common.c:434 [inline]
 ____kasan_kmalloc+0xba/0xf0 mm/kasan/common.c:513
 kasan_kmalloc include/linux/kasan.h:264 [inline]
 __kmalloc+0x168/0x300 mm/slub.c:4407
 kmalloc include/linux/slab.h:596 [inline]
 kzalloc include/linux/slab.h:721 [inline]
 lsm_cred_alloc security/security.c:539 [inline]
 security_prepare_creds+0x48/0x130 security/security.c:1725
 prepare_creds+0x459/0x610 kernel/cred.c:291
 copy_creds+0x149/0xca0 kernel/cred.c:365
 copy_process+0x8a7/0x3ef0 kernel/fork.c:2070
 kernel_clone+0x210/0x960 kernel/fork.c:2604
 __do_sys_clone kernel/fork.c:2721 [inline]
 __se_sys_clone kernel/fork.c:2705 [inline]
 __x64_sys_clone+0x23f/0x290 kernel/fork.c:2705
 do_syscall_x64 arch/x86/entry/common.c:50 [inline]
 do_syscall_64+0x3b/0xb0 arch/x86/entry/common.c:80
 entry_SYSCALL_64_after_hwframe+0x66/0xd0
RIP: 0033:0x7fbc98444e63
Code: 1f 84 00 00 00 00 00 64 48 8b 04 25 10 00 00 00 45 31 c0 31 d2 31 f6 bf 11 00 20 01 4c 8d 90 d0 02 00 00 b8 38 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 35 89 c2 85 c0 75 2c 64 48 8b 04 25 10 00 00
RSP: 002b:00007ffedba542b8 EFLAGS: 00000246 ORIG_RAX: 0000000000000038
RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007fbc98444e63
RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000001200011
RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000010
R10: 00005555570d4650 R11: 0000000000000246 R12: 0000000000000001
R13: 000000000002efa9 R14: 00007ffedba543dc R15: 0000000000000003
 </TASK>
INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.888 msecs

Crashes (7):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2024/04/19 12:17 linux-5.15.y c52b9710c83d af24b050 .config console log report syz C [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in sys_clone
2024/08/05 18:27 linux-5.15.y 7e89efd3ae1c e35c337f .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan-perf INFO: rcu detected stall in sys_clone
2024/07/22 01:39 linux-5.15.y 7c6d66f0266f b88348e9 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan-perf INFO: rcu detected stall in sys_clone
2024/07/10 16:53 linux-5.15.y f45bea23c39c 6f7fa383 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in sys_clone
2024/05/02 20:30 linux-5.15.y 284087d4f7d5 3ba885bc .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in sys_clone
2024/03/27 00:15 linux-5.15.y 9465fef4ae35 454571b6 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in sys_clone
2024/08/14 21:44 linux-5.15.y 7e89efd3ae1c e6b88e20 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan-arm64 INFO: rcu detected stall in sys_clone
* Struck through repros no longer work on HEAD.