syzbot


INFO: rcu detected stall in rt_sigreturn

Status: upstream: reported C repro on 2023/09/10 03:48
Bug presence: origin:upstream
Labels: missing-backport
[Documentation on labels]
Reported-by: syzbot+0ca35102d68b60f5d4a0@syzkaller.appspotmail.com
First crash: 473d, last: 5h31m
Fix commit to backport (bisect log) :
tree: upstream
commit 5f6bd380c7bdbe10f7b4e8ddcceed60ce0714c6d
Author: Peter Zijlstra <peterz@infradead.org>
Date: Mon May 27 12:06:55 2024 +0000

  sched/rt: Remove default bandwidth control

  
Fix bisection: the issue occurs on the latest tested release (bisect log)
Crash: INFO: rcu detected stall in syscall_exit_to_user_mode (log)
Repro: C syz .config
  
Bug presence (3)
Date Name Commit Repro Result
2024/10/27 linux-5.15.y (ToT) 74cdd62cb470 C [report] INFO: rcu detected stall in getpid
2023/09/10 upstream (ToT) 535a265d7f0d C [report] INFO: rcu detected stall in corrupted
2024/10/27 upstream (ToT) 850925a8133c C Didn't crash
Similar bugs (1)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: rcu detected stall in rt_sigreturn kernel C error done 3 115d 244d 0/28 auto-obsoleted due to no activity on 2024/12/10 16:21
Last patch testing requests (4)
Created Duration User Patch Repo Result
2024/11/09 01:16 11m retest repro linux-5.15.y report log
2024/11/09 01:16 11m retest repro linux-5.15.y report log
2024/11/09 01:16 11m retest repro linux-5.15.y report log
2024/11/09 01:16 10m retest repro linux-5.15.y report log
Fix bisection attempts (6)
Created Duration User Patch Repo Result
2024/12/01 04:26 5h37m fix candidate upstream OK (1) job log
2024/03/23 13:16 1h30m bisect fix linux-5.15.y OK (0) job log log
2024/02/22 06:25 1h43m bisect fix linux-5.15.y OK (0) job log log
2024/01/12 16:11 2h00m bisect fix linux-5.15.y OK (0) job log log
2023/12/12 10:43 1h13m bisect fix linux-5.15.y OK (0) job log log
2023/10/15 12:37 1h05m bisect fix linux-5.15.y OK (0) job log log

Sample crash report:
rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
	(detected by 1, t=10502 jiffies, g=3385, q=54)
rcu: All QSes seen, last rcu_preempt kthread activity 10501 (4294952190-4294941689), jiffies_till_next_fqs=1, root ->qsmask 0x0
rcu: rcu_preempt kthread starved for 10502 jiffies! g3385 f0x2 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=1
rcu: 	Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
rcu: RCU grace-period kthread stack dump:
task:rcu_preempt     state:R  running task     stack:27352 pid:   15 ppid:     2 flags:0x00004000
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5027 [inline]
 __schedule+0x12c4/0x45b0 kernel/sched/core.c:6373
 schedule+0x11b/0x1f0 kernel/sched/core.c:6456
 schedule_timeout+0x1b9/0x300 kernel/time/timer.c:1914
 rcu_gp_fqs_loop+0x2bf/0x1080 kernel/rcu/tree.c:1972
 rcu_gp_kthread+0xa4/0x360 kernel/rcu/tree.c:2145
 kthread+0x3f6/0x4f0 kernel/kthread.c:334
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:287
 </TASK>
rcu: Stack dump where RCU GP kthread last ran:
NMI backtrace for cpu 1
CPU: 1 PID: 3591 Comm: syz-executor391 Not tainted 5.15.167-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 09/13/2024
Call Trace:
 <IRQ>
 __dump_stack lib/dump_stack.c:88 [inline]
 dump_stack_lvl+0x1e3/0x2d0 lib/dump_stack.c:106
 nmi_cpu_backtrace+0x46a/0x4a0 lib/nmi_backtrace.c:111
 nmi_trigger_cpumask_backtrace+0x181/0x2a0 lib/nmi_backtrace.c:62
 trigger_single_cpu_backtrace include/linux/nmi.h:166 [inline]
 rcu_check_gp_kthread_starvation+0x1d2/0x240 kernel/rcu/tree_stall.h:487
 print_other_cpu_stall+0x137a/0x14d0 kernel/rcu/tree_stall.h:592
 check_cpu_stall kernel/rcu/tree_stall.h:745 [inline]
 rcu_pending kernel/rcu/tree.c:3932 [inline]
 rcu_sched_clock_irq+0xa38/0x1150 kernel/rcu/tree.c:2619
 update_process_times+0x196/0x200 kernel/time/timer.c:1818
 tick_sched_handle kernel/time/tick-sched.c:254 [inline]
 tick_sched_timer+0x386/0x550 kernel/time/tick-sched.c:1473
 __run_hrtimer kernel/time/hrtimer.c:1688 [inline]
 __hrtimer_run_queues+0x55b/0xcf0 kernel/time/hrtimer.c:1752
 hrtimer_interrupt+0x392/0x980 kernel/time/hrtimer.c:1814
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1085 [inline]
 __sysvec_apic_timer_interrupt+0x139/0x470 arch/x86/kernel/apic/apic.c:1102
 sysvec_apic_timer_interrupt+0x8c/0xb0 arch/x86/kernel/apic/apic.c:1096
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:638
RIP: 0010:debug_lockdep_rcu_enabled+0x25/0x30 kernel/rcu/update.c:281
Code: cc cc cc cc cc 31 c0 83 3d ab 0e b5 03 00 74 1d 83 3d 22 41 b5 03 00 74 14 65 48 8b 0d 94 1c ce 75 31 c0 83 b9 ec 0a 00 00 00 <0f> 94 c0 c3 cc cc cc cc cc cc cc 41 56 53 89 fb e8 d6 0d 00 00 41
RSP: 0018:ffffc90002e47ad8 EFLAGS: 00000246
RAX: 0000000000000000 RBX: ffff8880782ad940 RCX: ffff8880782ad940
RDX: 0000000000000000 RSI: ffffffff8a8b3da0 RDI: ffffffff8ad904c0
RBP: ffffc90002e47bf0 R08: ffffffff81b9b96c R09: ffffc90002e47cc0
R10: 0000000000000000 R11: dffffc0000000001 R12: 0000000000000000
R13: ffffc90002e47f58 R14: dffffc0000000000 R15: 1ffff920005c8f64
 ___might_sleep+0xdc/0x6a0 kernel/sched/core.c:9602
 __might_fault+0x6b/0x110 mm/memory.c:5324
 _copy_from_user+0x28/0x170 lib/usercopy.c:14
 copy_from_user include/linux/uaccess.h:192 [inline]
 restore_sigcontext+0xce/0x710 arch/x86/kernel/signal.c:91
 __do_sys_rt_sigreturn+0x190/0x250 arch/x86/kernel/signal.c:674
 do_syscall_x64 arch/x86/entry/common.c:50 [inline]
 do_syscall_64+0x3b/0xb0 arch/x86/entry/common.c:80
 entry_SYSCALL_64_after_hwframe+0x66/0xd0
RIP: 0033:0x7fe85427beb9
Code: 64 c7 00 16 00 00 00 b8 ff ff ff ff c3 0f 1f 40 00 90 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 c7 c0 0f 00 00 00 0f 05 <0f> 1f 80 00 00 00 00 48 81 ec 48 01 00 00 49 89 d0 64 48 8b 04 25
RSP: 002b:00007fff4f699700 EFLAGS: 00000206 ORIG_RAX: 000000000000000f
RAX: ffffffffffffffda RBX: 0000000000000003 RCX: 00007fe85427beb9
RDX: 00007fff4f699700 RSI: 00007fff4f699830 RDI: 0000000000000021
RBP: 0000000000000000 R08: 00007fe854224990 R09: 00007fe854224990
R10: 0000000000000000 R11: 0000000000000206 R12: 00007fe8542c231c
R13: 00007fe8542bc106 R14: 00007fff4f699ce0 R15: 0000000000000000
 </TASK>

Crashes (67):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2024/09/30 08:44 linux-5.15.y 3a5928702e71 ba29ff75 .config console log report syz / log C [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/06/22 09:53 linux-5.15.y 4878aadf2d15 edc5149a .config console log report syz / log C [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/05/17 09:36 linux-5.15.y 284087d4f7d5 c2e07261 .config console log report syz C [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/04/14 17:32 linux-5.15.y fa3df276cd36 c8349e48 .config console log report syz C [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2023/09/10 03:48 linux-5.15.y aff03380bda4 6654cf89 .config console log report syz C [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/12/26 07:36 linux-5.15.y 91786f140358 444551c4 .config console log report syz / log [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/12/14 18:36 linux-5.15.y 0a51d2d4527b 7cbfbb3a .config console log report syz / log [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/11/30 11:49 linux-5.15.y 0a51d2d4527b 68914665 .config console log report syz / log [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/11/29 13:49 linux-5.15.y 0a51d2d4527b 5df23865 .config console log report syz / log [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/12/09 17:35 linux-5.15.y 0a51d2d4527b 9ac0fdc6 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/12/07 02:39 linux-5.15.y 0a51d2d4527b 9ac0fdc6 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/11/17 06:16 linux-5.15.y d98fd109f827 cfe3a04a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/11/14 20:13 linux-5.15.y d98fd109f827 a8c99394 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/10/25 21:32 linux-5.15.y 74cdd62cb470 045e728d .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/10/25 19:02 linux-5.15.y 74cdd62cb470 045e728d .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/10/14 08:09 linux-5.15.y 3a5928702e71 084d8178 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/10/11 15:33 linux-5.15.y 3a5928702e71 cd942402 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/10/01 01:52 linux-5.15.y 3a5928702e71 bbd4e0a4 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/09/23 07:04 linux-5.15.y 3a5928702e71 6f888b75 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/09/10 09:53 linux-5.15.y 14e468424d3e 784df80e .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/09/07 19:53 linux-5.15.y 14e468424d3e 9750182a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/09/07 03:55 linux-5.15.y 14e468424d3e 9750182a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/09/02 18:51 linux-5.15.y fa93fa65db6e 1eda0d14 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/09/01 11:33 linux-5.15.y fa93fa65db6e 1eda0d14 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/08/28 05:08 linux-5.15.y fa93fa65db6e 6c853ff9 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/08/26 04:03 linux-5.15.y fa93fa65db6e d7d32352 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/08/23 03:51 linux-5.15.y fa93fa65db6e ce8a9099 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/08/22 06:31 linux-5.15.y fa93fa65db6e ca02180f .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/08/21 06:23 linux-5.15.y fa93fa65db6e 9f0ab3fb .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/08/19 19:57 linux-5.15.y fa93fa65db6e 9f0ab3fb .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/08/19 16:50 linux-5.15.y fa93fa65db6e 9f0ab3fb .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/08/14 19:55 linux-5.15.y 7e89efd3ae1c e6b88e20 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/08/14 11:32 linux-5.15.y 7e89efd3ae1c 07a4d4ad .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/08/14 11:13 linux-5.15.y 7e89efd3ae1c 07a4d4ad .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/08/13 15:02 linux-5.15.y 7e89efd3ae1c f21a18ca .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/08/09 00:11 linux-5.15.y 7e89efd3ae1c 61405512 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/08/05 06:15 linux-5.15.y 7e89efd3ae1c 1786a2a8 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/07/29 16:51 linux-5.15.y 7e89efd3ae1c 5187fc86 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/07/29 03:52 linux-5.15.y 7e89efd3ae1c 46eb10b7 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/07/29 01:30 linux-5.15.y 7e89efd3ae1c 46eb10b7 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/07/27 17:49 linux-5.15.y 7e89efd3ae1c 46eb10b7 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/07/25 16:39 linux-5.15.y 7c6d66f0266f 466a14e5 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/07/16 14:30 linux-5.15.y f45bea23c39c b66b37bd .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/07/11 10:08 linux-5.15.y f45bea23c39c c699c2eb .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/07/04 04:12 linux-5.15.y 4878aadf2d15 f76a75f3 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/07/02 14:58 linux-5.15.y 4878aadf2d15 07f0a0a0 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/07/01 17:42 linux-5.15.y 4878aadf2d15 b294e901 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/07/01 17:31 linux-5.15.y 4878aadf2d15 b294e901 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/06/27 17:21 linux-5.15.y 4878aadf2d15 6ef39602 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/06/22 11:12 linux-5.15.y 4878aadf2d15 edc5149a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/06/21 22:35 linux-5.15.y 4878aadf2d15 edc5149a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/06/21 21:59 linux-5.15.y 4878aadf2d15 edc5149a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/06/19 01:58 linux-5.15.y 4878aadf2d15 639d6cdf .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/06/16 11:33 linux-5.15.y c61bd26ae81a f429ab00 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/06/16 04:39 linux-5.15.y c61bd26ae81a f429ab00 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/06/13 05:04 linux-5.15.y c61bd26ae81a 2aa5052f .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/06/13 00:45 linux-5.15.y c61bd26ae81a f815599d .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/06/06 12:40 linux-5.15.y c61bd26ae81a 121701b6 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/06/03 15:38 linux-5.15.y c61bd26ae81a 0aba2352 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/05/28 00:01 linux-5.15.y c61bd26ae81a f550015e .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/05/24 05:27 linux-5.15.y 83655231580b 8f98448e .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/05/21 07:12 linux-5.15.y 83655231580b 4c0d3ee3 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/05/18 21:58 linux-5.15.y 83655231580b c0f1611a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/05/18 17:53 linux-5.15.y 83655231580b c0f1611a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2024/05/17 02:49 linux-5.15.y 284087d4f7d5 c2e07261 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
2023/11/11 12:48 linux-5.15.y 80529b4968a8 6d6dbf8a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in rt_sigreturn
* Struck through repros no longer work on HEAD.