syzbot


INFO: rcu detected stall in schedule

Status: upstream: reported on 2024/06/08 09:44
Reported-by: syzbot+3c8de62604f790092d97@syzkaller.appspotmail.com
First crash: 10d, last: 4d13h
Similar bugs (7)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: rcu detected stall in schedule (5) kernel 1 1108d 1108d 0/27 auto-closed as invalid on 2021/09/03 22:50
upstream INFO: rcu detected stall in schedule (4) cgroups mm 2 1623d 1622d 0/27 closed as invalid on 2020/01/09 08:13
upstream INFO: rcu detected stall in schedule (3) mm cgroups 4 1623d 1623d 0/27 closed as invalid on 2020/01/08 05:23
upstream INFO: rcu detected stall in schedule (2) kernel 10 1658d 1659d 0/27 closed as invalid on 2019/12/04 14:04
upstream INFO: rcu detected stall in schedule (7) usb C done 11 1d05h 21d 0/27 upstream: reported C repro on 2024/05/27 15:00
upstream INFO: rcu detected stall in schedule kernel 1 2002d 1997d 0/27 auto-closed as invalid on 2019/06/23 09:16
upstream INFO: rcu detected stall in schedule (6) kernel syz done 1 309d 306d 0/27 auto-obsoleted due to no activity on 2023/11/21 16:15

Sample crash report:
rcu: INFO: rcu_preempt self-detected stall on CPU
rcu: 	1-...!: (10502 ticks this GP) idle=fdfc/1/0x4000000000000000 softirq=76959/76961 fqs=3
	(t=10501 jiffies g=114017 q=48 ncpus=2)
rcu: rcu_preempt kthread starved for 10496 jiffies! g114017 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=0
rcu: 	Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
rcu: RCU grace-period kthread stack dump:
task:rcu_preempt     state:R  running task     stack:26144 pid:16    ppid:2      flags:0x00004000
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5245 [inline]
 __schedule+0x142d/0x4550 kernel/sched/core.c:6558
 schedule+0xbf/0x180 kernel/sched/core.c:6634
 schedule_timeout+0x1b9/0x300 kernel/time/timer.c:1965
 rcu_gp_fqs_loop+0x2d2/0x1150 kernel/rcu/tree.c:1706
 rcu_gp_kthread+0xa3/0x3b0 kernel/rcu/tree.c:1905
 kthread+0x28d/0x320 kernel/kthread.c:376
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:308
 </TASK>
rcu: Stack dump where RCU GP kthread last ran:
Sending NMI from CPU 1 to CPUs 0:
NMI backtrace for cpu 0
CPU: 0 PID: 22879 Comm: syz-executor.2 Not tainted 6.1.93-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 06/07/2024
RIP: 0010:psi_group_change+0x70c/0x12d0 kernel/sched/psi.c:839
Code: fc 48 c7 c7 80 43 ff 8c 4c 89 f6 e8 fe 1f fb 02 44 89 e7 48 8b 34 24 48 ba 00 00 00 00 00 fc ff df e9 2d ff ff ff 49 8d 5f 08 <48> 89 d8 48 c1 e8 03 0f b6 04 10 84 c0 0f 85 d0 05 00 00 80 3b 00
RSP: 0018:ffffc9001420f7c8 EFLAGS: 00000046
RAX: 0000000000000000 RBX: ffff888073d19008 RCX: 0000000000000002
RDX: dffffc0000000000 RSI: ffffe8ffffc856c0 RDI: 0000000000000000
RBP: 1ffffd1ffff90adf R08: ffffe8ffffc856f0 R09: ffffe8ffffc856f4
R10: ffffe8ffffc856f8 R11: ffffe8ffffc856fc R12: ffffe8ffffc856f8
R13: 0000000000000000 R14: 00000000fffffffb R15: ffff888073d19000
FS:  00007f16fed136c0(0000) GS:ffff8880b9800000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f16fe1aaf08 CR3: 000000001b2d8000 CR4: 00000000003506f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000003ef1 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <NMI>
 </NMI>
 <TASK>
 psi_task_switch+0x3a3/0x770 kernel/sched/psi.c:988
 psi_sched_switch kernel/sched/stats.h:199 [inline]
 __schedule+0x2056/0x4550 kernel/sched/core.c:6553
 schedule+0xbf/0x180 kernel/sched/core.c:6634
 futex_wait_queue+0x149/0x1d0 kernel/futex/waitwake.c:355
 futex_wait+0x203/0x5c0 kernel/futex/waitwake.c:656
 do_futex+0x3b5/0x490 kernel/futex/syscalls.c:106
 __do_sys_futex kernel/futex/syscalls.c:183 [inline]
 __se_sys_futex+0x3d7/0x460 kernel/futex/syscalls.c:164
 do_syscall_x64 arch/x86/entry/common.c:51 [inline]
 do_syscall_64+0x3b/0xb0 arch/x86/entry/common.c:81
 entry_SYSCALL_64_after_hwframe+0x68/0xd2
RIP: 0033:0x7f16fe07cea9
Code: 28 00 00 00 75 05 48 83 c4 28 c3 e8 e1 20 00 00 90 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 b0 ff ff ff f7 d8 64 89 01 48
RSP: 002b:00007f16fed13178 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca
RAX: ffffffffffffffda RBX: 00007f16fe1b3f88 RCX: 00007f16fe07cea9
RDX: 0000000000000000 RSI: 0000000000000080 RDI: 00007f16fe1b3f88
RBP: 00007f16fe1b3f80 R08: 00007f16fed136c0 R09: 00007f16fed136c0
R10: 0000000000000000 R11: 0000000000000246 R12: 00007f16fe1b3f8c
R13: 000000000000000b R14: 00007ffdbe2ad220 R15: 00007ffdbe2ad308
 </TASK>
CPU: 1 PID: 21 Comm: ksoftirqd/1 Not tainted 6.1.93-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 06/07/2024
RIP: 0010:finish_task_switch+0x1d3/0x810 kernel/sched/core.c:5124
Code: 2e 0b 00 48 83 c4 08 4c 89 f7 e8 98 30 00 00 e9 8f 04 00 00 4c 89 f7 e8 0b 32 36 09 e8 06 1e 32 00 fb 49 8d bc 24 f8 15 00 00 <48> 89 f8 48 c1 e8 03 49 bd 00 00 00 00 00 fc ff df 42 0f b6 04 28
RSP: 0018:ffffc900001b7aa8 EFLAGS: 00000286
RAX: 91eada32287dde00 RBX: ffff8880b993b748 RCX: ffffffff91c95103
RDX: dffffc0000000000 RSI: ffffffff8aec0240 RDI: ffff88801273b3b8
RBP: ffffc900001b7af0 R08: dffffc0000000000 R09: ffffed1017307541
R10: 0000000000000000 R11: dffffc0000000001 R12: ffff888012739dc0
R13: 1ffff110173276eb R14: ffff8880b983aa00 R15: ffff8880b993b758
FS:  0000000000000000(0000) GS:ffff8880b9900000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007febb211df80 CR3: 000000007bd55000 CR4: 00000000003506e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000003ef1 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <IRQ>
 </IRQ>
 <TASK>
 context_switch kernel/sched/core.c:5248 [inline]
 __schedule+0x1435/0x4550 kernel/sched/core.c:6558
 preempt_schedule_irq+0xf7/0x1c0 kernel/sched/core.c:6870
 irqentry_exit+0x53/0x80 kernel/entry/common.c:439
 asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:653
RIP: 0010:preempt_count_add+0x0/0x180 kernel/sched/core.c:5698
Code: 48 8b 0c 24 80 e1 07 80 c1 03 38 c1 7c 97 48 8b 3c 24 e8 53 b2 83 00 eb 8c e9 f2 fe ff ff 66 2e 0f 1f 84 00 00 00 00 00 66 90 <41> 57 41 56 53 89 fb 48 c7 c0 60 51 c9 91 48 c1 e8 03 49 bf 00 00
RSP: 0018:ffffc900001b7e48 EFLAGS: 00000202
RAX: 0000000000000001 RBX: 1ffff110024e73b8 RCX: ffffffff8a93a8f6
RDX: 0000000000000000 RSI: 0000000000000008 RDI: 0000000000000001
RBP: ffff88801273b528 R08: dffffc0000000000 R09: ffffed10024e73b9
R10: 0000000000000000 R11: dffffc0000000001 R12: ffff888012739dc0
R13: ffffffff8cfcf380 R14: ffff88801273b038 R15: dffffc0000000000
 schedule+0xb8/0x180 kernel/sched/core.c:6633
 smpboot_thread_fn+0x604/0xa30 kernel/smpboot.c:160
 kthread+0x28d/0x320 kernel/kthread.c:376
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:308
 </TASK>

Crashes (3):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2024/06/13 23:08 linux-6.1.y ae9f2a70d69e a9616ff5 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in schedule
2024/06/10 23:38 linux-6.1.y 88690811da69 048c640a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in schedule
2024/06/08 09:43 linux-6.1.y 88690811da69 82c05ab8 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in schedule
* Struck through repros no longer work on HEAD.