INFO: rcu detected stall in schedule_timeout (3)

Status: closed as invalid on 2020/01/09 08:13
Subsystems: cgroups mm
[Documentation on labels]
First crash: 2390d, last: 2389d
▶ ▼ Similar bugs (10)
Kernel Title Rank 🛈 Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: rcu detected stall in schedule_timeout (7) prio:low kernel 1 C error error 49 5h20m 623d 0/29 upstream: reported C repro on 2024/11/09 08:24
linux-6.1 INFO: rcu detected stall in schedule_timeout (2) origin:lts-only 1 C inconclusive 6 68d 325d 0/3 upstream: reported C repro on 2025/09/02 23:57
upstream INFO: rcu detected stall in schedule_timeout (2) kernel 1 2 2390d 2390d 0/29 closed as invalid on 2020/01/08 05:23
upstream INFO: rcu detected stall in schedule_timeout (4) kernel 1 1 1095d 1095d 0/29 closed as invalid on 2023/09/01 06:44
linux-6.1 INFO: rcu detected stall in schedule_timeout 1 28 763d 828d 0/3 auto-obsoleted due to no activity on 2024/08/31 04:44
upstream INFO: rcu detected stall in schedule_timeout (5) kernel 1 2 1000d 1036d 0/29 auto-obsoleted due to no activity on 2024/01/26 16:31
upstream INFO: rcu detected stall in schedule_timeout cgroups mm 1 69 2424d 2426d 0/29 closed as invalid on 2019/12/04 14:14
upstream INFO: rcu detected stall in schedule_timeout (6) usb 1 C done 40 642d 799d 28/29 fixed on 2024/10/22 11:57
linux-5.15 INFO: rcu detected stall in schedule_timeout origin:upstream 1 C inconclusive 13 6d01h 793d 0/3 upstream: reported C repro on 2024/05/22 14:45
linux-6.6 INFO: rcu detected stall in schedule_timeout origin:upstream 1 C error 8 28d 262d 0/2 upstream: reported C repro on 2025/11/04 19:17

Sample crash report:
rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
	(detected by 0, t=10502 jiffies, g=6497, q=72)
rcu: All QSes seen, last rcu_preempt kthread activity 10503 (4294954763-4294944260), jiffies_till_next_fqs=1, root ->qsmask 0x0
rcu_preempt     R  running task    28984    10      2 0x80004008
Call Trace:
 <IRQ>
 sched_show_task+0x40f/0x560 kernel/sched/core.c:5954
 print_other_cpu_stall kernel/rcu/tree_stall.h:410 [inline]
 check_cpu_stall kernel/rcu/tree_stall.h:538 [inline]
 rcu_pending kernel/rcu/tree.c:2827 [inline]
 rcu_sched_clock_irq+0x1861/0x1ad0 kernel/rcu/tree.c:2271
 update_process_times+0x12d/0x180 kernel/time/timer.c:1726
 tick_sched_handle kernel/time/tick-sched.c:167 [inline]
 tick_sched_timer+0x263/0x420 kernel/time/tick-sched.c:1310
 __run_hrtimer kernel/time/hrtimer.c:1517 [inline]
 __hrtimer_run_queues+0x403/0x840 kernel/time/hrtimer.c:1579
 hrtimer_interrupt+0x38c/0xda0 kernel/time/hrtimer.c:1641
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1110 [inline]
 smp_apic_timer_interrupt+0x109/0x280 arch/x86/kernel/apic/apic.c:1135
 apic_timer_interrupt+0xf/0x20 arch/x86/entry/entry_64.S:829
 </IRQ>
RIP: 0010:__memcg_kmem_uncharge+0xc/0x1a0 mm/memcontrol.c:2908
Code: 48 81 c3 08 02 00 00 48 89 df 4c 89 f6 e8 8c 85 ff ff 5b 41 5e 5d c3 0f 1f 80 00 00 00 00 55 48 89 e5 41 57 41 56 41 55 41 54 <53> 50 89 f3 49 89 fc 48 b8 00 00 00 00 00 fc ff df 4c 8d 77 38 4d
RSP: 0018:ffffc90000d0fc18 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
RAX: ffffffff81489244 RBX: ffffea00024bfb40 RCX: ffff8880a99ec280
RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffea00024bfb40
RBP: ffffc90000d0fc38 R08: 000000000003a728 R09: ffffed1012ce8e99
R10: ffffed1012ce8e99 R11: 0000000000000000 R12: ffff88809bf5dfa0
R13: dffffc0000000000 R14: 1ffff110137ebbf4 R15: ffff8880967474b8
 memcg_kmem_uncharge include/linux/memcontrol.h:1402 [inline]
 free_thread_stack+0x12e/0x590 kernel/fork.c:284
 release_task_stack kernel/fork.c:440 [inline]
 put_task_stack+0xa3/0x130 kernel/fork.c:451
 finish_task_switch+0x3f1/0x550 kernel/sched/core.c:3256
 context_switch kernel/sched/core.c:3388 [inline]
 __schedule+0x9a8/0xcc0 kernel/sched/core.c:4081
 schedule+0x181/0x210 kernel/sched/core.c:4155
 schedule_timeout+0x14f/0x240 kernel/time/timer.c:1895
 rcu_gp_fqs_loop kernel/rcu/tree.c:1661 [inline]
 rcu_gp_kthread+0xed8/0x1770 kernel/rcu/tree.c:1821
 kthread+0x332/0x350 kernel/kthread.c:255
 ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:352
rcu: rcu_preempt kthread starved for 10525 jiffies! g6497 f0x2 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=0
rcu: RCU grace-period kthread stack dump:
rcu_preempt     R  running task    28984    10      2 0x80004008
Call Trace:
 <IRQ>
 sched_show_task+0x40f/0x560 kernel/sched/core.c:5954
 rcu_check_gp_kthread_starvation+0x170/0x1b0 kernel/rcu/tree_stall.h:348
 print_other_cpu_stall kernel/rcu/tree_stall.h:418 [inline]
 check_cpu_stall kernel/rcu/tree_stall.h:538 [inline]
 rcu_pending kernel/rcu/tree.c:2827 [inline]
 rcu_sched_clock_irq+0x17d3/0x1ad0 kernel/rcu/tree.c:2271
 update_process_times+0x12d/0x180 kernel/time/timer.c:1726
 tick_sched_handle kernel/time/tick-sched.c:167 [inline]
 tick_sched_timer+0x263/0x420 kernel/time/tick-sched.c:1310
 __run_hrtimer kernel/time/hrtimer.c:1517 [inline]
 __hrtimer_run_queues+0x403/0x840 kernel/time/hrtimer.c:1579
 hrtimer_interrupt+0x38c/0xda0 kernel/time/hrtimer.c:1641
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1110 [inline]
 smp_apic_timer_interrupt+0x109/0x280 arch/x86/kernel/apic/apic.c:1135
 apic_timer_interrupt+0xf/0x20 arch/x86/entry/entry_64.S:829
 </IRQ>
RIP: 0010:__memcg_kmem_uncharge+0xc/0x1a0 mm/memcontrol.c:2908
Code: 48 81 c3 08 02 00 00 48 89 df 4c 89 f6 e8 8c 85 ff ff 5b 41 5e 5d c3 0f 1f 80 00 00 00 00 55 48 89 e5 41 57 41 56 41 55 41 54 <53> 50 89 f3 49 89 fc 48 b8 00 00 00 00 00 fc ff df 4c 8d 77 38 4d
RSP: 0018:ffffc90000d0fc18 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
RAX: ffffffff81489244 RBX: ffffea00024bfb40 RCX: ffff8880a99ec280
RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffea00024bfb40
RBP: ffffc90000d0fc38 R08: 000000000003a728 R09: ffffed1012ce8e99
R10: ffffed1012ce8e99 R11: 0000000000000000 R12: ffff88809bf5dfa0
R13: dffffc0000000000 R14: 1ffff110137ebbf4 R15: ffff8880967474b8
 memcg_kmem_uncharge include/linux/memcontrol.h:1402 [inline]
 free_thread_stack+0x12e/0x590 kernel/fork.c:284
 release_task_stack kernel/fork.c:440 [inline]
 put_task_stack+0xa3/0x130 kernel/fork.c:451
 finish_task_switch+0x3f1/0x550 kernel/sched/core.c:3256
 context_switch kernel/sched/core.c:3388 [inline]
 __schedule+0x9a8/0xcc0 kernel/sched/core.c:4081
 schedule+0x181/0x210 kernel/sched/core.c:4155
 schedule_timeout+0x14f/0x240 kernel/time/timer.c:1895
 rcu_gp_fqs_loop kernel/rcu/tree.c:1661 [inline]
 rcu_gp_kthread+0xed8/0x1770 kernel/rcu/tree.c:1821
 kthread+0x332/0x350 kernel/kthread.c:255
 ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:352

Crashes (11):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2020/01/08 12:45 upstream ae6088216ce4 6738e0b3 .config console log report ci-upstream-kasan-gce-smack-root
2020/01/08 12:07 upstream ae6088216ce4 6738e0b3 .config console log report ci-upstream-kasan-gce-smack-root
2020/01/08 11:31 upstream ae6088216ce4 6738e0b3 .config console log report ci-upstream-kasan-gce-smack-root
2020/01/08 10:30 upstream ae6088216ce4 6738e0b3 .config console log report ci-upstream-kasan-gce-smack-root
2020/01/08 09:28 upstream ae6088216ce4 6738e0b3 .config console log report ci-upstream-kasan-gce-smack-root
2020/01/08 08:44 upstream ae6088216ce4 6738e0b3 .config console log report ci-upstream-kasan-gce-smack-root
2020/01/08 08:27 upstream ae6088216ce4 6738e0b3 .config console log report ci-upstream-kasan-gce-smack-root
2020/01/08 07:32 upstream ae6088216ce4 6738e0b3 .config console log report ci-upstream-kasan-gce-smack-root
2020/01/08 06:37 upstream ae6088216ce4 6738e0b3 .config console log report ci-upstream-kasan-gce-smack-root
2020/01/08 05:50 upstream ae6088216ce4 6738e0b3 .config console log report ci-upstream-kasan-gce-smack-root
2020/01/08 05:45 upstream ae6088216ce4 6738e0b3 .config console log report ci-upstream-kasan-gce-smack-root
* Struck through repros no longer work on HEAD.