syzbot


INFO: rcu detected stall in schedule_timeout

Status: closed as invalid on 2019/12/04 14:14
Subsystems: cgroups mm
[Documentation on labels]
First crash: 1577d, last: 1576d
Similar bugs (4)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: rcu detected stall in schedule_timeout (3) cgroups mm 11 1541d 1541d 0/26 closed as invalid on 2020/01/09 08:13
upstream INFO: rcu detected stall in schedule_timeout (2) kernel 2 1541d 1541d 0/26 closed as invalid on 2020/01/08 05:23
upstream INFO: rcu detected stall in schedule_timeout (4) kernel 1 246d 246d 0/26 closed as invalid on 2023/09/01 06:44
upstream INFO: rcu detected stall in schedule_timeout (5) kernel 2 152d 187d 0/26 auto-obsoleted due to no activity on 2024/01/26 16:31

Sample crash report:
rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
	(detected by 0, t=10502 jiffies, g=6265, q=116)
rcu: All QSes seen, last rcu_preempt kthread activity 10503 (4294953867-4294943364), jiffies_till_next_fqs=1, root ->qsmask 0x0
rcu_preempt     R  running task    29104    10      2 0x80004008
Call Trace:
 <IRQ>
 sched_show_task+0x40f/0x560 kernel/sched/core.c:5954
 print_other_cpu_stall kernel/rcu/tree_stall.h:410 [inline]
 check_cpu_stall kernel/rcu/tree_stall.h:538 [inline]
 rcu_pending kernel/rcu/tree.c:2827 [inline]
 rcu_sched_clock_irq+0x1861/0x1ad0 kernel/rcu/tree.c:2271
 update_process_times+0x12d/0x180 kernel/time/timer.c:1726
 tick_sched_handle kernel/time/tick-sched.c:167 [inline]
 tick_sched_timer+0x263/0x420 kernel/time/tick-sched.c:1310
 __run_hrtimer kernel/time/hrtimer.c:1517 [inline]
 __hrtimer_run_queues+0x403/0x840 kernel/time/hrtimer.c:1579
 hrtimer_interrupt+0x38c/0xda0 kernel/time/hrtimer.c:1641
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1110 [inline]
 smp_apic_timer_interrupt+0x109/0x280 arch/x86/kernel/apic/apic.c:1135
 apic_timer_interrupt+0xf/0x20 arch/x86/entry/entry_64.S:829
 </IRQ>
RIP: 0010:__memcg_kmem_uncharge+0x2e/0x1a0 mm/memcontrol.c:2910
Code: 41 57 41 56 41 55 41 54 53 50 89 f3 49 89 fc 48 b8 00 00 00 00 00 fc ff df 4c 8d 77 38 4d 89 f5 49 c1 ed 03 41 80 7c 05 00 00 <74> 08 4c 89 f7 e8 78 fe fa ff 4d 8b 3e b8 01 00 00 00 89 d9 d3 e0
RSP: 0018:ffffc90000d0fc08 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
RAX: dffffc0000000000 RBX: 0000000000000000 RCX: ffff8880a9de8280
RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffea0002258c80
RBP: ffffc90000d0fc38 R08: 000000000003a728 R09: ffffed101274c697
R10: ffffed101274c697 R11: 0000000000000000 R12: ffffea0002258c80
R13: 1ffffd400044b197 R14: ffffea0002258cb8 R15: ffff888093a634a8
 memcg_kmem_uncharge include/linux/memcontrol.h:1402 [inline]
 free_thread_stack+0x12e/0x590 kernel/fork.c:284
 release_task_stack kernel/fork.c:440 [inline]
 put_task_stack+0xa3/0x130 kernel/fork.c:451
 finish_task_switch+0x3f1/0x550 kernel/sched/core.c:3256
 context_switch kernel/sched/core.c:3388 [inline]
 __schedule+0x9a8/0xcc0 kernel/sched/core.c:4081
 schedule+0x181/0x210 kernel/sched/core.c:4155
 schedule_timeout+0x14f/0x240 kernel/time/timer.c:1895
 rcu_gp_fqs_loop kernel/rcu/tree.c:1661 [inline]
 rcu_gp_kthread+0xed8/0x1770 kernel/rcu/tree.c:1821
 kthread+0x332/0x350 kernel/kthread.c:255
 ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:352
rcu: rcu_preempt kthread starved for 10524 jiffies! g6265 f0x2 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=0
rcu: RCU grace-period kthread stack dump:
rcu_preempt     R  running task    29104    10      2 0x80004008
Call Trace:
 <IRQ>
 sched_show_task+0x40f/0x560 kernel/sched/core.c:5954
 rcu_check_gp_kthread_starvation+0x170/0x1b0 kernel/rcu/tree_stall.h:348
 print_other_cpu_stall kernel/rcu/tree_stall.h:418 [inline]
 check_cpu_stall kernel/rcu/tree_stall.h:538 [inline]
 rcu_pending kernel/rcu/tree.c:2827 [inline]
 rcu_sched_clock_irq+0x17d3/0x1ad0 kernel/rcu/tree.c:2271
 update_process_times+0x12d/0x180 kernel/time/timer.c:1726
 tick_sched_handle kernel/time/tick-sched.c:167 [inline]
 tick_sched_timer+0x263/0x420 kernel/time/tick-sched.c:1310
 __run_hrtimer kernel/time/hrtimer.c:1517 [inline]
 __hrtimer_run_queues+0x403/0x840 kernel/time/hrtimer.c:1579
 hrtimer_interrupt+0x38c/0xda0 kernel/time/hrtimer.c:1641
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1110 [inline]
 smp_apic_timer_interrupt+0x109/0x280 arch/x86/kernel/apic/apic.c:1135
 apic_timer_interrupt+0xf/0x20 arch/x86/entry/entry_64.S:829
 </IRQ>
RIP: 0010:__memcg_kmem_uncharge+0x2e/0x1a0 mm/memcontrol.c:2910
Code: 41 57 41 56 41 55 41 54 53 50 89 f3 49 89 fc 48 b8 00 00 00 00 00 fc ff df 4c 8d 77 38 4d 89 f5 49 c1 ed 03 41 80 7c 05 00 00 <74> 08 4c 89 f7 e8 78 fe fa ff 4d 8b 3e b8 01 00 00 00 89 d9 d3 e0
RSP: 0018:ffffc90000d0fc08 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
RAX: dffffc0000000000 RBX: 0000000000000000 RCX: ffff8880a9de8280
RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffea0002258c80
RBP: ffffc90000d0fc38 R08: 000000000003a728 R09: ffffed101274c697
R10: ffffed101274c697 R11: 0000000000000000 R12: ffffea0002258c80
R13: 1ffffd400044b197 R14: ffffea0002258cb8 R15: ffff888093a634a8
 memcg_kmem_uncharge include/linux/memcontrol.h:1402 [inline]
 free_thread_stack+0x12e/0x590 kernel/fork.c:284
 release_task_stack kernel/fork.c:440 [inline]
 put_task_stack+0xa3/0x130 kernel/fork.c:451
 finish_task_switch+0x3f1/0x550 kernel/sched/core.c:3256
 context_switch kernel/sched/core.c:3388 [inline]
 __schedule+0x9a8/0xcc0 kernel/sched/core.c:4081
 schedule+0x181/0x210 kernel/sched/core.c:4155
 schedule_timeout+0x14f/0x240 kernel/time/timer.c:1895
 rcu_gp_fqs_loop kernel/rcu/tree.c:1661 [inline]
 rcu_gp_kthread+0xed8/0x1770 kernel/rcu/tree.c:1821
 kthread+0x332/0x350 kernel/kthread.c:255
 ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:352

Crashes (69):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2019/12/04 12:42 upstream 63de37476ebd 0ecb9746 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/04 11:32 upstream 63de37476ebd 0ecb9746 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/04 09:25 upstream 63de37476ebd 0ecb9746 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/04 08:14 upstream 63de37476ebd 0ecb9746 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/04 07:12 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/04 05:49 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/04 03:58 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/04 02:57 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/04 01:29 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/04 00:28 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 23:12 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 23:09 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 21:23 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 21:23 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 20:57 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 20:47 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 20:40 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 20:16 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 20:10 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 19:38 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 19:32 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 18:37 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 18:31 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 17:23 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 15:59 upstream 76bb8b05960c ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 14:35 upstream 76bb8b05960c ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 14:13 upstream 76bb8b05960c ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 14:08 upstream 76bb8b05960c ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 13:11 upstream 76bb8b05960c ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 11:05 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 11:01 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 10:21 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 10:03 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 08:36 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 08:27 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 08:07 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 07:42 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 06:46 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 06:13 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 06:02 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 05:11 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 05:11 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 03:21 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 02:28 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 01:36 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 01:08 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/02 23:38 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/02 23:22 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/02 22:56 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/02 20:42 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/02 20:31 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
* Struck through repros no longer work on HEAD.