syzbot


INFO: rcu detected stall in worker_thread

Status: closed as invalid on 2019/12/04 14:14
Subsystems: cgroups mm
[Documentation on labels]
First crash: 1607d, last: 1605d
Similar bugs (9)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: rcu detected stall in worker_thread (3) cgroups mm 1 1570d 1570d 0/26 closed as invalid on 2020/01/08 05:33
upstream INFO: rcu detected stall in worker_thread (4) cgroups mm 28 1570d 1570d 0/26 closed as invalid on 2020/01/09 08:13
linux-5.15 INFO: rcu detected stall in worker_thread 1 211d 211d 0/3 auto-obsoleted due to no activity on 2024/01/09 18:17
upstream INFO: rcu detected stall in worker_thread (8) kernel 1 353d 353d 0/26 auto-obsoleted due to no activity on 2023/08/07 05:14
upstream INFO: rcu detected stall in worker_thread (5) kernel 2 694d 731d 0/26 auto-closed as invalid on 2022/08/31 00:50
upstream INFO: rcu detected stall in worker_thread (9) netfilter C done 116 7h23m 202d 0/26 upstream: reported C repro on 2023/10/07 18:33
upstream INFO: rcu detected stall in worker_thread (2) cgroups mm 12 1570d 1570d 0/26 closed as invalid on 2020/01/08 05:23
upstream INFO: rcu detected stall in worker_thread (6) kernel 1 570d 570d 0/26 auto-obsoleted due to no activity on 2023/01/12 15:50
upstream INFO: rcu detected stall in worker_thread (7) kernel 1 463d 463d 0/26 auto-obsoleted due to no activity on 2023/04/27 16:37

Sample crash report:
rcu: INFO: rcu_preempt self-detected stall on CPU
rcu: 	1-...!: (10500 ticks this GP) idle=736/1/0x4000000000000002 softirq=10039/10043 fqs=39 
	(t=10500 jiffies g=6473 q=123)
rcu: rcu_preempt kthread starved for 10422 jiffies! g6473 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=0
rcu: RCU grace-period kthread stack dump:
rcu_preempt     R  running task    29032    10      2 0x80004000
Call Trace:
 context_switch kernel/sched/core.c:3385 [inline]
 __schedule+0x9a0/0xcc0 kernel/sched/core.c:4081
 schedule+0x181/0x210 kernel/sched/core.c:4155
 schedule_timeout+0x14f/0x240 kernel/time/timer.c:1895
 rcu_gp_fqs_loop kernel/rcu/tree.c:1661 [inline]
 rcu_gp_kthread+0xed8/0x1770 kernel/rcu/tree.c:1821
 kthread+0x332/0x350 kernel/kthread.c:255
 ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:352
NMI backtrace for cpu 1
CPU: 1 PID: 371 Comm: kworker/u4:5 Not tainted 5.4.0-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Workqueue:  0x0 (bat_events)
Call Trace:
 <IRQ>
 __dump_stack lib/dump_stack.c:77 [inline]
 dump_stack+0x1fb/0x318 lib/dump_stack.c:118
 nmi_cpu_backtrace+0xaf/0x1a0 lib/nmi_backtrace.c:101
 nmi_trigger_cpumask_backtrace+0x174/0x290 lib/nmi_backtrace.c:62
 arch_trigger_cpumask_backtrace+0x10/0x20 arch/x86/kernel/apic/hw_nmi.c:38
 trigger_single_cpu_backtrace include/linux/nmi.h:164 [inline]
 rcu_dump_cpu_stacks+0x15a/0x220 kernel/rcu/tree_stall.h:254
 print_cpu_stall kernel/rcu/tree_stall.h:455 [inline]
 check_cpu_stall kernel/rcu/tree_stall.h:529 [inline]
 rcu_pending kernel/rcu/tree.c:2827 [inline]
 rcu_sched_clock_irq+0xe25/0x1ad0 kernel/rcu/tree.c:2271
 update_process_times+0x12d/0x180 kernel/time/timer.c:1726
 tick_sched_handle kernel/time/tick-sched.c:167 [inline]
 tick_sched_timer+0x263/0x420 kernel/time/tick-sched.c:1310
 __run_hrtimer kernel/time/hrtimer.c:1517 [inline]
 __hrtimer_run_queues+0x403/0x840 kernel/time/hrtimer.c:1579
 hrtimer_interrupt+0x38c/0xda0 kernel/time/hrtimer.c:1641
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1110 [inline]
 smp_apic_timer_interrupt+0x109/0x280 arch/x86/kernel/apic/apic.c:1135
 apic_timer_interrupt+0xf/0x20 arch/x86/entry/entry_64.S:829
 </IRQ>
RIP: 0010:__memcg_kmem_uncharge+0xd/0x1a0 mm/memcontrol.c:2909
Code: 81 c3 08 02 00 00 48 89 df 4c 89 f6 e8 7c 87 ff ff 5b 41 5e 5d c3 0f 1f 80 00 00 00 00 55 48 89 e5 41 57 41 56 41 55 41 54 53 <50> 89 f3 49 89 fc 48 b8 00 00 00 00 00 fc ff df 4c 8d 77 38 4d 89
RSP: 0018:ffffc90002297bf8 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
RAX: ffffffff81486ea4 RBX: ffffea000243cf80 RCX: ffff8880a8818600
RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffea000243cf80
RBP: ffffc90002297c20 R08: 000000000003a728 R09: ffffed1015149a97
R10: ffffed1015149a97 R11: 0000000000000000 R12: ffff8880a7bcf720
R13: dffffc0000000000 R14: 1ffff11014f79ee4 R15: ffff8880a8a4d4a8
 memcg_kmem_uncharge include/linux/memcontrol.h:1402 [inline]
 free_thread_stack+0x12e/0x590 kernel/fork.c:284
 release_task_stack kernel/fork.c:440 [inline]
 put_task_stack+0xa3/0x130 kernel/fork.c:451
 finish_task_switch+0x3f1/0x550 kernel/sched/core.c:3256
 context_switch kernel/sched/core.c:3388 [inline]
 __schedule+0x9a8/0xcc0 kernel/sched/core.c:4081
 schedule+0x181/0x210 kernel/sched/core.c:4155
 worker_thread+0x10d6/0x1630 kernel/workqueue.c:2431
 kthread+0x332/0x350 kernel/kthread.c:255
 ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:352

Crashes (150):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2019/12/04 13:25 upstream 63de37476ebd 0ecb9746 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/04 12:20 upstream 63de37476ebd 0ecb9746 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/04 11:12 upstream 63de37476ebd 0ecb9746 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/04 10:21 upstream 63de37476ebd 0ecb9746 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/04 09:17 upstream 63de37476ebd 0ecb9746 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/04 08:09 upstream 63de37476ebd 0ecb9746 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/04 06:33 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/04 05:21 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/04 05:13 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/04 03:57 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/04 02:57 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/04 01:40 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/04 00:21 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 23:14 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 22:54 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 21:40 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 20:39 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 19:31 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 18:10 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 17:42 upstream 76bb8b05960c ae13a849 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 16:34 upstream 76bb8b05960c ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 15:24 upstream 76bb8b05960c ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 14:08 upstream 76bb8b05960c ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 12:50 upstream 76bb8b05960c ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 12:07 upstream 76bb8b05960c ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 10:34 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 09:31 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 08:24 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 06:34 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 06:18 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 06:02 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 05:56 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 05:36 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 05:13 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 04:54 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 04:53 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 04:51 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 04:38 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 04:29 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 04:20 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 04:09 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 04:04 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/03 03:44 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
2019/12/02 21:20 upstream 596cf45cbf6e ab342da3 .config console log report ci-upstream-kasan-gce-smack-root
* Struck through repros no longer work on HEAD.