syzbot


INFO: rcu detected stall in gc_worker

Status: upstream: reported C repro on 2023/07/03 02:12
Bug presence: origin:upstream
[Documentation on labels]
Reported-by: syzbot+458308355e7401f2f4c5@syzkaller.appspotmail.com
First crash: 525d, last: 17d
Bug presence (1)
Date Name Commit Repro Result
2023/07/05 upstream (ToT) d528014517f2 C [report] INFO: rcu detected stall in corrupted
Similar bugs (5)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: rcu detected stall in gc_worker (2) netfilter C unreliable 4 1058d 1096d 0/28 closed as invalid on 2022/02/08 10:33
upstream INFO: rcu detected stall in gc_worker (3) netfilter C done done 118 22d 995d 0/28 upstream: reported C repro on 2022/03/20 12:02
upstream INFO: rcu detected stall in gc_worker netfilter 8 2063d 2148d 0/28 auto-closed as invalid on 2019/10/14 16:34
linux-5.15 INFO: rcu detected stall in gc_worker origin:upstream C error 46 10d 491d 0/3 upstream: reported C repro on 2023/08/06 21:00
linux-4.19 INFO: rcu detected stall in gc_worker syz error 1 962d 962d 0/1 upstream: reported syz repro on 2022/04/22 15:43
Fix bisection attempts (6)
Created Duration User Patch Repo Result
2024/04/24 07:31 2h33m bisect fix linux-6.1.y OK (0) job log log
2024/02/16 22:50 2h26m bisect fix linux-6.1.y OK (0) job log log
2024/01/07 17:15 2h06m bisect fix linux-6.1.y OK (0) job log log
2023/11/26 07:58 2h12m bisect fix linux-6.1.y OK (0) job log log
2023/10/24 21:30 2h00m bisect fix linux-6.1.y OK (0) job log log
2023/09/18 17:35 2h25m bisect fix linux-6.1.y OK (0) job log log

Sample crash report:
rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
rcu: 	Tasks blocked on level-0 rcu_node (CPUs 0-1): P14/1:b..l
	(detected by 1, t=10503 jiffies, g=5593, q=147 ncpus=2)
task:kworker/0:1     state:R  running task     stack:24288 pid:14    ppid:2      flags:0x00004000
Workqueue: events_power_efficient gc_worker
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5241 [inline]
 __schedule+0x143f/0x4570 kernel/sched/core.c:6558
 preempt_schedule_irq+0xf7/0x1c0 kernel/sched/core.c:6870
 irqentry_exit+0x53/0x80 kernel/entry/common.c:439
 asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:691
RIP: 0010:lock_acquire+0x26f/0x5a0 kernel/locking/lockdep.c:5666
Code: 2b 00 74 08 4c 89 f7 e8 4f 7a 77 00 f6 44 24 61 02 0f 85 84 01 00 00 41 f7 c7 00 02 00 00 74 01 fb 48 c7 44 24 40 0e 36 e0 45 <4b> c7 44 25 00 00 00 00 00 43 c7 44 25 09 00 00 00 00 43 c7 44 25
RSP: 0018:ffffc900001379a0 EFLAGS: 00000206
RAX: 0000000000000001 RBX: 1ffff92000026f40 RCX: 1ffff92000026ee0
RDX: dffffc0000000000 RSI: ffffffff8b0c1440 RDI: ffffffff8b5d7540
RBP: ffffc90000137ae8 R08: dffffc0000000000 R09: fffffbfff224604d
R10: 0000000000000000 R11: dffffc0000000001 R12: 1ffff92000026f3c
R13: dffffc0000000000 R14: ffffc90000137a00 R15: 0000000000000246
 rcu_lock_acquire include/linux/rcupdate.h:350 [inline]
 rcu_read_lock include/linux/rcupdate.h:791 [inline]
 gc_worker+0x29b/0x1530 net/netfilter/nf_conntrack_core.c:1501
 process_one_work+0x8a9/0x11d0 kernel/workqueue.c:2292
 worker_thread+0xa47/0x1200 kernel/workqueue.c:2439
 kthread+0x28d/0x320 kernel/kthread.c:376
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:295
 </TASK>
rcu: rcu_preempt kthread starved for 10530 jiffies! g5593 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=1
rcu: 	Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
rcu: RCU grace-period kthread stack dump:
task:rcu_preempt     state:R  running task     stack:25528 pid:16    ppid:2      flags:0x00004000
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5241 [inline]
 __schedule+0x143f/0x4570 kernel/sched/core.c:6558
 schedule+0xbf/0x180 kernel/sched/core.c:6634
 schedule_timeout+0x1b9/0x300 kernel/time/timer.c:1965
 rcu_gp_fqs_loop+0x2d2/0x1150 kernel/rcu/tree.c:1706
 rcu_gp_kthread+0xa3/0x3b0 kernel/rcu/tree.c:1905
 kthread+0x28d/0x320 kernel/kthread.c:376
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:295
 </TASK>
rcu: Stack dump where RCU GP kthread last ran:
CPU: 1 PID: 4271 Comm: syz-executor280 Not tainted 6.1.114-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 09/13/2024
RIP: 0033:0x7efdda9aac07
Code: 0b e9 68 fe ff ff 48 83 c4 18 48 8d 3d 92 17 09 00 5b 5d 41 5c 41 5d 41 5e 41 5f e9 63 d8 fd ff 0f 1f 00 b8 27 00 00 00 0f 05 <c3> 0f 1f 84 00 00 00 00 00 b8 6e 00 00 00 0f 05 c3 0f 1f 84 00 00
RSP: 002b:00007fff421f7248 EFLAGS: 00000206
RAX: 0000000000000004 RBX: 00007fff421f73b0 RCX: 00007efdda9aac07
RDX: 00007fff421f7280 RSI: 00007fff421f73b0 RDI: 0000000000000021
RBP: 0000000000000000 R08: 00007efdda96c990 R09: 00007efdda96c990
R10: 0000000000000000 R11: 0000000000000206 R12: 00007fff421f784c
R13: 00007fff421f7880 R14: 00007fff421f7860 R15: 0000000000000001
FS:  00005555806023c0 GS:  0000000000000000

Crashes (63):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2024/10/27 12:04 linux-6.1.y 7ec6f9fa3d97 65e8686b .config console log report syz / log C [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/03/24 18:18 linux-6.1.y d7543167affd 0ea90952 .config console log report syz C [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/02/24 05:36 linux-6.1.y 81e1dc2f7001 8d446f15 .config console log report syz C [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2023/07/03 08:44 linux-6.1.y 0f4ac6b4c5f0 bfc47836 .config console log report syz C [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2023/07/03 02:12 linux-6.1.y 0f4ac6b4c5f0 bfc47836 .config console log report syz C [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/11/22 13:59 linux-6.1.y b67dc5c9ade9 4b25d554 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/11/15 20:55 linux-6.1.y 59d7b1a7104a cfe3a04a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/10/06 14:50 linux-6.1.y aa4cd140bba5 d7906eff .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/09/21 03:40 linux-6.1.y e526b12bf916 6f888b75 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan-perf INFO: rcu detected stall in gc_worker
2024/09/19 09:21 linux-6.1.y e526b12bf916 c673ca06 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/09/07 06:48 linux-6.1.y 699506173494 9750182a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/08/21 21:11 linux-6.1.y ee5e09825b81 db5852f9 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/08/15 20:37 linux-6.1.y 117ac406ba90 e4bacdaf .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/08/13 23:10 linux-6.1.y 36790ef5e00b f21a18ca .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/08/12 18:26 linux-6.1.y 36790ef5e00b 842184b3 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/08/10 01:19 linux-6.1.y 48d525b0e463 a83d9288 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/07/27 15:10 linux-6.1.y c1cec4dad96b 46eb10b7 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/07/26 23:52 linux-6.1.y c18e82d3ee44 46eb10b7 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/07/19 11:57 linux-6.1.y 9b3f9a5b12dc ee4e11c8 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/07/18 09:31 linux-6.1.y cac15753b8ce 0f902625 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/07/15 07:49 linux-6.1.y 266ee8e06d5b c605e6a2 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/07/11 01:48 linux-6.1.y 7753af06eebf 6f7fa383 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/07/10 01:13 linux-6.1.y 7753af06eebf 79d68ada .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/07/06 09:42 linux-6.1.y 7753af06eebf 2a40360c .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/07/06 05:37 linux-6.1.y 7753af06eebf 2a40360c .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/06/28 11:29 linux-6.1.y 99e6a620de00 6ef39602 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/06/26 13:09 linux-6.1.y eb44d83053d6 c6d33a01 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/06/26 07:03 linux-6.1.y eb44d83053d6 dec8bc94 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/06/08 04:33 linux-6.1.y 88690811da69 82c05ab8 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/06/07 10:18 linux-6.1.y 88690811da69 121701b6 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/06/06 06:11 linux-6.1.y 88690811da69 121701b6 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/06/05 13:53 linux-6.1.y 88690811da69 5aa1a7c9 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/06/05 13:49 linux-6.1.y 88690811da69 5aa1a7c9 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/06/05 13:49 linux-6.1.y 88690811da69 5aa1a7c9 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/06/05 00:19 linux-6.1.y 88690811da69 e1e2c66e .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/06/05 00:18 linux-6.1.y 88690811da69 e1e2c66e .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/06/04 23:01 linux-6.1.y 88690811da69 11f2afa5 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/06/03 23:13 linux-6.1.y 88690811da69 a1feae05 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/06/03 21:56 linux-6.1.y 88690811da69 a1feae05 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/06/03 21:56 linux-6.1.y 88690811da69 a1feae05 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/06/03 21:56 linux-6.1.y 88690811da69 a1feae05 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/06/03 21:50 linux-6.1.y 88690811da69 a1feae05 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/06/03 21:46 linux-6.1.y 88690811da69 a1feae05 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/06/03 18:45 linux-6.1.y 88690811da69 0aba2352 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/06/03 15:58 linux-6.1.y 88690811da69 0aba2352 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/06/01 06:00 linux-6.1.y 88690811da69 3113787f .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/06/01 01:50 linux-6.1.y 88690811da69 3113787f .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/05/31 13:45 linux-6.1.y 88690811da69 0c378259 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/05/31 13:41 linux-6.1.y 88690811da69 0c378259 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/05/28 23:22 linux-6.1.y 88690811da69 34889ee3 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/05/28 07:23 linux-6.1.y 88690811da69 f550015e .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/05/28 07:20 linux-6.1.y 88690811da69 f550015e .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/05/28 05:27 linux-6.1.y 88690811da69 f550015e .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/05/27 17:47 linux-6.1.y 88690811da69 761766e6 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/05/26 09:14 linux-6.1.y 88690811da69 a10a183e .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/05/26 09:06 linux-6.1.y 88690811da69 a10a183e .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/05/23 22:29 linux-6.1.y 4078fa637fcd 8f98448e .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/02/21 16:35 linux-6.1.y 8b4118fabd6e 3af7dd65 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2023/12/08 15:51 linux-6.1.y 6c6a6c7e211c 28b24332 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2023/12/07 11:55 linux-6.1.y c6114c845984 0a02ce36 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in gc_worker
2024/06/08 03:22 linux-6.1.y 88690811da69 82c05ab8 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan-arm64 INFO: rcu detected stall in gc_worker
2024/06/08 02:34 linux-6.1.y 88690811da69 82c05ab8 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan-arm64 INFO: rcu detected stall in gc_worker
* Struck through repros no longer work on HEAD.