syzbot

 sign-in | mailing list | source | docs
🐞 Open [617] 🐞 Fixed [37] 🐞 Invalid [315] ⬇ Missing Backports [51] 📈 Kernel Health 📈 Bugs/Month 📈 Bug Lifetimes 📈 Fuzzing 📈 Crashes 💬 Send us feedback

INFO: rcu detected stall in cleanup_net

Status: upstream: reported on 2023/07/11 05:04
Reported-by: syzbot+f5d4d279dfe9b422732e@syzkaller.appspotmail.com
First crash: 326d, last: 2h15m
▶ ▼ Similar bugs (12)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: rcu detected stall in cleanup_net (3) net 1 1720d 1720d 0/26 auto-closed as invalid on 2019/12/15 02:54
upstream INFO: rcu detected stall in cleanup_net (6) net 63 267d 510d 0/26 closed as invalid on 2023/10/27 14:39
linux-4.19 INFO: rcu detected stall in cleanup_net (2) 4 1070d 1202d 0/1 auto-closed as invalid on 2021/10/25 03:43
upstream INFO: rcu detected stall in cleanup_net kernel 5 2152d 2220d 0/26 closed as invalid on 2018/09/05 12:51
upstream INFO: rcu detected stall in cleanup_net (4) kernel C done 5 1365d 1361d 15/26 fixed on 2020/10/10 01:52
upstream INFO: rcu detected stall in cleanup_net (5) net 24 848d 1108d 0/26 closed as invalid on 2022/02/08 10:00
linux-4.19 INFO: rcu detected stall in cleanup_net 1 1592d 1592d 0/1 auto-closed as invalid on 2020/05/21 02:17
linux-6.1 INFO: rcu detected stall in cleanup_net origin:lts-only syz 31 11h00m 325d 0/3 upstream: reported syz repro on 2023/07/12 14:45
upstream INFO: rcu detected stall in cleanup_net (2) kernel 1 2063d 2059d 0/26 auto-closed as invalid on 2019/04/05 22:14
linux-4.19 BUG: soft lockup in cleanup_net (2) C 3 454d 566d 0/1 upstream: reported C repro on 2022/11/13 07:04
android-5-15 BUG: soft lockup in cleanup_net 3 12d 27d 0/2 premoderation: reported on 2024/05/05 13:03
linux-4.19 BUG: soft lockup in cleanup_net 4 699d 913d 0/1 auto-obsoleted due to no activity on 2022/10/30 18:15

Sample crash report:
rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
rcu: 	Tasks blocked on level-0 rcu_node (CPUs 0-1): P3771/1:b..l P161/1:b..l
	(detected by 1, t=10502 jiffies, g=18793, q=22)
task:kworker/u4:3    state:R  running task     stack:18584 pid:  161 ppid:     2 flags:0x00004000
Workqueue: netns cleanup_net
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5030 [inline]
 __schedule+0x12c4/0x45b0 kernel/sched/core.c:6376
 preempt_schedule_irq+0xf7/0x1c0 kernel/sched/core.c:6780
 irqentry_exit+0x53/0x80 kernel/entry/common.c:432
 asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:638
RIP: 0010:lock_acquire+0x252/0x4f0 kernel/locking/lockdep.c:5627
Code: 2b 00 74 08 4c 89 f7 e8 fc 7c 67 00 f6 44 24 61 02 0f 85 84 01 00 00 41 f7 c7 00 02 00 00 74 01 fb 48 c7 44 24 40 0e 36 e0 45 <4b> c7 44 25 00 00 00 00 00 43 c7 44 25 09 00 00 00 00 43 c7 44 25
RSP: 0018:ffffc900020478e0 EFLAGS: 00000206
RAX: 0000000000000001 RBX: 1ffff92000408f28 RCX: 1ffff92000408ec8
RDX: dffffc0000000000 RSI: ffffffff8a8b3c20 RDI: ffffffff8ad8f6c0
RBP: ffffc90002047a40 R08: dffffc0000000000 R09: fffffbfff1f7f019
R10: 0000000000000000 R11: dffffc0000000001 R12: 1ffff92000408f24
R13: dffffc0000000000 R14: ffffc90002047940 R15: 0000000000000246
 rcu_lock_acquire+0x2a/0x30 include/linux/rcupdate.h:312
 rcu_read_lock include/linux/rcupdate.h:739 [inline]
 inet_twsk_purge+0x129/0x9d0 net/ipv4/inet_timewait_sock.c:268
 ops_exit_list net/core/net_namespace.c:177 [inline]
 cleanup_net+0x763/0xb60 net/core/net_namespace.c:599
 process_one_work+0x8a1/0x10c0 kernel/workqueue.c:2310
 worker_thread+0xaca/0x1280 kernel/workqueue.c:2457
 kthread+0x3f6/0x4f0 kernel/kthread.c:334
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:300
 </TASK>
task:kworker/u4:10   state:R  running task     stack:21304 pid: 3771 ppid:     2 flags:0x00004000
Workqueue: bat_events batadv_nc_worker
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5030 [inline]
 __schedule+0x12c4/0x45b0 kernel/sched/core.c:6376
 preempt_schedule_irq+0xf7/0x1c0 kernel/sched/core.c:6780
 irqentry_exit+0x53/0x80 kernel/entry/common.c:432
 asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:638
RIP: 0010:lock_acquire+0x252/0x4f0 kernel/locking/lockdep.c:5627
Code: 2b 00 74 08 4c 89 f7 e8 fc 7c 67 00 f6 44 24 61 02 0f 85 84 01 00 00 41 f7 c7 00 02 00 00 74 01 fb 48 c7 44 24 40 0e 36 e0 45 <4b> c7 44 25 00 00 00 00 00 43 c7 44 25 09 00 00 00 00 43 c7 44 25
RSP: 0018:ffffc9000525fa80 EFLAGS: 00000206
RAX: 0000000000000001 RBX: 1ffff92000a4bf5c RCX: 1ffff92000a4befc
RDX: dffffc0000000000 RSI: ffffffff8a8b3c20 RDI: ffffffff8ad8f6c0
RBP: ffffc9000525fbd8 R08: dffffc0000000000 R09: fffffbfff1f7f019
R10: 0000000000000000 R11: dffffc0000000001 R12: 1ffff92000a4bf58
R13: dffffc0000000000 R14: ffffc9000525fae0 R15: 0000000000000246
 rcu_lock_acquire+0x2a/0x30 include/linux/rcupdate.h:312
 rcu_read_lock include/linux/rcupdate.h:739 [inline]
 batadv_nc_purge_orig_hash net/batman-adv/network-coding.c:412 [inline]
 batadv_nc_worker+0xc1/0x5b0 net/batman-adv/network-coding.c:723
 process_one_work+0x8a1/0x10c0 kernel/workqueue.c:2310
 worker_thread+0xaca/0x1280 kernel/workqueue.c:2457
 kthread+0x3f6/0x4f0 kernel/kthread.c:334
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:300
 </TASK>
rcu: rcu_preempt kthread starved for 10548 jiffies! g18793 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=0
rcu: 	Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
rcu: RCU grace-period kthread stack dump:
task:rcu_preempt     state:R  running task     stack:26712 pid:   15 ppid:     2 flags:0x00004000
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5030 [inline]
 __schedule+0x12c4/0x45b0 kernel/sched/core.c:6376
 schedule+0x11b/0x1f0 kernel/sched/core.c:6459
 schedule_timeout+0x1b9/0x300 kernel/time/timer.c:1914
 rcu_gp_fqs_loop+0x2bf/0x1080 kernel/rcu/tree.c:1972
 rcu_gp_kthread+0xa4/0x360 kernel/rcu/tree.c:2145
 kthread+0x3f6/0x4f0 kernel/kthread.c:334
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:300
 </TASK>
rcu: Stack dump where RCU GP kthread last ran:
Sending NMI from CPU 1 to CPUs 0:
NMI backtrace for cpu 0
CPU: 0 PID: 6152 Comm: syz-executor.2 Not tainted 5.15.160-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 04/02/2024
RIP: 0010:hlock_class kernel/locking/lockdep.c:192 [inline]
RIP: 0010:mark_lock+0x71/0x340 kernel/locking/lockdep.c:4569
Code: f5 09 eb 0b 89 d5 83 fa 20 0f 83 d0 02 00 00 41 be 01 00 00 00 89 e9 41 d3 e6 49 8d 5f 20 48 89 d8 48 c1 e8 03 42 0f b6 04 28 <84> c0 0f 85 27 02 00 00 8b 1b 81 e3 ff 1f 00 00 89 d8 c1 e8 06 48
RSP: 0018:ffffc90004ae7898 EFLAGS: 00000806
RAX: 0000000000000000 RBX: ffff8880513a4690 RCX: 0000000000000007
RDX: 0000000000000007 RSI: ffff8880513a4670 RDI: ffff8880513a3b80
RBP: 0000000000000007 R08: dffffc0000000000 R09: fffffbfff1f7f01f
R10: 0000000000000000 R11: dffffc0000000001 R12: 0000000000000000
R13: dffffc0000000000 R14: 0000000000000080 R15: ffff8880513a4670
FS:  0000555555b6c480(0000) GS:ffff8880b9a00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000001b30a23000 CR3: 000000007d545000 CR4: 00000000003506f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <NMI>
 </NMI>
 <TASK>
 __lock_acquire+0xc78/0x1ff0 kernel/locking/lockdep.c:4966
 lock_acquire+0x1db/0x4f0 kernel/locking/lockdep.c:5623
 __might_fault+0xb4/0x110 mm/memory.c:5328
 rseq_get_rseq_cs kernel/rseq.c:131 [inline]
 rseq_ip_fixup kernel/rseq.c:244 [inline]
 __rseq_handle_notify_resume+0x11b/0x1250 kernel/rseq.c:292
 rseq_handle_notify_resume include/linux/sched.h:2204 [inline]
 rseq_signal_deliver include/linux/sched.h:2213 [inline]
 setup_rt_frame arch/x86/kernel/signal.c:769 [inline]
 handle_signal arch/x86/kernel/signal.c:824 [inline]
 arch_do_signal_or_restart+0x27d/0x1890 arch/x86/kernel/signal.c:869
 handle_signal_work kernel/entry/common.c:154 [inline]
 exit_to_user_mode_loop+0x97/0x130 kernel/entry/common.c:178
 exit_to_user_mode_prepare+0xb1/0x140 kernel/entry/common.c:214
 __syscall_exit_to_user_mode_work kernel/entry/common.c:296 [inline]
 syscall_exit_to_user_mode+0x5d/0x240 kernel/entry/common.c:307
 do_syscall_64+0x47/0xb0 arch/x86/entry/common.c:86
 entry_SYSCALL_64_after_hwframe+0x66/0xd0
RIP: 0033:0x7f370839a956
Code: 77 f8 48 89 f8 48 89 eb eb 12 66 2e 0f 1f 84 00 00 00 00 00 48 8b 4b 08 48 83 c3 08 48 39 d1 72 f3 48 83 e8 08 48 39 f2 73 17 <66> 2e 0f 1f 84 00 00 00 00 00 48 8b 70 f8 48 83 e8 08 48 39 f2 72
RSP: 002b:00007ffe248cdc10 EFLAGS: 00000297
RAX: 00007f3707f3e4c8 RBX: 00007f3707d69990 RCX: ffffffff81a676ca
RDX: ffffffff81710c93 RSI: ffffffff81b9c0a5 RDI: 00007f3707f61000
RBP: 00007f3707d61010 R08: 00007f3707e61000 R09: 0000000000000010
R10: 0000000000000231 R11: 0000000081500a1f R12: 00007f3707d61008
R13: 0000000000000021 R14: 00007f3708516038 R15: 00007f3708516038
 </TASK>

Crashes (15):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2024/06/01 13:48 linux-5.15.y c61bd26ae81a 3113787f .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/05/28 06:45 linux-5.15.y c61bd26ae81a f550015e .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/05/25 00:47 linux-5.15.y 83655231580b a10a183e .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/05/24 04:39 linux-5.15.y 83655231580b 8f98448e .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/05/24 04:22 linux-5.15.y 83655231580b 8f98448e .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/05/19 04:30 linux-5.15.y 83655231580b c0f1611a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/05/18 19:16 linux-5.15.y 83655231580b c0f1611a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/05/18 05:12 linux-5.15.y 83655231580b c0f1611a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/05/17 10:42 linux-5.15.y 83655231580b c2e07261 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/04/12 22:11 linux-5.15.y cdfd0a7f0139 c8349e48 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/02/14 17:21 linux-5.15.y 6139f2a02fe0 d9b1cdd5 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2023/12/23 17:59 linux-5.15.y d93fa2c78854 fb427a07 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2023/11/24 10:31 linux-5.15.y 2a910f4af54d 5b429f39 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2023/08/23 03:38 linux-5.15.y f6f7927ac664 b81ca3f6 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2023/07/11 05:03 linux-5.15.y d54cfc420586 52ae002a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
* Struck through repros no longer work on HEAD.