syzbot


INFO: rcu detected stall in cleanup_net

Status: upstream: reported on 2023/07/11 05:04
Reported-by: syzbot+f5d4d279dfe9b422732e@syzkaller.appspotmail.com
First crash: 370d, last: 10h29m
Similar bugs (12)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: rcu detected stall in cleanup_net (3) net 1 1764d 1764d 0/27 auto-closed as invalid on 2019/12/15 02:54
upstream INFO: rcu detected stall in cleanup_net (6) net 63 312d 554d 0/27 closed as invalid on 2023/10/27 14:39
linux-4.19 INFO: rcu detected stall in cleanup_net (2) 4 1114d 1246d 0/1 auto-closed as invalid on 2021/10/25 03:43
upstream INFO: rcu detected stall in cleanup_net kernel 5 2196d 2264d 0/27 closed as invalid on 2018/09/05 12:51
upstream INFO: rcu detected stall in cleanup_net (4) kernel C done 5 1409d 1405d 15/27 fixed on 2020/10/10 01:52
upstream INFO: rcu detected stall in cleanup_net (5) net 24 893d 1152d 0/27 closed as invalid on 2022/02/08 10:00
linux-4.19 INFO: rcu detected stall in cleanup_net 1 1636d 1636d 0/1 auto-closed as invalid on 2020/05/21 02:17
linux-6.1 INFO: rcu detected stall in cleanup_net origin:lts-only syz error 65 1d11h 369d 0/3 upstream: reported syz repro on 2023/07/12 14:45
upstream INFO: rcu detected stall in cleanup_net (2) kernel 1 2108d 2104d 0/27 auto-closed as invalid on 2019/04/05 22:14
linux-4.19 BUG: soft lockup in cleanup_net (2) C 3 498d 610d 0/1 upstream: reported C repro on 2022/11/13 07:04
android-5-15 BUG: soft lockup in cleanup_net 4 43d 71d 0/2 premoderation: reported on 2024/05/05 13:03
linux-4.19 BUG: soft lockup in cleanup_net 4 744d 957d 0/1 auto-obsoleted due to no activity on 2022/10/30 18:15

Sample crash report:
rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
rcu: 	Tasks blocked on level-0 rcu_node (CPUs 0-1): P9/1:b..l
	(detected by 0, t=10502 jiffies, g=5209, q=33)
task:kworker/u4:0    state:R  running task     stack:24632 pid:    9 ppid:     2 flags:0x00004000
Workqueue: netns cleanup_net
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5030 [inline]
 __schedule+0x12c4/0x45b0 kernel/sched/core.c:6376
 preempt_schedule_irq+0xf7/0x1c0 kernel/sched/core.c:6780
 irqentry_exit+0x53/0x80 kernel/entry/common.c:432
 asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:638
RIP: 0010:lock_acquire+0x252/0x4f0 kernel/locking/lockdep.c:5627
Code: 2b 00 74 08 4c 89 f7 e8 ac 7e 67 00 f6 44 24 61 02 0f 85 84 01 00 00 41 f7 c7 00 02 00 00 74 01 fb 48 c7 44 24 40 0e 36 e0 45 <4b> c7 44 25 00 00 00 00 00 43 c7 44 25 09 00 00 00 00 43 c7 44 25
RSP: 0018:ffffc90000ce78e0 EFLAGS: 00000206
RAX: 0000000000000001 RBX: 1ffff9200019cf28 RCX: 1ffff9200019cec8
RDX: dffffc0000000000 RSI: ffffffff8a8b3ca0 RDI: ffffffff8ad8f680
RBP: ffffc90000ce7a40 R08: dffffc0000000000 R09: fffffbfff1f7f219
R10: 0000000000000000 R11: dffffc0000000001 R12: 1ffff9200019cf24
R13: dffffc0000000000 R14: ffffc90000ce7940 R15: 0000000000000246
 rcu_lock_acquire+0x2a/0x30 include/linux/rcupdate.h:312
 rcu_read_lock include/linux/rcupdate.h:739 [inline]
 inet_twsk_purge+0x129/0x9d0 net/ipv4/inet_timewait_sock.c:268
 ops_exit_list net/core/net_namespace.c:177 [inline]
 cleanup_net+0x763/0xb60 net/core/net_namespace.c:599
 process_one_work+0x8a1/0x10c0 kernel/workqueue.c:2310
 worker_thread+0xaca/0x1280 kernel/workqueue.c:2457
 kthread+0x3f6/0x4f0 kernel/kthread.c:334
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:300
 </TASK>
rcu: rcu_preempt kthread starved for 10522 jiffies! g5209 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=1
rcu: 	Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
rcu: RCU grace-period kthread stack dump:
task:rcu_preempt     state:R  running task     stack:25976 pid:   15 ppid:     2 flags:0x00004000
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5030 [inline]
 __schedule+0x12c4/0x45b0 kernel/sched/core.c:6376
 schedule+0x11b/0x1f0 kernel/sched/core.c:6459
 schedule_timeout+0x1b9/0x300 kernel/time/timer.c:1914
 rcu_gp_fqs_loop+0x2bf/0x1080 kernel/rcu/tree.c:1972
 rcu_gp_kthread+0xa4/0x360 kernel/rcu/tree.c:2145
 kthread+0x3f6/0x4f0 kernel/kthread.c:334
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:300
 </TASK>
rcu: Stack dump where RCU GP kthread last ran:
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 3658 Comm: syz.4.26 Not tainted 5.15.162-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 06/07/2024
RIP: 0010:match_held_lock+0x2/0xb0 kernel/locking/lockdep.c:5070
Code: 00 75 cf 48 c7 c7 a0 28 8b 8a 48 c7 c6 e0 28 8b 8a e8 42 81 2d f7 0f 0b eb b6 e8 09 fb ff ff 66 0f 1f 84 00 00 00 00 00 55 53 <bd> 01 00 00 00 48 39 77 10 74 67 48 89 fb 81 7f 20 00 00 10 00 72
RSP: 0018:ffffc90000dd0cc8 EFLAGS: 00000097
RAX: 0000000000000001 RBX: 0000000000000000 RCX: ffffc90000dd0d03
RDX: 1ffff920001ba1ac RSI: ffff8880b9b2a218 RDI: ffff888077988af0
RBP: ffffc90000dd0e10 R08: dffffc0000000000 R09: fffffbfff1bc8e76
R10: 0000000000000000 R11: dffffc0000000001 R12: 0000000000000000
R13: 0000000000000000 R14: ffff888077988af0 R15: ffff888077988af0
FS:  0000555555e3b500(0000) GS:ffff8880b9b00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000055faec9578f8 CR3: 0000000065fb0000 CR4: 00000000003506e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <NMI>
 </NMI>
 <IRQ>
 find_held_lock kernel/locking/lockdep.c:5115 [inline]
 __lock_release kernel/locking/lockdep.c:5300 [inline]
 lock_release+0x245/0x9a0 kernel/locking/lockdep.c:5643
 __raw_spin_unlock_irqrestore include/linux/spinlock_api_smp.h:158 [inline]
 _raw_spin_unlock_irqrestore+0x75/0x130 kernel/locking/spinlock.c:194
 hrtimer_interrupt+0x53c/0x980 kernel/time/hrtimer.c:1822
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1085 [inline]
 __sysvec_apic_timer_interrupt+0x139/0x470 arch/x86/kernel/apic/apic.c:1102
 sysvec_apic_timer_interrupt+0x8c/0xb0 arch/x86/kernel/apic/apic.c:1096
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:638
RIP: 0010:__raw_spin_unlock_irq include/linux/spinlock_api_smp.h:169 [inline]
RIP: 0010:_raw_spin_unlock_irq+0x25/0x40 kernel/locking/spinlock.c:202
Code: 21 80 f6 ff 90 53 48 89 fb 48 83 c7 18 48 8b 74 24 08 e8 3e d2 3a f7 48 89 df e8 16 26 3c f7 e8 51 de 5e f7 fb bf 01 00 00 00 <e8> 56 6c 2f f7 65 8b 05 57 72 da 75 85 c0 74 02 5b c3 e8 24 8f d8
RSP: 0018:ffffc900011ffbc0 EFLAGS: 00000282
RAX: c77c6e8e64169100 RBX: ffff88801d8f1bc0 RCX: ffffffff913f0f03
RDX: dffffc0000000000 RSI: ffffffff8a8b2a00 RDI: 0000000000000001
RBP: 0000000000000000 R08: ffffffff8186dbe0 R09: ffffed1003b1e379
R10: 0000000000000000 R11: dffffc0000000001 R12: 0000000000000021
R13: dffffc0000000000 R14: ffff88801d8f2058 R15: ffff88801d8f1bc0
 spin_unlock_irq include/linux/spinlock.h:413 [inline]
 get_signal+0x13ee/0x14e0 kernel/signal.c:2892
 arch_do_signal_or_restart+0xc3/0x1890 arch/x86/kernel/signal.c:867
 handle_signal_work kernel/entry/common.c:154 [inline]
 exit_to_user_mode_loop+0x97/0x130 kernel/entry/common.c:178
 exit_to_user_mode_prepare+0xb1/0x140 kernel/entry/common.c:214
 __syscall_exit_to_user_mode_work kernel/entry/common.c:296 [inline]
 syscall_exit_to_user_mode+0x5d/0x240 kernel/entry/common.c:307
 do_syscall_64+0x47/0xb0 arch/x86/entry/common.c:86
 entry_SYSCALL_64_after_hwframe+0x66/0xd0
RIP: 0033:0x7f582c9a66a0
Code: 28 83 45 28 04 48 8d 50 fc 48 89 55 38 89 78 fc 8b 45 28 48 83 c4 38 5b 5d 41 5c 41 5d 41 5e 41 5f c3 0f 1f 84 00 00 00 00 00 <41> b8 01 00 00 00 41 89 db 89 de 8d 7b 04 89 d8 89 c1 81 e1 ff 1f
RSP: 002b:00007ffcf55e86a0 EFLAGS: 00000246
RAX: 0000000000018ffe RBX: ffffffff8407f200 RCX: 0000000000001200
RDX: 00007f582c354148 RSI: 000000008407f200 RDI: 000000008407f204
RBP: 00007f582d788720 R08: 0000000000000001 R09: 00007f582c352000
R10: 0000000000000008 R11: 000000008407f200 R12: ffffffff8407f782
R13: 00007f582cc56ff8 R14: 0000000000000429 R15: 00007f582cc43000
 </TASK>
sched: RT throttling activated

Crashes (33):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2024/07/15 14:40 linux-5.15.y f45bea23c39c c605e6a2 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/07/11 01:05 linux-5.15.y f45bea23c39c 6f7fa383 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/07/04 04:12 linux-5.15.y 4878aadf2d15 f76a75f3 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/07/04 03:23 linux-5.15.y 4878aadf2d15 f76a75f3 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/07/01 15:22 linux-5.15.y 4878aadf2d15 b294e901 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/06/30 10:35 linux-5.15.y 4878aadf2d15 757f06b1 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/06/28 20:26 linux-5.15.y 4878aadf2d15 757f06b1 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/06/28 17:03 linux-5.15.y 4878aadf2d15 757f06b1 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/06/27 15:50 linux-5.15.y 4878aadf2d15 6ef39602 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/06/27 09:56 linux-5.15.y 4878aadf2d15 6ef39602 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/06/26 05:20 linux-5.15.y 4878aadf2d15 dec8bc94 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/06/22 08:03 linux-5.15.y 4878aadf2d15 edc5149a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/06/19 04:47 linux-5.15.y 4878aadf2d15 41b7e219 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/06/17 08:51 linux-5.15.y 4878aadf2d15 88722c0f .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/06/15 05:05 linux-5.15.y c61bd26ae81a f429ab00 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/06/12 02:11 linux-5.15.y c61bd26ae81a 4d75f4f7 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/06/10 22:06 linux-5.15.y c61bd26ae81a 048c640a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/06/10 09:01 linux-5.15.y c61bd26ae81a 82c05ab8 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/06/01 13:48 linux-5.15.y c61bd26ae81a 3113787f .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/05/28 06:45 linux-5.15.y c61bd26ae81a f550015e .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/05/25 00:47 linux-5.15.y 83655231580b a10a183e .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/05/24 04:39 linux-5.15.y 83655231580b 8f98448e .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/05/24 04:22 linux-5.15.y 83655231580b 8f98448e .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/05/19 04:30 linux-5.15.y 83655231580b c0f1611a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/05/18 19:16 linux-5.15.y 83655231580b c0f1611a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/05/18 05:12 linux-5.15.y 83655231580b c0f1611a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/05/17 10:42 linux-5.15.y 83655231580b c2e07261 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/04/12 22:11 linux-5.15.y cdfd0a7f0139 c8349e48 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2024/02/14 17:21 linux-5.15.y 6139f2a02fe0 d9b1cdd5 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2023/12/23 17:59 linux-5.15.y d93fa2c78854 fb427a07 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2023/11/24 10:31 linux-5.15.y 2a910f4af54d 5b429f39 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2023/08/23 03:38 linux-5.15.y f6f7927ac664 b81ca3f6 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
2023/07/11 05:03 linux-5.15.y d54cfc420586 52ae002a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in cleanup_net
* Struck through repros no longer work on HEAD.