syzbot

 sign-in | mailing list | source | docs
🐞 Open [706]
🐞 Fixed [58]
🐞 Invalid [596]
⬇ Missing Backports [56]
≡ Crashes
Kernel Health Bugs/Month Bug Lifetimes Fuzzing
💬 Send us feedback

INFO: rcu detected stall in sock_close (3)

Status: upstream: reported C repro on 2024/05/20 00:06
Bug presence: origin:upstream
[Documentation on labels]
Reported-by: syzbot+70b74492098cf96cdf23@syzkaller.appspotmail.com
First crash: 185d, last: 2d10h
▶ ▼ Bug presence (1)
Date Name Commit Repro Result
2024/05/20 upstream (ToT) eb6a9339efeb C [report] INFO: rcu detected stall in corrupted
▶ ▼ Similar bugs (12)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
linux-5.15 INFO: rcu detected stall in sock_close (2) 1 302d 302d 0/3 auto-obsoleted due to no activity on 2024/05/03 14:38
upstream INFO: rcu detected stall in sock_close (4) net 2 392d 429d 0/28 auto-obsoleted due to no activity on 2024/01/24 15:51
linux-6.1 INFO: rcu detected stall in sock_close (3) 1 192d 192d 0/3 auto-obsoleted due to no activity on 2024/08/21 03:02
linux-6.1 INFO: rcu detected stall in sock_close origin:upstream C done 1 500d 500d 3/3 fixed on 2023/09/23 10:26
upstream INFO: rcu detected stall in sock_close cgroups mm 6 1814d 1815d 0/28 closed as invalid on 2019/12/04 14:04
linux-6.1 INFO: rcu detected stall in sock_close (2) 1 294d 294d 0/3 auto-obsoleted due to no activity on 2024/05/11 05:25
upstream INFO: rcu detected stall in sock_close (3) tipc C done done 5 1101d 1596d 0/28 closed as invalid on 2022/02/08 10:42
linux-5.15 INFO: rcu detected stall in sock_close C error 2 480d 534d 0/3 auto-obsoleted due to no activity on 2023/11/07 13:02
upstream INFO: rcu detected stall in sock_close (2) cgroups mm 1 1779d 1779d 0/28 closed as invalid on 2020/01/09 08:13
android-5-10 BUG: soft lockup in sock_close C 80 7d18h 241d 0/2 upstream: reported C repro on 2024/03/25 07:28
android-5-15 BUG: soft lockup in sock_close origin:downstream C done 322 18d 239d 0/2 upstream: reported C repro on 2024/03/26 23:21
android-6-1 BUG: soft lockup in sock_close origin:downstream C error 3 24d 239d 0/2 upstream: reported C repro on 2024/03/27 04:09
▶ ▼ Fix bisection attempts (4)
Created Duration User Patch Repo Result
2024/11/19 06:26 1h56m bisect fix linux-5.15.y OK (0) job log log
2024/10/15 16:36 2h02m bisect fix linux-5.15.y OK (0) job log log
2024/09/15 09:14 1h28m bisect fix linux-5.15.y OK (0) job log log
2024/07/07 23:16 1h30m bisect fix linux-5.15.y OK (0) job log log

Sample crash report:
rcu: INFO: rcu_preempt self-detected stall on CPU
rcu: 	0-...!: (10501 ticks this GP) idle=bf5/1/0x4000000000000000 softirq=4775/4775 fqs=0 
	(t=10502 jiffies g=4693 q=5)
rcu: rcu_preempt kthread timer wakeup didn't happen for 10502 jiffies! g4693 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402
rcu: 	Possible timer handling issue on cpu=0 timer-softirq=9639
rcu: rcu_preempt kthread starved for 10505 jiffies! g4693 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0
rcu: 	Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
rcu: RCU grace-period kthread stack dump:
task:rcu_preempt     state:I stack:26368 pid:   15 ppid:     2 flags:0x00004000
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5030 [inline]
 __schedule+0x12c4/0x45b0 kernel/sched/core.c:6376
 schedule+0x11b/0x1f0 kernel/sched/core.c:6459
 schedule_timeout+0x1b9/0x300 kernel/time/timer.c:1914
 rcu_gp_fqs_loop+0x2bf/0x1080 kernel/rcu/tree.c:1972
 rcu_gp_kthread+0xa4/0x360 kernel/rcu/tree.c:2145
 kthread+0x3f6/0x4f0 kernel/kthread.c:334
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:300
 </TASK>
rcu: Stack dump where RCU GP kthread last ran:
NMI backtrace for cpu 0
CPU: 0 PID: 3638 Comm: syz-executor325 Not tainted 5.15.159-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 04/02/2024
Call Trace:
 <IRQ>
 __dump_stack lib/dump_stack.c:88 [inline]
 dump_stack_lvl+0x1e3/0x2d0 lib/dump_stack.c:106
 nmi_cpu_backtrace+0x46a/0x4a0 lib/nmi_backtrace.c:111
 nmi_trigger_cpumask_backtrace+0x181/0x2a0 lib/nmi_backtrace.c:62
 trigger_single_cpu_backtrace include/linux/nmi.h:166 [inline]
 rcu_check_gp_kthread_starvation+0x1d2/0x240 kernel/rcu/tree_stall.h:487
 print_cpu_stall+0x31b/0x600 kernel/rcu/tree_stall.h:631
 check_cpu_stall kernel/rcu/tree_stall.h:727 [inline]
 rcu_pending kernel/rcu/tree.c:3932 [inline]
 rcu_sched_clock_irq+0x8d9/0x1150 kernel/rcu/tree.c:2619
 update_process_times+0x196/0x200 kernel/time/timer.c:1818
 tick_sched_handle kernel/time/tick-sched.c:254 [inline]
 tick_sched_timer+0x386/0x550 kernel/time/tick-sched.c:1473
 __run_hrtimer kernel/time/hrtimer.c:1686 [inline]
 __hrtimer_run_queues+0x55b/0xcf0 kernel/time/hrtimer.c:1750
 hrtimer_interrupt+0x392/0x980 kernel/time/hrtimer.c:1812
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1085 [inline]
 __sysvec_apic_timer_interrupt+0x139/0x470 arch/x86/kernel/apic/apic.c:1102
 sysvec_apic_timer_interrupt+0x8c/0xb0 arch/x86/kernel/apic/apic.c:1096
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:638
RIP: 0010:lock_acquire+0x252/0x4f0 kernel/locking/lockdep.c:5627
Code: 2b 00 74 08 4c 89 f7 e8 fc 7c 67 00 f6 44 24 61 02 0f 85 84 01 00 00 41 f7 c7 00 02 00 00 74 01 fb 48 c7 44 24 40 0e 36 e0 45 <4b> c7 44 25 00 00 00 00 00 43 c7 44 25 09 00 00 00 00 43 c7 44 25
RSP: 0018:ffffc90002d864e0 EFLAGS: 00000206
RAX: 0000000000000001 RBX: 1ffff920005b0ca8 RCX: 1ffff920005b0c48
RDX: dffffc0000000000 RSI: ffffffff8a8b3c20 RDI: ffffffff8ad8f680
RBP: ffffc90002d86640 R08: dffffc0000000000 R09: fffffbfff1f7f019
R10: 0000000000000000 R11: dffffc0000000001 R12: 1ffff920005b0ca4
R13: dffffc0000000000 R14: ffffc90002d86540 R15: 0000000000000246
 rcu_lock_acquire+0x2a/0x30 include/linux/rcupdate.h:312
 rcu_read_lock include/linux/rcupdate.h:739 [inline]
 tipc_sk_lookup+0xc9/0x920 net/tipc/socket.c:2998
 tipc_sk_rcv+0x428/0x1d40 net/tipc/socket.c:2492
 tipc_node_xmit+0x1b7/0xf20 net/tipc/node.c:1703
 tipc_node_xmit_skb+0x145/0x1b0 net/tipc/node.c:1768
 tipc_sk_rcv+0x1ab7/0x1d40 net/tipc/socket.c:2522
 tipc_node_xmit+0x1b7/0xf20 net/tipc/node.c:1703
 tipc_sk_push_backlog net/tipc/socket.c:1316 [inline]
 tipc_sk_filter_connect net/tipc/socket.c:2255 [inline]
 tipc_sk_filter_rcv+0x18a2/0x33d0 net/tipc/socket.c:2364
 tipc_sk_enqueue net/tipc/socket.c:2445 [inline]
 tipc_sk_rcv+0x8a7/0x1d40 net/tipc/socket.c:2497
 tipc_node_xmit+0x1b7/0xf20 net/tipc/node.c:1703
 tipc_node_xmit_skb net/tipc/node.c:1768 [inline]
 tipc_node_distr_xmit+0x309/0x440 net/tipc/node.c:1783
 tipc_sk_backlog_rcv+0x199/0x220 net/tipc/socket.c:2412
 sk_backlog_rcv include/net/sock.h:1059 [inline]
 __release_sock+0x198/0x4b0 net/core/sock.c:2724
 release_sock+0x5d/0x1c0 net/core/sock.c:3265
 tipc_release+0x125f/0x16d0 net/tipc/socket.c:652
 __sock_release net/socket.c:649 [inline]
 sock_close+0xcd/0x230 net/socket.c:1336
 __fput+0x3bf/0x890 fs/file_table.c:280
 task_work_run+0x129/0x1a0 kernel/task_work.c:164
 tracehook_notify_resume include/linux/tracehook.h:189 [inline]
 exit_to_user_mode_loop+0x106/0x130 kernel/entry/common.c:181
 exit_to_user_mode_prepare+0xb1/0x140 kernel/entry/common.c:214
 __syscall_exit_to_user_mode_work kernel/entry/common.c:296 [inline]
 syscall_exit_to_user_mode+0x5d/0x240 kernel/entry/common.c:307
 do_syscall_64+0x47/0xb0 arch/x86/entry/common.c:86
 entry_SYSCALL_64_after_hwframe+0x66/0xd0
RIP: 0033:0x7fa17c093ae9
Code: 28 00 00 00 75 05 48 83 c4 28 c3 e8 51 18 00 00 90 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 b0 ff ff ff f7 d8 64 89 01 48
RSP: 002b:00007fa17c054218 EFLAGS: 00000246 ORIG_RAX: 000000000000002e
RAX: 00000000000203a0 RBX: 00007fa17c11f328 RCX: 00007fa17c093ae9
RDX: 0000000000000000 RSI: 00000000200003c0 RDI: 0000000000000003
RBP: 00007fa17c11f320 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 00007fa17c0ec470
R13: 00007fa17c0ec080 R14: 618a5986bea2420f R15: 0cec9143de7537c6
 </TASK>
NMI backtrace for cpu 0
CPU: 0 PID: 3638 Comm: syz-executor325 Not tainted 5.15.159-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 04/02/2024
Call Trace:
 <IRQ>
 __dump_stack lib/dump_stack.c:88 [inline]
 dump_stack_lvl+0x1e3/0x2d0 lib/dump_stack.c:106
 nmi_cpu_backtrace+0x46a/0x4a0 lib/nmi_backtrace.c:111
 nmi_trigger_cpumask_backtrace+0x181/0x2a0 lib/nmi_backtrace.c:62
 trigger_single_cpu_backtrace include/linux/nmi.h:166 [inline]
 rcu_dump_cpu_stacks+0x223/0x390 kernel/rcu/tree_stall.h:349
 print_cpu_stall+0x320/0x600 kernel/rcu/tree_stall.h:633
 check_cpu_stall kernel/rcu/tree_stall.h:727 [inline]
 rcu_pending kernel/rcu/tree.c:3932 [inline]
 rcu_sched_clock_irq+0x8d9/0x1150 kernel/rcu/tree.c:2619
 update_process_times+0x196/0x200 kernel/time/timer.c:1818
 tick_sched_handle kernel/time/tick-sched.c:254 [inline]
 tick_sched_timer+0x386/0x550 kernel/time/tick-sched.c:1473
 __run_hrtimer kernel/time/hrtimer.c:1686 [inline]
 __hrtimer_run_queues+0x55b/0xcf0 kernel/time/hrtimer.c:1750
 hrtimer_interrupt+0x392/0x980 kernel/time/hrtimer.c:1812
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1085 [inline]
 __sysvec_apic_timer_interrupt+0x139/0x470 arch/x86/kernel/apic/apic.c:1102
 sysvec_apic_timer_interrupt+0x8c/0xb0 arch/x86/kernel/apic/apic.c:1096
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:638
RIP: 0010:lock_acquire+0x252/0x4f0 kernel/locking/lockdep.c:5627
Code: 2b 00 74 08 4c 89 f7 e8 fc 7c 67 00 f6 44 24 61 02 0f 85 84 01 00 00 41 f7 c7 00 02 00 00 74 01 fb 48 c7 44 24 40 0e 36 e0 45 <4b> c7 44 25 00 00 00 00 00 43 c7 44 25 09 00 00 00 00 43 c7 44 25
RSP: 0018:ffffc90002d864e0 EFLAGS: 00000206
RAX: 0000000000000001 RBX: 1ffff920005b0ca8 RCX: 1ffff920005b0c48
RDX: dffffc0000000000 RSI: ffffffff8a8b3c20 RDI: ffffffff8ad8f680
RBP: ffffc90002d86640 R08: dffffc0000000000 R09: fffffbfff1f7f019
R10: 0000000000000000 R11: dffffc0000000001 R12: 1ffff920005b0ca4
R13: dffffc0000000000 R14: ffffc90002d86540 R15: 0000000000000246
 rcu_lock_acquire+0x2a/0x30 include/linux/rcupdate.h:312
 rcu_read_lock include/linux/rcupdate.h:739 [inline]
 tipc_sk_lookup+0xc9/0x920 net/tipc/socket.c:2998
 tipc_sk_rcv+0x428/0x1d40 net/tipc/socket.c:2492
 tipc_node_xmit+0x1b7/0xf20 net/tipc/node.c:1703
 tipc_node_xmit_skb+0x145/0x1b0 net/tipc/node.c:1768
 tipc_sk_rcv+0x1ab7/0x1d40 net/tipc/socket.c:2522
 tipc_node_xmit+0x1b7/0xf20 net/tipc/node.c:1703
 tipc_sk_push_backlog net/tipc/socket.c:1316 [inline]
 tipc_sk_filter_connect net/tipc/socket.c:2255 [inline]
 tipc_sk_filter_rcv+0x18a2/0x33d0 net/tipc/socket.c:2364
 tipc_sk_enqueue net/tipc/socket.c:2445 [inline]
 tipc_sk_rcv+0x8a7/0x1d40 net/tipc/socket.c:2497
 tipc_node_xmit+0x1b7/0xf20 net/tipc/node.c:1703
 tipc_node_xmit_skb net/tipc/node.c:1768 [inline]
 tipc_node_distr_xmit+0x309/0x440 net/tipc/node.c:1783
 tipc_sk_backlog_rcv+0x199/0x220 net/tipc/socket.c:2412
 sk_backlog_rcv include/net/sock.h:1059 [inline]
 __release_sock+0x198/0x4b0 net/core/sock.c:2724
 release_sock+0x5d/0x1c0 net/core/sock.c:3265
 tipc_release+0x125f/0x16d0 net/tipc/socket.c:652
 __sock_release net/socket.c:649 [inline]
 sock_close+0xcd/0x230 net/socket.c:1336
 __fput+0x3bf/0x890 fs/file_table.c:280
 task_work_run+0x129/0x1a0 kernel/task_work.c:164
 tracehook_notify_resume include/linux/tracehook.h:189 [inline]
 exit_to_user_mode_loop+0x106/0x130 kernel/entry/common.c:181
 exit_to_user_mode_prepare+0xb1/0x140 kernel/entry/common.c:214
 __syscall_exit_to_user_mode_work kernel/entry/common.c:296 [inline]
 syscall_exit_to_user_mode+0x5d/0x240 kernel/entry/common.c:307
 do_syscall_64+0x47/0xb0 arch/x86/entry/common.c:86
 entry_SYSCALL_64_after_hwframe+0x66/0xd0
RIP: 0033:0x7fa17c093ae9
Code: 28 00 00 00 75 05 48 83 c4 28 c3 e8 51 18 00 00 90 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 b0 ff ff ff f7 d8 64 89 01 48
RSP: 002b:00007fa17c054218 EFLAGS: 00000246 ORIG_RAX: 000000000000002e
RAX: 00000000000203a0 RBX: 00007fa17c11f328 RCX: 00007fa17c093ae9
RDX: 0000000000000000 RSI: 00000000200003c0 RDI: 0000000000000003
RBP: 00007fa17c11f320 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 00007fa17c0ec470
R13: 00007fa17c0ec080 R14: 618a5986bea2420f R15: 0cec9143de7537c6
 </TASK>

Crashes (8):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2024/05/20 09:23 linux-5.15.y 83655231580b c0f1611a .config console log report syz C [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in sock_close
2024/08/12 14:30 linux-5.15.y 7e89efd3ae1c 842184b3 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in sock_close
2024/05/29 16:28 linux-5.15.y c61bd26ae81a 34889ee3 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in sock_close
2024/05/29 16:26 linux-5.15.y c61bd26ae81a 34889ee3 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in sock_close
2024/05/29 06:52 linux-5.15.y c61bd26ae81a 34889ee3 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in sock_close
2024/05/29 06:33 linux-5.15.y c61bd26ae81a 34889ee3 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in sock_close
2024/05/29 06:24 linux-5.15.y c61bd26ae81a 34889ee3 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in sock_close
2024/05/20 00:06 linux-5.15.y 83655231580b c0f1611a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in sock_close
* Struck through repros no longer work on HEAD.