syzbot


INFO: rcu detected stall in sys_clock_nanosleep (5)

Status: upstream: reported C repro on 2023/08/17 09:25
Subsystems: kernel
[Documentation on labels]
Reported-by: syzbot+43cc00d616820666f675@syzkaller.appspotmail.com
First crash: 394d, last: 48d
Cause bisection: failed (error log, bisect log)
  
Fix bisection: fixed by (bisect log) :
commit 8c21ab1bae945686c602c5bfa4e3f3352c2452c5
Author: Eric Dumazet <edumazet@google.com>
Date: Tue Aug 29 12:35:41 2023 +0000

  net/sched: fq_pie: avoid stalls in fq_pie_timer()

  
Discussions (1)
Title Replies (including bot) Last reply
[syzbot] [kernel?] INFO: rcu detected stall in sys_clock_nanosleep (5) 0 (2) 2023/09/28 08:34
Similar bugs (8)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
linux-5.15 INFO: rcu detected stall in sys_clock_nanosleep 1 163d 163d 0/3 auto-obsoleted due to no activity on 2023/12/20 18:13
linux-6.1 INFO: rcu detected stall in sys_clock_nanosleep (2) 1 42d 42d 0/3 upstream: reported on 2024/01/10 22:07
upstream INFO: rcu detected stall in sys_clock_nanosleep (4) kernel 6 511d 632d 0/26 auto-obsoleted due to no activity on 2022/12/31 21:43
upstream INFO: rcu detected stall in sys_clock_nanosleep (3) kernel 3 809d 819d 0/26 closed as invalid on 2022/02/08 10:00
upstream INFO: rcu detected stall in sys_clock_nanosleep kernel 1 1064d 1064d 0/26 auto-closed as invalid on 2021/06/22 18:23
linux-6.1 INFO: rcu detected stall in sys_clock_nanosleep 1 339d 339d 0/3 auto-obsoleted due to no activity on 2023/07/17 12:13
upstream INFO: rcu detected stall in sys_clock_nanosleep (2) kernel 1 942d 942d 0/26 auto-closed as invalid on 2021/10/22 22:53
linux-5.15 INFO: rcu detected stall in sys_clock_nanosleep (2) 1 39d 39d 0/3 upstream: reported on 2024/01/13 21:31
Last patch testing requests (3)
Created Duration User Patch Repo Result
2023/09/01 01:29 22m retest repro upstream OK log
2023/09/01 01:29 22m retest repro net OK log
2023/08/17 10:49 23m hdanton@sina.com patch https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git c1a515d3c027 OK log

Sample crash report:
rcu: INFO: rcu_preempt self-detected stall on CPU
rcu: 	1-....: (10499 ticks this GP) idle=c37c/1/0x4000000000000000 softirq=8510/8511 fqs=5247
rcu: 	         hardirqs   softirqs   csw/system
rcu: 	 number:        2          0            0
rcu: 	cputime:    29992      22496           71   ==> 52520(ms)
rcu: 	(t=10503 jiffies g=5517 q=636 ncpus=2)
CPU: 1 PID: 5044 Comm: syz-executor388 Not tainted 6.5.0-rc4-syzkaller-00174-gc1a515d3c027 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 07/12/2023
RIP: 0010:taprio_dequeue_from_txq+0x120/0x8d0 net/sched/sch_taprio.c:731
Code: 02 00 00 48 b8 00 00 00 00 00 fc ff df 48 89 fa 48 c1 ea 03 0f b6 04 02 84 c0 74 08 3c 03 0f 8e 5f 06 00 00 8b ab d0 02 00 00 <4d> 8d 7c 24 18 48 ba 00 00 00 00 00 fc ff df 4c 89 f9 48 c1 e9 03
RSP: 0018:ffffc900001e0d00 EFLAGS: 00000246
RAX: 0000000000000000 RBX: ffff8880671f3000 RCX: 0000000000000100
RDX: 1ffff1100ce3e65a RSI: ffffffff88594162 RDI: ffff8880671f32d0
RBP: 0000000000000000 R08: 0000000000000004 R09: 0000000000000009
R10: 0000000000000000 R11: 0000000000000000 R12: ffff88807f540000
R13: ffff88802bf54000 R14: ffff888028b02000 R15: 0000000000000001
FS:  000055555610d480(0000) GS:ffff8880b9900000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007faf300544e3 CR3: 0000000076896000 CR4: 0000000000350ee0
Call Trace:
 <IRQ>
 taprio_dequeue_tc_priority+0x289/0x4b0 net/sched/sch_taprio.c:798
 taprio_dequeue+0x12e/0x5f0 net/sched/sch_taprio.c:868
 dequeue_skb net/sched/sch_generic.c:292 [inline]
 qdisc_restart net/sched/sch_generic.c:397 [inline]
 __qdisc_run+0x1c4/0x19d0 net/sched/sch_generic.c:415
 qdisc_run include/net/pkt_sched.h:125 [inline]
 qdisc_run include/net/pkt_sched.h:122 [inline]
 net_tx_action+0x71e/0xc80 net/core/dev.c:5049
 __do_softirq+0x218/0x965 kernel/softirq.c:553
 invoke_softirq kernel/softirq.c:427 [inline]
 __irq_exit_rcu kernel/softirq.c:632 [inline]
 irq_exit_rcu+0xb7/0x120 kernel/softirq.c:644
 sysvec_apic_timer_interrupt+0x93/0xc0 arch/x86/kernel/apic/apic.c:1109
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x1a/0x20 arch/x86/include/asm/idtentry.h:645
RIP: 0010:__raw_spin_unlock_irqrestore include/linux/spinlock_api_smp.h:152 [inline]
RIP: 0010:_raw_spin_unlock_irqrestore+0x31/0x70 kernel/locking/spinlock.c:194
Code: f5 53 48 8b 74 24 10 48 89 fb 48 83 c7 18 e8 d6 7b 31 f7 48 89 df e8 ae fa 31 f7 f7 c5 00 02 00 00 75 1f 9c 58 f6 c4 02 75 2f <bf> 01 00 00 00 e8 55 9d 23 f7 65 8b 05 a6 2b ce 75 85 c0 74 12 5b
RSP: 0018:ffffc90003cffc68 EFLAGS: 00000246
RAX: 0000000000000002 RBX: ffff8880b992b880 RCX: 1ffffffff1d56b59
RDX: 0000000000000000 RSI: ffffffff8a6c7480 RDI: ffffffff8ac80560
RBP: 0000000000000246 R08: 0000000000000001 R09: 0000000000000001
R10: ffffffff8eab8c57 R11: 0000000000000000 R12: dffffc0000000000
R13: ffffc90003cffdd0 R14: 00000000000f4240 R15: ffff888028c53b98
 hrtimer_start_expires include/linux/hrtimer.h:432 [inline]
 hrtimer_sleeper_start_expires kernel/time/hrtimer.c:1968 [inline]
 do_nanosleep+0x1f2/0x500 kernel/time/hrtimer.c:2044
 hrtimer_nanosleep+0x1ae/0x440 kernel/time/hrtimer.c:2100
 common_nsleep+0xa1/0xc0 kernel/time/posix-timers.c:1350
 __do_sys_clock_nanosleep kernel/time/posix-timers.c:1396 [inline]
 __se_sys_clock_nanosleep kernel/time/posix-timers.c:1373 [inline]
 __x64_sys_clock_nanosleep+0x344/0x490 kernel/time/posix-timers.c:1373
 do_syscall_x64 arch/x86/entry/common.c:50 [inline]
 do_syscall_64+0x38/0xb0 arch/x86/entry/common.c:80
 entry_SYSCALL_64_after_hwframe+0x63/0xcd
RIP: 0033:0x7faf300385b3
Code: 00 00 00 00 0f 1f 00 83 ff 03 74 7b 83 ff 02 b8 fa ff ff ff 49 89 ca 0f 44 f8 80 3d ee ca 04 00 00 74 14 b8 e6 00 00 00 0f 05 <f7> d8 c3 66 2e 0f 1f 84 00 00 00 00 00 48 83 ec 28 48 89 54 24 10
RSP: 002b:00007ffea76f6af8 EFLAGS: 00000202 ORIG_RAX: 00000000000000e6
RAX: ffffffffffffffda RBX: 000000000000000d RCX: 00007faf300385b3
RDX: 00007ffea76f6b10 RSI: 0000000000000000 RDI: 0000000000000000
RBP: 00000000000f4240 R08: 00000000000000d3 R09: 0000000000000001
R10: 0000000000000000 R11: 0000000000000202 R12: 00007ffea76f6bf0
R13: 0000000000033bc3 R14: 00007ffea76f6be4 R15: 0000000000000003
 </TASK>

Crashes (19):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2023/08/04 16:07 upstream c1a515d3c027 74621247 .config console log report syz C [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: rcu detected stall in sys_clock_nanosleep
2023/06/27 07:12 net 6709d4b7bc2e 4cd5bb25 .config console log report syz C [disk image] [vmlinux] [kernel image] ci-upstream-net-this-kasan-gce INFO: rcu detected stall in sys_clock_nanosleep
2023/11/10 11:35 upstream 89cdf9d55601 45e9b83e .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-selinux-root INFO: rcu detected stall in sys_clock_nanosleep
2023/08/11 05:20 upstream 25aa0bebba72 da3c3ef8 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_nanosleep
2023/07/16 23:40 upstream 20edcec23f92 35d9ecc5 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_nanosleep
2023/06/22 03:23 upstream dad9774deaf1 09ffe269 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-selinux-root INFO: rcu detected stall in sys_clock_nanosleep
2023/06/07 10:04 upstream a4d7d7011219 7086cdb9 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: rcu detected stall in sys_clock_nanosleep
2023/06/07 09:43 upstream a4d7d7011219 7086cdb9 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_nanosleep
2023/05/13 08:38 upstream 9a48d6046722 2b9ba477 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_nanosleep
2023/02/24 17:35 upstream d2980d8d8265 ee50e71c .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: rcu detected stall in sys_clock_nanosleep
2023/01/23 03:34 upstream 2475bf0250de 559a440a .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-selinux-root INFO: rcu detected stall in sys_clock_nanosleep
2023/07/27 19:28 net de52e17326c3 92476829 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-net-this-kasan-gce INFO: rcu detected stall in sys_clock_nanosleep
2023/06/06 01:36 net-next 28cfea989d6f a4ae4f42 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-net-kasan-gce INFO: rcu detected stall in sys_clock_nanosleep
2023/06/03 10:56 net-next 4ec732951702 a4ae4f42 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-net-kasan-gce INFO: rcu detected stall in sys_clock_nanosleep
2024/01/04 20:17 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing 79c58ab241be 28c42cff .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-usb INFO: rcu detected stall in sys_clock_nanosleep
2023/11/11 10:45 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing 6bc986ab839c 6d6dbf8a .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-usb INFO: rcu detected stall in sys_clock_nanosleep
2023/09/30 07:15 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing 6465e260f487 8e26a358 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-usb INFO: rcu detected stall in sys_clock_nanosleep
2023/09/29 09:47 linux-next df964ce9ef9f d265efd8 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in sys_clock_nanosleep
2023/02/07 04:37 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing 41070a7027e9 0a9c11b6 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-usb INFO: rcu detected stall in sys_clock_nanosleep
* Struck through repros no longer work on HEAD.