syzbot


INFO: rcu detected stall in sys_clock_adjtime

Status: upstream: reported C repro on 2020/07/07 15:13
Subsystems: fs
[Documentation on labels]
Reported-by: syzbot+25b7addb06e92c482190@syzkaller.appspotmail.com
First crash: 1351d, last: 8d11h
Cause bisection: introduced by (bisect log) [release commit]:
commit 84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d
Author: Greg Kroah-Hartman <gregkh@linuxfoundation.org>
Date: Mon Oct 22 06:37:37 2018 +0000

  Linux 4.19

Crash: kernel panic: panic_on_warn set (log)
Repro: C syz .config
  
Fix bisection the fix commit could be any of (bisect log):
  7cc2a8ea1048 Merge tag 'block-5.8-2020-07-01' of git://git.kernel.dk/linux-block
  303392fd5c16 Merge tag 'leds-5.14-rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/pavel/linux-leds
  
Discussions (5)
Title Replies (including bot) Last reply
[syzbot] Monthly fs report (Mar 2024) 0 (1) 2024/03/16 12:09
[syzbot] Monthly fs report (Dec 2023) 0 (1) 2023/12/12 22:02
[syzbot] Monthly fs report (Aug 2023) 0 (1) 2023/08/08 12:55
[syzbot] Monthly fs report (May 2023) 0 (1) 2023/05/06 14:02
INFO: rcu detected stall in sys_clock_adjtime 0 (1) 2020/07/07 15:13
Similar bugs (2)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
linux-6.1 INFO: rcu detected stall in sys_clock_adjtime 21 19d 361d 0/3 upstream: reported on 2023/03/24 02:32
linux-5.15 INFO: rcu detected stall in sys_clock_adjtime origin:upstream C 30 10d 347d 0/3 upstream: reported C repro on 2023/04/06 18:02
Last patch testing requests (6)
Created Duration User Patch Repo Result
2024/03/10 19:20 23m retest repro upstream report log
2024/02/17 19:42 25m retest repro upstream report log
2023/12/09 11:24 17m retest repro upstream report log
2023/09/13 00:53 15m retest repro upstream report log
2023/09/13 00:53 20m retest repro upstream OK log
2022/10/03 01:30 13m retest repro upstream report log
Fix bisection attempts (10)
Created Duration User Patch Repo Result
2021/07/04 01:21 31m bisect fix upstream job log (2)
2021/06/04 00:45 26m bisect fix upstream job log (0) log
2021/05/04 12:27 30m bisect fix upstream job log (0) log
2021/04/04 09:29 31m bisect fix upstream job log (0) log
2021/03/04 23:42 29m bisect fix upstream job log (0) log
2021/01/30 18:05 25m bisect fix upstream job log (0) log
2020/12/31 17:38 25m bisect fix upstream job log (0) log
2020/12/01 17:14 24m bisect fix upstream job log (0) log
2020/11/01 16:44 29m bisect fix upstream job log (0) log
2020/09/17 03:07 25m bisect fix upstream job log (0) log

Sample crash report:
rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
rcu: 	0-...!: (2 ticks this GP) idle=c46c/1/0x4000000000000000 softirq=6399/6401 fqs=1
rcu: 	(detected by 1, t=10502 jiffies, g=7613, q=108 ncpus=2)
Sending NMI from CPU 1 to CPUs 0:
NMI backtrace for cpu 0
CPU: 0 PID: 5080 Comm: syz-executor534 Not tainted 6.8.0-rc5-syzkaller-00329-gab0a97cffa0b #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/25/2024
RIP: 0010:hlock_class kernel/locking/lockdep.c:223 [inline]
RIP: 0010:__lock_acquire+0xeeb/0x1fd0 kernel/locking/lockdep.c:5133
Code: 0a 70 14 0e 00 4d 89 fc 0f 85 63 04 00 00 48 83 7c 24 30 00 0f 84 52 03 00 00 48 8b 44 24 48 48 8d 58 f8 48 89 d8 48 c1 e8 03 <0f> b6 04 38 84 c0 0f 85 7f 0e 00 00 8b 1b 81 e3 ff 1f 00 00 48 89
RSP: 0018:ffffc90000007a30 EFLAGS: 00000016
RAX: 1ffff1100fc4315c RBX: ffff88807e218ae0 RCX: 0000000001ba48fd
RDX: 000000004e47865c RSI: 0000000002c1e137 RDI: dffffc0000000000
RBP: bae15fa8ab7cafc1 R08: ffffffff92c8d4ff R09: 1ffffffff2591a9f
R10: dffffc0000000000 R11: fffffbfff2591aa0 R12: ffff88807e218000
R13: ffff88807e218000 R14: 0000000000000001 R15: ffff88807e218000
FS:  00005555563f7380(0000) GS:ffff8880b9400000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000020000600 CR3: 000000001ec88000 CR4: 0000000000350ef0
Call Trace:
 <NMI>
 </NMI>
 <IRQ>
 lock_acquire+0x1e3/0x530 kernel/locking/lockdep.c:5754
 __raw_spin_lock include/linux/spinlock_api_smp.h:133 [inline]
 _raw_spin_lock+0x2e/0x40 kernel/locking/spinlock.c:154
 spin_lock include/linux/spinlock.h:351 [inline]
 advance_sched+0xab/0xca0 net/sched/sch_taprio.c:935
 __run_hrtimer kernel/time/hrtimer.c:1689 [inline]
 __hrtimer_run_queues+0x596/0xd00 kernel/time/hrtimer.c:1753
 hrtimer_interrupt+0x396/0x990 kernel/time/hrtimer.c:1815
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1065 [inline]
 __sysvec_apic_timer_interrupt+0x109/0x3a0 arch/x86/kernel/apic/apic.c:1082
 sysvec_apic_timer_interrupt+0x92/0xb0 arch/x86/kernel/apic/apic.c:1076
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x1a/0x20 arch/x86/include/asm/idtentry.h:649
RIP: 0010:__raw_spin_unlock_irqrestore include/linux/spinlock_api_smp.h:152 [inline]
RIP: 0010:_raw_spin_unlock_irqrestore+0xd8/0x140 kernel/locking/spinlock.c:194
Code: 9c 8f 44 24 20 42 80 3c 23 00 74 08 4c 89 f7 e8 ae b0 83 f6 f6 44 24 21 02 75 52 41 f7 c7 00 02 00 00 74 01 fb bf 01 00 00 00 <e8> a3 6c f2 f5 65 8b 05 24 de 91 74 85 c0 74 43 48 c7 04 24 0e 36
RSP: 0018:ffffc900043f7900 EFLAGS: 00000206
RAX: 5591fdbf8ade3d00 RBX: 1ffff9200087ef24 RCX: ffffffff8171893a
RDX: dffffc0000000000 RSI: ffffffff8baab660 RDI: 0000000000000001
RBP: ffffc900043f7990 R08: ffffffff92c8d427 R09: 1ffffffff2591a84
R10: dffffc0000000000 R11: fffffbfff2591a85 R12: dffffc0000000000
R13: 1ffff9200087ef20 R14: ffffc900043f7920 R15: 0000000000000246
 clock_was_set+0x6a1/0x830 kernel/time/hrtimer.c:972
 timekeeping_inject_offset+0x4e8/0x580 kernel/time/timekeeping.c:1395
 do_adjtimex+0x515/0xab0 kernel/time/timekeeping.c:2444
 do_clock_adjtime kernel/time/posix-timers.c:1159 [inline]
 __do_sys_clock_adjtime kernel/time/posix-timers.c:1171 [inline]
 __se_sys_clock_adjtime kernel/time/posix-timers.c:1162 [inline]
 __x64_sys_clock_adjtime+0x1e3/0x290 kernel/time/posix-timers.c:1162
 do_syscall_64+0xfb/0x240
 entry_SYSCALL_64_after_hwframe+0x6f/0x77
RIP: 0033:0x7f2b5a96dee9
Code: 28 00 00 00 75 05 48 83 c4 28 c3 e8 d1 19 00 00 90 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 b8 ff ff ff f7 d8 64 89 01 48
RSP: 002b:00007ffe782c3e78 EFLAGS: 00000246 ORIG_RAX: 0000000000000131
RAX: ffffffffffffffda RBX: 0000000000000003 RCX: 00007f2b5a96dee9
RDX: 00007f2b5a96dee9 RSI: 0000000020000100 RDI: 0000000000000000
RBP: 00000000000f4240 R08: 0000000000000000 R09: 0000000100000000
R10: 0000000100000000 R11: 0000000000000246 R12: 00007ffe782c3ed0
R13: 0000000000000001 R14: 00007ffe782c3ed0 R15: 0000000000000003
 </TASK>
INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 2.477 msecs
rcu: rcu_preempt kthread starved for 10500 jiffies! g7613 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=1
rcu: 	Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
rcu: RCU grace-period kthread stack dump:
task:rcu_preempt     state:R  running task     stack:25496 pid:17    tgid:17    ppid:2      flags:0x00004000
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5400 [inline]
 __schedule+0x17d1/0x49f0 kernel/sched/core.c:6727
 __schedule_loop kernel/sched/core.c:6802 [inline]
 schedule+0x149/0x260 kernel/sched/core.c:6817
 schedule_timeout+0x1bd/0x310 kernel/time/timer.c:2183
 rcu_gp_fqs_loop+0x2df/0x1330 kernel/rcu/tree.c:1663
 rcu_gp_kthread+0xa7/0x3b0 kernel/rcu/tree.c:1862
 kthread+0x2f1/0x390 kernel/kthread.c:388
 ret_from_fork+0x4d/0x80 arch/x86/kernel/process.c:147
 ret_from_fork_asm+0x1b/0x30 arch/x86/entry/entry_64.S:242
 </TASK>
rcu: Stack dump where RCU GP kthread last ran:
CPU: 1 PID: 59 Comm: kworker/u4:4 Not tainted 6.8.0-rc5-syzkaller-00329-gab0a97cffa0b #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/25/2024
Workqueue: events_unbound toggle_allocation_gate
RIP: 0010:csd_lock_wait kernel/smp.c:311 [inline]
RIP: 0010:smp_call_function_many_cond+0x1855/0x2960 kernel/smp.c:855
Code: 89 e6 83 e6 01 31 ff e8 99 d4 0b 00 41 83 e4 01 49 bc 00 00 00 00 00 fc ff df 75 07 e8 44 d0 0b 00 eb 38 f3 90 42 0f b6 04 23 <84> c0 75 11 41 f7 45 00 01 00 00 00 74 1e e8 28 d0 0b 00 eb e4 44
RSP: 0018:ffffc900015a7720 EFLAGS: 00000293
RAX: 0000000000000000 RBX: 1ffff110172888c1 RCX: ffff888016781dc0
RDX: 0000000000000000 RSI: 0000000000000001 RDI: 0000000000000000
RBP: ffffc900015a7920 R08: ffffffff81879cf7 R09: 1ffffffff2591a84
R10: dffffc0000000000 R11: fffffbfff2591a85 R12: dffffc0000000000
R13: ffff8880b9444608 R14: ffff8880b953da80 R15: 0000000000000000
FS:  0000000000000000(0000) GS:ffff8880b9500000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f2b5a9bb3b0 CR3: 000000000df32000 CR4: 0000000000350ef0
Call Trace:
 <IRQ>
 </IRQ>
 <TASK>
 on_each_cpu_cond_mask+0x3f/0x80 kernel/smp.c:1023
 on_each_cpu include/linux/smp.h:71 [inline]
 text_poke_sync arch/x86/kernel/alternative.c:2087 [inline]
 text_poke_bp_batch+0x352/0xb30 arch/x86/kernel/alternative.c:2297
 text_poke_flush arch/x86/kernel/alternative.c:2488 [inline]
 text_poke_finish+0x30/0x50 arch/x86/kernel/alternative.c:2495
 arch_jump_label_transform_apply+0x1c/0x30 arch/x86/kernel/jump_label.c:146
 static_key_enable_cpuslocked+0x136/0x260 kernel/jump_label.c:205
 static_key_enable+0x1a/0x20 kernel/jump_label.c:218
 toggle_allocation_gate+0xb5/0x250 mm/kfence/core.c:826
 process_one_work kernel/workqueue.c:2633 [inline]
 process_scheduled_works+0x915/0x1420 kernel/workqueue.c:2706
 worker_thread+0xa5f/0x1000 kernel/workqueue.c:2787
 kthread+0x2f1/0x390 kernel/kthread.c:388
 ret_from_fork+0x4d/0x80 arch/x86/kernel/process.c:147
 ret_from_fork_asm+0x1b/0x30 arch/x86/entry/entry_64.S:242
 </TASK>

Crashes (45):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2024/02/25 19:08 upstream ab0a97cffa0b 8d446f15 .config strace log report syz C [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: rcu detected stall in sys_clock_adjtime
2023/08/17 12:31 upstream 4853c74bd7ab 74b106b6 .config strace log report syz C [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2020/07/07 05:48 upstream 7cc2a8ea1048 51095195 .config console log report syz C ci-upstream-kasan-gce-smack-root
2023/12/11 03:46 upstream a39b6ac3781d 28b24332 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2023/11/25 09:37 upstream 0f5cc96c367f 5b429f39 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2023/11/22 17:23 upstream c2d5304e6c64 03e12510 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2023/11/13 20:51 upstream b85ea95d0864 cb976f63 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2023/10/27 17:26 upstream 750b95887e56 bf285f0c .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2023/10/27 03:58 upstream 3a568e3a961b bf285f0c .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2023/10/27 01:45 upstream 3a568e3a961b bf285f0c .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2023/10/21 19:53 upstream 9c5d00cb7b6b 361b23dc .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2023/10/02 23:28 upstream 8f1b4600373f 50b20e75 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2023/10/02 05:23 upstream 8a749fd1a872 8e26a358 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2023/09/30 12:49 upstream 9f3ebbef746f 8e26a358 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2023/09/27 22:16 upstream 633b47cb009d 2895a507 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2023/09/27 17:02 upstream 0e945134b680 2895a507 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2023/09/26 22:19 upstream 50768a425b46 0b6a67ac .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2023/09/25 11:59 upstream 6465e260f487 0b6a67ac .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2023/09/23 02:20 upstream 8018e02a8703 0b6a67ac .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2023/09/21 23:53 upstream b5cbe7c00aa0 0b6a67ac .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2023/09/21 09:23 upstream 42dc814987c1 0b6a67ac .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2023/09/17 22:10 upstream e789286468a9 0b6a67ac .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2023/08/28 09:25 upstream 2dde18cd1d8f 03d9c195 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2023/08/25 12:22 upstream 4f9e7fabf864 03d9c195 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2023/08/22 21:00 upstream 53663f4103ff b81ca3f6 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2023/08/20 08:14 upstream 9e6c269de404 d216d8a0 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2023/07/30 01:07 upstream 12214540ad87 92476829 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2023/07/24 11:19 upstream 6eaae1980760 06460670 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2023/07/04 09:55 upstream 24be4d0b46bb 6e553898 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2023/06/28 12:55 upstream 6f612579be9d 8064cb02 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2023/05/22 10:06 upstream 44c026a73be8 4bce1a3e .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2023/05/18 10:25 upstream 1b66c114d161 3bb7af1d .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2023/05/05 04:57 upstream 3c4aa4434377 518a39a6 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2023/03/14 14:20 upstream fc89d7fb499b 0d5c4377 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2023/01/18 11:14 upstream c1649ec55708 42660d9e .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2023/01/18 00:02 upstream 6e50979a9c87 aedf5331 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2022/10/14 09:56 upstream 55be6084c8e0 4954e4b2 .config console log report info [disk image] [vmlinux] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2021/10/01 07:13 upstream 4de593fb965f 1d849ab4 .config console log report info ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in sys_clock_adjtime
2020/10/02 14:35 upstream 472e5b056f00 9602ddf4 .config console log report info ci-upstream-kasan-gce-smack-root
2020/09/22 06:18 upstream 98477740630f 9e1fa68e .config console log report info ci-upstream-kasan-gce-smack-root
2020/08/18 03:07 upstream 06a4ec1d9dc6 424dd8e7 .config console log report ci-upstream-kasan-gce-smack-root
2020/08/07 08:34 upstream d6efb3ac3e6c cb436c69 .config console log report ci-upstream-kasan-gce-smack-root
2020/08/04 15:13 upstream c0842fbc1b18 80a06902 .config console log report ci-upstream-kasan-gce-smack-root
2020/07/27 13:08 upstream 92ed30191993 cb93dc6a .config console log report ci-upstream-kasan-gce-smack-root
2023/06/11 08:42 git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux.git for-kernelci d8b213732169 7086cdb9 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-gce-arm64 BUG: soft lockup in sys_clock_adjtime
* Struck through repros no longer work on HEAD.