syzbot


INFO: rcu detected stall in sys_clock_adjtime (2)

Status: upstream: reported on 2024/12/09 15:30
Reported-by: syzbot+a9e12e4beb0106fea630@syzkaller.appspotmail.com
First crash: 12d, last: 5d13h
Similar bugs (3)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
linux-6.1 INFO: rcu detected stall in sys_clock_adjtime 28 187d 638d 0/3 auto-obsoleted due to no activity on 2024/09/25 13:11
upstream INFO: rcu detected stall in sys_clock_adjtime kernel C done inconclusive 126 2d16h 1628d 0/28 upstream: reported C repro on 2020/07/07 15:13
linux-5.15 INFO: rcu detected stall in sys_clock_adjtime origin:upstream C 47 3d14h 625d 0/3 upstream: reported C repro on 2023/04/06 18:02

Sample crash report:
rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
rcu: 	1-...!: (1 GPs behind) idle=a0c4/1/0x4000000000000000 softirq=18520/18522 fqs=1
	(detected by 0, t=10505 jiffies, g=22113, q=296 ncpus=2)
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 6233 Comm: syz.5.531 Tainted: G        W          6.1.120-syzkaller-00773-g52f863f820fd #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 11/25/2024
RIP: 0010:__lock_release kernel/locking/lockdep.c:5348 [inline]
RIP: 0010:lock_release+0x2b2/0xa20 kernel/locking/lockdep.c:5682
Code: 03 42 0f b6 04 38 84 c0 0f 85 0a 05 00 00 83 3b 00 0f 85 0b 04 00 00 4d 8d 74 24 20 4c 89 f3 48 c1 eb 03 42 0f b6 04 3b 84 c0 <48> 8b 34 24 0f 85 07 05 00 00 45 8b 2e 41 81 fd 00 00 10 00 72 24
RSP: 0018:ffffc900001e0ae0 EFLAGS: 00000046
RAX: 0000000000000000 RBX: 1ffff1100a7f1c92 RCX: ffffc900001e0b03
RDX: 0000000000000002 RSI: ffffffff975cbd58 RDI: ffff888053f8e470
RBP: ffffc900001e0c10 R08: dffffc0000000000 R09: fffffbfff1d360c6
R10: 0000000000000000 R11: dffffc0000000001 R12: ffff888053f8e470
R13: 0000000000000002 R14: ffff888053f8e490 R15: dffffc0000000000
FS:  00007f27c548d6c0(0000) GS:ffff8880b8f00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000020000440 CR3: 0000000053a3f000 CR4: 00000000003506e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <NMI>
 </NMI>
 <IRQ>
 __raw_spin_unlock_irqrestore include/linux/spinlock_api_smp.h:149 [inline]
 _raw_spin_unlock_irqrestore+0x75/0x130 kernel/locking/spinlock.c:194
 debug_object_activate+0x2f9/0x4e0 lib/debugobjects.c:716
 debug_hrtimer_activate kernel/time/hrtimer.c:421 [inline]
 debug_activate kernel/time/hrtimer.c:476 [inline]
 enqueue_hrtimer+0x30/0x410 kernel/time/hrtimer.c:1085
 __run_hrtimer kernel/time/hrtimer.c:1706 [inline]
 __hrtimer_run_queues+0x728/0xe50 kernel/time/hrtimer.c:1753
 hrtimer_interrupt+0x392/0x980 kernel/time/hrtimer.c:1815
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1107 [inline]
 __sysvec_apic_timer_interrupt+0x158/0x5b0 arch/x86/kernel/apic/apic.c:1124
 instr_sysvec_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1118 [inline]
 sysvec_apic_timer_interrupt+0x9b/0xc0 arch/x86/kernel/apic/apic.c:1118
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:691
RIP: 0010:__raw_spin_unlock_irqrestore include/linux/spinlock_api_smp.h:152 [inline]
RIP: 0010:_raw_spin_unlock_irqrestore+0xd4/0x130 kernel/locking/spinlock.c:194
Code: 9c 8f 44 24 20 42 80 3c 23 00 74 08 4c 89 f7 e8 b2 87 25 f7 f6 44 24 21 02 75 4e 41 f7 c7 00 02 00 00 74 01 fb bf 01 00 00 00 <e8> 37 f1 a1 f6 65 8b 05 f8 d0 45 75 85 c0 74 3f 48 c7 04 24 0e 36
RSP: 0018:ffffc90003857920 EFLAGS: 00000206
RAX: 8dc836f41c8bf000 RBX: 1ffff9200070af28 RCX: ffffffff816b123a
RDX: dffffc0000000000 RSI: ffffffff8b0c0360 RDI: 0000000000000001
RBP: ffffc900038579b0 R08: dffffc0000000000 R09: fffffbfff2249c4d
R10: 0000000000000000 R11: dffffc0000000001 R12: dffffc0000000000
R13: 1ffff9200070af24 R14: ffffc90003857940 R15: 0000000000000246
 clock_was_set+0x177/0x900 kernel/time/hrtimer.c:971
 timekeeping_inject_offset+0x65f/0x710 kernel/time/timekeeping.c:1395
 do_adjtimex+0x511/0xab0 kernel/time/timekeeping.c:2444
 do_clock_adjtime kernel/time/posix-timers.c:1154 [inline]
 __do_sys_clock_adjtime kernel/time/posix-timers.c:1166 [inline]
 __se_sys_clock_adjtime kernel/time/posix-timers.c:1157 [inline]
 __x64_sys_clock_adjtime+0x1dc/0x290 kernel/time/posix-timers.c:1157
 do_syscall_x64 arch/x86/entry/common.c:51 [inline]
 do_syscall_64+0x3b/0xb0 arch/x86/entry/common.c:81
 entry_SYSCALL_64_after_hwframe+0x68/0xd2
RIP: 0033:0x7f27c4585d19
Code: ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 a8 ff ff ff f7 d8 64 89 01 48
RSP: 002b:00007f27c548d038 EFLAGS: 00000246 ORIG_RAX: 0000000000000131
RAX: ffffffffffffffda RBX: 00007f27c4775fa0 RCX: 00007f27c4585d19
RDX: 0000000000000000 RSI: 0000000020000480 RDI: 0000000000000000
RBP: 00007f27c4601a20 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
R13: 0000000000000000 R14: 00007f27c4775fa0 R15: 00007ffc98d80128
 </TASK>
rcu: rcu_preempt kthread starved for 10500 jiffies! g22113 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=0
rcu: 	Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
rcu: RCU grace-period kthread stack dump:
task:rcu_preempt     state:R  running task     stack:26048 pid:16    ppid:2      flags:0x00004000
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5241 [inline]
 __schedule+0x143f/0x4570 kernel/sched/core.c:6558
 schedule+0xbf/0x180 kernel/sched/core.c:6634
 schedule_timeout+0x1b9/0x300 kernel/time/timer.c:1965
 rcu_gp_fqs_loop+0x2d2/0x1150 kernel/rcu/tree.c:1706
 rcu_gp_kthread+0xa3/0x3b0 kernel/rcu/tree.c:1905
 kthread+0x28d/0x320 kernel/kthread.c:376
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:295
 </TASK>
rcu: Stack dump where RCU GP kthread last ran:
CPU: 0 PID: 5195 Comm: kworker/u4:8 Tainted: G        W          6.1.120-syzkaller-00773-g52f863f820fd #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 11/25/2024
Workqueue: events_unbound toggle_allocation_gate
RIP: 0010:csd_lock_wait kernel/smp.c:424 [inline]
RIP: 0010:smp_call_function_many_cond+0x1fb3/0x3460 kernel/smp.c:998
Code: e6 01 31 ff e8 0e 44 0b 00 41 83 e5 01 49 bd 00 00 00 00 00 fc ff df 75 0a e8 99 40 0b 00 e9 1b ff ff ff f3 90 42 0f b6 04 2b <84> c0 75 14 41 f7 07 01 00 00 00 0f 84 fe fe ff ff e8 77 40 0b 00
RSP: 0018:ffffc9000e6c75a0 EFLAGS: 00000293
RAX: 0000000000000000 RBX: 1ffff110171e81b1 RCX: ffff88802e72bb80
RDX: 0000000000000000 RSI: 0000000000000001 RDI: 0000000000000000
RBP: ffffc9000e6c7980 R08: ffffffff817f5bc2 R09: fffffbfff2249c4d
R10: 0000000000000000 R11: dffffc0000000001 R12: 0000000800000000
R13: dffffc0000000000 R14: 0000000000000001 R15: ffff8880b8f40d88
FS:  0000000000000000(0000) GS:ffff8880b8e00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000555560ae7808 CR3: 000000000d08e000 CR4: 00000000003506f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <IRQ>
 </IRQ>
 <TASK>
 on_each_cpu_cond_mask+0x3b/0x80 kernel/smp.c:1166
 on_each_cpu include/linux/smp.h:71 [inline]
 text_poke_sync arch/x86/kernel/alternative.c:1334 [inline]
 text_poke_bp_batch+0x2bb/0x940 arch/x86/kernel/alternative.c:1534
 text_poke_flush arch/x86/kernel/alternative.c:1725 [inline]
 text_poke_finish+0x16/0x30 arch/x86/kernel/alternative.c:1732
 arch_jump_label_transform_apply+0x13/0x20 arch/x86/kernel/jump_label.c:146
 static_key_enable_cpuslocked+0x12e/0x250 kernel/jump_label.c:207
 static_key_enable+0x16/0x20 kernel/jump_label.c:220
 toggle_allocation_gate+0xbf/0x480 mm/kfence/core.c:804
 process_one_work+0x8a9/0x11d0 kernel/workqueue.c:2292
 worker_thread+0xa47/0x1200 kernel/workqueue.c:2439
 kthread+0x28d/0x320 kernel/kthread.c:376
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:295
 </TASK>

Crashes (3):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2024/12/16 12:11 linux-6.1.y 52f863f820fd eec85da6 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in sys_clock_adjtime
2024/12/13 22:09 linux-6.1.y e4d90d63d385 7cbfbb3a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in sys_clock_adjtime
2024/12/09 15:30 linux-6.1.y e4d90d63d385 9ac0fdc6 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in sys_clock_adjtime
* Struck through repros no longer work on HEAD.