syzbot


INFO: rcu detected stall in clocksource_watchdog

Status: closed as invalid on 2019/11/29 14:24
Subsystems: kvm
[Documentation on labels]
First crash: 1602d, last: 1602d
Similar bugs (1)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: rcu detected stall in clocksource_watchdog (2) kernel 1 1226d 1226d 0/26 auto-closed as invalid on 2021/03/09 21:15

Sample crash report:
rcu: INFO: rcu_preempt self-detected stall on CPU
rcu: 	0-....: (1 GPs behind) idle=e36/1/0x4000000000000004 softirq=40404/44525 fqs=5180 
	(t=10500 jiffies g=34565 q=710)
NMI backtrace for cpu 0
CPU: 0 PID: 24452 Comm: syz-executor.0 Not tainted 5.4.0-syzkaller #0
Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.12.0-59-gc9ba5276e321-prebuilt.qemu.org 04/01/2014
Call Trace:
 <IRQ>
 __dump_stack lib/dump_stack.c:77 [inline]
 dump_stack+0x197/0x210 lib/dump_stack.c:118
 nmi_cpu_backtrace.cold+0x70/0xb2 lib/nmi_backtrace.c:101
 nmi_trigger_cpumask_backtrace+0x23b/0x28b lib/nmi_backtrace.c:62
 arch_trigger_cpumask_backtrace+0x14/0x20 arch/x86/kernel/apic/hw_nmi.c:38
 trigger_single_cpu_backtrace include/linux/nmi.h:164 [inline]
 rcu_dump_cpu_stacks+0x183/0x1cf kernel/rcu/tree_stall.h:254
 print_cpu_stall kernel/rcu/tree_stall.h:455 [inline]
 check_cpu_stall kernel/rcu/tree_stall.h:529 [inline]
 rcu_pending kernel/rcu/tree.c:2827 [inline]
 rcu_sched_clock_irq.cold+0x509/0xc02 kernel/rcu/tree.c:2271
 update_process_times+0x2d/0x70 kernel/time/timer.c:1726
 tick_sched_handle+0xa2/0x190 kernel/time/tick-sched.c:167
 tick_sched_timer+0x53/0x140 kernel/time/tick-sched.c:1310
 __run_hrtimer kernel/time/hrtimer.c:1514 [inline]
 __hrtimer_run_queues+0x364/0xe40 kernel/time/hrtimer.c:1576
 hrtimer_interrupt+0x314/0x770 kernel/time/hrtimer.c:1638
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1110 [inline]
 smp_apic_timer_interrupt+0x160/0x610 arch/x86/kernel/apic/apic.c:1135
 apic_timer_interrupt+0xf/0x20 arch/x86/entry/entry_64.S:829
RIP: 0010:kvm_kick_cpu+0x6b/0x90 arch/x86/kernel/kvm.c:767
Code: df 48 89 da 48 c1 ea 03 0f b6 14 02 48 89 d8 83 e0 07 83 c0 01 38 d0 7c 04 84 d2 75 12 0f b7 0b b8 05 00 00 00 31 db 0f 01 c1 <5b> 41 5c 5d c3 48 89 df e8 e8 6b 7f 00 eb e4 e8 21 6c 7f 00 eb af
RSP: 0018:ffff88802d209b70 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000001
RDX: 0000000000000000 RSI: 000000000000011d RDI: ffffffff88e12168
RBP: ffff88802d209b80 R08: 1ffffffff12368f4 R09: fffffbfff12368f5
R10: fffffbfff12368f4 R11: ffffffff891b47a3 R12: 0000000000000001
R13: ffffffff891b47a0 R14: 000000000000001d R15: ffff88807ffc9200
 pv_kick arch/x86/include/asm/paravirt.h:653 [inline]
 __pv_queued_spin_unlock_slowpath+0x16a/0x270 kernel/locking/qspinlock_paravirt.h:533
 __raw_callee_save___pv_queued_spin_unlock_slowpath+0x15/0x24
 .slowpath+0x9/0x15
 pv_queued_spin_unlock arch/x86/include/asm/paravirt.h:643 [inline]
 queued_spin_unlock arch/x86/include/asm/qspinlock.h:55 [inline]
 do_raw_spin_unlock+0x178/0x270 kernel/locking/spinlock_debug.c:139
 __raw_spin_unlock include/linux/spinlock_api_smp.h:151 [inline]
 _raw_spin_unlock+0x1e/0x40 kernel/locking/spinlock.c:183
 spin_unlock include/linux/spinlock.h:378 [inline]
 clocksource_watchdog+0x46/0x9a0 kernel/time/clocksource.c:299
 call_timer_fn+0x1ac/0x780 kernel/time/timer.c:1404
 expire_timers kernel/time/timer.c:1449 [inline]
 __run_timers kernel/time/timer.c:1773 [inline]
 __run_timers kernel/time/timer.c:1740 [inline]
 run_timer_softirq+0x6c3/0x1790 kernel/time/timer.c:1786
 __do_softirq+0x262/0x98c kernel/softirq.c:292
 invoke_softirq kernel/softirq.c:373 [inline]
 irq_exit+0x19b/0x1e0 kernel/softirq.c:413
 exiting_irq arch/x86/include/asm/apic.h:536 [inline]
 smp_apic_timer_interrupt+0x1a3/0x610 arch/x86/kernel/apic/apic.c:1137
 apic_timer_interrupt+0xf/0x20 arch/x86/entry/entry_64.S:829
 </IRQ>
RIP: 0010:__raw_spin_unlock_irq include/linux/spinlock_api_smp.h:169 [inline]
RIP: 0010:_raw_spin_unlock_irq+0x4f/0x80 kernel/locking/spinlock.c:199
Code: c0 68 34 13 89 48 ba 00 00 00 00 00 fc ff df 48 c1 e8 03 80 3c 10 00 75 33 48 83 3d 12 6a 96 01 00 74 20 fb 66 0f 1f 44 00 00 <bf> 01 00 00 00 e8 e7 ab d3 f9 65 8b 05 18 54 85 78 85 c0 74 06 41
RSP: 0018:ffff88806dfbf8d8 EFLAGS: 00000286 ORIG_RAX: ffffffffffffff13
RAX: 1ffffffff122668d RBX: ffff888013278580 RCX: 0000000000000006
RDX: dffffc0000000000 RSI: 0000000000000008 RDI: ffff888013278e14
RBP: ffff88806dfbf8e0 R08: 1ffffffff15377c0 R09: fffffbfff15377c1
R10: fffffbfff15377c0 R11: ffffffff8a9bbe07 R12: ffff88802d237380
R13: ffffffff8907a1c0 R14: ffff88802ae94980 R15: 0000000000000000
 finish_lock_switch kernel/sched/core.c:3124 [inline]
 finish_task_switch+0x147/0x750 kernel/sched/core.c:3224
 context_switch kernel/sched/core.c:3388 [inline]
 __schedule+0x8e9/0x1f30 kernel/sched/core.c:4081
 preempt_schedule_common+0x4f/0xe0 kernel/sched/core.c:4236
 preempt_schedule+0x4b/0x60 kernel/sched/core.c:4261
 ___preempt_schedule+0x16/0x18 arch/x86/entry/thunk_64.S:50
 smp_call_function_single+0x410/0x480 kernel/smp.c:313
 task_function_call+0xe9/0x180 kernel/events/core.c:114
 perf_install_in_context+0x308/0x5a0 kernel/events/core.c:2746
 __do_sys_perf_event_open+0x1cbc/0x2c70 kernel/events/core.c:11543
 __se_sys_perf_event_open kernel/events/core.c:11151 [inline]
 __x64_sys_perf_event_open+0xbe/0x150 kernel/events/core.c:11151
 do_syscall_64+0xfa/0x790 arch/x86/entry/common.c:294
 entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x45a759
Code: bd b1 fb ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 0f 83 8b b1 fb ff c3 66 2e 0f 1f 84 00 00 00 00
RSP: 002b:00007fec015b0c88 EFLAGS: 00000246 ORIG_RAX: 000000000000012a
RAX: ffffffffffffffda RBX: 000000000071bfa8 RCX: 000000000045a759
RDX: ffffffffffffffff RSI: 0000000000000000 RDI: 00000000200003c0
RBP: 0000000000000005 R08: 0000000000000001 R09: 0000000000000000
R10: ffffffffffffffff R11: 0000000000000246 R12: 00007fec015b16d4
R13: 00000000004aec17 R14: 00000000006f1cb0 R15: 00000000ffffffff

Crashes (3):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2019/11/29 12:09 upstream 81b6b96475ac d29b9e84 .config console log report ci-qemu-upstream
2019/11/29 12:08 upstream 81b6b96475ac d29b9e84 .config console log report ci-qemu-upstream
2019/11/29 11:24 upstream 81b6b96475ac d29b9e84 .config console log report ci-qemu-upstream
* Struck through repros no longer work on HEAD.