syzbot


INFO: rcu detected stall in asm_sysvec_reschedule_ipi (2)

Status: auto-obsoleted due to no activity on 2025/02/25 01:23
Subsystems: kernel
[Documentation on labels]
First crash: 280d, last: 278d
Similar bugs (1)
Kernel Title Rank 🛈 Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: rcu detected stall in asm_sysvec_reschedule_ipi kernel 1 1 1832d 1832d 0/29 auto-closed as invalid on 2020/11/24 08:54

Sample crash report:
rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
rcu: 	1-...!: (0 ticks this GP) idle=40ac/1/0x4000000000000000 softirq=89094/89094 fqs=1
rcu: 	(detected by 0, t=10502 jiffies, g=128637, q=123 ncpus=2)
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 UID: 0 PID: 19779 Comm: kworker/1:2 Not tainted 6.12.0-syzkaller-09734-g445d9f05fa14 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 09/13/2024
Workqueue: events_freezable_pwr_efficient sync_hw_clock
RIP: 0010:iterate_chain_key kernel/locking/lockdep.c:448 [inline]
RIP: 0010:__lock_acquire+0xd3e/0x3c40 kernel/locking/lockdep.c:5214
Code: c1 c2 06 31 ca 01 d8 29 d3 89 d9 89 d3 01 c2 c1 c3 08 31 cb 89 d9 29 d8 01 d3 c1 c1 10 89 de 31 c8 89 c1 29 c2 01 d8 c1 c9 0d <31> d1 89 ca 29 ce 01 c8 c1 c2 04 89 c0 31 f2 48 c1 e2 20 48 09 c2
RSP: 0018:ffffc90000a18b48 EFLAGS: 00000092
RAX: 00000000f49cd270 RBX: 00000000ef968c96 RCX: 000000002ed02832
RDX: 00000000fae9315e RSI: 00000000ef968c96 RDI: ffffffff96e85ae8
RBP: ffffffff96f41b40 R08: 0000000000000000 R09: fffffbfff2dd0798
R10: ffffffff96e83cc7 R11: 0000000000000002 R12: ffff8880301253a9
R13: ffff888030124880 R14: 0000000000000003 R15: ffff8880301253b0
FS:  0000000000000000(0000) GS:ffff8880b8700000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000002035d030 CR3: 000000003683c000 CR4: 00000000003526f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <NMI>
 </NMI>
 <IRQ>
 lock_acquire.part.0+0x11b/0x380 kernel/locking/lockdep.c:5849
 rcu_lock_acquire include/linux/rcupdate.h:337 [inline]
 rcu_read_lock include/linux/rcupdate.h:849 [inline]
 advance_sched+0x67f/0xc60 net/sched/sch_taprio.c:985
 __run_hrtimer kernel/time/hrtimer.c:1739 [inline]
 __hrtimer_run_queues+0x20a/0xae0 kernel/time/hrtimer.c:1803
 hrtimer_interrupt+0x392/0x8e0 kernel/time/hrtimer.c:1865
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1038 [inline]
 __sysvec_apic_timer_interrupt+0x10f/0x400 arch/x86/kernel/apic/apic.c:1055
 instr_sysvec_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1049 [inline]
 sysvec_apic_timer_interrupt+0x9f/0xc0 arch/x86/kernel/apic/apic.c:1049
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x1a/0x20 arch/x86/include/asm/idtentry.h:702
RIP: 0010:preempt_schedule_irq+0x4c/0x90 kernel/sched/core.c:7078
Code: df 55 65 48 8b 2d b4 4b d3 74 53 48 89 eb 48 c1 eb 03 48 01 c3 bf 01 00 00 00 e8 8f a2 2c f6 e8 7a ee 65 f6 fb bf 01 00 00 00 <e8> 0f 9d ff ff 9c 58 fa f6 c4 02 75 1e bf 01 00 00 00 e8 4d 50 2c
RSP: 0018:ffffc9000c83fb18 EFLAGS: 00000202
RAX: 000000000002729d RBX: ffffed1006024910 RCX: 1ffffffff2de8374
RDX: 0000000000000000 RSI: ffffffff8b6cdee0 RDI: 0000000000000001
RBP: ffff888030124880 R08: 0000000000000001 R09: fffffbfff2dd07d4
R10: ffffffff96e83ea7 R11: 0000000000000000 R12: 0000000000000000
R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
 irqentry_exit+0x36/0x90 kernel/entry/common.c:354
 asm_sysvec_reschedule_ipi+0x1a/0x20 arch/x86/include/asm/idtentry.h:707
RIP: 0010:lock_acquire.part.0+0x155/0x380 kernel/locking/lockdep.c:5814
Code: b8 ff ff ff ff 65 0f c1 05 50 12 97 7e 83 f8 01 0f 85 d0 01 00 00 9c 58 f6 c4 02 0f 85 e5 01 00 00 48 85 ed 0f 85 b6 01 00 00 <48> b8 00 00 00 00 00 fc ff df 48 01 c3 48 c7 03 00 00 00 00 48 c7
RSP: 0018:ffffc9000c83fbe0 EFLAGS: 00000206
RAX: 0000000000000046 RBX: 1ffff92001907f7d RCX: 0000000000000001
RDX: 0000000000000001 RSI: ffffffff8b6ce1e0 RDI: ffffffff8bd1e140
RBP: 0000000000000200 R08: 0000000000258ba8 R09: fffffbfff2e03aea
R10: ffffffff9701d757 R11: 1ffffffff2c4945e R12: 0000000000000000
R13: ffffc9000c83fd80 R14: 0000000000000000 R15: 0000000000000000
 process_one_work+0x927/0x1ba0 kernel/workqueue.c:3205
 process_scheduled_works kernel/workqueue.c:3310 [inline]
 worker_thread+0x6c8/0xf00 kernel/workqueue.c:3391
 kthread+0x2c1/0x3a0 kernel/kthread.c:389
 ret_from_fork+0x45/0x80 arch/x86/kernel/process.c:147
 ret_from_fork_asm+0x1a/0x30 arch/x86/entry/entry_64.S:244
 </TASK>
rcu: rcu_preempt kthread starved for 10495 jiffies! g128637 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=0
rcu: 	Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
rcu: RCU grace-period kthread stack dump:
task:rcu_preempt     state:R  running task     stack:27600 pid:17    tgid:17    ppid:2      flags:0x00004000
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5369 [inline]
 __schedule+0xe58/0x5ad0 kernel/sched/core.c:6756
 __schedule_loop kernel/sched/core.c:6833 [inline]
 schedule+0xe7/0x350 kernel/sched/core.c:6848
 schedule_timeout+0x124/0x280 kernel/time/sleep_timeout.c:99
 rcu_gp_fqs_loop+0x1eb/0xb00 kernel/rcu/tree.c:2045
 rcu_gp_kthread+0x271/0x380 kernel/rcu/tree.c:2247
 kthread+0x2c1/0x3a0 kernel/kthread.c:389
 ret_from_fork+0x45/0x80 arch/x86/kernel/process.c:147
 ret_from_fork_asm+0x1a/0x30 arch/x86/entry/entry_64.S:244
 </TASK>
rcu: Stack dump where RCU GP kthread last ran:
CPU: 0 UID: 0 PID: 16367 Comm: kworker/u8:0 Not tainted 6.12.0-syzkaller-09734-g445d9f05fa14 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 09/13/2024
Workqueue: events_unbound toggle_allocation_gate
RIP: 0010:csd_lock_wait kernel/smp.c:340 [inline]
RIP: 0010:smp_call_function_many_cond+0x458/0x1300 kernel/smp.c:884
Code: 0c 00 85 ed 74 4d 48 b8 00 00 00 00 00 fc ff df 4d 89 f4 4c 89 f5 49 c1 ec 03 83 e5 07 49 01 c4 83 c5 03 e8 2a 17 0c 00 f3 90 <41> 0f b6 04 24 40 38 c5 7c 08 84 c0 0f 85 a7 0c 00 00 8b 43 08 31
RSP: 0018:ffffc9000465f998 EFLAGS: 00000293
RAX: 0000000000000000 RBX: ffff8880b8744a40 RCX: ffffffff8182b59c
RDX: ffff88807ed22440 RSI: ffffffff8182b576 RDI: 0000000000000005
RBP: 0000000000000003 R08: 0000000000000005 R09: 0000000000000000
R10: 0000000000000001 R11: 0000000000000006 R12: ffffed10170e8949
R13: 0000000000000001 R14: ffff8880b8744a48 R15: ffff8880b863fe40
FS:  0000000000000000(0000) GS:ffff8880b8600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000055556c9a7808 CR3: 000000000df7e000 CR4: 00000000003526f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <IRQ>
 </IRQ>
 <TASK>
 on_each_cpu_cond_mask+0x40/0x90 kernel/smp.c:1051
 on_each_cpu include/linux/smp.h:71 [inline]
 text_poke_sync arch/x86/kernel/alternative.c:2114 [inline]
 text_poke_bp_batch+0x22b/0x760 arch/x86/kernel/alternative.c:2324
 text_poke_flush arch/x86/kernel/alternative.c:2515 [inline]
 text_poke_flush arch/x86/kernel/alternative.c:2512 [inline]
 text_poke_finish+0x30/0x40 arch/x86/kernel/alternative.c:2522
 arch_jump_label_transform_apply+0x1c/0x30 arch/x86/kernel/jump_label.c:146
 jump_label_update+0x1d7/0x400 kernel/jump_label.c:920
 static_key_enable_cpuslocked+0x1b7/0x270 kernel/jump_label.c:210
 static_key_enable+0x1a/0x20 kernel/jump_label.c:223
 toggle_allocation_gate mm/kfence/core.c:849 [inline]
 toggle_allocation_gate+0xfc/0x260 mm/kfence/core.c:841
 process_one_work+0x9c5/0x1ba0 kernel/workqueue.c:3229
 process_scheduled_works kernel/workqueue.c:3310 [inline]
 worker_thread+0x6c8/0xf00 kernel/workqueue.c:3391
 kthread+0x2c1/0x3a0 kernel/kthread.c:389
 ret_from_fork+0x45/0x80 arch/x86/kernel/process.c:147
 ret_from_fork_asm+0x1a/0x30 arch/x86/entry/entry_64.S:244
 </TASK>

Crashes (2):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2024/11/27 01:14 upstream 445d9f05fa14 11dbc254 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-selinux-root INFO: rcu detected stall in asm_sysvec_reschedule_ipi
2024/11/25 10:16 upstream 9f16d5e6f220 68da6d95 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-smack-root INFO: rcu detected stall in asm_sysvec_reschedule_ipi
* Struck through repros no longer work on HEAD.