syzbot


INFO: rcu detected stall in __run_timers

Status: upstream: reported on 2024/10/20 16:20
Reported-by: syzbot+7b218fb068fc9cdcaa45@syzkaller.appspotmail.com
First crash: 32d, last: 32d
Similar bugs (12)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: rcu detected stall in __run_timers (4) tomoyo 4 1750d 1765d 0/28 auto-closed as invalid on 2020/05/06 02:55
linux-5.15 INFO: rcu detected stall in __run_timers 1 583d 583d 0/3 auto-obsoleted due to no activity on 2023/08/15 19:18
upstream INFO: rcu detected stall in __run_timers net 2 2265d 2267d 0/28 closed as invalid on 2018/09/11 10:51
upstream INFO: rcu detected stall in __run_timers (2) block 58 2137d 2261d 0/28 closed as dup on 2019/01/02 16:40
upstream INFO: rcu detected stall in __run_timers (7) kernfs 25 73d 177d 0/28 auto-obsoleted due to no activity on 2024/11/08 17:44
upstream INFO: rcu detected stall in __run_timers (6) kernel 2 992d 1009d 0/28 auto-closed as invalid on 2022/06/02 21:46
upstream INFO: rcu detected stall in __run_timers (3) mm 4 1877d 1898d 0/28 auto-closed as invalid on 2019/12/31 08:04
upstream INFO: rcu detected stall in __run_timers (5) kernel C error error 63 1024d 1538d 0/28 closed as invalid on 2022/02/08 10:39
android-5-10 BUG: soft lockup in __run_timers 2 93d 162d 0/2 auto-obsoleted due to no activity on 2024/11/18 04:44
android-54 BUG: soft lockup in __run_timers 1 146d 146d 0/2 auto-obsoleted due to no activity on 2024/09/26 00:22
android-5-15 BUG: soft lockup in __run_timers 1 64d 64d 0/2 premoderation: reported on 2024/09/17 23:46
upstream BUG: soft lockup in __run_timers kernel 1 655d 651d 0/28 auto-obsoleted due to no activity on 2023/05/06 12:08

Sample crash report:
rcu: INFO: rcu_preempt detected expedited stalls on CPUs/tasks: { 1-.... } 2667 jiffies s: 24717 root: 0x2/.
rcu: blocking rcu_node structures (internal RCU debug):
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 11319 Comm: syz.0.2181 Not tainted 6.1.113-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 09/13/2024
RIP: 0010:lock_acquire+0x281/0x5a0 kernel/locking/lockdep.c:5666
Code: 85 84 01 00 00 41 f7 c7 00 02 00 00 74 01 fb 48 c7 44 24 40 0e 36 e0 45 4b c7 44 25 00 00 00 00 00 43 c7 44 25 09 00 00 00 00 <43> c7 44 25 11 00 00 00 00 66 43 c7 44 25 15 00 00 43 c6 44 25 17
RSP: 0018:ffffc900001e0680 EFLAGS: 00000046
RAX: 0000000000000001 RBX: 1ffff9200003c0dc RCX: ffffffff816b55e2
RDX: dffffc0000000000 RSI: ffffffff8b0c1440 RDI: ffffffff8b5d7340
RBP: ffffc900001e07c8 R08: dffffc0000000000 R09: fffffbfff224604d
R10: 0000000000000000 R11: dffffc0000000001 R12: 1ffff9200003c0d8
R13: dffffc0000000000 R14: ffffc900001e06e0 R15: 0000000000000046
FS:  0000000000000000(0000) GS:ffff8880b8f00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f0748d1ed58 CR3: 000000005985b000 CR4: 00000000003506e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <NMI>
 </NMI>
 <IRQ>
 __raw_spin_lock_irqsave include/linux/spinlock_api_smp.h:110 [inline]
 _raw_spin_lock_irqsave+0xd1/0x120 kernel/locking/spinlock.c:162
 debug_object_activate+0x68/0x4e0 lib/debugobjects.c:698
 debug_hrtimer_activate kernel/time/hrtimer.c:421 [inline]
 debug_activate kernel/time/hrtimer.c:476 [inline]
 enqueue_hrtimer+0x30/0x410 kernel/time/hrtimer.c:1085
 __run_hrtimer kernel/time/hrtimer.c:1706 [inline]
 __hrtimer_run_queues+0x728/0xe50 kernel/time/hrtimer.c:1753
 hrtimer_interrupt+0x392/0x980 kernel/time/hrtimer.c:1815
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1095 [inline]
 __sysvec_apic_timer_interrupt+0x156/0x580 arch/x86/kernel/apic/apic.c:1112
 instr_sysvec_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1106 [inline]
 sysvec_apic_timer_interrupt+0x4d/0xc0 arch/x86/kernel/apic/apic.c:1106
 asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:691
RIP: 0010:__raw_spin_unlock_irq include/linux/spinlock_api_smp.h:160 [inline]
RIP: 0010:_raw_spin_unlock_irq+0x25/0x40 kernel/locking/spinlock.c:202
Code: 91 9b f5 ff 90 53 48 89 fb 48 83 c7 18 48 8b 74 24 08 e8 ce 26 b9 f6 48 89 df e8 c6 64 ba f6 e8 31 bb df f6 fb bf 01 00 00 00 <e8> c6 ee ac f6 65 8b 05 27 d7 50 75 85 c0 74 02 5b c3 e8 d4 fa 4e
RSP: 0018:ffffc900001e0c70 EFLAGS: 00000282
RAX: 24a835c74295fa00 RBX: ffff8880b8f28340 RCX: ffffffff816b09aa
RDX: dffffc0000000000 RSI: ffffffff8b0c02c0 RDI: 0000000000000001
RBP: ffffc900001e0dd0 R08: dffffc0000000000 R09: fffffbfff224604d
R10: 0000000000000000 R11: dffffc0000000001 R12: ffff8880746cd700
R13: 1ffff110171e5070 R14: ffff8880746cd720 R15: ffffffff89643300
 expire_timers kernel/time/timer.c:1548 [inline]
 __run_timers+0x66c/0x890 kernel/time/timer.c:1820
 run_timer_softirq+0x63/0xf0 kernel/time/timer.c:1833
 handle_softirqs+0x2ee/0xa40 kernel/softirq.c:571
 __do_softirq kernel/softirq.c:605 [inline]
 invoke_softirq kernel/softirq.c:445 [inline]
 __irq_exit_rcu+0x157/0x240 kernel/softirq.c:654
 irq_exit_rcu+0x5/0x20 kernel/softirq.c:666
 instr_sysvec_irq_work arch/x86/kernel/irq_work.c:17 [inline]
 sysvec_irq_work+0x9d/0xc0 arch/x86/kernel/irq_work.c:17
 </IRQ>
 <TASK>
 asm_sysvec_irq_work+0x16/0x20 arch/x86/include/asm/idtentry.h:728
RIP: 0010:rcu_read_unlock_special+0x84/0x540 kernel/rcu/tree_plugin.h:682
Code: f1 f1 f1 00 f2 f2 f2 49 89 04 17 66 41 c7 44 17 09 f3 f3 41 c6 44 17 0b f3 65 44 8b 25 1d 21 8e 7e 41 f7 c4 00 00 f0 00 74 45 <48> c7 44 24 20 0e 36 e0 45 4a c7 04 3a 00 00 00 00 66 42 c7 44 3a
RSP: 0018:ffffc9000331f160 EFLAGS: 00000206
RAX: 24a835c74295fa00 RBX: 1ffff92000663e34 RCX: ffffffff816b09aa
RDX: dffffc0000000000 RSI: ffffffff8b0c02c0 RDI: ffffffff8b5d7340
RBP: ffffc9000331f238 R08: dffffc0000000000 R09: fffffbfff224604d
R10: 0000000000000000 R11: dffffc0000000001 R12: ffffffff8d32fe00
R13: ffff88802ac85d98 R14: ffffc9000331f1a0 R15: 1ffff92000663e30
 __rcu_read_unlock+0x92/0x100 kernel/rcu/tree_plugin.h:426
 rcu_read_unlock include/linux/rcupdate.h:823 [inline]
 __folio_memcg_unlock+0xfd/0x120 mm/memcontrol.c:2148
 page_remove_rmap+0x819/0xed0 mm/rmap.c:1462
 zap_pte_range mm/memory.c:1453 [inline]
 zap_pmd_range mm/memory.c:1574 [inline]
 zap_pud_range mm/memory.c:1603 [inline]
 zap_p4d_range mm/memory.c:1624 [inline]
 unmap_page_range+0x1217/0x2740 mm/memory.c:1645
 unmap_vmas+0x48b/0x640 mm/memory.c:1730
 exit_mmap+0x252/0x9f0 mm/mmap.c:3227
 __mmput+0x115/0x3c0 kernel/fork.c:1199
 exit_mm+0x226/0x300 kernel/exit.c:565
 do_exit+0x9f6/0x26a0 kernel/exit.c:858
 do_group_exit+0x202/0x2b0 kernel/exit.c:1021
 get_signal+0x16f7/0x17d0 kernel/signal.c:2870
 arch_do_signal_or_restart+0xb0/0x1a10 arch/x86/kernel/signal.c:871
 exit_to_user_mode_loop+0x6a/0x100 kernel/entry/common.c:174
 exit_to_user_mode_prepare+0xb1/0x140 kernel/entry/common.c:210
 __syscall_exit_to_user_mode_work kernel/entry/common.c:292 [inline]
 syscall_exit_to_user_mode+0x60/0x270 kernel/entry/common.c:303
 do_syscall_64+0x47/0xb0 arch/x86/entry/common.c:87
 entry_SYSCALL_64_after_hwframe+0x68/0xd2
RIP: 0033:0x7ff2b197dff9
Code: Unable to access opcode bytes at 0x7ff2b197dfcf.
RSP: 002b:00007ff2b17de0e8 EFLAGS: 00000246 ORIG_RAX: 00000000000000ca
RAX: fffffffffffffe00 RBX: 00007ff2b1b36138 RCX: 00007ff2b197dff9
RDX: 0000000000000000 RSI: 0000000000000080 RDI: 00007ff2b1b36138
RBP: 00007ff2b1b36130 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 00007ff2b1b3613c
R13: 0000000000000000 R14: 00007fff1845b2d0 R15: 00007fff1845b3b8
 </TASK>

Crashes (1):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2024/10/20 16:19 linux-6.1.y 54d90d17e8ce cd6fc0a3 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan-perf INFO: rcu detected stall in __run_timers
* Struck through repros no longer work on HEAD.