syzbot


BUG: soft lockup in __run_timers

Status: auto-obsoleted due to no activity on 2024/09/26 00:22
First crash: 146d, last: 146d
Similar bugs (8)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
android-5-10 BUG: soft lockup in __run_timers 2 93d 162d 0/2 auto-obsoleted due to no activity on 2024/11/18 04:44
android-5-15 BUG: soft lockup in __run_timers 1 64d 64d 0/2 premoderation: reported on 2024/09/17 23:46
upstream BUG: soft lockup in __run_timers kernel 1 655d 651d 0/28 auto-obsoleted due to no activity on 2023/05/06 12:08
upstream INFO: rcu detected stall in __run_timers (5) kernel C error error 63 1024d 1538d 0/28 closed as invalid on 2022/02/08 10:39
linux-5.15 INFO: rcu detected stall in __run_timers 1 583d 583d 0/3 auto-obsoleted due to no activity on 2023/08/15 19:18
upstream INFO: rcu detected stall in __run_timers (7) kernfs 25 73d 177d 0/28 auto-obsoleted due to no activity on 2024/11/08 17:44
linux-6.1 INFO: rcu detected stall in __run_timers 1 32d 32d 0/3 upstream: reported on 2024/10/20 16:20
upstream INFO: rcu detected stall in __run_timers (6) kernel 2 992d 1009d 0/28 auto-closed as invalid on 2022/06/02 21:46

Sample crash report:
RBP: 00007fac08613756 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
R13: 000000000000000b R14: 00007fac08720fa0 R15: 00007fff240fb018
watchdog: BUG: soft lockup - CPU#1 stuck for 123s! [syz.2.1686:5407]
Modules linked in:
CPU: 1 PID: 5407 Comm: syz.2.1686 Not tainted 5.4.274-syzkaller-00002-g6f97bd951d82 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 06/07/2024
RIP: 0010:__raw_spin_unlock_irq include/linux/spinlock_api_smp.h:169 [inline]
RIP: 0010:_raw_spin_unlock_irq+0x45/0x60 kernel/locking/spinlock.c:199
Code: 08 00 74 0c 48 c7 c7 90 3b eb 85 e8 75 12 43 fd 48 83 3d cd 2c 9a 01 00 74 29 48 89 df e8 e3 e7 fa fc 66 90 fb bf 01 00 00 00 <e8> 66 d4 f3 fc 65 8b 05 ab 7e b1 7b 85 c0 74 02 5b c3 e8 34 45 af
RSP: 0018:ffff8881f6f09d50 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
RAX: 0000000000000001 RBX: ffff8881f6f49500 RCX: dffffc0000000000
RDX: 0000000000000101 RSI: 0000000000000000 RDI: 0000000000000001
RBP: ffff8881f6f09ec8 R08: ffffffff8154d3ee R09: 0000000000000003
R10: ffffffffffffffff R11: dffffc0000000001 R12: ffffffff83f0a8e0
R13: dffffc0000000000 R14: 1ffff1103b595226 R15: ffff8881daca9130
FS:  00007fac078146c0(0000) GS:ffff8881f6f00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fac08592aff CR3: 0000000005e0e000 CR4: 00000000003406a0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <IRQ>
 expire_timers kernel/time/timer.c:1492 [inline]
 __run_timers+0x869/0xbe0 kernel/time/timer.c:1817
 run_timer_softirq+0x63/0xf0 kernel/time/timer.c:1830
 __do_softirq+0x23b/0x6b7 kernel/softirq.c:292
 invoke_softirq kernel/softirq.c:373 [inline]
 irq_exit+0x195/0x1c0 kernel/softirq.c:413
 exiting_irq arch/x86/include/asm/apic.h:538 [inline]
 smp_apic_timer_interrupt+0x11a/0x460 arch/x86/kernel/apic/apic.c:1149
 apic_timer_interrupt+0xf/0x20 arch/x86/entry/entry_64.S:834
 </IRQ>
RIP: 0010:free_pages_and_swap_cache+0x0/0x90 mm/swap_state.c:290
Code: 58 ed ff e8 12 75 d2 ff 49 ff cc e9 62 fe ff ff e8 05 75 d2 ff 48 ff cb e9 90 fe ff ff e8 f8 74 d2 ff 48 ff cb e9 72 ff ff ff <55> 41 57 41 56 41 54 53 41 89 f6 48 89 fb e8 dd 74 d2 ff e8 38 76
RSP: 0018:ffff8881ec8d7558 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
RAX: ffff8881e20e3f00 RBX: ffff8881ec8d7930 RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffff8881ec8d7940
RBP: 0000000000000008 R08: ffffffff818d5649 R09: ffff8881ec8d7910
R10: 0000000000000000 R11: dffffc0000000001 R12: dffffc0000000000
R13: ffff8881ec8d7938 R14: ffff8881ec8d7900 R15: 1ffff1103d91af27
 tlb_batch_pages_flush mm/mmu_gather.c:49 [inline]
 tlb_flush_mmu_free mm/mmu_gather.c:189 [inline]
 tlb_flush_mmu+0xc8/0x170 mm/mmu_gather.c:196
 zap_pte_range mm/memory.c:1173 [inline]
 zap_pmd_range mm/memory.c:1222 [inline]
 zap_pud_range mm/memory.c:1251 [inline]
 zap_p4d_range mm/memory.c:1272 [inline]
 unmap_page_range+0x1d29/0x2620 mm/memory.c:1293
 unmap_single_vma mm/memory.c:1338 [inline]
 unmap_vmas+0x355/0x4b0 mm/memory.c:1370
 exit_mmap+0x2bc/0x520 mm/mmap.c:3191
 __mmput+0x8e/0x2c0 kernel/fork.c:1101
 exit_mm kernel/exit.c:536 [inline]
 do_exit+0xc08/0x2bc0 kernel/exit.c:846
 do_group_exit+0x138/0x300 kernel/exit.c:982
 get_signal+0xdb1/0x1440 kernel/signal.c:2735
 do_signal+0xb0/0x11f0 arch/x86/kernel/signal.c:809
 exit_to_usermode_loop+0xc0/0x1a0 arch/x86/entry/common.c:159
 prepare_exit_to_usermode+0x199/0x200 arch/x86/entry/common.c:194
 entry_SYSCALL_64_after_hwframe+0x5c/0xc1
RIP: 0033:0x7fac08592b29
Code: Bad RIP value.
RSP: 002b:00007fac07814048 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
RAX: 0000000000000000 RBX: 00007fac08720fa0 RCX: 00007fac08592b29
RDX: 00000000200006c0 RSI: 0000000000005452 RDI: 0000000000000003
RBP: 00007fac08613756 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
R13: 000000000000000b R14: 00007fac08720fa0 R15: 00007fff240fb018
Sending NMI from CPU 1 to CPUs 0:
NMI backtrace for cpu 0
CPU: 0 PID: 5584 Comm: syz.3.1728 Not tainted 5.4.274-syzkaller-00002-g6f97bd951d82 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 06/07/2024
RIP: 0010:llist_add_batch+0x1f/0xb0 lib/llist.c:28
Code: 90 90 90 90 90 90 90 90 90 90 90 55 41 57 41 56 41 55 41 54 53 49 89 d4 49 89 f6 49 89 ff e8 38 fb 37 ff 4c 89 e5 48 c1 ed 03 <4d> 89 f5 49 c1 ed 03 48 b8 00 00 00 00 00 fc ff df 80 7c 05 00 00
RSP: 0018:ffff8881f6e097d0 EFLAGS: 00000802
RAX: ffffffff822c40e8 RBX: 0000000000000000 RCX: ffff8881d6dd8000
RDX: 0000000080010103 RSI: ffff8881da710318 RDI: ffff8881da710318
RBP: 1ffff1103edca9b6 R08: ffffffff816d8369 R09: ffffed103b4e2063
R10: 0000000000000000 R11: dffffc0000000001 R12: ffff8881f6e54db0
R13: 1ffff1103b4e2060 R14: ffff8881da710318 R15: ffff8881da710318
FS:  00007f3f8c7756c0(0000) GS:ffff8881f6e00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000055555588d4a8 CR3: 00000001e4be5000 CR4: 00000000003406b0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600
Call Trace:
 <NMI>
 </NMI>
 <IRQ>
 llist_add include/linux/llist.h:209 [inline]
 __irq_work_queue_local+0xa4/0x160 kernel/irq_work.c:69
 irq_work_queue+0xfe/0x140 kernel/irq_work.c:83
 __perf_event_overflow+0x282/0x360 kernel/events/core.c:8305
 perf_swevent_hrtimer+0x3fd/0x560 kernel/events/core.c:9688
 __run_hrtimer kernel/time/hrtimer.c:1581 [inline]
 __hrtimer_run_queues+0x3e9/0xb90 kernel/time/hrtimer.c:1643
 hrtimer_interrupt+0x38a/0x890 kernel/time/hrtimer.c:1705
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1122 [inline]
 smp_apic_timer_interrupt+0x110/0x460 arch/x86/kernel/apic/apic.c:1147
 apic_timer_interrupt+0xf/0x20 arch/x86/entry/entry_64.S:834
RIP: 0010:ffs arch/x86/include/asm/bitops.h:297 [inline]
RIP: 0010:__do_softirq+0xfa/0x6b7 kernel/softirq.c:280
Code: 48 89 44 24 50 4c 89 7c 24 60 44 0f b7 fb 48 c7 c7 e0 65 a7 84 e8 46 6e b1 fd 65 66 c7 05 cc 71 85 7b 00 00 fb 44 89 7c 24 34 <b8> ff ff ff ff 0f bc 44 24 34 89 c5 ff c5 0f 85 b0 00 00 00 48 c7
RSP: 0018:ffff8881f6e09ef8 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
RAX: 0000000000000000 RBX: 0000000000400002 RCX: ffff8881d6dd8000
RDX: 0000000080000102 RSI: 0000000000000102 RDI: 0000000000000000
RBP: dffffc0000000000 R08: ffffffff82316ca1 R09: ffffffff86e92018
R10: ffffffff86e92003 R11: 1ffffffff0dd2400 R12: dffffc0000000000
R13: 0000000000000000 R14: ffff8881f5dcbf00 R15: 0000000000000002
 invoke_softirq kernel/softirq.c:373 [inline]
 irq_exit+0x195/0x1c0 kernel/softirq.c:413
 exiting_irq arch/x86/include/asm/apic.h:538 [inline]
 smp_apic_timer_interrupt+0x11a/0x460 arch/x86/kernel/apic/apic.c:1149
 apic_timer_interrupt+0xf/0x20 arch/x86/entry/entry_64.S:834
 </IRQ>
RIP: 0010:__raw_spin_unlock_irq include/linux/spinlock_api_smp.h:169 [inline]
RIP: 0010:_raw_spin_unlock_irq+0x45/0x60 kernel/locking/spinlock.c:199
Code: 08 00 74 0c 48 c7 c7 90 3b eb 85 e8 75 12 43 fd 48 83 3d cd 2c 9a 01 00 74 29 48 89 df e8 e3 e7 fa fc 66 90 fb bf 01 00 00 00 <e8> 66 d4 f3 fc 65 8b 05 ab 7e b1 7b 85 c0 74 02 5b c3 e8 34 45 af
RSP: 0018:ffff8881eba8f2f0 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
RAX: 0000000000000001 RBX: ffff8881f6e57b40 RCX: dffffc0000000000
RDX: 0000000040000000 RSI: 0000000000000000 RDI: 0000000000000001
RBP: ffff8881eba8f350 R08: ffffffff81799989 R09: fffffbfff0c96e5b
R10: 0000000000000000 R11: dffffc0000000001 R12: ffff8881f6e57b40
R13: ffff8881d6dd8000 R14: dffffc0000000000 R15: 0000000000000000
 finish_lock_switch kernel/sched/core.c:3347 [inline]
 finish_task_switch+0x130/0x590 kernel/sched/core.c:3447
 context_switch kernel/sched/core.c:3611 [inline]
 __schedule+0xb0d/0x1320 kernel/sched/core.c:4307
 preempt_schedule_irq+0xc7/0x140 kernel/sched/core.c:4558
 retint_kernel+0x1b/0x1b
RIP: 0010:pte_lockptr include/linux/mm.h:2039 [inline]
RIP: 0010:zap_pte_range mm/memory.c:1063 [inline]
RIP: 0010:zap_pmd_range mm/memory.c:1222 [inline]
RIP: 0010:zap_pud_range mm/memory.c:1251 [inline]
RIP: 0010:zap_p4d_range mm/memory.c:1272 [inline]
RIP: 0010:unmap_page_range+0xa40/0x2620 mm/memory.c:1293
Code: 26 75 d9 ff 4c 89 6c 24 08 ba 10 00 00 00 48 8d bc 24 80 01 00 00 31 f6 e8 9d 2d 09 00 48 8b 84 24 c0 00 00 00 42 80 3c 20 00 <48> 8b 5c 24 50 74 08 48 89 df e8 01 5a 09 00 4c 8b 3b 31 c0 48 89
RSP: 0018:ffff8881eba8f5a0 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
RAX: 1ffff1103ca19466 RBX: 0400000000000080 RCX: 0000000000000000
RDX: 0000000000000010 RSI: 0000000000000000 RDI: ffff8881eba8f730
RBP: ffff8881eba8f790 R08: dffffc0000000000 R09: ffff8881eba8f720
R10: 0000000000000000 R11: dffffc0000000001 R12: dffffc0000000000
R13: 00007f3f8cd5a000 R14: 0000000000000000 R15: 0000000000000000
 unmap_single_vma mm/memory.c:1338 [inline]
 unmap_vmas+0x355/0x4b0 mm/memory.c:1370
 exit_mmap+0x2bc/0x520 mm/mmap.c:3191
 __mmput+0x8e/0x2c0 kernel/fork.c:1101
 exit_mm kernel/exit.c:536 [inline]
 do_exit+0xc08/0x2bc0 kernel/exit.c:846
 do_group_exit+0x138/0x300 kernel/exit.c:982
 get_signal+0xdb1/0x1440 kernel/signal.c:2735
 do_signal+0xb0/0x11f0 arch/x86/kernel/signal.c:809
 exit_to_usermode_loop+0xc0/0x1a0 arch/x86/entry/common.c:159
 prepare_exit_to_usermode+0x199/0x200 arch/x86/entry/common.c:194
 entry_SYSCALL_64_after_hwframe+0x5c/0xc1
RIP: 0033:0x7f3f8d4f3b29
Code: Bad RIP value.
RSP: 002b:00007f3f8c775048 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
RAX: 0000000000000000 RBX: 00007f3f8d681fa0 RCX: 00007f3f8d4f3b29
RDX: 00000000200006c0 RSI: 0000000000005452 RDI: 0000000000000003
RBP: 00007f3f8d574756 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
R13: 000000000000000b R14: 00007f3f8d681fa0 R15: 00007ffd97fc06c8

Crashes (1):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2024/06/28 00:11 android12-5.4 6f97bd951d82 6ef39602 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-4-perf-kasan BUG: soft lockup in __run_timers
* Struck through repros no longer work on HEAD.