syzbot


BUG: soft lockup in sys_perf_event_open (2)

Status: moderation: reported on 2024/10/03 01:56
Subsystems: kvm fs
[Documentation on labels]
Reported-by: syzbot+d50d0015274d31ba1907@syzkaller.appspotmail.com
First crash: 137d, last: 26d
Similar bugs (6)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
android-5-15 BUG: soft lockup in sys_perf_event_open 1 283d 283d 0/2 auto-obsoleted due to no activity on 2024/08/04 07:07
upstream BUG: soft lockup in sys_perf_event_open perf 1 258d 254d 0/28 auto-obsoleted due to no activity on 2024/08/29 01:52
linux-5.15 INFO: rcu detected stall in sys_perf_event_open (2) origin:lts-only C error 5 21d 400d 0/3 upstream: reported C repro on 2024/01/09 18:19
linux-6.1 INFO: rcu detected stall in sys_perf_event_open (2) origin:lts-only syz done 3 32d 143d 0/3 upstream: reported syz repro on 2024/09/23 05:55
linux-6.1 INFO: rcu detected stall in sys_perf_event_open 1 247d 247d 0/3 auto-obsoleted due to no activity on 2024/09/19 01:45
linux-5.15 INFO: rcu detected stall in sys_perf_event_open 1 666d 666d 0/3 auto-obsoleted due to no activity on 2023/08/17 04:33

Sample crash report:
watchdog: BUG: soft lockup - CPU#0 stuck for 143s! [syz.1.1329:9783]
Modules linked in:
irq event stamp: 185256
hardirqs last  enabled at (185255): [<ffffffff814b099b>] kvm_wait+0x23b/0x2c0
hardirqs last disabled at (185256): [<ffffffff8bc8e65e>] sysvec_apic_timer_interrupt+0xe/0xc0 arch/x86/kernel/apic/apic.c:1049
softirqs last  enabled at (185220): [<ffffffff8161e427>] __do_softirq kernel/softirq.c:595 [inline]
softirqs last  enabled at (185220): [<ffffffff8161e427>] invoke_softirq kernel/softirq.c:435 [inline]
softirqs last  enabled at (185220): [<ffffffff8161e427>] __irq_exit_rcu+0xf7/0x220 kernel/softirq.c:662
softirqs last disabled at (185181): [<ffffffff8161e427>] __do_softirq kernel/softirq.c:595 [inline]
softirqs last disabled at (185181): [<ffffffff8161e427>] invoke_softirq kernel/softirq.c:435 [inline]
softirqs last disabled at (185181): [<ffffffff8161e427>] __irq_exit_rcu+0xf7/0x220 kernel/softirq.c:662
CPU: 0 UID: 0 PID: 9783 Comm: syz.1.1329 Not tainted 6.13.0-rc7-syzkaller-00019-gc45323b7560e #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 12/27/2024
RIP: 0010:native_safe_halt arch/x86/include/asm/irqflags.h:48 [inline]
RIP: 0010:arch_safe_halt arch/x86/include/asm/irqflags.h:106 [inline]
RIP: 0010:kvm_wait+0x250/0x2c0 arch/x86/kernel/kvm.c:1064
Code: 3b 45 0f b6 f6 44 89 ff 44 89 f6 e8 5a 79 54 00 e8 f5 32 5c 00 45 38 f7 75 15 66 90 e8 c9 78 54 00 0f 00 2d 72 08 bd 0a fb f4 <e9> 50 fe ff ff e8 b6 78 54 00 fb e9 45 fe ff ff 89 d9 80 e1 07 38
RSP: 0018:ffffc90004b3f880 EFLAGS: 00000242
RAX: ffffffff814b09a7 RBX: ffff88802340f2d0 RCX: ffff88805427bc00
RDX: 0000000000000003 RSI: ffffffff8c0a98e0 RDI: ffffffff8c5fb220
RBP: ffffc90004b3f950 R08: ffffffff942a58bf R09: 1ffffffff2854b17
R10: dffffc0000000000 R11: fffffbfff2854b18 R12: 1ffff92000967f14
R13: dffffc0000000000 R14: 0000000000000003 R15: 0000000000000003
FS:  00007f71eb5b76c0(0000) GS:ffff8880b8600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000001b30d0af40 CR3: 0000000022bf8000 CR4: 00000000003526f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000600
Call Trace:
 <IRQ>
 </IRQ>
 <TASK>
 pv_wait arch/x86/include/asm/paravirt.h:596 [inline]
 pv_wait_head_or_lock kernel/locking/qspinlock_paravirt.h:466 [inline]
 __pv_queued_spin_lock_slowpath+0x8d0/0xdb0 kernel/locking/qspinlock.c:508
 pv_queued_spin_lock_slowpath arch/x86/include/asm/paravirt.h:584 [inline]
 queued_spin_lock_slowpath+0x42/0x50 arch/x86/include/asm/qspinlock.h:51
 queued_spin_lock include/asm-generic/qspinlock.h:114 [inline]
 do_raw_spin_lock+0x272/0x370 kernel/locking/spinlock_debug.c:116
 spin_lock include/linux/spinlock.h:351 [inline]
 d_instantiate+0x64/0xa0 fs/dcache.c:1903
 alloc_path_pseudo fs/file_table.c:360 [inline]
 alloc_file_pseudo+0x19e/0x290 fs/file_table.c:372
 __anon_inode_getfile fs/anon_inodes.c:109 [inline]
 anon_inode_getfile+0xc8/0x180 fs/anon_inodes.c:147
 __do_sys_perf_event_open kernel/events/core.c:13010 [inline]
 __se_sys_perf_event_open+0x224f/0x34b0 kernel/events/core.c:12721
 do_syscall_x64 arch/x86/entry/common.c:52 [inline]
 do_syscall_64+0xf3/0x230 arch/x86/entry/common.c:83
 entry_SYSCALL_64_after_hwframe+0x77/0x7f
RIP: 0033:0x7f71ea785d29
Code: ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 a8 ff ff ff f7 d8 64 89 01 48
RSP: 002b:00007f71eb5b7038 EFLAGS: 00000246 ORIG_RAX: 000000000000012a
RAX: ffffffffffffffda RBX: 00007f71ea976080 RCX: 00007f71ea785d29
RDX: ffffffffffffffff RSI: 0000000000000000 RDI: 0000000020000500
RBP: 00007f71ea801b08 R08: 0000000000000009 R09: 0000000000000000
R10: ffffffffffffffff R11: 0000000000000246 R12: 0000000000000000
R13: 0000000000000000 R14: 00007f71ea976080 R15: 00007ffd74c72fa8
 </TASK>
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 UID: 0 PID: 9775 Comm: syz.4.1328 Not tainted 6.13.0-rc7-syzkaller-00019-gc45323b7560e #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 12/27/2024
RIP: 0010:check_kcov_mode kernel/kcov.c:183 [inline]
RIP: 0010:write_comp_data kernel/kcov.c:246 [inline]
RIP: 0010:__sanitizer_cov_trace_const_cmp4+0x18/0x90 kernel/kcov.c:314
Code: 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa 4c 8b 04 24 65 48 8b 14 25 00 d6 03 00 65 8b 05 40 4f 64 7e <25> 00 01 ff 00 74 10 3d 00 01 00 00 75 5b 83 ba 1c 16 00 00 00 74
RSP: 0018:ffffc90000a18bf8 EFLAGS: 00000046
RAX: 0000000000000103 RBX: ffffc90000a18cc0 RCX: ffff888028ab8000
RDX: ffff888028ab8000 RSI: 0000000000000014 RDI: 0000000000002000
RBP: ffffc90000a18d28 R08: ffffffff81a915fa R09: 1ffffffff2033076
R10: dffffc0000000000 R11: fffffbfff2033077 R12: 0000000000000014
R13: 1ffff92000143190 R14: ffffc90000a18ca0 R15: ffffc90000a18cc0
FS:  0000555588878500(0000) GS:ffff8880b8700000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000110c360f8c CR3: 000000006fcc4000 CR4: 00000000003526f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000600
Call Trace:
 <NMI>
 </NMI>
 <IRQ>
 perf_trace_buf_alloc+0x2a/0x2f0 kernel/trace/trace_event_perf.c:405
 do_perf_trace_preemptirq_template include/trace/events/preemptirq.h:14 [inline]
 perf_trace_preemptirq_template+0x192/0x3f0 include/trace/events/preemptirq.h:14
 trace_irq_disable+0xf5/0x120 include/trace/events/preemptirq.h:36
 irqentry_enter+0x39/0x60 kernel/entry/common.c:297
 sysvec_irq_work+0xe/0xc0 arch/x86/kernel/irq_work.c:17
 asm_sysvec_irq_work+0x1a/0x20 arch/x86/include/asm/idtentry.h:738
RIP: 0010:variable_ffs arch/x86/include/asm/bitops.h:321 [inline]
RIP: 0010:handle_softirqs+0x1ef/0x9b0 kernel/softirq.c:549
Code: 00 00 00 45 0f b7 e4 48 c7 c7 80 93 09 8c e8 48 3f 67 0a 65 66 c7 05 26 fc a1 7e 00 00 e8 89 62 45 00 fb 49 c7 c6 c0 b0 60 8e <b8> ff ff ff ff 41 0f bc c4 41 89 c7 41 ff c7 0f 84 0a 04 00 00 44
RSP: 0018:ffffc90000a18e20 EFLAGS: 00000282
RAX: 54a3c22f9885a800 RBX: ffffc90000a18ee0 RCX: ffffffff817b387a
RDX: dffffc0000000000 RSI: ffffffff8c0a98e0 RDI: ffffffff8c5fb220
RBP: ffffc90000a18f50 R08: ffffffff942a58bf R09: 1ffffffff2854b17
R10: dffffc0000000000 R11: fffffbfff2854b18 R12: 0000000000000200
R13: 0000000000000000 R14: ffffffff8e60b0c0 R15: 1ffff11005157000
 __do_softirq kernel/softirq.c:595 [inline]
 invoke_softirq kernel/softirq.c:435 [inline]
 __irq_exit_rcu+0xf7/0x220 kernel/softirq.c:662
 irq_exit_rcu+0x9/0x30 kernel/softirq.c:678
 instr_sysvec_irq_work arch/x86/kernel/irq_work.c:17 [inline]
 sysvec_irq_work+0xa3/0xc0 arch/x86/kernel/irq_work.c:17
 </IRQ>
 <TASK>
 asm_sysvec_irq_work+0x1a/0x20 arch/x86/include/asm/idtentry.h:738
RIP: 0010:rcu_read_unlock_special+0x88/0x570 kernel/rcu/tree_plugin.h:693
Code: f1 f1 f1 00 f2 f2 f2 49 89 04 14 66 41 c7 44 14 09 f3 f3 41 c6 44 14 0b f3 65 44 8b 3d e9 d2 7d 7e 41 f7 c7 00 00 f0 00 74 49 <48> c7 44 24 20 0e 36 e0 45 4a c7 04 22 00 00 00 00 66 42 c7 44 22
RSP: 0018:ffffc90003ebfc20 EFLAGS: 00000206
RAX: 54a3c22f9885a800 RBX: 1ffff920007d7f8c RCX: ffffffff817b387a
RDX: dffffc0000000000 RSI: ffffffff8c0a98e0 RDI: ffffffff8c5fb220
RBP: ffffc90003ebfcf8 R08: ffffffff942a58bf R09: 1ffffffff2854b17
R10: dffffc0000000000 R11: fffffbfff2854b18 R12: 1ffff920007d7f88
R13: ffff888028ab8460 R14: ffffc90003ebfc60 R15: 0000000000000000
 __rcu_read_unlock+0xa1/0x110 kernel/rcu/tree_plugin.h:437
 dput+0x197/0x2b0 fs/dcache.c:866
 __fput+0x5ba/0xa50 fs/file_table.c:458
 task_work_run+0x24f/0x310 kernel/task_work.c:239
 resume_user_mode_work include/linux/resume_user_mode.h:50 [inline]
 exit_to_user_mode_loop kernel/entry/common.c:114 [inline]
 exit_to_user_mode_prepare include/linux/entry-common.h:329 [inline]
 __syscall_exit_to_user_mode_work kernel/entry/common.c:207 [inline]
 syscall_exit_to_user_mode+0x13f/0x340 kernel/entry/common.c:218
 do_syscall_64+0x100/0x230 arch/x86/entry/common.c:89
 entry_SYSCALL_64_after_hwframe+0x77/0x7f
RIP: 0033:0x7f4e09b85d29
Code: ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 a8 ff ff ff f7 d8 64 89 01 48
RSP: 002b:00007fffc1e5a3a8 EFLAGS: 00000246 ORIG_RAX: 00000000000001b4
RAX: 0000000000000000 RBX: 00007f4e09d77ba0 RCX: 00007f4e09b85d29
RDX: 0000000000000000 RSI: 000000000000001e RDI: 0000000000000003
RBP: 00007f4e09d77ba0 R08: 0000000000000248 R09: 00007fffc1e5a69f
R10: 00000000003ffb94 R11: 0000000000000246 R12: 0000000000045dd7
R13: 00007f4e09d76080 R14: 0000000000000032 R15: ffffffffffffffff
 </TASK>

Crashes (6):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2025/01/18 04:30 bpf c45323b7560e f2cb035c .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-bpf-kasan-gce BUG: soft lockup in sys_perf_event_open
2024/10/08 13:18 bpf 45126b155e3b 402f1df0 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-bpf-kasan-gce BUG: soft lockup in sys_perf_event_open
2024/09/29 01:51 bpf 99a648c951ba ba29ff75 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-bpf-kasan-gce BUG: soft lockup in sys_perf_event_open
2024/11/07 03:25 bpf-next 5f67329cb29c df3dc63b .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-bpf-next-kasan-gce BUG: soft lockup in sys_perf_event_open
2024/11/06 04:34 bpf-next 1850ce1bddf2 3a465482 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-bpf-next-kasan-gce BUG: soft lockup in sys_perf_event_open
2024/10/27 17:51 bpf-next 87cb58aebdf7 65e8686b .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-bpf-next-kasan-gce BUG: soft lockup in sys_perf_event_open
* Struck through repros no longer work on HEAD.