syzbot


BUG: soft lockup in sys_perf_event_open (2)

Status: moderation: reported on 2024/10/03 01:56
Subsystems: fs kvm
[Documentation on labels]
Reported-by: syzbot+d50d0015274d31ba1907@syzkaller.appspotmail.com
First crash: 53d, last: 14d
Similar bugs (6)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
android-5-15 BUG: soft lockup in sys_perf_event_open 1 198d 198d 0/2 auto-obsoleted due to no activity on 2024/08/04 07:07
upstream BUG: soft lockup in sys_perf_event_open perf 1 174d 170d 0/28 auto-obsoleted due to no activity on 2024/08/29 01:52
linux-5.15 INFO: rcu detected stall in sys_perf_event_open (2) origin:lts-only C error 2 50d 316d 0/3 upstream: reported C repro on 2024/01/09 18:19
linux-6.1 INFO: rcu detected stall in sys_perf_event_open (2) 1 59d 59d 0/3 upstream: reported on 2024/09/23 05:55
linux-6.1 INFO: rcu detected stall in sys_perf_event_open 1 163d 163d 0/3 auto-obsoleted due to no activity on 2024/09/19 01:45
linux-5.15 INFO: rcu detected stall in sys_perf_event_open 1 582d 582d 0/3 auto-obsoleted due to no activity on 2023/08/17 04:33

Sample crash report:
watchdog: BUG: soft lockup - CPU#1 stuck for 143s! [syz.1.229:5961]
Modules linked in:
irq event stamp: 11335934
hardirqs last  enabled at (11335933): [<ffffffff8bc45533>] irqentry_exit+0x63/0x90 kernel/entry/common.c:357
hardirqs last disabled at (11335934): [<ffffffff8bc430de>] sysvec_apic_timer_interrupt+0xe/0xc0 arch/x86/kernel/apic/apic.c:1037
softirqs last  enabled at (11335140): [<ffffffff81576384>] __do_softirq kernel/softirq.c:588 [inline]
softirqs last  enabled at (11335140): [<ffffffff81576384>] invoke_softirq kernel/softirq.c:428 [inline]
softirqs last  enabled at (11335140): [<ffffffff81576384>] __irq_exit_rcu+0xf4/0x1c0 kernel/softirq.c:637
softirqs last disabled at (11335119): [<ffffffff81576384>] __do_softirq kernel/softirq.c:588 [inline]
softirqs last disabled at (11335119): [<ffffffff81576384>] invoke_softirq kernel/softirq.c:428 [inline]
softirqs last disabled at (11335119): [<ffffffff81576384>] __irq_exit_rcu+0xf4/0x1c0 kernel/softirq.c:637
CPU: 1 UID: 0 PID: 5961 Comm: syz.1.229 Not tainted 6.11.0-syzkaller-10556-g45126b155e3b #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 09/13/2024
RIP: 0010:pv_wait_head_or_lock kernel/locking/qspinlock_paravirt.h:430 [inline]
RIP: 0010:__pv_queued_spin_lock_slowpath+0x781/0xdb0 kernel/locking/qspinlock.c:508
Code: ff 42 0f b6 04 2b 84 c0 75 6c 66 c7 84 24 b0 00 00 00 00 01 48 8b 44 24 40 42 0f b6 04 28 84 c0 75 77 41 80 3e 00 74 0c f3 90 <41> ff c4 75 d2 e9 a0 00 00 00 4c 89 f7 be 02 00 00 00 e8 68 3d 30
RSP: 0018:ffffc90016637960 EFLAGS: 00000206
RAX: 0000000000000000 RBX: 1ffff92002cc6f42 RCX: ffffc90016637a01
RDX: ffffc900048e1000 RSI: 000000000003ffff RDI: 0000000000040000
RBP: ffffc90016637a98 R08: ffffffff942687ff R09: 1ffffffff284d0ff
R10: dffffc0000000000 R11: fffffbfff284d100 R12: 00000000ffffd086
R13: dffffc0000000000 R14: ffff888148c12dc8 R15: ffffc90016637a20
FS:  00007f287413f6c0(0000) GS:ffff8880b8700000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000000000 CR3: 000000007bb3e000 CR4: 00000000003506f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <IRQ>
 </IRQ>
 <TASK>
 pv_queued_spin_lock_slowpath arch/x86/include/asm/paravirt.h:584 [inline]
 queued_spin_lock_slowpath+0x42/0x50 arch/x86/include/asm/qspinlock.h:51
 queued_spin_lock include/asm-generic/qspinlock.h:114 [inline]
 do_raw_spin_lock+0x272/0x370 kernel/locking/spinlock_debug.c:116
 spin_lock include/linux/spinlock.h:351 [inline]
 d_instantiate+0x64/0xa0 fs/dcache.c:1893
 alloc_path_pseudo fs/file_table.c:341 [inline]
 alloc_file_pseudo+0x19e/0x290 fs/file_table.c:353
 __anon_inode_getfile fs/anon_inodes.c:109 [inline]
 anon_inode_getfile+0xc8/0x180 fs/anon_inodes.c:147
 __do_sys_perf_event_open kernel/events/core.c:12946 [inline]
 __se_sys_perf_event_open+0x2553/0x3870 kernel/events/core.c:12658
 do_syscall_x64 arch/x86/entry/common.c:52 [inline]
 do_syscall_64+0xf3/0x230 arch/x86/entry/common.c:83
 entry_SYSCALL_64_after_hwframe+0x77/0x7f
RIP: 0033:0x7f287337dff9
Code: ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 a8 ff ff ff f7 d8 64 89 01 48
RSP: 002b:00007f287413f038 EFLAGS: 00000246 ORIG_RAX: 000000000000012a
RAX: ffffffffffffffda RBX: 00007f2873535f80 RCX: 00007f287337dff9
RDX: ffffffffffffffff RSI: 0000000000000000 RDI: 0000000020000500
RBP: 00007f28733f0296 R08: 0000000000000009 R09: 0000000000000000
R10: ffffffffffffffff R11: 0000000000000246 R12: 0000000000000000
R13: 0000000000000000 R14: 00007f2873535f80 R15: 00007fff6714b288
 </TASK>
Sending NMI from CPU 1 to CPUs 0:
NMI backtrace for cpu 0
CPU: 0 UID: 0 PID: 5960 Comm: syz.3.231 Not tainted 6.11.0-syzkaller-10556-g45126b155e3b #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 09/13/2024
RIP: 0010:native_save_fl arch/x86/include/asm/irqflags.h:32 [inline]
RIP: 0010:arch_local_save_flags arch/x86/include/asm/irqflags.h:87 [inline]
RIP: 0010:irq_work_run_list kernel/irq_work.c:245 [inline]
RIP: 0010:irq_work_run+0xf6/0x350 kernel/irq_work.c:261
Code: 64 03 00 4d 89 ee 49 c1 ee 03 4c 03 3b 43 80 3c 26 00 74 08 4c 89 ef e8 58 f6 5a 00 48 c7 44 24 60 00 00 00 00 9c 8f 44 24 60 <43> 80 3c 26 00 74 08 4c 89 ef e8 4b f5 5a 00 4c 8b 74 24 60 bb 00
RSP: 0018:ffffc90000007c80 EFLAGS: 00000046
RAX: 1ffffffff1c6314a RBX: ffffffff8e318a50 RCX: ffff888074a98000
RDX: 0000000000010100 RSI: 0000000000000000 RDI: 0000000000000008
RBP: ffffc90000007d50 R08: ffffffff81a36ee7 R09: 1ffffffff2039cad
R10: dffffc0000000000 R11: fffffbfff2039cae R12: dffffc0000000000
R13: ffffc90000007ce0 R14: 1ffff92000000f9c R15: ffff8880b8636438
FS:  000055555984c500(0000) GS:ffff8880b8600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000110c28517a CR3: 000000002f414000 CR4: 00000000003506f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000600
Call Trace:
 <NMI>
 </NMI>
 <IRQ>
 __sysvec_irq_work+0xb8/0x430 arch/x86/kernel/irq_work.c:22
 instr_sysvec_irq_work arch/x86/kernel/irq_work.c:17 [inline]
 sysvec_irq_work+0x4f/0xc0 arch/x86/kernel/irq_work.c:17
 asm_sysvec_irq_work+0x1a/0x20 arch/x86/include/asm/idtentry.h:738
RIP: 0010:variable_ffs arch/x86/include/asm/bitops.h:321 [inline]
RIP: 0010:handle_softirqs+0x1e3/0x980 kernel/softirq.c:542
Code: 7c 24 70 45 0f b7 e4 48 c7 c7 60 bf 09 8c e8 a4 0a 6d 0a 65 66 c7 05 62 7e ac 7e 00 00 e8 55 1b 45 00 fb 49 c7 c6 c0 a0 60 8e <b8> ff ff ff ff 41 0f bc c4 41 89 c7 41 ff c7 0f 84 eb 03 00 00 44
RSP: 0018:ffffc90000007e40 EFLAGS: 00000286
RAX: 43257090f82e8e00 RBX: ffffc90000007ee0 RCX: ffffffff8170892a
RDX: dffffc0000000000 RSI: ffffffff8c0aca40 RDI: ffffffff8c6100a0
RBP: ffffc90000007f50 R08: ffffffff942687ff R09: 1ffffffff284d0ff
R10: dffffc0000000000 R11: fffffbfff284d100 R12: 0000000000000200
R13: 0000000000000000 R14: ffffffff8e60a0c0 R15: 1ffff1100e953000
 __do_softirq kernel/softirq.c:588 [inline]
 invoke_softirq kernel/softirq.c:428 [inline]
 __irq_exit_rcu+0xf4/0x1c0 kernel/softirq.c:637
 irq_exit_rcu+0x9/0x30 kernel/softirq.c:649
 instr_sysvec_irq_work arch/x86/kernel/irq_work.c:17 [inline]
 sysvec_irq_work+0xa3/0xc0 arch/x86/kernel/irq_work.c:17
 </IRQ>
 <TASK>
 asm_sysvec_irq_work+0x1a/0x20 arch/x86/include/asm/idtentry.h:738
RIP: 0010:rcu_read_unlock_special+0x88/0x550 kernel/rcu/tree_plugin.h:693
Code: f1 f1 f1 00 f2 f2 f2 49 89 04 17 66 41 c7 44 17 09 f3 f3 41 c6 44 17 0b f3 65 44 8b 25 59 60 88 7e 41 f7 c4 00 00 f0 00 74 49 <48> c7 44 24 20 0e 36 e0 45 4a c7 04 3a 00 00 00 00 66 42 c7 44 3a
RSP: 0018:ffffc90015a6fc20 EFLAGS: 00000206
RAX: 43257090f82e8e00 RBX: 1ffff92002b4df8c RCX: ffffffff8170892a
RDX: dffffc0000000000 RSI: ffffffff8c0aca40 RDI: ffffffff8c6100a0
RBP: ffffc90015a6fd00 R08: ffffffff942687ff R09: 1ffffffff284d0ff
R10: dffffc0000000000 R11: fffffbfff284d100 R12: 0000000000000000
R13: ffff888074a98460 R14: ffffc90015a6fc60 R15: 1ffff92002b4df88
 __rcu_read_unlock+0xa1/0x110 kernel/rcu/tree_plugin.h:437
 dput+0x197/0x2b0 fs/dcache.c:856
 __fput+0x5d2/0x880 fs/file_table.c:439
 task_work_run+0x24f/0x310 kernel/task_work.c:228
 resume_user_mode_work include/linux/resume_user_mode.h:50 [inline]
 exit_to_user_mode_loop kernel/entry/common.c:114 [inline]
 exit_to_user_mode_prepare include/linux/entry-common.h:328 [inline]
 __syscall_exit_to_user_mode_work kernel/entry/common.c:207 [inline]
 syscall_exit_to_user_mode+0x168/0x370 kernel/entry/common.c:218
 do_syscall_64+0x100/0x230 arch/x86/entry/common.c:89
 entry_SYSCALL_64_after_hwframe+0x77/0x7f
RIP: 0033:0x7f5abd97dff9
Code: ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 a8 ff ff ff f7 d8 64 89 01 48
RSP: 002b:00007fff137c4518 EFLAGS: 00000246 ORIG_RAX: 00000000000001b4
RAX: 0000000000000000 RBX: 000000000001b425 RCX: 00007f5abd97dff9
RDX: 0000000000000000 RSI: 000000000000001e RDI: 0000000000000003
RBP: 00007f5abdb37a80 R08: 0000000000000001 R09: 00007fff137c480f
R10: 00007f5abd800000 R11: 0000000000000246 R12: 000000000001b499
R13: 00007fff137c4620 R14: 0000000000000032 R15: ffffffffffffffff
 </TASK>

Crashes (5):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2024/10/08 13:18 bpf 45126b155e3b 402f1df0 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-bpf-kasan-gce BUG: soft lockup in sys_perf_event_open
2024/09/29 01:51 bpf 99a648c951ba ba29ff75 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-bpf-kasan-gce BUG: soft lockup in sys_perf_event_open
2024/11/07 03:25 bpf-next 5f67329cb29c df3dc63b .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-bpf-next-kasan-gce BUG: soft lockup in sys_perf_event_open
2024/11/06 04:34 bpf-next 1850ce1bddf2 3a465482 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-bpf-next-kasan-gce BUG: soft lockup in sys_perf_event_open
2024/10/27 17:51 bpf-next 87cb58aebdf7 65e8686b .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-bpf-next-kasan-gce BUG: soft lockup in sys_perf_event_open
* Struck through repros no longer work on HEAD.