syzbot


BUG: soft lockup in bpf_link_release

Status: premoderation: reported on 2024/04/08 01:38
Reported-by: syzbot+99c5c868959c8fdb55d1@syzkaller.appspotmail.com
First crash: 102d, last: 20d
Similar bugs (2)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: rcu detected stall in bpf_link_release (2) kernel 1 615d 615d 0/27 auto-obsoleted due to no activity on 2023/02/13 11:46
upstream INFO: rcu detected stall in bpf_link_release kernel 1 930d 930d 0/27 closed as invalid on 2022/02/08 10:10

Sample crash report:
RBP: ffffffffffffffff R08: 0000000000000001 R09: 0000001eb796034f
R10: 00007fbbcf62f000 R11: 0000000000000246 R12: 00007fbbcf932fac
R13: 0000000000000032 R14: 00007fbbcf934aa0 R15: 00007fbbcf932fa0
 </TASK>
watchdog: BUG: soft lockup - CPU#1 stuck for 226s! [syz.2.376:1651]
Modules linked in:
CPU: 1 PID: 1651 Comm: syz.2.376 Not tainted 5.15.150-syzkaller-00330-g9044d25b8ff5 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 06/07/2024
RIP: 0010:__sanitizer_cov_trace_pc+0x0/0x60 kernel/kcov.c:190
Code: 00 00 00 0f 0b 0f 1f 44 00 00 55 48 89 e5 53 48 89 fb e8 13 00 00 00 48 8b 3d 74 1e 96 05 48 89 de e8 c4 76 41 00 5b 5d c3 cc <55> 48 89 e5 48 8b 45 08 65 48 8b 0d d0 35 92 7e 65 8b 15 d1 35 92
RSP: 0018:ffffc90000a87858 EFLAGS: 00000202
RAX: 0000000000000000 RBX: 1ffff1103ee07af1 RCX: ffff88811b098000
RDX: 0000000000000000 RSI: 0000000000000001 RDI: 0000000000000000
RBP: ffffc90000a87978 R08: ffffffff816592da R09: ffffed103ee271d3
R10: 0000000000000000 R11: dffffc0000000001 R12: 0000000000000000
R13: ffff8881f703d788 R14: ffff8881f7138e80 R15: dffffc0000000000
FS:  000055555713e500(0000) GS:ffff8881f7100000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000020000000 CR3: 000000011f1ae000 CR4: 00000000003526a0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <IRQ>
 </IRQ>
 <TASK>
 on_each_cpu_cond_mask+0x40/0x80 kernel/smp.c:1135
 on_each_cpu include/linux/smp.h:71 [inline]
 text_poke_sync arch/x86/kernel/alternative.c:1201 [inline]
 text_poke_bp_batch+0x1c4/0x5d0 arch/x86/kernel/alternative.c:1392
 text_poke_flush arch/x86/kernel/alternative.c:1560 [inline]
 text_poke_finish+0x1a/0x30 arch/x86/kernel/alternative.c:1567
 arch_jump_label_transform_apply+0x15/0x30 arch/x86/kernel/jump_label.c:146
 __jump_label_update+0x36a/0x380 kernel/jump_label.c:459
 jump_label_update+0x3af/0x450 kernel/jump_label.c:830
 static_key_disable_cpuslocked+0xcd/0x1b0 kernel/jump_label.c:207
 static_key_disable+0x1a/0x30 kernel/jump_label.c:215
 tracepoint_remove_func kernel/tracepoint.c:417 [inline]
 tracepoint_probe_unregister+0x60a/0x900 kernel/tracepoint.c:551
 bpf_probe_unregister+0x61/0x70 kernel/trace/bpf_trace.c:1954
 bpf_raw_tp_link_release+0x63/0x90 kernel/bpf/syscall.c:2880
 bpf_link_free+0x129/0x3f0 kernel/bpf/syscall.c:2451
 bpf_link_put kernel/bpf/syscall.c:2477 [inline]
 bpf_link_release+0x170/0x180 kernel/bpf/syscall.c:2485
 __fput+0x3fe/0x910 fs/file_table.c:280
 ____fput+0x15/0x20 fs/file_table.c:308
 task_work_run+0x129/0x190 kernel/task_work.c:164
 tracehook_notify_resume include/linux/tracehook.h:189 [inline]
 exit_to_user_mode_loop+0xc4/0xe0 kernel/entry/common.c:175
 exit_to_user_mode_prepare+0x5a/0xa0 kernel/entry/common.c:208
 __syscall_exit_to_user_mode_work kernel/entry/common.c:290 [inline]
 syscall_exit_to_user_mode+0x26/0x160 kernel/entry/common.c:301
 do_syscall_64+0x49/0xb0 arch/x86/entry/common.c:86
 entry_SYSCALL_64_after_hwframe+0x61/0xcb
RIP: 0033:0x7fbbcf7a4b99
Code: ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 a8 ff ff ff f7 d8 64 89 01 48
RSP: 002b:00007ffeb7960038 EFLAGS: 00000246 ORIG_RAX: 00000000000001b4
RAX: 0000000000000000 RBX: 0000000000017eef RCX: 00007fbbcf7a4b99
RDX: 0000000000000000 RSI: 000000000000001e RDI: 0000000000000003
RBP: ffffffffffffffff R08: 0000000000000001 R09: 0000001eb796034f
R10: 00007fbbcf62f000 R11: 0000000000000246 R12: 00007fbbcf932fac
R13: 0000000000000032 R14: 00007fbbcf934aa0 R15: 00007fbbcf932fa0
 </TASK>
Sending NMI from CPU 1 to CPUs 0:
NMI backtrace for cpu 0
CPU: 0 PID: 1602 Comm: syz.4.361 Not tainted 5.15.150-syzkaller-00330-g9044d25b8ff5 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 06/07/2024
RIP: 0010:native_halt arch/x86/include/asm/irqflags.h:57 [inline]
RIP: 0010:halt arch/x86/include/asm/irqflags.h:98 [inline]
RIP: 0010:kvm_wait+0x117/0x180 arch/x86/kernel/kvm.c:912
Code: 48 c1 e8 03 42 0f b6 04 20 84 c0 44 8b 74 24 1c 75 53 41 0f b6 45 00 44 38 f0 0f 85 63 ff ff ff 66 90 0f 00 2d 7a 02 f3 03 f4 <e9> 54 ff ff ff fa 4c 89 e8 48 c1 e8 03 42 0f b6 04 20 84 c0 44 8b
RSP: 0018:ffffc90000007640 EFLAGS: 00000046
RAX: 0000000000000003 RBX: 1ffff92000000ecc RCX: ffffffff8154fbbf
RDX: dffffc0000000000 RSI: 0000000000000003 RDI: ffff88810e0d5780
RBP: ffffc900000076f0 R08: dffffc0000000000 R09: ffffed1021c1aaf1
R10: 0000000000000000 R11: dffffc0000000001 R12: dffffc0000000000
R13: ffff88810e0d5780 R14: 0000000000000003 R15: 1ffff92000000ed0
FS:  0000555556bf8500(0000) GS:ffff8881f7000000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f246898b0e0 CR3: 0000000104987000 CR4: 00000000003526b0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <NMI>
 </NMI>
 <IRQ>
 pv_wait arch/x86/include/asm/paravirt.h:597 [inline]
 pv_wait_head_or_lock kernel/locking/qspinlock_paravirt.h:470 [inline]
 __pv_queued_spin_lock_slowpath+0x6bc/0xc40 kernel/locking/qspinlock.c:508
 pv_queued_spin_lock_slowpath arch/x86/include/asm/paravirt.h:585 [inline]
 queued_spin_lock_slowpath arch/x86/include/asm/qspinlock.h:51 [inline]
 queued_spin_lock include/asm-generic/qspinlock.h:85 [inline]
 do_raw_spin_lock_flags include/linux/spinlock.h:199 [inline]
 __raw_spin_lock_irqsave include/linux/spinlock_api_smp.h:119 [inline]
 _raw_spin_lock_irqsave+0x1a0/0x210 kernel/locking/spinlock.c:162
 __lock_task_sighand kernel/signal.c:1413 [inline]
 lock_task_sighand include/linux/sched/signal.h:710 [inline]
 do_send_sig_info+0x7e/0x230 kernel/signal.c:1302
 group_send_sig_info+0x113/0x460 kernel/signal.c:1451
 bpf_send_signal_common+0x2d8/0x420 kernel/trace/bpf_trace.c:824
 ____bpf_send_signal kernel/trace/bpf_trace.c:829 [inline]
 bpf_send_signal+0x19/0x20 kernel/trace/bpf_trace.c:827
 bpf_prog_2a4b6e86cea73e9e+0x1a/0xf50
 bpf_dispatcher_nop_func include/linux/bpf.h:785 [inline]
 __bpf_prog_run include/linux/filter.h:625 [inline]
 bpf_prog_run include/linux/filter.h:632 [inline]
 __bpf_trace_run kernel/trace/bpf_trace.c:1880 [inline]
 bpf_trace_run2+0xec/0x210 kernel/trace/bpf_trace.c:1917
 __bpf_trace_kfree+0x6f/0x90 include/trace/events/kmem.h:118
 trace_kfree include/trace/events/kmem.h:118 [inline]
 kfree+0x1f3/0x220 mm/slub.c:4569
 deferred_put_nlk_sk+0x45/0x220 net/netlink/af_netlink.c:735
 rcu_do_batch+0x57a/0xc10 kernel/rcu/tree.c:2523
 rcu_core+0x517/0x1020 kernel/rcu/tree.c:2763
 rcu_core_si+0x9/0x10 kernel/rcu/tree.c:2776
 __do_softirq+0x26d/0x5bf kernel/softirq.c:565
 do_softirq+0xf6/0x150 kernel/softirq.c:452
 </IRQ>
 <TASK>
 __local_bh_enable_ip+0x75/0x80 kernel/softirq.c:379
 __raw_spin_unlock_bh include/linux/spinlock_api_smp.h:176 [inline]
 _raw_spin_unlock_bh+0x51/0x60 kernel/locking/spinlock.c:210
 __sock_map_delete net/core/sock_map.c:426 [inline]
 sock_map_delete_elem+0xcb/0x130 net/core/sock_map.c:448
 bpf_prog_2c29ac5cdc6b1842+0x3a/0x68c
 bpf_dispatcher_nop_func include/linux/bpf.h:785 [inline]
 __bpf_prog_run include/linux/filter.h:625 [inline]
 bpf_prog_run include/linux/filter.h:632 [inline]
 __bpf_trace_run kernel/trace/bpf_trace.c:1880 [inline]
 bpf_trace_run3+0x11e/0x250 kernel/trace/bpf_trace.c:1918
 __bpf_trace_kmem_cache_free+0x99/0xc0 include/trace/events/kmem.h:138
 trace_kmem_cache_free include/trace/events/kmem.h:138 [inline]
 kmem_cache_free+0x2c3/0x2e0 mm/slub.c:3536
 __sigqueue_free kernel/signal.c:462 [inline]
 collect_signal kernel/signal.c:601 [inline]
 __dequeue_signal+0x4f8/0x600 kernel/signal.c:623
 dequeue_signal+0x10c/0x520 kernel/signal.c:643
 get_signal+0x7cf/0x1630 kernel/signal.c:2777
 arch_do_signal_or_restart+0xbd/0x1680 arch/x86/kernel/signal.c:867
 handle_signal_work kernel/entry/common.c:148 [inline]
 exit_to_user_mode_loop+0xa0/0xe0 kernel/entry/common.c:172
 exit_to_user_mode_prepare+0x5a/0xa0 kernel/entry/common.c:208
 __syscall_exit_to_user_mode_work kernel/entry/common.c:290 [inline]
 syscall_exit_to_user_mode+0x26/0x160 kernel/entry/common.c:301
 do_syscall_64+0x49/0xb0 arch/x86/entry/common.c:86
 entry_SYSCALL_64_after_hwframe+0x61/0xcb
RIP: 0033:0x7f8b5434bb85
Code: 24 0c 89 3c 24 48 89 4c 24 18 e8 c6 57 ff ff 4c 8b 54 24 18 48 8b 54 24 10 41 89 c0 8b 74 24 0c 8b 3c 24 b8 e6 00 00 00 0f 05 <44> 89 c7 48 89 04 24 e8 1f 58 ff ff 48 8b 04 24 48 83 c4 28 f7 d8
RSP: 002b:00007ffdb46c35e0 EFLAGS: 00000293 ORIG_RAX: 00000000000000e6
RAX: 0000000000000000 RBX: 00007f8b544a7fa0 RCX: 00007f8b5434bb85
RDX: 00007ffdb46c3620 RSI: 0000000000000000 RDI: 0000000000000000
RBP: 00007f8b544a9aa0 R08: 0000000000000000 R09: 00007ffdb46d20b0
R10: 0000000000000000 R11: 0000000000000293 R12: 0000000000018a64
R13: 0000000000000032 R14: 00007f8b544a9aa0 R15: 00007f8b544a8078
 </TASK>

Crashes (17):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2024/06/29 04:29 android13-5.15-lts 9044d25b8ff5 757f06b1 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15 BUG: soft lockup in bpf_link_release
2024/06/16 15:04 android13-5.15-lts 85445b5a2107 f429ab00 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15 BUG: soft lockup in bpf_link_release
2024/06/15 13:47 android13-5.15-lts 85445b5a2107 f429ab00 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: soft lockup in bpf_link_release
2024/06/12 11:06 android13-5.15-lts 79bd336c7a94 f815599d .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15 BUG: soft lockup in bpf_link_release
2024/06/02 20:19 android13-5.15-lts 424f92bcbe8f 3113787f .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: soft lockup in bpf_link_release
2024/05/29 18:44 android13-5.15-lts 424f92bcbe8f 34889ee3 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15 BUG: soft lockup in bpf_link_release
2024/05/22 07:42 android13-5.15-lts 5d96939590c0 1014eca7 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: soft lockup in bpf_link_release
2024/05/17 19:48 android13-5.15-lts 5d96939590c0 a12e99e7 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: soft lockup in bpf_link_release
2024/05/16 15:42 android13-5.15-lts 5d96939590c0 ef5d53ed .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: soft lockup in bpf_link_release
2024/05/13 13:54 android13-5.15-lts 5d96939590c0 9026e142 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: soft lockup in bpf_link_release
2024/05/13 03:26 android13-5.15-lts 5d96939590c0 9026e142 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15 BUG: soft lockup in bpf_link_release
2024/05/04 16:40 android13-5.15-lts 5d96939590c0 610f2a54 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: soft lockup in bpf_link_release
2024/04/29 00:22 android13-5.15-lts 5d96939590c0 07b455f9 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15 BUG: soft lockup in bpf_link_release
2024/04/26 22:28 android13-5.15-lts 5d96939590c0 059e9963 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15 BUG: soft lockup in bpf_link_release
2024/04/26 19:13 android13-5.15-lts 5d96939590c0 059e9963 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: soft lockup in bpf_link_release
2024/04/14 08:10 android13-5.15-lts 993bed180178 c8349e48 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15 BUG: soft lockup in bpf_link_release
2024/04/08 01:37 android13-5.15-lts 993bed180178 ca620dd8 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: soft lockup in bpf_link_release
* Struck through repros no longer work on HEAD.