Kernel | Title | Repro | Cause bisect | Fix bisect | Count | Last | Reported | Patched | Status |
---|---|---|---|---|---|---|---|---|---|
upstream | INFO: rcu detected stall in llc_rcv (2) bpf net | 1 | 268d | 268d | 0/28 | auto-obsoleted due to no activity on 2024/12/17 08:05 |
syzbot |
sign-in | mailing list | source | docs |
Kernel | Title | Repro | Cause bisect | Fix bisect | Count | Last | Reported | Patched | Status |
---|---|---|---|---|---|---|---|---|---|
upstream | INFO: rcu detected stall in llc_rcv (2) bpf net | 1 | 268d | 268d | 0/28 | auto-obsoleted due to no activity on 2024/12/17 08:05 |
rcu: INFO: rcu_preempt detected stalls on CPUs/tasks: rcu: Tasks blocked on level-0 rcu_node (CPUs 0-1): P5446 P5442/1:b..l rcu: (detected by 1, t=10502 jiffies, g=10377, q=659 ncpus=2) task:syz-executor.2 state:R running task stack:21328 pid:5442 tgid:5437 ppid:5113 flags:0x00004002 Call Trace: <TASK> context_switch kernel/sched/core.c:5408 [inline] __schedule+0x17e8/0x4a50 kernel/sched/core.c:6745 preempt_schedule_common+0x84/0xd0 kernel/sched/core.c:6924 preempt_schedule+0xe1/0xf0 kernel/sched/core.c:6948 preempt_schedule_thunk+0x1a/0x30 arch/x86/entry/thunk.S:12 __raw_spin_unlock include/linux/spinlock_api_smp.h:143 [inline] _raw_spin_unlock+0x3e/0x50 kernel/locking/spinlock.c:186 spin_unlock include/linux/spinlock.h:391 [inline] follow_page_pte+0xe96/0x1d90 mm/gup.c:1003 follow_pmd_mask mm/gup.c:1040 [inline] follow_pud_mask mm/gup.c:1095 [inline] follow_p4d_mask mm/gup.c:1116 [inline] follow_page_mask+0x766/0x2e00 mm/gup.c:1162 __get_user_pages+0x67e/0x1590 mm/gup.c:1587 __get_user_pages_locked mm/gup.c:1857 [inline] __gup_longterm_locked+0x1ff6/0x2a80 mm/gup.c:2556 gup_fast_fallback+0x2732/0x2b40 mm/gup.c:3473 pin_user_pages_fast+0xcc/0x160 mm/gup.c:3579 iov_iter_extract_user_pages lib/iov_iter.c:1583 [inline] iov_iter_extract_pages+0x3db/0x720 lib/iov_iter.c:1646 __bio_iov_iter_get_pages block/bio.c:1283 [inline] bio_iov_iter_get_pages+0x541/0x1930 block/bio.c:1361 iomap_dio_bio_iter+0xc8e/0x1670 fs/iomap/direct-io.c:388 __iomap_dio_rw+0x1295/0x2370 fs/iomap/direct-io.c:660 iomap_dio_rw+0x46/0xa0 fs/iomap/direct-io.c:749 ext4_dio_write_iter fs/ext4/file.c:577 [inline] ext4_file_write_iter+0x15e5/0x1a10 fs/ext4/file.c:696 new_sync_write fs/read_write.c:497 [inline] vfs_write+0xa72/0xc90 fs/read_write.c:590 ksys_write+0x1a0/0x2c0 fs/read_write.c:643 do_syscall_x64 arch/x86/entry/common.c:52 [inline] do_syscall_64+0xf5/0x240 arch/x86/entry/common.c:83 entry_SYSCALL_64_after_hwframe+0x77/0x7f RIP: 0033:0x7f88b987cee9 RSP: 002b:00007f88ba69c0c8 EFLAGS: 00000246 ORIG_RAX: 0000000000000001 RAX: ffffffffffffffda RBX: 00007f88b99ac050 RCX: 00007f88b987cee9 RDX: 00000000175d9003 RSI: 0000000020000200 RDI: 0000000000000006 RBP: 00007f88b98c949e R08: 0000000000000000 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 R13: 000000000000006e R14: 00007f88b99ac050 R15: 00007ffe1a95be68 </TASK> task:syz-executor.1 state:R running task stack:23696 pid:5446 tgid:5445 ppid:5114 flags:0x00004002 Call Trace: <IRQ> sched_show_task+0x50c/0x6d0 kernel/sched/core.c:9191 rcu_print_detail_task_stall_rnp kernel/rcu/tree_stall.h:262 [inline] print_other_cpu_stall+0x122d/0x15e0 kernel/rcu/tree_stall.h:639 check_cpu_stall kernel/rcu/tree_stall.h:799 [inline] rcu_pending kernel/rcu/tree.c:4309 [inline] rcu_sched_clock_irq+0x9f4/0x10a0 kernel/rcu/tree.c:2636 update_process_times+0x1ce/0x230 kernel/time/timer.c:2485 tick_sched_handle kernel/time/tick-sched.c:276 [inline] tick_nohz_handler+0x37c/0x500 kernel/time/tick-sched.c:297 __run_hrtimer kernel/time/hrtimer.c:1687 [inline] __hrtimer_run_queues+0x55b/0xd50 kernel/time/hrtimer.c:1751 hrtimer_interrupt+0x396/0x990 kernel/time/hrtimer.c:1813 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1032 [inline] __sysvec_apic_timer_interrupt+0x110/0x3f0 arch/x86/kernel/apic/apic.c:1049 instr_sysvec_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1043 [inline] sysvec_apic_timer_interrupt+0x52/0xc0 arch/x86/kernel/apic/apic.c:1043 asm_sysvec_apic_timer_interrupt+0x1a/0x20 arch/x86/include/asm/idtentry.h:702 RIP: 0010:__sanitizer_cov_trace_pc+0x5d/0x70 kernel/kcov.c:225 Code: f8 15 00 00 83 fa 02 75 21 48 8b 91 00 16 00 00 48 8b 32 48 8d 7e 01 8b 89 fc 15 00 00 48 39 cf 73 08 48 89 3a 48 89 44 f2 08 <c3> cc cc cc cc 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 90 90 90 RSP: 0018:ffffc90000a183a8 EFLAGS: 00000246 RAX: ffffffff8133763f RBX: ffffc900098778d8 RCX: ffff88802602da00 RDX: 0000000080000102 RSI: ffff88802602da00 RDI: ffffc900098778d8 RBP: 1ffff9200014309a R08: ffffffff81411ffd R09: ffffffff81411f56 R10: 0000000000000003 R11: ffff88802602da00 R12: ffffc900098778d8 R13: ffff88802602da00 R14: ffffc90000a184e0 R15: ffffc90000a184c0 get_stack_info+0x1f/0x180 arch/x86/kernel/dumpstack_64.c:193 stack_access_ok arch/x86/kernel/unwind_orc.c:396 [inline] deref_stack_reg arch/x86/kernel/unwind_orc.c:403 [inline] unwind_next_frame+0x12ae/0x2a00 arch/x86/kernel/unwind_orc.c:585 arch_stack_walk+0x151/0x1b0 arch/x86/kernel/stacktrace.c:25 stack_trace_save+0x118/0x1d0 kernel/stacktrace.c:122 kasan_save_stack mm/kasan/common.c:47 [inline] kasan_save_track+0x3f/0x80 mm/kasan/common.c:68 kasan_save_free_info+0x40/0x50 mm/kasan/generic.c:579 poison_slab_object+0xe0/0x150 mm/kasan/common.c:240 __kasan_slab_free+0x37/0x60 mm/kasan/common.c:256 kasan_slab_free include/linux/kasan.h:184 [inline] slab_free_hook mm/slub.c:2195 [inline] slab_free mm/slub.c:4436 [inline] kmem_cache_free+0x145/0x350 mm/slub.c:4511 skb_kfree_head net/core/skbuff.c:1067 [inline] skb_free_head net/core/skbuff.c:1081 [inline] skb_release_data+0x64d/0x880 net/core/skbuff.c:1108 skb_release_all net/core/skbuff.c:1173 [inline] __kfree_skb net/core/skbuff.c:1187 [inline] kfree_skb_reason+0x1a3/0x3b0 net/core/skbuff.c:1223 llc_rcv+0x6ec/0xc00 __netif_receive_skb_one_core net/core/dev.c:5624 [inline] __netif_receive_skb+0x2e0/0x650 net/core/dev.c:5738 process_backlog+0x391/0x7d0 net/core/dev.c:6067 __napi_poll+0xcb/0x490 net/core/dev.c:6721 napi_poll net/core/dev.c:6790 [inline] net_rx_action+0x7bb/0x10a0 net/core/dev.c:6906 handle_softirqs+0x2d6/0x990 kernel/softirq.c:554 do_softirq+0x11b/0x1e0 kernel/softirq.c:455 </IRQ> <TASK> __local_bh_enable_ip+0x1bb/0x200 kernel/softirq.c:382 local_bh_enable include/linux/bottom_half.h:33 [inline] bpf_test_run+0x433/0x910 net/bpf/test_run.c:426 bpf_prog_test_run_skb+0xafa/0x13a0 net/bpf/test_run.c:1066 bpf_prog_test_run+0x33a/0x3b0 kernel/bpf/syscall.c:4291 __sys_bpf+0x48d/0x810 kernel/bpf/syscall.c:5705 __do_sys_bpf kernel/bpf/syscall.c:5794 [inline] __se_sys_bpf kernel/bpf/syscall.c:5792 [inline] __x64_sys_bpf+0x7c/0x90 kernel/bpf/syscall.c:5792 do_syscall_x64 arch/x86/entry/common.c:52 [inline] do_syscall_64+0xf5/0x240 arch/x86/entry/common.c:83 entry_SYSCALL_64_after_hwframe+0x77/0x7f RIP: 0033:0x7f5228c7cee9 Code: 28 00 00 00 75 05 48 83 c4 28 c3 e8 e1 20 00 00 90 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 b0 ff ff ff f7 d8 64 89 01 48 RSP: 002b:00007f52299250c8 EFLAGS: 00000246 ORIG_RAX: 0000000000000141 RAX: ffffffffffffffda RBX: 00007f5228dabf80 RCX: 00007f5228c7cee9 RDX: 0000000000000050 RSI: 0000000020000080 RDI: 000000000000000a RBP: 00007f5228cc949e R08: 0000000000000000 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 R13: 000000000000000b R14: 00007f5228dabf80 R15: 00007ffedb6df8c8 </TASK> rcu: rcu_preempt kthread starved for 10617 jiffies! g10377 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=0 rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. rcu: RCU grace-period kthread stack dump: task:rcu_preempt state:R running task stack:25456 pid:17 tgid:17 ppid:2 flags:0x00004000 Call Trace: <TASK> context_switch kernel/sched/core.c:5408 [inline] __schedule+0x17e8/0x4a50 kernel/sched/core.c:6745 __schedule_loop kernel/sched/core.c:6822 [inline] schedule+0x14b/0x320 kernel/sched/core.c:6837 schedule_timeout+0x1be/0x310 kernel/time/timer.c:2581 rcu_gp_fqs_loop+0x2df/0x1370 kernel/rcu/tree.c:2000 rcu_gp_kthread+0xa7/0x3b0 kernel/rcu/tree.c:2202 kthread+0x2f0/0x390 kernel/kthread.c:389 ret_from_fork+0x4b/0x80 arch/x86/kernel/process.c:147 ret_from_fork_asm+0x1a/0x30 arch/x86/entry/entry_64.S:244 </TASK> rcu: Stack dump where RCU GP kthread last ran: Sending NMI from CPU 1 to CPUs 0: NMI backtrace for cpu 0 skipped: idling at native_safe_halt arch/x86/include/asm/irqflags.h:48 [inline] NMI backtrace for cpu 0 skipped: idling at arch_safe_halt arch/x86/include/asm/irqflags.h:86 [inline] NMI backtrace for cpu 0 skipped: idling at acpi_safe_halt+0x21/0x30 drivers/acpi/processor_idle.c:112 sched: RT throttling activated
Time | Kernel | Commit | Syzkaller | Config | Log | Report | Syz repro | C repro | VM info | Assets (help?) | Manager | Title |
---|---|---|---|---|---|---|---|---|---|---|---|---|
2024/05/24 07:35 | linux-next | 124cfbcd6d18 | 8f98448e | .config | console log | report | info | [disk image] [vmlinux] [kernel image] | ci-upstream-linux-next-kasan-gce-root | INFO: rcu detected stall in llc_rcv |