syzbot

 sign-in | mailing list | source | docs
🐞 Open [681]
🐞 Fixed [69]
🐞 Invalid [841]
⬇ Missing Backports [102]
≡ Crashes
Kernel Health Bugs/Month Bug Lifetimes Fuzzing
💬 Send us feedback

INFO: rcu detected stall in NF_HOOK (3)

Status: upstream: reported on 2025/01/03 04:32
Reported-by: syzbot+6a80e603e135d8003e86@syzkaller.appspotmail.com
First crash: 108d, last: 90d
▶ ▼ Similar bugs (6)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: rcu detected stall in NF_HOOK netfilter usb C error 13 290d 305d 0/28 closed as dup on 2024/06/20 17:29
linux-5.15 INFO: rcu detected stall in NF_HOOK 1 410d 410d 0/3 auto-obsoleted due to no activity on 2024/06/15 14:02
linux-6.1 INFO: rcu detected stall in NF_HOOK origin:lts-only syz unreliable 19 41d 321d 0/3 upstream: reported syz repro on 2024/06/04 14:31
upstream INFO: rcu detected stall in NF_HOOK (2) netfilter C inconclusive error 67 11d 193d 0/28 upstream: reported C repro on 2024/10/10 12:45
linux-5.15 INFO: rcu detected stall in NF_HOOK (2) 1 292d 292d 0/3 auto-obsoleted due to no activity on 2024/10/11 06:09
android-54 BUG: soft lockup in NF_HOOK 1 313d 313d 0/2 auto-obsoleted due to no activity on 2024/09/10 19:37

Sample crash report:
rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
rcu: 	0-...!: (1 ticks this GP) idle=205/1/0x4000000000000000 softirq=13776/13776 fqs=0 
	(detected by 1, t=10502 jiffies, g=18913, q=4865)
Sending NMI from CPU 1 to CPUs 0:
NMI backtrace for cpu 0
CPU: 0 PID: 14 Comm: ksoftirqd/0 Not tainted 5.15.176-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 12/27/2024
RIP: 0010:hlock_class kernel/locking/lockdep.c:197 [inline]
RIP: 0010:__lock_acquire+0x1211/0x1ff0 kernel/locking/lockdep.c:5009
Code: 00 00 41 8b 1f 81 e3 ff 1f 00 00 89 d8 c1 e8 06 48 8d 3c c5 00 a1 98 90 be 08 00 00 00 e8 67 89 67 00 48 0f a3 1d bf bb 35 0f <73> 1b 48 8d 04 5b 48 c1 e0 06 48 8d 98 c0 1f 31 90 48 ba 00 00 00
RSP: 0000:ffffc90000007a80 EFLAGS: 00000057
RAX: 0000000000000001 RBX: 0000000000000061 RCX: ffffffff8162e539
RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff9098a108
RBP: 4b21b045db16ba9e R08: dffffc0000000000 R09: fffffbfff2131422
R10: 0000000000000000 R11: dffffc0000000001 R12: 0000000000000002
R13: ffff88813ff228a8 R14: ffff88813ff21dc0 R15: ffff88813ff22920
FS:  0000000000000000(0000) GS:ffff8880b8e00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000001b3021fffc CR3: 000000004206c000 CR4: 00000000003506f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <NMI>
 </NMI>
 <IRQ>
 lock_acquire+0x1db/0x4f0 kernel/locking/lockdep.c:5623
 __raw_spin_lock_irq include/linux/spinlock_api_smp.h:128 [inline]
 _raw_spin_lock_irq+0xcf/0x110 kernel/locking/spinlock.c:170
 __run_hrtimer kernel/time/hrtimer.c:1692 [inline]
 __hrtimer_run_queues+0x662/0xcf0 kernel/time/hrtimer.c:1752
 hrtimer_interrupt+0x392/0x980 kernel/time/hrtimer.c:1814
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1097 [inline]
 __sysvec_apic_timer_interrupt+0x13b/0x4b0 arch/x86/kernel/apic/apic.c:1114
 instr_sysvec_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1108 [inline]
 sysvec_apic_timer_interrupt+0x9b/0xc0 arch/x86/kernel/apic/apic.c:1108
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:676
RIP: 0010:memset_erms+0xb/0x10 arch/x86/lib/memset_64.S:65
Code: 03 40 0f b6 f6 48 b8 01 01 01 01 01 01 01 01 48 0f af c6 f3 48 ab 89 d1 f3 aa 4c 89 c8 c3 90 49 89 f9 40 88 f0 48 89 d1 f3 aa <4c> 89 c8 c3 90 49 89 fa 40 0f b6 ce 48 b8 01 01 01 01 01 01 01 01
RSP: 0000:ffffc90000d369e0 EFLAGS: 00000202
RAX: 0000000000000000 RBX: ffffc90000d36af0 RCX: 0000000000000000
RDX: 0000000000000010 RSI: 0000000000000000 RDI: ffffc90000d36b00
RBP: ffffffff8ef44994 R08: dffffc0000000000 R09: ffffc90000d36af0
R10: 0000000000000000 R11: dffffc0000000001 R12: 1ffffffff1de8932
R13: 1ffffffff1de8932 R14: ffffffff8ef44990 R15: ffffc90000d36aa0
 unwind_next_frame+0xbc8/0x1fa0 arch/x86/kernel/unwind_orc.c:547
 arch_stack_walk+0x10d/0x140 arch/x86/kernel/stacktrace.c:25
 stack_trace_save+0x113/0x1c0 kernel/stacktrace.c:122
 kasan_save_stack mm/kasan/common.c:38 [inline]
 kasan_set_track+0x4b/0x80 mm/kasan/common.c:46
 kasan_set_free_info+0x1f/0x40 mm/kasan/generic.c:360
 ____kasan_slab_free+0xd8/0x120 mm/kasan/common.c:366
 kasan_slab_free include/linux/kasan.h:230 [inline]
 slab_free_hook mm/slub.c:1705 [inline]
 slab_free_freelist_hook+0xdd/0x160 mm/slub.c:1731
 slab_free mm/slub.c:3499 [inline]
 kmem_cache_free+0x91/0x1f0 mm/slub.c:3515
 nft_synproxy_eval_v4+0x3ce/0x610 net/netfilter/nft_synproxy.c:60
 nft_synproxy_do_eval+0x359/0xa60 net/netfilter/nft_synproxy.c:141
 expr_call_ops_eval net/netfilter/nf_tables_core.c:198 [inline]
 nft_do_chain+0x467/0x16b0 net/netfilter/nf_tables_core.c:238
 nft_do_chain_inet+0x3f8/0x680 net/netfilter/nft_chain_filter.c:161
 nf_hook_entry_hookfn include/linux/netfilter.h:142 [inline]
 nf_hook_slow+0xae/0x1e0 net/netfilter/core.c:584
 nf_hook include/linux/netfilter.h:257 [inline]
 NF_HOOK+0x26b/0x410 include/linux/netfilter.h:300
 NF_HOOK+0x364/0x410 include/linux/netfilter.h:302
 __netif_receive_skb_one_core net/core/dev.c:5493 [inline]
 __netif_receive_skb+0x1c6/0x530 net/core/dev.c:5607
 process_backlog+0x363/0x7f0 net/core/dev.c:6484
 __napi_poll+0xc7/0x440 net/core/dev.c:7043
 napi_poll net/core/dev.c:7110 [inline]
 net_rx_action+0x617/0xda0 net/core/dev.c:7200
 handle_softirqs+0x3a7/0x930 kernel/softirq.c:558
 run_ksoftirqd+0xc6/0x120 kernel/softirq.c:925
 smpboot_thread_fn+0x51b/0x9d0 kernel/smpboot.c:164
 kthread+0x3f6/0x4f0 kernel/kthread.c:334
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:287
 </TASK>
rcu: rcu_preempt kthread timer wakeup didn't happen for 10501 jiffies! g18913 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402
rcu: 	Possible timer handling issue on cpu=0 timer-softirq=7660
rcu: rcu_preempt kthread starved for 10502 jiffies! g18913 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0
rcu: 	Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
rcu: RCU grace-period kthread stack dump:
task:rcu_preempt     state:I stack:26712 pid:   15 ppid:     2 flags:0x00004000
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5027 [inline]
 __schedule+0x12c4/0x45b0 kernel/sched/core.c:6373
 schedule+0x11b/0x1f0 kernel/sched/core.c:6456
 schedule_timeout+0x1b9/0x300 kernel/time/timer.c:1914
 rcu_gp_fqs_loop+0x2bf/0x1080 kernel/rcu/tree.c:1972
 rcu_gp_kthread+0xa4/0x360 kernel/rcu/tree.c:2145
 kthread+0x3f6/0x4f0 kernel/kthread.c:334
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:287
 </TASK>
rcu: Stack dump where RCU GP kthread last ran:
Sending NMI from CPU 1 to CPUs 0:
NMI backtrace for cpu 0
CPU: 0 PID: 14 Comm: ksoftirqd/0 Not tainted 5.15.176-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 12/27/2024
RIP: 0010:check_wait_context kernel/locking/lockdep.c:4709 [inline]
RIP: 0010:__lock_acquire+0x714/0x1ff0 kernel/locking/lockdep.c:4962
Code: 8b 7c 24 10 75 1f 48 8b 44 24 68 0f b6 04 10 84 c0 0f 85 e2 14 00 00 83 3f 00 41 0f 94 c7 45 00 ff 41 80 c7 02 48 8b 44 24 40 <0f> b6 04 10 84 c0 0f 85 19 13 00 00 48 8b 44 24 30 44 3b 20 0f 8d
RSP: 0000:ffffc90000007a60 EFLAGS: 00000002
RAX: 1ffff11027fe4515 RBX: 00000000000e4ccc RCX: ffff88813ff228b0
RDX: dffffc0000000000 RSI: 0000000000000002 RDI: ffff88813ff22894
RBP: 0000000000000001 R08: dffffc0000000000 R09: fffffbfff2131454
R10: 0000000000000000 R11: dffffc0000000001 R12: 0000000000000002
R13: ffff88813ff228a8 R14: 1ffff11027fe4524 R15: ffff88813ff22902
FS:  0000000000000000(0000) GS:ffff8880b8e00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000001b3021fffc CR3: 000000004206c000 CR4: 00000000003506f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <NMI>
 </NMI>
 <IRQ>
 lock_acquire+0x1db/0x4f0 kernel/locking/lockdep.c:5623
 __raw_spin_lock include/linux/spinlock_api_smp.h:142 [inline]
 _raw_spin_lock+0x2a/0x40 kernel/locking/spinlock.c:154
 spin_lock include/linux/spinlock.h:363 [inline]
 advance_sched+0x47/0x940 net/sched/sch_taprio.c:716
 __run_hrtimer kernel/time/hrtimer.c:1688 [inline]
 __hrtimer_run_queues+0x598/0xcf0 kernel/time/hrtimer.c:1752
 hrtimer_interrupt+0x392/0x980 kernel/time/hrtimer.c:1814
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1097 [inline]
 __sysvec_apic_timer_interrupt+0x13b/0x4b0 arch/x86/kernel/apic/apic.c:1114
 instr_sysvec_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1108 [inline]
 sysvec_apic_timer_interrupt+0x9b/0xc0 arch/x86/kernel/apic/apic.c:1108
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:676
RIP: 0010:memset_erms+0xb/0x10 arch/x86/lib/memset_64.S:65
Code: 03 40 0f b6 f6 48 b8 01 01 01 01 01 01 01 01 48 0f af c6 f3 48 ab 89 d1 f3 aa 4c 89 c8 c3 90 49 89 f9 40 88 f0 48 89 d1 f3 aa <4c> 89 c8 c3 90 49 89 fa 40 0f b6 ce 48 b8 01 01 01 01 01 01 01 01
RSP: 0000:ffffc90000d369e0 EFLAGS: 00000202
RAX: 0000000000000000 RBX: ffffc90000d36af0 RCX: 0000000000000000
RDX: 0000000000000010 RSI: 0000000000000000 RDI: ffffc90000d36b00
RBP: ffffffff8ef44994 R08: dffffc0000000000 R09: ffffc90000d36af0
R10: 0000000000000000 R11: dffffc0000000001 R12: 1ffffffff1de8932
R13: 1ffffffff1de8932 R14: ffffffff8ef44990 R15: ffffc90000d36aa0
 unwind_next_frame+0xbc8/0x1fa0 arch/x86/kernel/unwind_orc.c:547
 arch_stack_walk+0x10d/0x140 arch/x86/kernel/stacktrace.c:25
 stack_trace_save+0x113/0x1c0 kernel/stacktrace.c:122
 kasan_save_stack mm/kasan/common.c:38 [inline]
 kasan_set_track+0x4b/0x80 mm/kasan/common.c:46
 kasan_set_free_info+0x1f/0x40 mm/kasan/generic.c:360
 ____kasan_slab_free+0xd8/0x120 mm/kasan/common.c:366
 kasan_slab_free include/linux/kasan.h:230 [inline]
 slab_free_hook mm/slub.c:1705 [inline]
 slab_free_freelist_hook+0xdd/0x160 mm/slub.c:1731
 slab_free mm/slub.c:3499 [inline]
 kmem_cache_free+0x91/0x1f0 mm/slub.c:3515
 nft_synproxy_eval_v4+0x3ce/0x610 net/netfilter/nft_synproxy.c:60
 nft_synproxy_do_eval+0x359/0xa60 net/netfilter/nft_synproxy.c:141
 expr_call_ops_eval net/netfilter/nf_tables_core.c:198 [inline]
 nft_do_chain+0x467/0x16b0 net/netfilter/nf_tables_core.c:238
 nft_do_chain_inet+0x3f8/0x680 net/netfilter/nft_chain_filter.c:161
 nf_hook_entry_hookfn include/linux/netfilter.h:142 [inline]
 nf_hook_slow+0xae/0x1e0 net/netfilter/core.c:584
 nf_hook include/linux/netfilter.h:257 [inline]
 NF_HOOK+0x26b/0x410 include/linux/netfilter.h:300
 NF_HOOK+0x364/0x410 include/linux/netfilter.h:302
 __netif_receive_skb_one_core net/core/dev.c:5493 [inline]
 __netif_receive_skb+0x1c6/0x530 net/core/dev.c:5607
 process_backlog+0x363/0x7f0 net/core/dev.c:6484
 __napi_poll+0xc7/0x440 net/core/dev.c:7043
 napi_poll net/core/dev.c:7110 [inline]
 net_rx_action+0x617/0xda0 net/core/dev.c:7200
 handle_softirqs+0x3a7/0x930 kernel/softirq.c:558
 run_ksoftirqd+0xc6/0x120 kernel/softirq.c:925
 smpboot_thread_fn+0x51b/0x9d0 kernel/smpboot.c:164
 kthread+0x3f6/0x4f0 kernel/kthread.c:334
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:287
 </TASK>

Crashes (2):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2025/01/21 22:51 linux-5.15.y 4735586da88e da72ac06 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan INFO: rcu detected stall in NF_HOOK
2025/01/03 04:31 linux-5.15.y 91786f140358 d3ccff63 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan-perf INFO: rcu detected stall in NF_HOOK
* Struck through repros no longer work on HEAD.