syzbot


INFO: rcu detected stall in NF_HOOK

Status: upstream: reported syz repro on 2024/06/04 14:31
Bug presence: origin:lts-only
[Documentation on labels]
Reported-by: syzbot+07b6b1dd6376c8d6cf9a@syzkaller.appspotmail.com
First crash: 326d, last: 45d
Bug presence (2)
Date Name Commit Repro Result
2024/12/06 linux-6.1.y (ToT) e4d90d63d385 C [report] INFO: rcu detected stall in corrupted
2024/12/06 upstream (ToT) b8f52214c61a C Didn't crash
Similar bugs (6)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: rcu detected stall in NF_HOOK netfilter usb C error 13 295d 310d 0/28 closed as dup on 2024/06/20 17:29
linux-5.15 INFO: rcu detected stall in NF_HOOK 1 415d 415d 0/3 auto-obsoleted due to no activity on 2024/06/15 14:02
linux-5.15 INFO: rcu detected stall in NF_HOOK (3) 2 94d 113d 0/3 upstream: reported on 2025/01/03 04:32
upstream INFO: rcu detected stall in NF_HOOK (2) netfilter C inconclusive error 70 5h55m 198d 0/28 upstream: reported C repro on 2024/10/10 12:45
linux-5.15 INFO: rcu detected stall in NF_HOOK (2) 1 297d 297d 0/3 auto-obsoleted due to no activity on 2024/10/11 06:09
android-54 BUG: soft lockup in NF_HOOK 1 317d 317d 0/2 auto-obsoleted due to no activity on 2024/09/10 19:37
Fix bisection attempts (1)
Created Duration User Patch Repo Result
2024/12/07 02:41 12h11m fix candidate upstream OK (1) job log

Sample crash report:
rcu: INFO: rcu_preempt detected expedited stalls on CPUs/tasks: { 1-.... } 3947 jiffies s: 10937 root: 0x2/.
rcu: blocking rcu_node structures (internal RCU debug):
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 5219 Comm: syz.5.254 Not tainted 6.1.119-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 09/13/2024
RIP: 0010:arch_static_branch arch/x86/include/asm/jump_label.h:27 [inline]
RIP: 0010:static_key_false include/linux/jump_label.h:207 [inline]
RIP: 0010:native_write_msr arch/x86/include/asm/msr.h:147 [inline]
RIP: 0010:wrmsr arch/x86/include/asm/msr.h:254 [inline]
RIP: 0010:native_apic_msr_write+0x35/0x50 arch/x86/include/asm/apic.h:206
Code: 74 2a 83 ff 30 74 25 eb 10 81 ff d0 00 00 00 74 1b 81 ff e0 00 00 00 74 13 c1 ef 04 81 c7 00 08 00 00 89 f9 89 f0 31 d2 0f 30 <66> 90 c3 89 f6 31 d2 e9 ef 71 34 03 66 2e 0f 1f 84 00 00 00 00 00
RSP: 0018:ffffc900001dfd60 EFLAGS: 00000046
RAX: 0000000000000149 RBX: ffffffff8cda3a30 RCX: 0000000000000838
RDX: 0000000000000000 RSI: 0000000000000149 RDI: 0000000000000838
RBP: 0000000000000149 R08: ffffffff817ce08d R09: fffffbfff1d35ef6
R10: 0000000000000000 R11: dffffc0000000001 R12: ffff8880b8f271c0
R13: dffffc0000000000 R14: 0000000000000149 R15: dffffc0000000000
FS:  00007fe7405126c0(0000) GS:ffff8880b8f00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fe24be1e5a0 CR3: 0000000060d58000 CR4: 00000000003506e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <NMI>
 </NMI>
 <IRQ>
 apic_write arch/x86/include/asm/apic.h:394 [inline]
 lapic_next_event+0x5b/0x70 arch/x86/kernel/apic/apic.c:478
 clockevents_program_event+0x1c5/0x310 kernel/time/clockevents.c:334
 hrtimer_interrupt+0x546/0x980 kernel/time/hrtimer.c:1828
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1107 [inline]
 __sysvec_apic_timer_interrupt+0x158/0x5b0 arch/x86/kernel/apic/apic.c:1124
 instr_sysvec_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1118 [inline]
 sysvec_apic_timer_interrupt+0x4d/0xc0 arch/x86/kernel/apic/apic.c:1118
 asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:691
RIP: 0010:lock_is_held_type+0x137/0x180
Code: 75 40 48 c7 04 24 00 00 00 00 9c 8f 04 24 f7 04 24 00 02 00 00 75 46 41 f7 c4 00 02 00 00 74 01 fb 65 48 8b 04 25 28 00 00 00 <48> 3b 44 24 08 75 3c 89 e8 48 83 c4 10 5b 41 5c 41 5d 41 5e 41 5f
RSP: 0018:ffffc900001dffc8 EFLAGS: 00000206
RAX: 73e753379cb05000 RBX: 0000000000000003 RCX: ffff88802afe0000
RDX: 0000000000000100 RSI: ffffffff8b0c1340 RDI: ffffffff8b5e6200
RBP: 0000000000000000 R08: ffffffff8971d1ff R09: ffffc900001e0350
R10: ffffc900001e0340 R11: dffffc0000000001 R12: 0000000000000246
R13: ffff88802afe0000 R14: 00000000ffffffff R15: ffffffff8e50a768
 lock_is_held include/linux/lockdep.h:283 [inline]
 lockdep_rtnl_is_held+0x17/0x30 net/core/rtnetlink.c:172
 __in6_dev_get include/net/addrconf.h:323 [inline]
 ip6_ignore_linkdown include/net/addrconf.h:414 [inline]
 find_match+0xd8/0xc10 net/ipv6/route.c:747
 __find_rr_leaf+0x271/0x8e0 net/ipv6/route.c:835
 find_rr_leaf net/ipv6/route.c:856 [inline]
 rt6_select net/ipv6/route.c:900 [inline]
 fib6_table_lookup+0x40f/0xbb0 net/ipv6/route.c:2189
 ip6_pol_route+0x207/0x14e0 net/ipv6/route.c:2225
 pol_lookup_func include/net/ip6_fib.h:579 [inline]
 fib6_rule_lookup+0x265/0x620 net/ipv6/fib6_rules.c:116
 ip6_route_input_lookup net/ipv6/route.c:2294 [inline]
 ip6_route_input+0x830/0xd90 net/ipv6/route.c:2590
 ip6_rcv_finish+0x140/0x230 net/ipv6/ip6_input.c:77
 NF_HOOK+0x39d/0x450 include/linux/netfilter.h:302
 __netif_receive_skb_one_core net/core/dev.c:5536 [inline]
 __netif_receive_skb+0x1c6/0x530 net/core/dev.c:5650
 process_backlog+0x381/0x760 net/core/dev.c:5978
 __napi_poll+0xc7/0x470 net/core/dev.c:6545
 napi_poll net/core/dev.c:6612 [inline]
 net_rx_action+0x70f/0xeb0 net/core/dev.c:6726
 handle_softirqs+0x2ee/0xa40 kernel/softirq.c:571
 __do_softirq kernel/softirq.c:605 [inline]
 invoke_softirq kernel/softirq.c:445 [inline]
 __irq_exit_rcu+0x157/0x240 kernel/softirq.c:654
 irq_exit_rcu+0x5/0x20 kernel/softirq.c:666
 instr_sysvec_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1118 [inline]
 sysvec_apic_timer_interrupt+0xa0/0xc0 arch/x86/kernel/apic/apic.c:1118
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:691
RIP: 0010:perf_trace_lock_acquire+0x3d1/0x4a0 include/trace/events/lock.h:24
Code: 4c 89 e7 44 89 f6 89 da 48 8b 4c 24 30 6a 00 ff 74 24 20 e8 51 20 47 00 48 83 c4 10 48 c7 44 24 60 0e 36 e0 45 48 8b 44 24 58 <49> c7 04 07 00 00 00 00 41 c7 44 07 08 00 00 00 00 65 48 8b 04 25
RSP: 0018:ffffc90005cb7260 EFLAGS: 00000246
RAX: 1ffff92000b96e58 RBX: ffffc90005cb72e0 RCX: 000000008b0d1505
RDX: 0000000000000000 RSI: ffffffff8b5e61e0 RDI: ffffffff8b5e61a0
RBP: ffffc90005cb7380 R08: 0000000000000002 R09: 0000000000000000
R10: 0000000000000000 R11: dffffc0000000001 R12: ffffe8ffffd348c8
R13: ffffffff8d1f7220 R14: ffffc90005cb72e0 R15: dffffc0000000000
 trace_lock_acquire include/trace/events/lock.h:24 [inline]
 lock_acquire+0x544/0x5a0 kernel/locking/lockdep.c:5633
 rcu_lock_acquire include/linux/rcupdate.h:350 [inline]
 rcu_read_lock include/linux/rcupdate.h:791 [inline]
 page_ext_get+0x39/0x2a0 mm/page_ext.c:157
 __page_table_check_zero+0x139/0x4b0 mm/page_table_check.c:146
 page_table_check_free include/linux/page_table_check.h:46 [inline]
 free_pages_prepare mm/page_alloc.c:1445 [inline]
 free_pcp_prepare mm/page_alloc.c:1494 [inline]
 free_unref_page_prepare+0xf73/0x1120 mm/page_alloc.c:3369
 free_unref_page+0x33/0x3e0 mm/page_alloc.c:3464
 mm_free_pgd kernel/fork.c:742 [inline]
 __mmdrop+0xb2/0x470 kernel/fork.c:793
 mmdrop include/linux/sched/mm.h:50 [inline]
 mmdrop_sched include/linux/sched/mm.h:78 [inline]
 finish_task_switch+0x2cd/0x810 kernel/sched/core.c:5145
 context_switch kernel/sched/core.c:5244 [inline]
 __schedule+0x1447/0x4570 kernel/sched/core.c:6558
 preempt_schedule_irq+0xf7/0x1c0 kernel/sched/core.c:6870
 irqentry_exit+0x53/0x80 kernel/entry/common.c:439
 asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:691
RIP: 0010:arch_atomic64_sub mm/slab.h:784 [inline]
RIP: 0010:arch_atomic_long_sub include/linux/atomic/atomic-long.h:107 [inline]
RIP: 0010:atomic_long_sub include/linux/atomic/atomic-instrumented.h:1362 [inline]
RIP: 0010:dec_slabs_node mm/slub.c:1325 [inline]
RIP: 0010:discard_slab mm/slub.c:2036 [inline]
RIP: 0010:__unfreeze_partials+0x1a4/0x210 mm/slub.c:2586
Code: 74 5a 48 8b 06 48 83 f8 ff 74 73 48 8b 6e 08 0f b7 4e 2a 81 e1 ff 7f 00 00 48 c1 e8 3a 48 8b 84 c3 d0 00 00 00 f0 48 ff 48 58 <f0> 48 29 48 60 f6 43 0a 08 75 12 48 89 df e8 59 fb ff ff 48 89 ee
RSP: 0018:ffffc90005cb7a38 EFLAGS: 00000202
RAX: ffff888017c409c0 RBX: ffff888017c42140 RCX: 0000000000000004
RDX: 0000000000000000 RSI: ffffea0000679800 RDI: 0000000000000001
RBP: ffffea00015a3600 R08: dffffc0000000000 R09: ffffed10171e8231
R10: 0000000000000000 R11: dffffc0000000001 R12: ffffffff7fffffff
R13: 0000000000000000 R14: ffff888017c409c0 R15: 0000000080040000
 put_cpu_partial+0x17b/0x250 mm/slub.c:2662
 qlink_free mm/kasan/quarantine.c:168 [inline]
 qlist_free_all+0x76/0xe0 mm/kasan/quarantine.c:187
 kasan_quarantine_reduce+0x156/0x170 mm/kasan/quarantine.c:294
 __kasan_slab_alloc+0x1f/0x70 mm/kasan/common.c:305
 kasan_slab_alloc include/linux/kasan.h:201 [inline]
 slab_post_alloc_hook+0x52/0x3a0 mm/slab.h:737
 slab_alloc_node mm/slub.c:3398 [inline]
 __kmem_cache_alloc_node+0x137/0x260 mm/slub.c:3437
 kmalloc_trace+0x26/0xe0 mm/slab_common.c:1026
 kmalloc include/linux/slab.h:557 [inline]
 kzalloc include/linux/slab.h:693 [inline]
 apparmor_sk_alloc_security+0x73/0x100 security/apparmor/lsm.c:812
 security_sk_alloc+0x6d/0xa0 security/security.c:2331
 sk_prot_alloc+0xfa/0x200 net/core/sock.c:2050
 sk_alloc+0x36/0x350 net/core/sock.c:2100
 packet_create+0x100/0x7b0 net/packet/af_packet.c:3413
 __sock_create+0x488/0x930 net/socket.c:1550
 sock_create net/socket.c:1606 [inline]
 __sys_socket_create net/socket.c:1643 [inline]
 __sys_socket+0x136/0x3a0 net/socket.c:1671
 __do_sys_socket net/socket.c:1684 [inline]
 __se_sys_socket net/socket.c:1682 [inline]
 __x64_sys_socket+0x76/0x80 net/socket.c:1682
 do_syscall_x64 arch/x86/entry/common.c:51 [inline]
 do_syscall_64+0x3b/0xb0 arch/x86/entry/common.c:81
 entry_SYSCALL_64_after_hwframe+0x68/0xd2
RIP: 0033:0x7fe73f77ff19
Code: ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 a8 ff ff ff f7 d8 64 89 01 48
RSP: 002b:00007fe740512058 EFLAGS: 00000246 ORIG_RAX: 0000000000000029
RAX: ffffffffffffffda RBX: 00007fe73f946080 RCX: 00007fe73f77ff19
RDX: 0000000000000300 RSI: 0200000000000002 RDI: 0000000000000011
RBP: 00007fe73f7f3986 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
R13: 0000000000000000 R14: 00007fe73f946080 R15: 00007ffdf1209138
 </TASK>

Crashes (19):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2024/12/05 23:03 linux-6.1.y e4d90d63d385 29f61fce .config console log report syz / log [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan-perf INFO: rcu detected stall in NF_HOOK
2025/03/11 22:54 linux-6.1.y 6ae7ac5c4251 16256247 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan-perf INFO: rcu detected stall in NF_HOOK
2025/02/09 01:00 linux-6.1.y 0cbb5f65e52f ef44b750 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan-perf INFO: rcu detected stall in NF_HOOK
2024/12/15 23:08 linux-6.1.y 52f863f820fd 7cbfbb3a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan-perf INFO: rcu detected stall in NF_HOOK
2024/10/19 12:25 linux-6.1.y 54d90d17e8ce cd6fc0a3 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan-perf INFO: rcu detected stall in NF_HOOK
2024/10/13 20:52 linux-6.1.y aa4cd140bba5 084d8178 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan-perf INFO: rcu detected stall in NF_HOOK
2024/10/13 05:07 linux-6.1.y aa4cd140bba5 084d8178 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan-perf INFO: rcu detected stall in NF_HOOK
2024/10/09 12:23 linux-6.1.y aa4cd140bba5 402f1df0 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan-perf INFO: rcu detected stall in NF_HOOK
2024/10/02 15:25 linux-6.1.y aa4cd140bba5 02f9582a .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan-perf INFO: rcu detected stall in NF_HOOK
2024/09/21 23:19 linux-6.1.y e526b12bf916 6f888b75 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan-perf INFO: rcu detected stall in NF_HOOK
2024/09/18 13:55 linux-6.1.y 5f55cad62cc9 c673ca06 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan-perf INFO: rcu detected stall in NF_HOOK
2024/09/14 18:35 linux-6.1.y 5f55cad62cc9 c7e35043 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan-perf INFO: rcu detected stall in NF_HOOK
2024/08/26 18:55 linux-6.1.y ee5e09825b81 9aee4e0b .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan-perf INFO: rcu detected stall in NF_HOOK
2024/08/18 03:04 linux-6.1.y 117ac406ba90 dbc93b08 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan-perf INFO: rcu detected stall in NF_HOOK
2024/08/11 18:25 linux-6.1.y 36790ef5e00b 6f4edef4 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan-perf INFO: rcu detected stall in NF_HOOK
2024/08/01 23:10 linux-6.1.y c1cec4dad96b 1e9c4cf3 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan-perf INFO: rcu detected stall in NF_HOOK
2024/08/01 20:35 linux-6.1.y c1cec4dad96b 1e9c4cf3 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan-perf INFO: rcu detected stall in NF_HOOK
2024/07/29 11:42 linux-6.1.y c1cec4dad96b 5187fc86 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan-perf INFO: rcu detected stall in NF_HOOK
2024/06/04 14:31 linux-6.1.y 88690811da69 11f2afa5 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-6-1-kasan INFO: rcu detected stall in NF_HOOK
* Struck through repros no longer work on HEAD.