syzbot


INFO: rcu detected stall in packet_rcv

Status: auto-closed as invalid on 2021/12/19 00:49
Subsystems: net
[Documentation on labels]
First crash: 913d, last: 913d
Similar bugs (1)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: rcu detected stall in packet_rcv (2) net 1 115d 115d 0/26 auto-obsoleted due to no activity on 2024/03/25 03:49

Sample crash report:
rcu: INFO: rcu_preempt self-detected stall on CPU
rcu: 	0-...!: (10499 ticks this GP) idle=c39/1/0x4000000000000000 softirq=219282/219282 fqs=65 
	(t=10500 jiffies g=402357 q=1602)
rcu: rcu_preempt kthread starved for 10340 jiffies! g402357 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=1
rcu: 	Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
rcu: RCU grace-period kthread stack dump:
task:rcu_preempt     state:R  running task     stack:27856 pid:   14 ppid:     2 flags:0x00004000
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:4965 [inline]
 __schedule+0xa9a/0x4940 kernel/sched/core.c:6246
 schedule+0xd2/0x260 kernel/sched/core.c:6319
 schedule_timeout+0x14a/0x2a0 kernel/time/timer.c:1881
 rcu_gp_fqs_loop+0x186/0x810 kernel/rcu/tree.c:1966
 rcu_gp_kthread+0x1de/0x320 kernel/rcu/tree.c:2139
 kthread+0x405/0x4f0 kernel/kthread.c:327
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:295
 </TASK>
rcu: Stack dump where RCU GP kthread last ran:
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 3816 Comm: syz-executor.3 Not tainted 5.15.0-rc5-next-20211018-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
RIP: 0010:lookup_chain_cache kernel/locking/lockdep.c:3694 [inline]
RIP: 0010:lookup_chain_cache_add kernel/locking/lockdep.c:3714 [inline]
RIP: 0010:validate_chain kernel/locking/lockdep.c:3769 [inline]
RIP: 0010:__lock_acquire+0x1669/0x54a0 kernel/locking/lockdep.c:5027
Code: eb 83 b5 80 46 86 c8 61 49 0f af ef 48 c1 ed 30 48 8d 04 ed 60 79 eb 8f 48 89 c2 48 89 44 24 08 48 b8 00 00 00 00 00 fc ff df <48> c1 ea 03 80 3c 02 00 0f 85 10 3b 00 00 48 8b 1c ed 60 79 eb 8f
RSP: 0018:ffffc90000dc01f0 EFLAGS: 00000002
RAX: dffffc0000000000 RBX: 0000000000000043 RCX: ffffffff815c4b4f
RDX: ffffffff8febc980 RSI: 0000000000000008 RDI: ffffffff8ff47a08
RBP: 0000000000000a04 R08: 0000000000000000 R09: ffffffff8ff47a0f
R10: fffffbfff1fe8f41 R11: 0000000000000000 R12: ffff8880a32ca7b8
R13: ffff8880a32c9d00 R14: 0000000000000001 R15: fe0f396dc9977943
FS:  00007fd55b0b9700(0000) GS:ffff8880b9d00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000001fffff00 CR3: 00000001552d7000 CR4: 00000000003506e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <IRQ>
 lock_acquire kernel/locking/lockdep.c:5637 [inline]
 lock_acquire+0x1ab/0x510 kernel/locking/lockdep.c:5602
 seqcount_lockdep_reader_access include/linux/seqlock.h:103 [inline]
 timekeeping_get_delta kernel/time/timekeeping.c:252 [inline]
 timekeeping_get_ns kernel/time/timekeeping.c:386 [inline]
 ktime_get+0x147/0x470 kernel/time/timekeeping.c:829
 clockevents_program_event+0x141/0x370 kernel/time/clockevents.c:326
 tick_program_event+0xac/0x140 kernel/time/tick-oneshot.c:44
 hrtimer_interrupt+0x36e/0x790 kernel/time/hrtimer.c:1824
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1086 [inline]
 __sysvec_apic_timer_interrupt+0x146/0x530 arch/x86/kernel/apic/apic.c:1103
 sysvec_apic_timer_interrupt+0x40/0xc0 arch/x86/kernel/apic/apic.c:1097
 asm_sysvec_apic_timer_interrupt+0x12/0x20 arch/x86/include/asm/idtentry.h:638
RIP: 0010:orc_ip arch/x86/kernel/unwind_orc.c:30 [inline]
RIP: 0010:__orc_find+0x6f/0xf0 arch/x86/kernel/unwind_orc.c:52
Code: 72 4d 4c 89 e0 48 29 e8 48 89 c2 48 c1 e8 3f 48 c1 fa 02 48 01 d0 48 d1 f8 48 8d 5c 85 00 48 89 d8 48 c1 e8 03 42 0f b6 14 38 <48> 89 d8 83 e0 07 83 c0 03 38 d0 7c 04 84 d2 75 48 48 63 03 48 01
RSP: 0018:ffffc90000dc0658 EFLAGS: 00000a06
RAX: 1ffffffff1b3a2ed RBX: ffffffff8d9d1768 RCX: ffffffff81443799
RDX: 0000000000000000 RSI: ffffffff8e0b2d30 RDI: ffffffff8d9d1758
RBP: ffffffff8d9d1758 R08: ffffffff8e0b2d30 R09: 0000000000000001
R10: fffff520001b80fc R11: 0000000000088089 R12: ffffffff8d9d177c
R13: ffffffff8d9d1758 R14: ffffffff8d9d1758 R15: dffffc0000000000
 orc_find arch/x86/kernel/unwind_orc.c:173 [inline]
 unwind_next_frame+0x32a/0x1ca0 arch/x86/kernel/unwind_orc.c:443
 arch_stack_walk+0x7d/0xe0 arch/x86/kernel/stacktrace.c:25
 stack_trace_save+0x8c/0xc0 kernel/stacktrace.c:122
 kasan_save_stack+0x1e/0x50 mm/kasan/common.c:38
 kasan_set_track+0x21/0x30 mm/kasan/common.c:46
 kasan_set_free_info+0x20/0x30 mm/kasan/generic.c:370
 ____kasan_slab_free mm/kasan/common.c:366 [inline]
 ____kasan_slab_free mm/kasan/common.c:328 [inline]
 __kasan_slab_free+0xff/0x130 mm/kasan/common.c:374
 kasan_slab_free include/linux/kasan.h:235 [inline]
 slab_free_hook mm/slub.c:1700 [inline]
 slab_free_freelist_hook+0x8b/0x1c0 mm/slub.c:1726
 slab_free mm/slub.c:3491 [inline]
 kfree+0xf6/0x560 mm/slub.c:4539
 skb_free_head net/core/skbuff.c:653 [inline]
 skb_release_data+0x65a/0x790 net/core/skbuff.c:675
 skb_release_all net/core/skbuff.c:740 [inline]
 __kfree_skb net/core/skbuff.c:754 [inline]
 consume_skb net/core/skbuff.c:910 [inline]
 consume_skb+0xc2/0x160 net/core/skbuff.c:904
 packet_rcv+0xea/0x13e0 net/packet/af_packet.c:2214
 __netif_receive_skb_one_core+0x114/0x180 net/core/dev.c:5455
 __netif_receive_skb+0x24/0x1b0 net/core/dev.c:5569
 process_backlog+0x2a5/0x6c0 net/core/dev.c:6445
 __napi_poll+0xaf/0x440 net/core/dev.c:7010
 napi_poll net/core/dev.c:7077 [inline]
 net_rx_action+0x801/0xb40 net/core/dev.c:7164
 __do_softirq+0x29b/0x9c2 kernel/softirq.c:558
 invoke_softirq kernel/softirq.c:432 [inline]
 __irq_exit_rcu+0x123/0x180 kernel/softirq.c:637
 irq_exit_rcu+0x5/0x20 kernel/softirq.c:649
 sysvec_apic_timer_interrupt+0x93/0xc0 arch/x86/kernel/apic/apic.c:1097
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x12/0x20 arch/x86/include/asm/idtentry.h:638
RIP: 0010:lock_acquire+0x1ef/0x510 kernel/locking/lockdep.c:5605
Code: dc a5 7e 83 f8 01 0f 85 b4 02 00 00 9c 58 f6 c4 02 0f 85 9f 02 00 00 48 83 7c 24 08 00 74 01 fb 48 b8 00 00 00 00 00 fc ff df <48> 01 c3 48 c7 03 00 00 00 00 48 c7 43 08 00 00 00 00 48 8b 84 24
RSP: 0018:ffffc9000edb7908 EFLAGS: 00000206
RAX: dffffc0000000000 RBX: 1ffff92001db6f23 RCX: ffffffff815c4b4f
RDX: 1ffff110146594ec RSI: 0000000000000000 RDI: 0000000000000000
RBP: 0000000000000001 R08: 0000000000000000 R09: ffffffff8ff47a17
R10: fffffbfff1fe8f42 R11: 0000000000000000 R12: 0000000000000000
R13: 0000000000000000 R14: ffffffff8bca67c0 R15: 0000000000000000
 __fs_reclaim_acquire mm/page_alloc.c:4533 [inline]
 fs_reclaim_acquire+0x115/0x160 mm/page_alloc.c:4547
 might_alloc include/linux/sched/mm.h:248 [inline]
 slab_pre_alloc_hook mm/slab.h:492 [inline]
 slab_alloc_node mm/slub.c:3127 [inline]
 slab_alloc mm/slub.c:3220 [inline]
 kmem_cache_alloc+0x3e/0x390 mm/slub.c:3225
 dup_mm+0x8a/0x13e0 kernel/fork.c:1492
 copy_mm kernel/fork.c:1553 [inline]
 copy_process+0x6fe5/0x75a0 kernel/fork.c:2242
 kernel_clone+0xe7/0xab0 kernel/fork.c:2632
 __do_sys_clone+0xc8/0x110 kernel/fork.c:2749
 do_syscall_x64 arch/x86/entry/common.c:50 [inline]
 do_syscall_64+0x35/0xb0 arch/x86/entry/common.c:80
 entry_SYSCALL_64_after_hwframe+0x44/0xae
RIP: 0033:0x7fd55db43a39
Code: ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 bc ff ff ff f7 d8 64 89 01 48
RSP: 002b:00007fd55b0b9188 EFLAGS: 00000246 ORIG_RAX: 0000000000000038
RAX: ffffffffffffffda RBX: 00007fd55dc46f60 RCX: 00007fd55db43a39
RDX: 0000000000000000 RSI: 0000000020000300 RDI: 0000000010002000
RBP: 00007fd55db9dc5f R08: 0000000020000440 R09: 0000000000000000
R10: 0000000020000400 R11: 0000000000000246 R12: 0000000000000000
R13: 00007ffe219b7d7f R14: 00007fd55b0b9300 R15: 0000000000022000
 </TASK>
NMI backtrace for cpu 0
CPU: 0 PID: 3815 Comm: syz-executor.3 Not tainted 5.15.0-rc5-next-20211018-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Call Trace:
 <IRQ>
 __dump_stack lib/dump_stack.c:88 [inline]
 dump_stack_lvl+0xcd/0x134 lib/dump_stack.c:106
 nmi_cpu_backtrace.cold+0x47/0x144 lib/nmi_backtrace.c:105
 nmi_trigger_cpumask_backtrace+0x1ae/0x220 lib/nmi_backtrace.c:62
 trigger_single_cpu_backtrace include/linux/nmi.h:164 [inline]
 rcu_dump_cpu_stacks+0x25e/0x3f0 kernel/rcu/tree_stall.h:343
 print_cpu_stall kernel/rcu/tree_stall.h:604 [inline]
 check_cpu_stall kernel/rcu/tree_stall.h:688 [inline]
 rcu_pending kernel/rcu/tree.c:3889 [inline]
 rcu_sched_clock_irq.cold+0x9d/0x746 kernel/rcu/tree.c:2608
 update_process_times+0x16d/0x200 kernel/time/timer.c:1785
 tick_sched_handle+0x9b/0x180 kernel/time/tick-sched.c:226
 tick_sched_timer+0x1b0/0x2d0 kernel/time/tick-sched.c:1428
 __run_hrtimer kernel/time/hrtimer.c:1685 [inline]
 __hrtimer_run_queues+0x1c0/0xe50 kernel/time/hrtimer.c:1749
 hrtimer_interrupt+0x31c/0x790 kernel/time/hrtimer.c:1811
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1086 [inline]
 __sysvec_apic_timer_interrupt+0x146/0x530 arch/x86/kernel/apic/apic.c:1103
 sysvec_apic_timer_interrupt+0x40/0xc0 arch/x86/kernel/apic/apic.c:1097
 asm_sysvec_apic_timer_interrupt+0x12/0x20 arch/x86/include/asm/idtentry.h:638
RIP: 0010:check_region_inline mm/kasan/generic.c:169 [inline]
RIP: 0010:kasan_check_range+0x9/0x180 mm/kasan/generic.c:189
Code: 47 08 48 c7 c6 28 97 37 8b 48 8d 50 ff a8 01 48 0f 45 fa e8 b9 6f ec ff 0f 0b 0f 1f 80 00 00 00 00 48 85 f6 0f 84 70 01 00 00 <49> 89 f9 41 54 44 0f b6 c2 49 01 f1 55 53 0f 82 18 01 00 00 48 b8
RSP: 0018:ffffc90000007d30 EFLAGS: 00000202
RAX: 0000000000000000 RBX: 0000000000000100 RCX: ffffffff8166783b
RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffffff8d8ffa10
RBP: ffffc90000007d70 R08: 0000000000000007 R09: ffffffff8ff47b6f
R10: ffffffff81667810 R11: 0000000000000000 R12: ffff88809f623b38
R13: 1ffff92000000fa8 R14: ffffffff87675fd0 R15: 0000000000000000
 instrument_atomic_read include/linux/instrumented.h:71 [inline]
 test_bit include/asm-generic/bitops/instrumented-non-atomic.h:134 [inline]
 cpumask_test_cpu include/linux/cpumask.h:379 [inline]
 cpu_online include/linux/cpumask.h:921 [inline]
 trace_timer_expire_entry include/trace/events/timer.h:90 [inline]
 call_timer_fn+0x17b/0x6b0 kernel/time/timer.c:1420
 expire_timers kernel/time/timer.c:1466 [inline]
 __run_timers.part.0+0x675/0xa20 kernel/time/timer.c:1734
 __run_timers kernel/time/timer.c:1715 [inline]
 run_timer_softirq+0xb3/0x1d0 kernel/time/timer.c:1747
 __do_softirq+0x29b/0x9c2 kernel/softirq.c:558
 invoke_softirq kernel/softirq.c:432 [inline]
 __irq_exit_rcu+0x123/0x180 kernel/softirq.c:637
 irq_exit_rcu+0x5/0x20 kernel/softirq.c:649
 sysvec_apic_timer_interrupt+0x93/0xc0 arch/x86/kernel/apic/apic.c:1097
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x12/0x20 arch/x86/include/asm/idtentry.h:638
RIP: 0010:unwind_next_frame+0x42/0x1ca0 arch/x86/kernel/unwind_orc.c:418
Code: 81 ec a0 00 00 00 48 c7 44 24 40 b3 8a b5 41 48 8d 5c 24 40 48 c7 44 24 48 29 98 35 8b 48 c1 eb 03 48 c7 44 24 50 70 d9 33 81 <48> 8d 14 03 c7 02 f1 f1 f1 f1 c7 42 04 00 f3 f3 f3 48 89 fa 65 48
RSP: 0018:ffffc9000ef0f450 EFLAGS: 00000a02
RAX: dffffc0000000000 RBX: 1ffff92001de1e92 RCX: ffffc9000ef0f618
RDX: ffffc9000ef10000 RSI: 1ffff92001de1eb1 RDI: ffffc9000ef0f578
RBP: dffffc0000000000 R08: 0000000000000001 R09: ffffc9000ef0f578
R10: fffff52001de1ebc R11: 0000000000000000 R12: fffff52001de1eb1
R13: fffff52001de1eb0 R14: ffffc9000ef0f578 R15: ffffc9000ef0f578
 __unwind_start+0x50b/0x7e0 arch/x86/kernel/unwind_orc.c:712
 unwind_start arch/x86/include/asm/unwind.h:62 [inline]
 arch_stack_walk+0x5c/0xe0 arch/x86/kernel/stacktrace.c:24
 stack_trace_save+0x8c/0xc0 kernel/stacktrace.c:122
 kasan_save_stack+0x1e/0x50 mm/kasan/common.c:38
 kasan_set_track mm/kasan/common.c:46 [inline]
 set_alloc_info mm/kasan/common.c:434 [inline]
 __kasan_slab_alloc+0x90/0xc0 mm/kasan/common.c:467
 kasan_slab_alloc include/linux/kasan.h:259 [inline]
 slab_post_alloc_hook mm/slab.h:519 [inline]
 slab_alloc_node mm/slub.c:3212 [inline]
 slab_alloc mm/slub.c:3220 [inline]
 kmem_cache_alloc+0x209/0x390 mm/slub.c:3225
 kmem_cache_zalloc include/linux/slab.h:714 [inline]
 alloc_vfsmnt+0x23/0x6b0 fs/namespace.c:197
 clone_mnt+0x6d/0x1080 fs/namespace.c:1055
 copy_tree+0x3ad/0xae0 fs/namespace.c:1872
 copy_mnt_ns+0x1a0/0xae0 fs/namespace.c:3428
 create_new_namespaces+0xd6/0xb20 kernel/nsproxy.c:78
 copy_namespaces+0x391/0x450 kernel/nsproxy.c:178
 copy_process+0x2da7/0x75a0 kernel/fork.c:2245
 kernel_clone+0xe7/0xab0 kernel/fork.c:2632
 __do_sys_clone+0xc8/0x110 kernel/fork.c:2749
 do_syscall_x64 arch/x86/entry/common.c:50 [inline]
 do_syscall_64+0x35/0xb0 arch/x86/entry/common.c:80
 entry_SYSCALL_64_after_hwframe+0x44/0xae
RIP: 0033:0x7fd55db43a39
Code: ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 bc ff ff ff f7 d8 64 89 01 48
RSP: 002b:00007fd55b0b9188 EFLAGS: 00000246 ORIG_RAX: 0000000000000038
RAX: ffffffffffffffda RBX: 00007fd55dc46f60 RCX: 00007fd55db43a39
RDX: 0000000000000000 RSI: 0000000000000000 RDI: 000000006cb2e100
RBP: 00007fd55db9dc5f R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
R13: 00007ffe219b7d7f R14: 00007fd55b0b9300 R15: 0000000000022000
 </TASK>
----------------
Code disassembly (best guess), 1 bytes skipped:
   0:	83 b5 80 46 86 c8 61 	xorl   $0x61,-0x3779b980(%rbp)
   7:	49 0f af ef          	imul   %r15,%rbp
   b:	48 c1 ed 30          	shr    $0x30,%rbp
   f:	48 8d 04 ed 60 79 eb 	lea    -0x701486a0(,%rbp,8),%rax
  16:	8f
  17:	48 89 c2             	mov    %rax,%rdx
  1a:	48 89 44 24 08       	mov    %rax,0x8(%rsp)
  1f:	48 b8 00 00 00 00 00 	movabs $0xdffffc0000000000,%rax
  26:	fc ff df
* 29:	48 c1 ea 03          	shr    $0x3,%rdx <-- trapping instruction
  2d:	80 3c 02 00          	cmpb   $0x0,(%rdx,%rax,1)
  31:	0f 85 10 3b 00 00    	jne    0x3b47
  37:	48 8b 1c ed 60 79 eb 	mov    -0x701486a0(,%rbp,8),%rbx
  3e:	8f

Crashes (1):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2021/10/20 00:42 linux-next 60e8840126bd 466b7db1 .config console log report info ci-upstream-linux-next-kasan-gce-root INFO: rcu detected stall in packet_rcv
* Struck through repros no longer work on HEAD.