syzbot


INFO: rcu detected stall in hsr_announce

Status: upstream: reported on 2024/08/15 19:00
Reported-by: syzbot+10d5aeaed47a1779bb0d@syzkaller.appspotmail.com
First crash: 55d, last: 9d16h
Similar bugs (11)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
linux-6.1 INFO: rcu detected stall in hsr_announce 2 18d 37d 0/3 upstream: reported on 2024/09/03 13:47
upstream INFO: rcu detected stall in hsr_announce (3) net 1 1772d 1772d 0/28 closed as invalid on 2019/12/04 14:04
upstream INFO: rcu detected stall in hsr_announce (5) net 4 1060d 1072d 0/28 closed as invalid on 2022/02/08 10:00
upstream INFO: rcu detected stall in hsr_announce (6) kvm 2 898d 898d 0/28 auto-closed as invalid on 2022/06/25 07:59
linux-4.14 INFO: rcu detected stall in hsr_announce C error 25 1560d 1758d 0/1 upstream: reported C repro on 2019/12/17 23:42
upstream INFO: rcu detected stall in hsr_announce (4) net 1 1398d 1398d 0/28 auto-closed as invalid on 2021/03/11 15:56
upstream INFO: rcu detected stall in hsr_announce net 1 1852d 1852d 0/28 auto-closed as invalid on 2019/11/13 18:24
upstream INFO: rcu detected stall in hsr_announce (2) net 3 1777d 1777d 0/28 closed as invalid on 2019/11/29 14:24
linux-4.19 INFO: rcu detected stall in hsr_announce 1 1472d 1472d 0/1 auto-closed as invalid on 2021/01/27 07:34
linux-4.19 BUG: soft lockup in hsr_announce (2) 7 723d 1177d 0/1 auto-obsoleted due to no activity on 2023/02/15 11:56
upstream BUG: soft lockup in hsr_announce (2) net 3 378d 387d 0/28 auto-obsoleted due to no activity on 2023/12/27 12:08

Sample crash report:
rcu: INFO: rcu_preempt self-detected stall on CPU
rcu: 	0-....: (1 GPs behind) idle=581/1/0x4000000000000000 softirq=29182/29185 fqs=4529 
	(t=10500 jiffies g=37233 q=1720)
NMI backtrace for cpu 0
CPU: 0 PID: 9408 Comm: syz.2.1641 Not tainted 5.15.167-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 09/13/2024
Call Trace:
 <IRQ>
 __dump_stack lib/dump_stack.c:88 [inline]
 dump_stack_lvl+0x1e3/0x2d0 lib/dump_stack.c:106
 nmi_cpu_backtrace+0x46a/0x4a0 lib/nmi_backtrace.c:111
 nmi_trigger_cpumask_backtrace+0x181/0x2a0 lib/nmi_backtrace.c:62
 trigger_single_cpu_backtrace include/linux/nmi.h:166 [inline]
 rcu_dump_cpu_stacks+0x223/0x390 kernel/rcu/tree_stall.h:349
 print_cpu_stall+0x320/0x600 kernel/rcu/tree_stall.h:633
 check_cpu_stall kernel/rcu/tree_stall.h:727 [inline]
 rcu_pending kernel/rcu/tree.c:3932 [inline]
 rcu_sched_clock_irq+0x8d9/0x1150 kernel/rcu/tree.c:2619
 update_process_times+0x196/0x200 kernel/time/timer.c:1818
 tick_sched_handle kernel/time/tick-sched.c:254 [inline]
 tick_sched_timer+0x386/0x550 kernel/time/tick-sched.c:1473
 __run_hrtimer kernel/time/hrtimer.c:1688 [inline]
 __hrtimer_run_queues+0x55b/0xcf0 kernel/time/hrtimer.c:1752
 hrtimer_interrupt+0x392/0x980 kernel/time/hrtimer.c:1814
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1085 [inline]
 __sysvec_apic_timer_interrupt+0x139/0x470 arch/x86/kernel/apic/apic.c:1102
 sysvec_apic_timer_interrupt+0x3e/0xb0 arch/x86/kernel/apic/apic.c:1096
 asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:638
RIP: 0010:seqcount_lockdep_reader_access+0x1dc/0x220 include/linux/seqlock.h:106
Code: 00 4d 85 ed 75 16 e8 33 ab 10 00 eb 15 e8 2c ab 10 00 e8 27 9e c4 08 4d 85 ed 74 ea e8 1d ab 10 00 fb 48 c7 04 24 0e 36 e0 45 <4b> c7 04 3c 00 00 00 00 66 43 c7 44 3c 09 00 00 43 c6 44 3c 0b 00
RSP: 0018:ffffc900000073a0 EFLAGS: 00000246
RAX: ffffffff816faf53 RBX: 0000000000000000 RCX: ffff888076f29dc0
RDX: 0000000000000100 RSI: 0000000000000000 RDI: 0000000000000000
RBP: ffffc90000007458 R08: ffffffff816faf29 R09: fffffbfff20e2437
R10: 0000000000000000 R11: dffffc0000000001 R12: dffffc0000000000
R13: 0000000000000200 R14: 0000000000000046 R15: 1ffff92000000e74
 ktime_get_with_offset+0x8c/0x320 kernel/time/timekeeping.c:872
 ktime_get_real include/linux/timekeeping.h:79 [inline]
 __net_timestamp include/linux/skbuff.h:3946 [inline]
 netif_rx_internal+0x3f0/0x5d0 net/core/dev.c:4926
 netif_rx+0x9d/0x3c0 net/core/dev.c:4978
 veth_forward_skb drivers/net/veth.c:297 [inline]
 veth_xmit+0x61d/0xa60 drivers/net/veth.c:350
 __netdev_start_xmit include/linux/netdevice.h:5019 [inline]
 netdev_start_xmit include/linux/netdevice.h:5033 [inline]
 xmit_one net/core/dev.c:3617 [inline]
 dev_hard_start_xmit+0x298/0x7a0 net/core/dev.c:3633
 __dev_queue_xmit+0x1cee/0x3230 net/core/dev.c:4248
 hsr_xmit net/hsr/hsr_forward.c:338 [inline]
 hsr_forward_do net/hsr/hsr_forward.c:429 [inline]
 hsr_forward_skb+0x133c/0x1b50 net/hsr/hsr_forward.c:577
 send_hsr_supervision_frame+0x540/0xad0 net/hsr/hsr_device.c:326
 hsr_announce+0x176/0x300 net/hsr/hsr_device.c:382
 call_timer_fn+0x16d/0x560 kernel/time/timer.c:1451
 expire_timers kernel/time/timer.c:1496 [inline]
 __run_timers+0x67c/0x890 kernel/time/timer.c:1767
 run_timer_softirq+0x63/0xf0 kernel/time/timer.c:1780
 handle_softirqs+0x3a7/0x930 kernel/softirq.c:558
 __do_softirq kernel/softirq.c:592 [inline]
 invoke_softirq kernel/softirq.c:432 [inline]
 __irq_exit_rcu+0x157/0x240 kernel/softirq.c:641
 irq_exit_rcu+0x5/0x20 kernel/softirq.c:653
 sysvec_apic_timer_interrupt+0x91/0xb0 arch/x86/kernel/apic/apic.c:1096
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:638
RIP: 0010:generic_exec_single+0x3d3/0x4d0 kernel/smp.c:532
Code: df eb 27 e8 0f d8 0b 00 0f 0b e9 58 fd ff ff e8 03 d8 0b 00 e8 fe ca bf 08 4d 85 ff 0f 84 5e ff ff ff e8 f0 d7 0b 00 fb 31 c0 <48> c7 44 24 20 0e 36 e0 45 4b c7 04 2c 00 00 00 00 66 43 c7 44 2c
RSP: 0018:ffffc900030479e0 EFLAGS: 00000246
RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffff888076f29dc0
RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000
RBP: ffffc90003047ab0 R08: ffffffff817481c2 R09: fffffbfff20e2439
R10: 0000000000000000 R11: dffffc0000000001 R12: dffffc0000000000
R13: 1ffff92000608f40 R14: 0000000000000046 R15: 0000000000000200
 smp_call_function_single+0x257/0x530 kernel/smp.c:755
 task_function_call kernel/events/core.c:120 [inline]
 perf_install_in_context+0x6b6/0xa90 kernel/events/core.c:3016
 __do_sys_perf_event_open kernel/events/core.c:12741 [inline]
 __se_sys_perf_event_open+0x3608/0x4510 kernel/events/core.c:12335
 do_syscall_x64 arch/x86/entry/common.c:50 [inline]
 do_syscall_64+0x3b/0xb0 arch/x86/entry/common.c:80
 entry_SYSCALL_64_after_hwframe+0x66/0xd0
RIP: 0033:0x7fb7978dcff9
Code: ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 a8 ff ff ff f7 d8 64 89 01 48
RSP: 002b:00007fb795d55038 EFLAGS: 00000246 ORIG_RAX: 000000000000012a
RAX: ffffffffffffffda RBX: 00007fb797a94f80 RCX: 00007fb7978dcff9
RDX: ffffffffffffffff RSI: 0000000000000000 RDI: 0000000020000840
RBP: 00007fb79794f296 R08: 000000000000000b R09: 0000000000000000
R10: ffffffffffffffff R11: 0000000000000246 R12: 0000000000000000
R13: 0000000000000000 R14: 00007fb797a94f80 R15: 00007ffc2324bcb8
 </TASK>

Crashes (6):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2024/09/30 22:51 linux-5.15.y 3a5928702e71 bbd4e0a4 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan-perf INFO: rcu detected stall in hsr_announce
2024/09/27 23:18 linux-5.15.y 3a5928702e71 440b26ec .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan-perf INFO: rcu detected stall in hsr_announce
2024/09/02 05:45 linux-5.15.y fa93fa65db6e 1eda0d14 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan-perf INFO: rcu detected stall in hsr_announce
2024/08/30 09:34 linux-5.15.y fa93fa65db6e ee2602b8 .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan-perf INFO: rcu detected stall in hsr_announce
2024/08/22 05:57 linux-5.15.y fa93fa65db6e ca02180f .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan-perf INFO: rcu detected stall in hsr_announce
2024/08/15 18:59 linux-5.15.y 7e89efd3ae1c e4bacdaf .config console log report info [disk image] [vmlinux] [kernel image] ci2-linux-5-15-kasan-perf INFO: rcu detected stall in hsr_announce
* Struck through repros no longer work on HEAD.