protocol 88fb is buggy, dev hsr_slave_0
protocol 88fb is buggy, dev hsr_slave_1
net_ratelimit: 18 callbacks suppressed
protocol 88fb is buggy, dev hsr_slave_0
protocol 88fb is buggy, dev hsr_slave_1
rcu: INFO: rcu_preempt self-detected stall on CPU
rcu: 0-....: (10555 ticks this GP) idle=63e/1/0x4000000000000002 softirq=208601/208602 fqs=4827
rcu: (t=10500 jiffies g=234701 q=1438)
rcu: rcu_preempt kthread starved for 781 jiffies! g234701 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=1
rcu: RCU grace-period kthread stack dump:
rcu_preempt I29104 10 2 0x80000000
Call Trace:
context_switch kernel/sched/core.c:2826 [inline]
__schedule+0x866/0x1dc0 kernel/sched/core.c:3474
schedule+0x92/0x1c0 kernel/sched/core.c:3518
schedule_timeout+0x4db/0xfc0 kernel/time/timer.c:1804
rcu_gp_kthread+0xd5c/0x2190 kernel/rcu/tree.c:2202
kthread+0x354/0x420 kernel/kthread.c:246
ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415
NMI backtrace for cpu 0
CPU: 0 PID: 9 Comm: ksoftirqd/0 Not tainted 4.19.72 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Call Trace:
__dump_stack lib/dump_stack.c:77 [inline]
dump_stack+0x172/0x1f0 lib/dump_stack.c:113
nmi_cpu_backtrace.cold+0x63/0xa4 lib/nmi_backtrace.c:101
nmi_trigger_cpumask_backtrace+0x1b0/0x1f8 lib/nmi_backtrace.c:62
arch_trigger_cpumask_backtrace+0x14/0x20 arch/x86/kernel/apic/hw_nmi.c:38
trigger_single_cpu_backtrace include/linux/nmi.h:164 [inline]
rcu_dump_cpu_stacks+0x189/0x1d5 kernel/rcu/tree.c:1340
print_cpu_stall kernel/rcu/tree.c:1478 [inline]
check_cpu_stall kernel/rcu/tree.c:1550 [inline]
__rcu_pending kernel/rcu/tree.c:3293 [inline]
rcu_pending kernel/rcu/tree.c:3336 [inline]
rcu_check_callbacks.cold+0x5e3/0xd90 kernel/rcu/tree.c:2682
update_process_times+0x32/0x80 kernel/time/timer.c:1636
tick_sched_handle+0xa2/0x190 kernel/time/tick-sched.c:164
tick_sched_timer+0x47/0x130 kernel/time/tick-sched.c:1274
__run_hrtimer kernel/time/hrtimer.c:1398 [inline]
__hrtimer_run_queues+0x33b/0xdc0 kernel/time/hrtimer.c:1460
hrtimer_interrupt+0x314/0x770 kernel/time/hrtimer.c:1518
local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1067 [inline]
smp_apic_timer_interrupt+0x111/0x550 arch/x86/kernel/apic/apic.c:1092
apic_timer_interrupt+0xf/0x20 arch/x86/entry/entry_64.S:893
RIP: 0010:list_add_tail include/linux/list.h:93 [inline]
RIP: 0010:list_move_tail include/linux/list.h:183 [inline]
RIP: 0010:hhf_dequeue+0x636/0xa00 net/sched/sch_hhf.c:438
Code: 48 c1 ea 03 42 80 3c 22 00 0f 85 7c 03 00 00 4d 89 3e e8 3d d8 dc fb 4d 8d b5 58 03 00 00 4c 89 f0 48 c1 e8 03 42 80 3c 20 00 <0f> 85 4e 03 00 00 4d 8b bd 58 03 00 00 48 89 df 48 8b 55 c8 4c 89
RSP: 0018:ffff8880aa236998 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
RAX: 1ffff1101530b18b RBX: ffff8880a9858bb8 RCX: ffffffff858e7de6
RDX: 0000000000000100 RSI: ffffffff858e7e53 RDI: ffff8880a9858c58
RBP: ffff8880aa2369e8 R08: ffff8880aa226240 R09: 0000000000000006
R10: ffff8880aa226bb0 R11: 0000000018da6103 R12: dffffc0000000000
R13: ffff8880a9858900 R14: ffff8880a9858c58 R15: ffff8880a9858c50
dequeue_skb net/sched/sch_generic.c:277 [inline]
qdisc_restart net/sched/sch_generic.c:380 [inline]
__qdisc_run+0x1e7/0x1960 net/sched/sch_generic.c:398
__dev_xmit_skb net/core/dev.c:3501 [inline]
__dev_queue_xmit+0x165c/0x2fe0 net/core/dev.c:3811
dev_queue_xmit+0x18/0x20 net/core/dev.c:3876
br_dev_queue_push_xmit+0x405/0x5d0 net/bridge/br_forward.c:56
br_nf_dev_queue_xmit+0x365/0x1610 net/bridge/br_netfilter_hooks.c:779
NF_HOOK include/linux/netfilter.h:289 [inline]
NF_HOOK include/linux/netfilter.h:283 [inline]
br_nf_post_routing+0x76f/0x12f0 net/bridge/br_netfilter_hooks.c:825
nf_hook_entry_hookfn include/linux/netfilter.h:119 [inline]
nf_hook_slow+0xbc/0x1e0 net/netfilter/core.c:511
nf_hook include/linux/netfilter.h:244 [inline]
NF_HOOK include/linux/netfilter.h:287 [inline]
br_forward_finish+0x215/0x400 net/bridge/br_forward.c:69
br_nf_hook_thresh+0x2e9/0x370 net/bridge/br_netfilter_hooks.c:1008
br_nf_forward_finish+0x356/0x700 net/bridge/br_netfilter_hooks.c:553
NF_HOOK include/linux/netfilter.h:289 [inline]
NF_HOOK include/linux/netfilter.h:283 [inline]
br_nf_forward_ip net/bridge/br_netfilter_hooks.c:620 [inline]
br_nf_forward_ip+0x6b4/0x17c0 net/bridge/br_netfilter_hooks.c:564
nf_hook_entry_hookfn include/linux/netfilter.h:119 [inline]
nf_hook_slow+0xbc/0x1e0 net/netfilter/core.c:511
nf_hook include/linux/netfilter.h:244 [inline]
NF_HOOK include/linux/netfilter.h:287 [inline]
__br_forward+0x393/0xb30 net/bridge/br_forward.c:113
deliver_clone+0x61/0xc0 net/bridge/br_forward.c:129
br_flood+0x5fa/0x710 net/bridge/br_forward.c:238
br_handle_frame_finish+0xf72/0x1510 net/bridge/br_input.c:167
br_nf_hook_thresh+0x2e9/0x370 net/bridge/br_netfilter_hooks.c:1008
br_nf_pre_routing_finish_ipv6+0x6ed/0xd70 net/bridge/br_netfilter_ipv6.c:210
NF_HOOK include/linux/netfilter.h:289 [inline]
br_nf_pre_routing_ipv6+0x4a5/0x8ca net/bridge/br_netfilter_ipv6.c:240
br_nf_pre_routing+0x1016/0x159c net/bridge/br_netfilter_hooks.c:494
nf_hook_entry_hookfn include/linux/netfilter.h:119 [inline]
nf_hook_slow+0xbc/0x1e0 net/netfilter/core.c:511
nf_hook include/linux/netfilter.h:244 [inline]
NF_HOOK include/linux/netfilter.h:287 [inline]
br_handle_frame+0x985/0x1480 net/bridge/br_input.c:306
__netif_receive_skb_core+0xac1/0x3570 net/core/dev.c:4861
__netif_receive_skb_one_core+0xa8/0x1a0 net/core/dev.c:4930
__netif_receive_skb+0x2c/0x1d0 net/core/dev.c:5044
process_backlog+0x23a/0x7a0 net/core/dev.c:5855
napi_poll net/core/dev.c:6278 [inline]
net_rx_action+0x4f5/0x1070 net/core/dev.c:6344
__do_softirq+0x25c/0x921 kernel/softirq.c:292
run_ksoftirqd kernel/softirq.c:653 [inline]
run_ksoftirqd+0x8e/0x110 kernel/softirq.c:645
smpboot_thread_fn+0x6a3/0xa30 kernel/smpboot.c:164
kthread+0x354/0x420 kernel/kthread.c:246
ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415
rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
rcu: 0-....: (10652 ticks this GP) idle=63e/1/0x4000000000000000 softirq=208588/208602 fqs=4760
rcu: (detected by 1, t=10503 jiffies, g=12449, q=4)
Sending NMI from CPU 1 to CPUs 0:
INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.189 msecs
NMI backtrace for cpu 0
CPU: 0 PID: 9 Comm: ksoftirqd/0 Not tainted 4.19.72 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
RIP: 0010:check_kcov_mode kernel/kcov.c:67 [inline]
RIP: 0010:write_comp_data+0x10/0x70 kernel/kcov.c:122
Code: 00 00 48 8b 11 48 83 c2 01 48 39 d0 76 07 48 89 34 d1 48 89 11 5d c3 0f 1f 00 65 4c 8b 04 25 40 ee 01 00 65 8b 05 e0 96 96 7e 00 01 1f 00 75 51 41 8b 80 d0 12 00 00 83 f8 03 75 45 49 8b 80
RSP: 0018:ffff8880aa236980 EFLAGS: 00000246
RAX: 0000000000000301 RBX: ffff8880a9858bb8 RCX: ffffffff858e7de6
RDX: 0000000000000001 RSI: 0000000000000000 RDI: 0000000000000001
RBP: ffff8880aa236988 R08: ffff8880aa226240 R09: 0000000000000006
R10: ffff8880aa226bb0 R11: 0000000018da6103 R12: dffffc0000000000
R13: ffff8880a9858900 R14: 0000000000000001 R15: 0000000000000000
FS: 0000000000000000(0000) GS:ffff8880ae800000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000c420812000 CR3: 000000000866d000 CR4: 00000000001426f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
__list_del_entry include/linux/list.h:117 [inline]
list_move_tail include/linux/list.h:182 [inline]
hhf_dequeue+0x5b6/0xa00 net/sched/sch_hhf.c:438
dequeue_skb net/sched/sch_generic.c:277 [inline]
qdisc_restart net/sched/sch_generic.c:380 [inline]
__qdisc_run+0x1e7/0x1960 net/sched/sch_generic.c:398
__dev_xmit_skb net/core/dev.c:3501 [inline]
__dev_queue_xmit+0x165c/0x2fe0 net/core/dev.c:3811
dev_queue_xmit+0x18/0x20 net/core/dev.c:3876
br_dev_queue_push_xmit+0x405/0x5d0 net/bridge/br_forward.c:56
br_nf_dev_queue_xmit+0x365/0x1610 net/bridge/br_netfilter_hooks.c:779
NF_HOOK include/linux/netfilter.h:289 [inline]
NF_HOOK include/linux/netfilter.h:283 [inline]
br_nf_post_routing+0x76f/0x12f0 net/bridge/br_netfilter_hooks.c:825
nf_hook_entry_hookfn include/linux/netfilter.h:119 [inline]
nf_hook_slow+0xbc/0x1e0 net/netfilter/core.c:511
nf_hook include/linux/netfilter.h:244 [inline]
NF_HOOK include/linux/netfilter.h:287 [inline]
br_forward_finish+0x215/0x400 net/bridge/br_forward.c:69
br_nf_hook_thresh+0x2e9/0x370 net/bridge/br_netfilter_hooks.c:1008
br_nf_forward_finish+0x356/0x700 net/bridge/br_netfilter_hooks.c:553
NF_HOOK include/linux/netfilter.h:289 [inline]
NF_HOOK include/linux/netfilter.h:283 [inline]
br_nf_forward_ip net/bridge/br_netfilter_hooks.c:620 [inline]
br_nf_forward_ip+0x6b4/0x17c0 net/bridge/br_netfilter_hooks.c:564
nf_hook_entry_hookfn include/linux/netfilter.h:119 [inline]
nf_hook_slow+0xbc/0x1e0 net/netfilter/core.c:511
nf_hook include/linux/netfilter.h:244 [inline]
NF_HOOK include/linux/netfilter.h:287 [inline]
__br_forward+0x393/0xb30 net/bridge/br_forward.c:113
deliver_clone+0x61/0xc0 net/bridge/br_forward.c:129
br_flood+0x5fa/0x710 net/bridge/br_forward.c:238
br_handle_frame_finish+0xf72/0x1510 net/bridge/br_input.c:167
br_nf_hook_thresh+0x2e9/0x370 net/bridge/br_netfilter_hooks.c:1008
br_nf_pre_routing_finish_ipv6+0x6ed/0xd70 net/bridge/br_netfilter_ipv6.c:210
NF_HOOK include/linux/netfilter.h:289 [inline]
br_nf_pre_routing_ipv6+0x4a5/0x8ca net/bridge/br_netfilter_ipv6.c:240
br_nf_pre_routing+0x1016/0x159c net/bridge/br_netfilter_hooks.c:494
nf_hook_entry_hookfn include/linux/netfilter.h:119 [inline]
nf_hook_slow+0xbc/0x1e0 net/netfilter/core.c:511
nf_hook include/linux/netfilter.h:244 [inline]
NF_HOOK include/linux/netfilter.h:287 [inline]
br_handle_frame+0x985/0x1480 net/bridge/br_input.c:306
__netif_receive_skb_core+0xac1/0x3570 net/core/dev.c:4861
__netif_receive_skb_one_core+0xa8/0x1a0 net/core/dev.c:4930
__netif_receive_skb+0x2c/0x1d0 net/core/dev.c:5044
process_backlog+0x23a/0x7a0 net/core/dev.c:5855
napi_poll net/core/dev.c:6278 [inline]
net_rx_action+0x4f5/0x1070 net/core/dev.c:6344
__do_softirq+0x25c/0x921 kernel/softirq.c:292
run_ksoftirqd kernel/softirq.c:653 [inline]
run_ksoftirqd+0x8e/0x110 kernel/softirq.c:645
smpboot_thread_fn+0x6a3/0xa30 kernel/smpboot.c:164
kthread+0x354/0x420 kernel/kthread.c:246
ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415
rcu: rcu_sched kthread starved for 932 jiffies! g12449 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=1
rcu: RCU grace-period kthread stack dump:
rcu_sched I29104 11 2 0x80000000
Call Trace:
context_switch kernel/sched/core.c:2826 [inline]
__schedule+0x866/0x1dc0 kernel/sched/core.c:3474
schedule+0x92/0x1c0 kernel/sched/core.c:3518
schedule_timeout+0x4db/0xfc0 kernel/time/timer.c:1804
rcu_gp_kthread+0xd5c/0x2190 kernel/rcu/tree.c:2202
kthread+0x354/0x420 kernel/kthread.c:246
ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:415