rcu: INFO: rcu_preempt self-detected stall on CPU rcu: 1-...!: (1 GPs behind) idle=3f2/0/0x3 softirq=8968/8969 fqs=1 (t=10500 jiffies g=7089 q=46) rcu: rcu_preempt kthread starved for 10498 jiffies! g7089 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0 rcu: RCU grace-period kthread stack dump: rcu_preempt I29440 10 2 0x80004000 Call Trace: context_switch kernel/sched/core.c:3265 [inline] __schedule+0x76e/0x17a0 kernel/sched/core.c:3937 schedule+0xd9/0x260 kernel/sched/core.c:4004 schedule_timeout+0x486/0xc50 kernel/time/timer.c:1893 rcu_gp_fqs_loop kernel/rcu/tree.c:1639 [inline] rcu_gp_kthread+0x9b2/0x18d0 kernel/rcu/tree.c:1799 kthread+0x361/0x430 kernel/kthread.c:255 ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:352 NMI backtrace for cpu 1 CPU: 1 PID: 0 Comm: swapper/1 Not tainted 5.3.0-rc6-next-20190830 #75 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011 Call Trace: __dump_stack lib/dump_stack.c:77 [inline] dump_stack+0x172/0x1f0 lib/dump_stack.c:113 nmi_cpu_backtrace.cold+0x70/0xb2 lib/nmi_backtrace.c:101 nmi_trigger_cpumask_backtrace+0x23b/0x28b lib/nmi_backtrace.c:62 arch_trigger_cpumask_backtrace+0x14/0x20 arch/x86/kernel/apic/hw_nmi.c:38 trigger_single_cpu_backtrace include/linux/nmi.h:164 [inline] rcu_dump_cpu_stacks+0x183/0x1cf kernel/rcu/tree_stall.h:254 print_cpu_stall kernel/rcu/tree_stall.h:455 [inline] check_cpu_stall kernel/rcu/tree_stall.h:529 [inline] rcu_pending kernel/rcu/tree.c:2795 [inline] rcu_sched_clock_irq.cold+0x4fd/0xc12 kernel/rcu/tree.c:2244 update_process_times+0x2d/0x70 kernel/time/timer.c:1724 tick_sched_handle+0xa2/0x190 kernel/time/tick-sched.c:167 tick_sched_timer+0x53/0x140 kernel/time/tick-sched.c:1299 __run_hrtimer kernel/time/hrtimer.c:1504 [inline] __hrtimer_run_queues+0x364/0xe40 kernel/time/hrtimer.c:1566 hrtimer_interrupt+0x314/0x770 kernel/time/hrtimer.c:1628 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1106 [inline] smp_apic_timer_interrupt+0x160/0x610 arch/x86/kernel/apic/apic.c:1131 apic_timer_interrupt+0xf/0x20 arch/x86/entry/entry_64.S:830 RIP: 0010:__sanitizer_cov_trace_const_cmp4+0x11/0x20 kernel/kcov.c:189 Code: bf 03 00 00 00 48 89 e5 48 8b 4d 08 e8 d8 fe ff ff 5d c3 66 0f 1f 44 00 00 55 89 f2 89 fe bf 05 00 00 00 48 89 e5 48 8b 4d 08 ba fe ff ff 5d c3 0f 1f 84 00 00 00 00 00 55 48 89 f2 48 89 fe RSP: 0018:ffff8880ae9095b8 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13 RAX: 0000000000000000 RBX: ffff8880a0300af8 RCX: ffffffff85cb69b9 RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000005 RBP: ffff8880ae9095b8 R08: ffff8880a98d0340 R09: fffffbfff14ed341 R10: ffff8880a98d0ca8 R11: ffff8880a98d0340 R12: dffffc0000000000 R13: ffff8880a0300800 R14: ffff8880a0300b90 R15: 0000000000000000 hhf_dequeue+0xb9/0xa20 net/sched/sch_hhf.c:434 dequeue_skb net/sched/sch_generic.c:258 [inline] qdisc_restart net/sched/sch_generic.c:361 [inline] __qdisc_run+0x1e7/0x19d0 net/sched/sch_generic.c:379 __dev_xmit_skb net/core/dev.c:3533 [inline] __dev_queue_xmit+0x16f1/0x37c0 net/core/dev.c:3838 dev_queue_xmit+0x18/0x20 net/core/dev.c:3902 neigh_hh_output include/net/neighbour.h:500 [inline] neigh_output include/net/neighbour.h:509 [inline] ip6_finish_output2+0xf58/0x2550 net/ipv6/ip6_output.c:116 __ip6_finish_output+0x444/0xaa0 net/ipv6/ip6_output.c:142 ip6_finish_output+0x38/0x1f0 net/ipv6/ip6_output.c:152 NF_HOOK_COND include/linux/netfilter.h:294 [inline] ip6_output+0x235/0x7f0 net/ipv6/ip6_output.c:175 dst_output include/net/dst.h:436 [inline] NF_HOOK include/linux/netfilter.h:305 [inline] NF_HOOK include/linux/netfilter.h:299 [inline] mld_sendpack+0x9c7/0xed0 net/ipv6/mcast.c:1682 mld_send_cr net/ipv6/mcast.c:1978 [inline] mld_ifc_timer_expire+0x449/0x8a0 net/ipv6/mcast.c:2477 call_timer_fn+0x1ac/0x780 kernel/time/timer.c:1404 expire_timers kernel/time/timer.c:1449 [inline] __run_timers kernel/time/timer.c:1771 [inline] __run_timers kernel/time/timer.c:1738 [inline] run_timer_softirq+0x6c0/0x17f0 kernel/time/timer.c:1784 __do_softirq+0x262/0x98c kernel/softirq.c:292 invoke_softirq kernel/softirq.c:373 [inline] irq_exit+0x19b/0x1e0 kernel/softirq.c:413 exiting_irq arch/x86/include/asm/apic.h:536 [inline] smp_apic_timer_interrupt+0x1a3/0x610 arch/x86/kernel/apic/apic.c:1133 apic_timer_interrupt+0xf/0x20 arch/x86/entry/entry_64.S:830 RIP: 0010:native_safe_halt+0xe/0x10 arch/x86/include/asm/irqflags.h:61 Code: 38 c1 69 fa eb 8a 90 90 90 90 90 90 e9 07 00 00 00 0f 00 2d 64 b8 64 00 f4 c3 66 90 e9 07 00 00 00 0f 00 2d 54 b8 64 00 fb f4 90 55 48 89 e5 41 57 41 56 41 55 41 54 53 e8 5e a7 1c fa e8 69 RSP: 0018:ffff8880a98dfcd0 EFLAGS: 00000282 ORIG_RAX: ffffffffffffff13 RAX: 1ffffffff11e5db7 RBX: 0000000000000000 RCX: 0000000000000000 RDX: dffffc0000000000 RSI: 0000000000000006 RDI: ffff8880a98d0bdc RBP: ffff8880a98dfd00 R08: ffff8880a98d0340 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000001 R13: 0000000000000000 R14: 0000000000000060 R15: 0000000000000001 default_enter_idle+0x71/0xf0 drivers/cpuidle/cpuidle-haltpoll.c:27 cpuidle_enter_state+0xef/0xfb0 drivers/cpuidle/cpuidle.c:229 cpuidle_enter+0x4f/0xa0 drivers/cpuidle/cpuidle.c:344 call_cpuidle kernel/sched/idle.c:117 [inline] cpuidle_idle_call kernel/sched/idle.c:201 [inline] do_idle+0x45f/0x6e0 kernel/sched/idle.c:263 cpu_startup_entry+0x1b/0x20 kernel/sched/idle.c:354 start_secondary+0x2f4/0x410 arch/x86/kernel/smpboot.c:264 secondary_startup_64+0xa4/0xb0 arch/x86/kernel/head_64.S:241