INFO: task kworker/u4:1:22 blocked for more than 120 seconds. Not tainted 4.9.94-g8683408 #3 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. kworker/u4:1 D25736 22 2 0x00000000 Workqueue: netns cleanup_net ffff8801d9bf1800 ffff8801aa4faa00 ffff88019bacd500 ffff880190863000 ffff8801db221b98 ffff8801d94f7958 ffffffff838c040d ffff8801d9bf20c8 ffffed003b37e418 ffff8801d9bf1800 00fffc0000000000 ffff8801db222468 Call Trace: [] schedule+0x7f/0x1b0 kernel/sched/core.c:3557 [] schedule_preempt_disabled+0x13/0x20 kernel/sched/core.c:3590 [] __mutex_lock_common kernel/locking/mutex.c:582 [inline] [] mutex_lock_nested+0x326/0x870 kernel/locking/mutex.c:621 [] rtnl_lock+0x17/0x20 net/core/rtnetlink.c:70 [] ipmr_rules_exit net/ipv4/ipmr.c:290 [inline] [] ipmr_net_exit+0x80/0x120 net/ipv4/ipmr.c:2805 [] ops_exit_list.isra.6+0xb0/0x160 net/core/net_namespace.c:136 [] cleanup_net+0x321/0x630 net/core/net_namespace.c:473 [] process_one_work+0x7e1/0x1500 kernel/workqueue.c:2092 [] worker_thread+0xd6/0x10a0 kernel/workqueue.c:2226 [] kthread+0x26d/0x300 kernel/kthread.c:211 [] ret_from_fork+0x5c/0x70 arch/x86/entry/entry_64.S:373 Showing all locks held in the system: 4 locks held by kworker/u4:1/22: #0: ("%s""netns"){.+.+.+}, at: [] work_static include/linux/workqueue.h:186 [inline] #0: ("%s""netns"){.+.+.+}, at: [] set_work_data kernel/workqueue.c:617 [inline] #0: ("%s""netns"){.+.+.+}, at: [] set_work_pool_and_clear_pending kernel/workqueue.c:644 [inline] #0: ("%s""netns"){.+.+.+}, at: [] process_one_work+0x6ee/0x1500 kernel/workqueue.c:2085 #1: (net_cleanup_work){+.+.+.}, at: [] process_one_work+0x728/0x1500 kernel/workqueue.c:2089 #2: (net_mutex){+.+.+.}, at: [] cleanup_net+0x13f/0x630 net/core/net_namespace.c:439 #3: (rtnl_mutex){+.+.+.}, at: [] rtnl_lock+0x17/0x20 net/core/rtnetlink.c:70 3 locks held by kworker/0:1/25: #0: ("%s"("ipv6_addrconf")){.+.+..}, at: [] work_static include/linux/workqueue.h:186 [inline] #0: ("%s"("ipv6_addrconf")){.+.+..}, at: [] set_work_data kernel/workqueue.c:617 [inline] #0: ("%s"("ipv6_addrconf")){.+.+..}, at: [] set_work_pool_and_clear_pending kernel/workqueue.c:644 [inline] #0: ("%s"("ipv6_addrconf")){.+.+..}, at: [] process_one_work+0x6ee/0x1500 kernel/workqueue.c:2085 #1: ((addr_chk_work).work){+.+...}, at: [] process_one_work+0x728/0x1500 kernel/workqueue.c:2089 #2: (rtnl_mutex){+.+.+.}, at: [] rtnl_lock+0x17/0x20 net/core/rtnetlink.c:70 2 locks held by khungtaskd/516: #0: (rcu_read_lock){......}, at: [] check_hung_uninterruptible_tasks kernel/hung_task.c:168 [inline] #0: (rcu_read_lock){......}, at: [] watchdog+0x11c/0xa20 kernel/hung_task.c:239 #1: (tasklist_lock){.+.+..}, at: [] debug_show_all_locks+0x79/0x218 kernel/locking/lockdep.c:4336 1 lock held by rsyslogd/3646: #0: (&f->f_pos_lock){+.+.+.}, at: [] __fdget_pos+0xac/0xd0 fs/file.c:781 2 locks held by getty/3742: #0: (&tty->ldisc_sem){++++++}, at: [] ldsem_down_read+0x32/0x40 drivers/tty/tty_ldsem.c:367 #1: (&ldata->atomic_read_lock){+.+.+.}, at: [] n_tty_read+0x202/0x16b0 drivers/tty/n_tty.c:2133 1 lock held by syz-executor2/14130: #0: (ipvs->sync_mutex){+.+.+.}, at: [] do_ip_vs_set_ctl+0x645/0xbd0 net/netfilter/ipvs/ip_vs_ctl.c:2402 2 locks held by syz-executor2/14141: #0: (rtnl_mutex){+.+.+.}, at: [] rtnl_lock+0x17/0x20 net/core/rtnetlink.c:70 #1: (ipvs->sync_mutex){+.+.+.}, at: [] do_ip_vs_set_ctl+0x90d/0xbd0 net/netfilter/ipvs/ip_vs_ctl.c:2397 1 lock held by syz-executor4/14133: #0: (rtnl_mutex){+.+.+.}, at: [] rtnl_lock+0x17/0x20 net/core/rtnetlink.c:70 1 lock held by syz-executor4/14188: #0: (rtnl_mutex){+.+.+.}, at: [] rtnl_lock+0x17/0x20 net/core/rtnetlink.c:70 1 lock held by syz-executor4/14193: #0: (rtnl_mutex){+.+.+.}, at: [] rtnl_lock+0x17/0x20 net/core/rtnetlink.c:70 1 lock held by ipvs-b:8:0/14142: #0: (rtnl_mutex){+.+.+.}, at: [] rtnl_lock+0x17/0x20 net/core/rtnetlink.c:70 1 lock held by syz-executor1/14150: #0: (rtnl_mutex){+.+.+.}, at: [] rtnl_lock net/core/rtnetlink.c:70 [inline] #0: (rtnl_mutex){+.+.+.}, at: [] rtnetlink_rcv+0x1b/0x40 net/core/rtnetlink.c:4064 1 lock held by syz-executor1/14189: #0: (rtnl_mutex){+.+.+.}, at: [] rtnl_lock net/core/rtnetlink.c:70 [inline] #0: (rtnl_mutex){+.+.+.}, at: [] rtnetlink_rcv+0x1b/0x40 net/core/rtnetlink.c:4064 1 lock held by syz-executor3/14169: #0: (rtnl_mutex){+.+.+.}, at: [] rtnl_lock+0x17/0x20 net/core/rtnetlink.c:70 ============================================= NMI backtrace for cpu 0 CPU: 0 PID: 516 Comm: khungtaskd Not tainted 4.9.94-g8683408 #3 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011 ffff8801d86bfd08 ffffffff81d9b509 0000000000000000 0000000000000000 0000000000000000 0000000000000001 ffffffff810b7d60 ffff8801d86bfd40 ffffffff81da6837 0000000000000000 0000000000000000 0000000000000002 Call Trace: [] __dump_stack lib/dump_stack.c:15 [inline] [] dump_stack+0xc1/0x128 lib/dump_stack.c:51 [] nmi_cpu_backtrace.cold.2+0x48/0x87 lib/nmi_backtrace.c:99 [] nmi_trigger_cpumask_backtrace+0x12a/0x14f lib/nmi_backtrace.c:60 [] arch_trigger_cpumask_backtrace+0x14/0x20 arch/x86/kernel/apic/hw_nmi.c:37 [] trigger_all_cpu_backtrace include/linux/nmi.h:58 [inline] [] check_hung_task kernel/hung_task.c:125 [inline] [] check_hung_uninterruptible_tasks kernel/hung_task.c:182 [inline] [] watchdog+0x6b4/0xa20 kernel/hung_task.c:239 [] kthread+0x26d/0x300 kernel/kthread.c:211 [] ret_from_fork+0x5c/0x70 arch/x86/entry/entry_64.S:373 Sending NMI from CPU 0 to CPUs 1: NMI backtrace for cpu 1 CPU: 1 PID: 0 Comm: swapper/1 Not tainted 4.9.94-g8683408 #3 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011 task: ffff8801d9b73000 task.stack: ffff8801d9b88000 RIP: 0010:[] c [] match_held_lock+0x1b/0x570 kernel/locking/lockdep.c:3405 RSP: 0018:ffff8801db307d30 EFLAGS: 00000086 RAX: dffffc0000000000 RBX: ffff8801d9b73000 RCX: 1ffffffff084247d RDX: 1ffff1003b36e718 RSI: ffffffff844bbf80 RDI: ffff8801d9b738d8 RBP: ffff8801db307d48 R08: ffff8801d9b738e8 R09: 0000000000000001 R10: ffff8801d9b73000 R11: 0000000000000001 R12: ffffed003b36e718 R13: ffff8801d9b738c8 R14: ffffffff844bbf80 R15: 0000000000000000 FS: 0000000000000000(0000) GS:ffff8801db300000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00000000024b8b10 CR3: 00000001be9c8000 CR4: 0000000000160670 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Stack: ffff8801d9b738c8c ffffffff844bbf80c 0000000000000000c ffff8801db307d88c ffffffff8122e3c2c ffff8801d9b738c0c 0000000000000246c ffff8801d9b73000c ffffffff844bbf80c ffff8801db321b80c 000000010000f1adc ffff8801db307db0c Call Trace: d [] __lock_is_held+0xa2/0xf0 kernel/locking/lockdep.c:3597 [] lock_is_held+0xb4/0x140 kernel/locking/lockdep.c:3794 [] rebalance_domains+0x803/0xbc0 kernel/sched/fair.c:10078 [] run_rebalance_domains+0x2f9/0x510 kernel/sched/fair.c:10332 [] __do_softirq+0x20b/0x937 kernel/softirq.c:284 [] invoke_softirq kernel/softirq.c:364 [inline] [] irq_exit+0x147/0x190 kernel/softirq.c:405 [] smp_reschedule_interrupt+0x71/0x90 arch/x86/kernel/smp.c:270 [] reschedule_interrupt+0xa0/0xb0 arch/x86/entry/entry_64.S:671 d [] ? native_safe_halt+0x6/0x10 arch/x86/include/asm/irqflags.h:53 [] arch_safe_halt arch/x86/include/asm/paravirt.h:104 [inline] [] default_idle+0x55/0x360 arch/x86/kernel/process.c:295 [] arch_cpu_idle+0x10/0x20 arch/x86/kernel/process.c:286 [] default_idle_call+0x45/0x60 kernel/sched/idle.c:97 [] cpuidle_idle_call kernel/sched/idle.c:155 [inline] [] cpu_idle_loop kernel/sched/idle.c:248 [inline] [] cpu_startup_entry+0x2b5/0x380 kernel/sched/idle.c:303 [] start_secondary+0x323/0x400 arch/x86/kernel/smpboot.c:254 Code: c81 c48 c89 ce5 ce8 cb7 cf9 cff cff c5d cc3 c0f c1f c44 c00 c00 c48 cb8 c00 c00 c00 c00 c00 cfc cff cdf c55 c48 c89 ce5 c41 c57 c41 c56 c41 c55 c49 c89 cfd c48 c83 cc7 c10 c<48> c89 cfa c41 c54 c48 cc1 cea c03 c53 c48 c83 cec c08 c80 c3c c02 c00 c0f c85 c51 c