ip6_tunnel: ip6tnl1 xmit: Local address not yet configured! ip6_tunnel: ip6tnl1 xmit: Local address not yet configured! ip6_tunnel: ip6tnl1 xmit: Local address not yet configured! ip6_tunnel: ip6tnl1 xmit: Local address not yet configured! BUG: workqueue lockup - pool[ 715.906121] INFO: task kworker/u4:3:2135 blocked for more than 140 seconds. Not tainted 4.9.184+ #5 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. kworker/u4:3 D 25288 2135 2 0x80000000 Workqueue: netns cleanup_net 0000000000000087 ffff8801d11a4740 ffff8801ce199080 ffff8801db721000 ffff8801d25f8000 ffff8801db721018 ffff8801a4def798 ffffffff8280a5ce ffff8801d3d611a8 ffffffff82813859 00ff8801d3d611a8 ffff8801db7218f0Call Trace: [<00000000150b6da6>] schedule+0x92/0x1c0 kernel/sched/core.c:3546 [<00000000857f036d>] schedule_preempt_disabled+0x13/0x20 kernel/sched/core.c:3579 [<0000000064412bb7>] __mutex_lock_common kernel/locking/mutex.c:582 [inline] [<0000000064412bb7>] mutex_lock_nested+0x38d/0x920 kernel/locking/mutex.c:621 [<00000000295dd74f>] rtnl_lock+0x17/0x20 net/core/rtnetlink.c:70 [<0000000055834c81>] netdev_run_todo+0x212/0x780 net/core/dev.c:7553 [<000000003af83fc1>] rtnl_unlock+0xe/0x10 net/core/rtnetlink.c:104 [<00000000ac9dd43d>] vti6_exit_net+0x360/0x4e0 net/ipv6/ip6_vti.c:1125 [<000000000edc94fe>] ops_exit_list.isra.0+0xb0/0x160 net/core/net_namespace.c:136 [<000000004649104f>] cleanup_net+0x3d6/0x8a0 net/core/net_namespace.c:474 [<000000009584e185>] process_one_work+0x88b/0x1600 kernel/workqueue.c:2114 [<00000000ea084584>] worker_thread+0x5df/0x11d0 kernel/workqueue.c:2251 [<000000007231a81c>] kthread+0x278/0x310 kernel/kthread.c:211 [<00000000a7bfa42c>] ret_from_fork+0x5c/0x70 arch/x86/entry/entry_64.S:375 Showing all locks held in the system: 2 locks held by khungtaskd/24: #0: (rcu_read_lock){......}, at: [<000000004acc9211>] check_hung_uninterruptible_tasks kernel/hung_task.c:169 [inline] (rcu_read_lock){......}, at: [<000000004acc9211>] watchdog+0x14b/0xaf0 kernel/hung_task.c:263 (tasklist_lock){.+.+..}, at: [<000000000a685e1d>] debug_show_all_locks+0x7f/0x21f kernel/locking/lockdep.c:4336 #0: (&f->f_pos_lock){+.+.+.}, at: [<0000000001979a0c>] __fdget_pos+0xa8/0xd0 fs/file.c:782 #0: (&tty->ldisc_sem){++++++}, at: [<000000002a0cbb51>] ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:377 (&ldata->atomic_read_lock){+.+...}, at: [<00000000d693a741>] n_tty_read+0x1fe/0x1820 drivers/tty/n_tty.c:2156 #0: ("%s""netns"){.+.+.+}, at: [<00000000be3b47d8>] process_one_work+0x790/0x1600 kernel/workqueue.c:2107 (net_cleanup_work){+.+.+.}, at: [<000000009de5eed5>] process_one_work+0x7ce/0x1600 kernel/workqueue.c:2111 (net_mutex){+.+.+.}, at: [<00000000694fb37a>] cleanup_net+0x131/0x8a0 net/core/net_namespace.c:440 (rtnl_mutex){+.+.+.}, at: [<00000000295dd74f>] rtnl_lock+0x17/0x20 net/core/rtnetlink.c:70 #0: ("%s"("ipv6_addrconf")){.+.+..}, at: [<00000000be3b47d8>] process_one_work+0x790/0x1600 kernel/workqueue.c:2107 ((&(&ifa->dad_work)->work)){+.+...}, at: [<000000009de5eed5>] process_one_work+0x7ce/0x1600 kernel/workqueue.c:2111 (rtnl_mutex){+.+.+.}, at: [<00000000295dd74f>] rtnl_lock+0x17/0x20 net/core/rtnetlink.c:70 #0: (&sb->s_type->i_mutex_key#8){+.+.+.}, at: [<00000000ede06774>] inode_lock include/linux/fs.h:771 [inline] (&sb->s_type->i_mutex_key#8){+.+.+.}, at: [<00000000ede06774>] __sock_release+0x89/0x2c0 net/socket.c:604 #0: (&sb->s_type->i_mutex_key#8){+.+.+.}, at: [<00000000ede06774>] inode_lock include/linux/fs.h:771 [inline] (&sb->s_type->i_mutex_key#8){+.+.+.}, at: [<00000000ede06774>] __sock_release+0x89/0x2c0 net/socket.c:604 #0: (&sb->s_type->i_mutex_key#8){+.+.+.}, at: [<00000000ede06774>] inode_lock include/linux/fs.h:771 [inline] (&sb->s_type->i_mutex_key#8){+.+.+.}, at: [<00000000ede06774>] __sock_release+0x89/0x2c0 net/socket.c:604 #0: (net_mutex){+.+.+.}, at: [<00000000fd79e9bc>] copy_net_ns+0x15b/0x340 net/core/net_namespace.c:407 #0: (net_mutex){+.+.+.}, at: [<00000000fd79e9bc>] copy_net_ns+0x15b/0x340 net/core/net_namespace.c:407 #0: (net_mutex){+.+.+.}, at: [<00000000fd79e9bc>] copy_net_ns+0x15b/0x340 net/core/net_namespace.c:407 #0: (rtnl_mutex){+.+.+.}, at: [<00000000295dd74f>] rtnl_lock+0x17/0x20 net/core/rtnetlink.c:70 #0: (rtnl_mutex){+.+.+.}, at: [<00000000295dd74f>] rtnl_lock+0x17/0x20 net/core/rtnetlink.c:70 #0: (&sb->s_type->i_mutex_key#8){+.+.+.}, at: [<00000000ede06774>] inode_lock include/linux/fs.h:771 [inline] (&sb->s_type->i_mutex_key#8){+.+.+.}, at: [<00000000ede06774>] __sock_release+0x89/0x2c0 net/socket.c:604 (rcu_preempt_state.exp_mutex){+.+...}, at: [<00000000017b1d73>] exp_funnel_lock kernel/rcu/tree_exp.h:289 [inline] (rcu_preempt_state.exp_mutex){+.+...}, at: [<00000000017b1d73>] _synchronize_rcu_expedited+0x3a7/0x850 kernel/rcu/tree_exp.h:569 #0: (rtnl_mutex){+.+.+.}, at: [<00000000295dd74f>] rtnl_lock+0x17/0x20 net/core/rtnetlink.c:70 (rcu_preempt_state.exp_mutex){+.+...}, at: [<000000006c74a7f5>] exp_funnel_lock kernel/rcu/tree_exp.h:256 [inline] (rcu_preempt_state.exp_mutex){+.+...}, at: [<000000006c74a7f5>] _synchronize_rcu_expedited+0x339/0x850 kernel/rcu/tree_exp.h:569 #0: (rtnl_mutex){+.+.+.}, at: [<00000000295dd74f>] rtnl_lock+0x17/0x20 net/core/rtnetlink.c:70 #0: (rtnl_mutex){+.+.+.}, at: [<00000000295dd74f>] rtnl_lock+0x17/0x20 net/core/rtnetlink.c:70 #0: (rtnl_mutex){+.+.+.}, at: [<00000000295dd74f>] rtnl_lock+0x17/0x20 net/core/rtnetlink.c:70 ============================================= NMI backtrace for cpu 1 CPU: 1 PID: 24 Comm: khungtaskd Not tainted 4.9.184+ #5 ffff8801d98efcc8 ffffffff81b580a1 0000000000000001 0000000000000000 0000000000000001 ffffffff81099a01 dffffc0000000000 ffff8801d98efd00 ffffffff81b6333c 0000000000000001 0000000000000000 0000000000000001Call Trace: [<0000000048a6d4eb>] __dump_stack lib/dump_stack.c:15 [inline] [<0000000048a6d4eb>] dump_stack+0xc1/0x120 lib/dump_stack.c:51 [<000000006350b788>] nmi_cpu_backtrace.cold+0x47/0x87 lib/nmi_backtrace.c:99 [<00000000d1eba9f5>] nmi_trigger_cpumask_backtrace+0x124/0x155 lib/nmi_backtrace.c:60 [<000000006e32bc68>] arch_trigger_cpumask_backtrace+0x14/0x20 arch/x86/kernel/apic/hw_nmi.c:37 [<000000003e5e6913>] trigger_all_cpu_backtrace include/linux/nmi.h:58 [inline] [<000000003e5e6913>] check_hung_task kernel/hung_task.c:126 [inline] [<000000003e5e6913>] check_hung_uninterruptible_tasks kernel/hung_task.c:183 [inline] [<000000003e5e6913>] watchdog+0x670/0xaf0 kernel/hung_task.c:263 [<000000007231a81c>] kthread+0x278/0x310 kernel/kthread.c:211 [<00000000a7bfa42c>] ret_from_fork+0x5c/0x70 arch/x86/entry/entry_64.S:375 Sending NMI from CPU 1 to CPUs 0: NMI backtrace for cpu 0 CPU: 0 PID: 3 Comm: kworker/0:0 Not tainted 4.9.184+ #5 Workqueue: events rtc_timer_do_workc task: 000000000ed3881d task.stack: 00000000b71312f5 RIP: 0010:[] c [<00000000b45b6957>] io_serial_in+0x6b/0x90 drivers/tty/serial/8250/8250_port.c:414 RSP: 0018:ffff8801db6077b0 EFLAGS: 00000002 RAX: dffffc0000000020 RBX: 00000000000003fd RCX: 0000000000000000 RDX: 00000000000003fd RSI: ffffffff81d77bd1 RDI: ffffffff84b65d18 RBP: ffff8801db6077c0 R08: 0000000000000001 R09: 0000000000000000 R10: 0000000000000001 R11: ffffffff841d456a R12: ffffffff84b65ce0 R13: 0000000000000020 R14: fffffbfff096cbe3 R15: fffffbfff096cba5 FS: 0000000000000000(0000) GS:ffff8801db600000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 0000000000000000 CR3: 0000000003026000 CR4: 00000000001606b0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000600 Stack: ffffffff84b65ce0c 0000000000002706c ffff8801db607810c ffffffff81d79e74c ffff8801da602f80c ffffffff84b65d28c ffffffff84b65f1ac ffffffff841d454fc ffffffff84b65ce0c 0000000000000020c dffffc0000000000c 0000000000000020c Call Trace: d [<00000000d52d7449>] serial_in drivers/tty/serial/8250/8250.h:111 [inline] d [<00000000d52d7449>] wait_for_xmitr+0x94/0x1e0 drivers/tty/serial/8250/8250_port.c:1997 [<00000000a2436981>] serial8250_console_putchar+0x20/0x60 drivers/tty/serial/8250/8250_port.c:3103 [<00000000f4d40493>] uart_console_write+0x56/0xe0 drivers/tty/serial/serial_core.c:1880 [<000000009c3ba7f0>] serial8250_console_write+0x2fb/0x860 drivers/tty/serial/8250/8250_port.c:3169 [<00000000bd41af46>] univ8250_console_write+0x5f/0x70 drivers/tty/serial/8250/8250_core.c:594 [<00000000fc2d966d>] call_console_drivers.isra.0.constprop.0+0x1ac/0x360 kernel/printk/printk.c:1594 [<0000000085e056c2>] console_cont_flush kernel/printk/printk.c:2321 [inline] [<0000000085e056c2>] console_unlock+0x17b/0xb20 kernel/printk/printk.c:2387 [<00000000cc47299e>] vprintk_emit+0x43f/0x6f0 kernel/printk/printk.c:1908 [<000000003fb6a3c1>] vprintk+0x28/0x30 kernel/printk/printk.c:1918 [<000000008b120a65>] vprintk_func kernel/printk/internal.h:36 [inline] [<000000008b120a65>] printk+0xc2/0xf5 kernel/printk/printk.c:1980 [<00000000caaba007>] wq_watchdog_timer_fn.cold+0x11/0x66 kernel/workqueue.c:5432 [<00000000a55c8fea>] call_timer_fn+0x167/0x6d0 kernel/time/timer.c:1319 [<00000000b0a39171>] expire_timers+0x25b/0x5c0 kernel/time/timer.c:1359 [<00000000d4780961>] __run_timers kernel/time/timer.c:1674 [inline] [<00000000d4780961>] run_timer_softirq+0x404/0x620 kernel/time/timer.c:1689 [<000000008526ada1>] __do_softirq+0x22d/0x964 kernel/softirq.c:288 [<00000000a7b70138>] invoke_softirq kernel/softirq.c:368 [inline] [<00000000a7b70138>] irq_exit+0x119/0x160 kernel/softirq.c:409 [<00000000f30a8c2c>] exiting_irq arch/x86/include/asm/apic.h:669 [inline] [<00000000f30a8c2c>] smp_apic_timer_interrupt+0x7e/0xb0 arch/x86/kernel/apic/apic.c:962 [<000000001261afdc>] apic_timer_interrupt+0x9d/0xb0 arch/x86/entry/entry_64.S:650 d [<0000000077a5c9da>] ? rtc_aie_update_irq+0x30/0x30 drivers/rtc/interface.c:538 [<00000000f018ebe5>] spin_unlock_irqrestore include/linux/spinlock.h:362 [inline] [<00000000f018ebe5>] rtc_handle_legacy_irq+0x81/0x190 drivers/rtc/interface.c:515 [<00000000c5acdf9c>] rtc_uie_update_irq+0x20/0x30 drivers/rtc/interface.c:550 [<00000000a7a9d4ac>] rtc_timer_do_work+0x1fe/0x600 drivers/rtc/interface.c:881 [<000000009584e185>] process_one_work+0x88b/0x1600 kernel/workqueue.c:2114 [<00000000ea084584>] worker_thread+0x5df/0x11d0 kernel/workqueue.c:2251 [<000000007231a81c>] kthread+0x278/0x310 kernel/kthread.c:211 [<00000000a7bfa42c>] ret_from_fork+0x5c/0x70 arch/x86/entry/entry_64.S:375 Code: c24 cc9 c00 c00 c00 c49 c8d c7c c24 c38 c48 cb8 c00 c00 c00 c00 c00 cfc cff cdf c48 c89 cfa c48 cc1 cea c03 cd3 ce3 c80 c3c c02 c00 c75 c17 c41 c03 c5c c24 c38 c89 cda cec c<5b> c0f cb6 cc0 c41 c5c c5d cc3 ce8 c38 c53 c78 cff ceb cc2 ce8 c91 c53 c78 cff ceb c