[ 490.894851][ T101] device bridge_slave_1 left promiscuous mode [ 490.901376][ T101] bridge0: port 2(bridge_slave_1) entered disabled state [ 490.947503][ T101] device bridge_slave_0 left promiscuous mode [ 490.953791][ T101] bridge0: port 1(bridge_slave_0) entered disabled state [ 492.355718][ T101] device hsr_slave_1 left promiscuous mode [ 492.397024][ T101] device hsr_slave_0 left promiscuous mode [ 492.437900][ T101] team0 (unregistering): Port device team_slave_1 removed [ 492.448221][ T101] team0 (unregistering): Port device team_slave_0 removed [ 492.460090][ T101] bond0 (unregistering): Releasing backup interface bond_slave_1 [ 492.496104][ T101] bond0 (unregistering): Releasing backup interface bond_slave_0 [ 492.587587][ T101] bond0 (unregistering): Released all slaves Warning: Permanently added '10.128.0.232' (ECDSA) to the list of known hosts. [ 493.329970][ T2897] IPVS: ftp: loaded support on port[0] = 21 [ 493.334846][ T2899] IPVS: ftp: loaded support on port[0] = 21 [ 493.347697][ T2896] IPVS: ftp: loaded support on port[0] = 21 [ 493.348800][ T2900] IPVS: ftp: loaded support on port[0] = 21 [ 493.361270][ T2895] IPVS: ftp: loaded support on port[0] = 21 [ 493.370464][ T2898] IPVS: ftp: loaded support on port[0] = 21 [ 501.913949][ T101] device bridge_slave_1 left promiscuous mode [ 501.920168][ T101] bridge0: port 2(bridge_slave_1) entered disabled state [ 501.964235][ T101] device bridge_slave_0 left promiscuous mode [ 501.970475][ T101] bridge0: port 1(bridge_slave_0) entered disabled state [ 502.024971][ T101] device bridge_slave_1 left promiscuous mode [ 502.031196][ T101] bridge0: port 2(bridge_slave_1) entered disabled state [ 502.084325][ T101] device bridge_slave_0 left promiscuous mode [ 502.090608][ T101] bridge0: port 1(bridge_slave_0) entered disabled state [ 502.146660][ T101] device bridge_slave_1 left promiscuous mode [ 502.152791][ T101] bridge0: port 2(bridge_slave_1) entered disabled state [ 502.194774][ T101] device bridge_slave_0 left promiscuous mode [ 502.201060][ T101] bridge0: port 1(bridge_slave_0) entered disabled state [ 502.254328][ T101] device bridge_slave_1 left promiscuous mode [ 502.260536][ T101] bridge0: port 2(bridge_slave_1) entered disabled state [ 502.304085][ T101] device bridge_slave_0 left promiscuous mode [ 502.310293][ T101] bridge0: port 1(bridge_slave_0) entered disabled state [ 502.354396][ T101] device bridge_slave_1 left promiscuous mode [ 502.360549][ T101] bridge0: port 2(bridge_slave_1) entered disabled state [ 502.404240][ T101] device bridge_slave_0 left promiscuous mode [ 502.410446][ T101] bridge0: port 1(bridge_slave_0) entered disabled state [ 517.785587][ T101] device hsr_slave_1 left promiscuous mode [ 517.826563][ T101] device hsr_slave_0 left promiscuous mode [ 517.860587][ T101] team0 (unregistering): Port device team_slave_1 removed [ 517.872441][ T101] team0 (unregistering): Port device team_slave_0 removed [ 517.885144][ T101] bond0 (unregistering): Releasing backup interface bond_slave_1 [ 517.909719][ T101] bond0 (unregistering): Releasing backup interface bond_slave_0 [ 517.990784][ T101] bond0 (unregistering): Released all slaves [ 518.126741][ T101] device hsr_slave_1 left promiscuous mode [ 518.155906][ T101] device hsr_slave_0 left promiscuous mode [ 518.196430][ T101] team0 (unregistering): Port device team_slave_1 removed [ 518.208147][ T101] team0 (unregistering): Port device team_slave_0 removed [ 518.219941][ T101] bond0 (unregistering): Releasing backup interface bond_slave_1 [ 518.267916][ T101] bond0 (unregistering): Releasing backup interface bond_slave_0 [ 518.355169][ T101] bond0 (unregistering): Released all slaves [ 518.485405][ T101] device hsr_slave_1 left promiscuous mode [ 518.519530][ T101] device hsr_slave_0 left promiscuous mode [ 518.571132][ T101] team0 (unregistering): Port device team_slave_1 removed [ 518.586323][ T101] team0 (unregistering): Port device team_slave_0 removed [ 518.597629][ T101] bond0 (unregistering): Releasing backup interface bond_slave_1 [ 518.647497][ T101] bond0 (unregistering): Releasing backup interface bond_slave_0 [ 518.728647][ T101] bond0 (unregistering): Released all slaves [ 518.835810][ T101] device hsr_slave_1 left promiscuous mode [ 518.866171][ T101] device hsr_slave_0 left promiscuous mode [ 518.906732][ T101] team0 (unregistering): Port device team_slave_1 removed [ 518.923567][ T101] team0 (unregistering): Port device team_slave_0 removed [ 518.940672][ T101] bond0 (unregistering): Releasing backup interface bond_slave_1 [ 518.978608][ T101] bond0 (unregistering): Releasing backup interface bond_slave_0 [ 519.035954][ T101] bond0 (unregistering): Released all slaves [ 519.136134][ T101] device hsr_slave_1 left promiscuous mode [ 519.176996][ T101] device hsr_slave_0 left promiscuous mode [ 519.199083][ T101] team0 (unregistering): Port device team_slave_1 removed [ 519.214424][ T101] team0 (unregistering): Port device team_slave_0 removed [ 519.224495][ T101] bond0 (unregistering): Releasing backup interface bond_slave_1 [ 519.269908][ T101] bond0 (unregistering): Releasing backup interface bond_slave_0 [ 519.342088][ T101] bond0 (unregistering): Released all slaves [ 519.606855][ T101] ------------[ cut here ]------------ [ 519.613178][ T101] ODEBUG: free active (active state 0) object type: timer_list hint: delayed_work_timer_fn+0x0/0x90 [ 519.623995][ T101] WARNING: CPU: 0 PID: 101 at lib/debugobjects.c:328 debug_print_object+0x16a/0x210 [ 519.633339][ T101] Kernel panic - not syncing: panic_on_warn set ... [ 519.639911][ T101] CPU: 0 PID: 101 Comm: kworker/u4:3 Not tainted 5.1.0+ #1 [ 519.647087][ T101] Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011 [ 519.657121][ T101] Workqueue: netns cleanup_net [ 519.661857][ T101] Call Trace: [ 519.665123][ T101] dump_stack+0x113/0x167 [ 519.669432][ T101] ? debug_print_object+0x16a/0x210 [ 519.674598][ T101] panic+0x212/0x41d [ 519.678463][ T101] ? __warn_printk+0xd6/0xd6 [ 519.683041][ T101] __warn.cold.8+0x1b/0x36 [ 519.687532][ T101] ? debug_print_object+0x16a/0x210 [ 519.692749][ T101] report_bug+0x1a4/0x200 [ 519.697051][ T101] do_error_trap+0x11b/0x200 [ 519.701614][ T101] do_invalid_op+0x36/0x40 [ 519.705999][ T101] ? debug_print_object+0x16a/0x210 [ 519.711163][ T101] invalid_op+0x14/0x20 [ 519.715284][ T101] RIP: 0010:debug_print_object+0x16a/0x210 [ 519.721052][ T101] Code: 20 87 48 89 fa 48 c1 ea 03 80 3c 02 00 0f 85 92 00 00 00 48 8b 14 dd e0 21 20 87 4c 89 fe 48 c7 c7 80 17 20 87 e8 19 2b 3d fe <0f> 0b 83 05 49 e2 d4 05 01 48 83 c4 18 5b 41 5c 41 5d 41 5e 41 5f [ 519.740619][ T101] RSP: 0018:ffff8880a95e7840 EFLAGS: 00010082 [ 519.746648][ T101] RAX: 0000000000000000 RBX: 0000000000000003 RCX: 0000000000000000 [ 519.754591][ T101] RDX: 0000000000000004 RSI: 0000000000000008 RDI: ffffffff89cd6be0 [ 519.762534][ T101] RBP: ffff8880a95e7880 R08: ffffed1015d43ef9 R09: ffffed1015d43ef8 [ 519.770486][ T101] R10: ffffed1015d43ef8 R11: ffff8880aea1f7c7 R12: 0000000000000001 [ 519.778430][ T101] R13: ffffffff881a39c0 R14: ffffffff81580cc0 R15: ffffffff87201e00 [ 519.786391][ T101] ? __internal_add_timer+0x1e0/0x1e0 [ 519.791739][ T101] ? _raw_spin_unlock_irqrestore+0x6d/0xd0 [ 519.797514][ T101] debug_check_no_obj_freed+0x264/0x472 [ 519.803028][ T101] kfree+0xbd/0x230 [ 519.806803][ T101] kvfree+0x2c/0x30 [ 519.810581][ T101] netdev_freemem+0x47/0x60 [ 519.815054][ T101] netdev_release+0x6c/0x90 [ 519.819523][ T101] device_release+0x74/0x1d0 [ 519.824082][ T101] kobject_put.cold.9+0x22e/0x281 [ 519.829074][ T101] netdev_run_todo+0x4c4/0x6b0 [ 519.833807][ T101] ? register_netdev+0x30/0x30 [ 519.838543][ T101] ? unregister_netdevice_queue+0xf3/0x240 [ 519.844318][ T101] ? net_set_todo+0x2c/0x130 [ 519.848888][ T101] rtnl_unlock+0x9/0x10 [ 519.853012][ T101] default_device_exit_batch+0x2ec/0x3d0 [ 519.858636][ T101] ? unregister_netdevice_many+0x1f0/0x1f0 [ 519.864411][ T101] ? rtnl_unlock+0x9/0x10 [ 519.868708][ T101] ? default_device_exit+0x1ac/0x230 [ 519.873965][ T101] ? do_wait_intr_irq+0x310/0x310 [ 519.878959][ T101] ops_exit_list.isra.5+0xd9/0x130 [ 519.884039][ T101] cleanup_net+0x363/0x850 [ 519.888422][ T101] ? netns_install+0x170/0x170 [ 519.893158][ T101] process_one_work+0x835/0x16b0 [ 519.898062][ T101] ? pwq_dec_nr_in_flight+0x2c0/0x2c0 [ 519.903406][ T101] ? lock_acquire+0x173/0x3d0 [ 519.908060][ T101] worker_thread+0x85/0xb60 [ 519.912529][ T101] ? __kthread_parkme+0x47/0x190 [ 519.917431][ T101] kthread+0x327/0x3f0 [ 519.921467][ T101] ? process_one_work+0x16b0/0x16b0 [ 519.926638][ T101] ? kthread_cancel_delayed_work_sync+0x10/0x10 [ 519.932845][ T101] ret_from_fork+0x3a/0x50 [ 519.937233][ T101] [ 519.937234][ T101] ====================================================== [ 519.937235][ T101] WARNING: possible circular locking dependency detected [ 519.937236][ T101] 5.1.0+ #1 Not tainted [ 519.937237][ T101] ------------------------------------------------------ [ 519.937238][ T101] kworker/u4:3/101 is trying to acquire lock: [ 519.937238][ T101] 00000000463dee30 ((console_sem).lock){-.-.}, at: down_trylock+0x13/0x70 [ 519.937242][ T101] [ 519.937242][ T101] but task is already holding lock: [ 519.937243][ T101] 000000009bb317f9 (&obj_hash[i].lock){-.-.}, at: debug_check_no_obj_freed+0xad/0x472 [ 519.937246][ T101] [ 519.937247][ T101] which lock already depends on the new lock. [ 519.937248][ T101] [ 519.937248][ T101] [ 519.937249][ T101] the existing dependency chain (in reverse order) is: [ 519.937250][ T101] [ 519.937250][ T101] -> #3 (&obj_hash[i].lock){-.-.}: [ 519.937253][ T101] lock_acquire+0x173/0x3d0 [ 519.937254][ T101] _raw_spin_lock_irqsave+0x99/0xd0 [ 519.937255][ T101] __debug_object_init+0xc3/0xd70 [ 519.937255][ T101] debug_object_init+0x16/0x20 [ 519.937256][ T101] hrtimer_init+0x26/0x220 [ 519.937257][ T101] init_dl_task_timer+0x1b/0x50 [ 519.937258][ T101] __sched_fork+0x211/0x4c0 [ 519.937258][ T101] init_idle+0x75/0x6d0 [ 519.937259][ T101] sched_init+0x935/0x9d4 [ 519.937260][ T101] start_kernel+0x35a/0x6e7 [ 519.937261][ T101] x86_64_start_reservations+0x29/0x2b [ 519.937261][ T101] x86_64_start_kernel+0x76/0x79 [ 519.937262][ T101] secondary_startup_64+0xa4/0xb0 [ 519.937263][ T101] [ 519.937263][ T101] -> #2 (&rq->lock){-.-.}: [ 519.937266][ T101] lock_acquire+0x173/0x3d0 [ 519.937267][ T101] _raw_spin_lock+0x2d/0x40 [ 519.937268][ T101] task_fork_fair+0x65/0x4b0 [ 519.937269][ T101] sched_fork+0x3b0/0x8c0 [ 519.937269][ T101] copy_process.part.38+0x1aab/0x7270 [ 519.937270][ T101] _do_fork+0x15d/0xb90 [ 519.937271][ T101] kernel_thread+0x24/0x30 [ 519.937272][ T101] rest_init+0x21/0x279 [ 519.937272][ T101] arch_call_rest_init+0x9/0xc [ 519.937273][ T101] start_kernel+0x6ae/0x6e7 [ 519.937274][ T101] x86_64_start_reservations+0x29/0x2b [ 519.937275][ T101] x86_64_start_kernel+0x76/0x79 [ 519.937275][ T101] secondary_startup_64+0xa4/0xb0 [ 519.937276][ T101] [ 519.937277][ T101] -> #1 (&p->pi_lock){-.-.}: [ 519.937279][ T101] lock_acquire+0x173/0x3d0 [ 519.937280][ T101] _raw_spin_lock_irqsave+0x99/0xd0 [ 519.937281][ T101] try_to_wake_up+0x90/0xfc0 [ 519.937281][ T101] wake_up_process+0x10/0x20 [ 519.937282][ T101] __up.isra.1+0x136/0x1a0 [ 519.937283][ T101] up+0x95/0xe0 [ 519.937284][ T101] __up_console_sem+0xa0/0x150 [ 519.937284][ T101] console_unlock+0x502/0xb90 [ 519.937285][ T101] vprintk_emit+0x191/0x540 [ 519.937286][ T101] vprintk_default+0x1a/0x20 [ 519.937287][ T101] vprintk_func+0x49/0x12c [ 519.937287][ T101] printk+0x9a/0xc0 [ 519.937288][ T101] do_exit.cold.19+0xd0/0x21e [ 519.937289][ T101] do_group_exit+0xf4/0x2f0 [ 519.937290][ T101] __x64_sys_exit_group+0x39/0x40 [ 519.937291][ T101] do_syscall_64+0xd6/0x4e0 [ 519.937291][ T101] entry_SYSCALL_64_after_hwframe+0x49/0xbe [ 519.937292][ T101] [ 519.937292][ T101] -> #0 ((console_sem).lock){-.-.}: [ 519.937295][ T101] __lock_acquire+0x249a/0x4390 [ 519.937296][ T101] lock_acquire+0x173/0x3d0 [ 519.937297][ T101] _raw_spin_lock_irqsave+0x99/0xd0 [ 519.937297][ T101] down_trylock+0x13/0x70 [ 519.937298][ T101] __down_trylock_console_sem+0x93/0x190 [ 519.937299][ T101] console_trylock+0x11/0x50 [ 519.937300][ T101] vprintk_emit+0x184/0x540 [ 519.937301][ T101] vprintk_default+0x1a/0x20 [ 519.937301][ T101] vprintk_func+0x49/0x12c [ 519.937302][ T101] printk+0x9a/0xc0 [ 519.937303][ T101] __warn_printk+0x86/0xd6 [ 519.937304][ T101] debug_print_object+0x16a/0x210 [ 519.937305][ T101] debug_check_no_obj_freed+0x264/0x472 [ 519.937305][ T101] kfree+0xbd/0x230 [ 519.937306][ T101] kvfree+0x2c/0x30 [ 519.937307][ T101] netdev_freemem+0x47/0x60 [ 519.937307][ T101] netdev_release+0x6c/0x90 [ 519.937308][ T101] device_release+0x74/0x1d0 [ 519.937309][ T101] kobject_put.cold.9+0x22e/0x281 [ 519.937310][ T101] netdev_run_todo+0x4c4/0x6b0 [ 519.937310][ T101] rtnl_unlock+0x9/0x10 [ 519.937311][ T101] default_device_exit_batch+0x2ec/0x3d0 [ 519.937312][ T101] ops_exit_list.isra.5+0xd9/0x130 [ 519.937313][ T101] cleanup_net+0x363/0x850 [ 519.937313][ T101] process_one_work+0x835/0x16b0 [ 519.937314][ T101] worker_thread+0x85/0xb60 [ 519.937315][ T101] kthread+0x327/0x3f0 [ 519.937316][ T101] ret_from_fork+0x3a/0x50 [ 519.937316][ T101] [ 519.937317][ T101] other info that might help us debug this: [ 519.937318][ T101] [ 519.937318][ T101] Chain exists of: [ 519.937319][ T101] (console_sem).lock --> &rq->lock --> &obj_hash[i].lock [ 519.937323][ T101] [ 519.937323][ T101] Possible unsafe locking scenario: [ 519.937324][ T101] [ 519.937325][ T101] CPU0 CPU1 [ 519.937325][ T101] ---- ---- [ 519.937326][ T101] lock(&obj_hash[i].lock); [ 519.937328][ T101] lock(&rq->lock); [ 519.937329][ T101] lock(&obj_hash[i].lock); [ 519.937331][ T101] lock((console_sem).lock); [ 519.937333][ T101] [ 519.937333][ T101] *** DEADLOCK *** [ 519.937334][ T101] [ 519.937335][ T101] 4 locks held by kworker/u4:3/101: [ 519.937335][ T101] #0: 0000000030a1f053 ((wq_completion)netns){+.+.}, at: process_one_work+0x762/0x16b0 [ 519.937339][ T101] #1: 000000009feff629 (net_cleanup_work){+.+.}, at: process_one_work+0x792/0x16b0 [ 519.937342][ T101] #2: 0000000040e48faf (pernet_ops_rwsem){++++}, at: cleanup_net+0xb4/0x850 [ 519.937345][ T101] #3: 000000009bb317f9 (&obj_hash[i].lock){-.-.}, at: debug_check_no_obj_freed+0xad/0x472 [ 519.937348][ T101] [ 519.937349][ T101] stack backtrace: [ 519.937350][ T101] CPU: 0 PID: 101 Comm: kworker/u4:3 Not tainted 5.1.0+ #1 [ 519.937351][ T101] Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011 [ 519.937352][ T101] Workqueue: netns cleanup_net [ 519.937353][ T101] Call Trace: [ 519.937354][ T101] dump_stack+0x113/0x167 [ 519.937355][ T101] print_circular_bug.isra.39.cold.60+0x1bd/0x27d [ 519.937355][ T101] ? save_trace+0xe0/0x290 [ 519.937356][ T101] check_prev_add.constprop.49+0xfe2/0x2380 [ 519.937357][ T101] ? check_usage+0x560/0x560 [ 519.937358][ T101] ? check_prev_add.constprop.49+0x8cc/0x2380 [ 519.937358][ T101] ? __lock_acquire+0x5ea/0x4390 [ 519.937359][ T101] ? __lockdep_reset_lock+0x510/0x510 [ 519.937360][ T101] __lock_acquire+0x249a/0x4390 [ 519.937361][ T101] ? __lockdep_reset_lock+0x510/0x510 [ 519.937361][ T101] ? mark_held_locks+0x130/0x130 [ 519.937362][ T101] ? kvm_sched_clock_read+0x9/0x20 [ 519.937363][ T101] ? sched_clock+0x31/0x40 [ 519.937364][ T101] lock_acquire+0x173/0x3d0 [ 519.937364][ T101] ? down_trylock+0x13/0x70 [ 519.937365][ T101] ? vprintk_emit+0x184/0x540 [ 519.937366][ T101] ? vprintk_emit+0x184/0x540 [ 519.937366][ T101] _raw_spin_lock_irqsave+0x99/0xd0 [ 519.937367][ T101] ? down_trylock+0x13/0x70 [ 519.937368][ T101] down_trylock+0x13/0x70 [ 519.937369][ T101] ? vprintk_emit+0x184/0x540 [ 519.937370][ T101] __down_trylock_console_sem+0x93/0x190 [ 519.937371][ T101] console_trylock+0x11/0x50 [ 519.937372][ T101] vprintk_emit+0x184/0x540 [ 519.937373][ T101] ? __internal_add_timer+0x1e0/0x1e0 [ 519.937374][ T101] vprintk_default+0x1a/0x20 [ 519.937374][ T101] vprintk_func+0x49/0x12c [ 519.937375][ T101] printk+0x9a/0xc0 [ 519.937376][ T101] ? kmsg_dump_rewind_nolock+0xdf/0xdf [ 519.937376][ T101] ? queue_work_node+0x270/0x270 [ 519.937377][ T101] __warn_printk+0x86/0xd6 [ 519.937378][ T101] ? add_taint.cold.5+0x11/0x11 [ 519.937379][ T101] ? __free_object+0xe1/0x1f0 [ 519.937379][ T101] ? lock_downgrade+0x860/0x860 [ 519.937380][ T101] ? _raw_spin_unlock_irqrestore+0x63/0xd0 [ 519.937381][ T101] ? queue_work_node+0x270/0x270 [ 519.937382][ T101] debug_print_object+0x16a/0x210 [ 519.937382][ T101] ? _raw_spin_unlock_irqrestore+0x6d/0xd0 [ 519.937383][ T101] debug_check_no_obj_freed+0x264/0x472 [ 519.937384][ T101] kfree+0xbd/0x230 [ 519.937384][ T101] kvfree+0x2c/0x30 [ 519.937385][ T101] netdev_freemem+0x47/0x60 [ 519.937386][ T101] netdev_release+0x6c/0x90 [ 519.937387][ T101] device_release+0x74/0x1d0 [ 519.937387][ T101] kobject_put.cold.9+0x22e/0x281 [ 519.937388][ T101] netdev_run_todo+0x4c4/0x6b0 [ 519.937389][ T101] ? register_netdev+0x30/0x30 [ 519.937390][ T101] ? unregister_netdevice_queue+0xf3/0x240 [ 519.937390][ T101] ? net_set_todo+0x2c/0x130 [ 519.937391][ T101] rtnl_unlock+0x9/0x10 [ 519.937392][ T101] default_device_exit_batch+0x2ec/0x3d0 [ 519.937393][ T101] ? unregister_netdevice_many+0x1f0/0x1f0 [ 519.937393][ T101] ? rtnl_unlock+0x9/0x10 [ 519.937394][ T101] ? default_device_exit+0x1ac/0x230 [ 519.937395][ T101] ? do_wait_intr_irq+0x310/0x310 [ 519.937395][ T101] ops_exit_list.isra.5+0xd9/0x130 [ 519.937396][ T101] cleanup_net+0x363/0x850 [ 519.937397][ T101] ? netns_install+0x170/0x170 [ 519.937398][ T101] process_one_work+0x835/0x16b0 [ 519.937399][ T101] ? pwq_dec_nr_in_flight+0x2c0/0x2c0 [ 519.937399][ T101] ? lock_acquire+0x173/0x3d0 [ 519.937400][ T101] worker_thread+0x85/0xb60 [ 519.937401][ T101] ? __kthread_parkme+0x47/0x190 [ 519.937402][ T101] kthread+0x327/0x3f0 [ 519.937402][ T101] ? process_one_work+0x16b0/0x16b0 [ 519.937403][ T101] ? kthread_cancel_delayed_work_sync+0x10/0x10 [ 519.937404][ T101] ret_from_fork+0x3a/0x50 [ 519.938576][ T101] Kernel Offset: disabled [ 520.887754][ T101] Rebooting in 86400 seconds..