INFO: task kworker/0:1:2276 blocked for more than 143 seconds. Not tainted 5.3.0+ #0 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. kworker/0:1 D27480 2276 2 0x80004000 Workqueue: events linkwatch_event Call Trace: context_switch kernel/sched/core.c:3384 [inline] __schedule+0x74b/0xb80 kernel/sched/core.c:4069 schedule+0x131/0x1e0 kernel/sched/core.c:4136 schedule_preempt_disabled+0x13/0x20 kernel/sched/core.c:4195 __mutex_lock_common+0x1411/0x2e20 kernel/locking/mutex.c:1033 __mutex_lock kernel/locking/mutex.c:1103 [inline] mutex_lock_nested+0x1b/0x30 kernel/locking/mutex.c:1118 rtnl_lock+0x17/0x20 net/core/rtnetlink.c:72 linkwatch_event+0xe/0x60 net/core/link_watch.c:242 process_one_work+0x7ef/0x10e0 kernel/workqueue.c:2269 worker_thread+0xc01/0x1630 kernel/workqueue.c:2415 kthread+0x332/0x350 kernel/kthread.c:255 ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:352 INFO: task kworker/0:3:31987 blocked for more than 143 seconds. Not tainted 5.3.0+ #0 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. kworker/0:3 D27304 31987 2 0x80004000 Workqueue: events switchdev_deferred_process_work Call Trace: context_switch kernel/sched/core.c:3384 [inline] __schedule+0x74b/0xb80 kernel/sched/core.c:4069 schedule+0x131/0x1e0 kernel/sched/core.c:4136 schedule_preempt_disabled+0x13/0x20 kernel/sched/core.c:4195 __mutex_lock_common+0x1411/0x2e20 kernel/locking/mutex.c:1033 __mutex_lock kernel/locking/mutex.c:1103 [inline] mutex_lock_nested+0x1b/0x30 kernel/locking/mutex.c:1118 rtnl_lock+0x17/0x20 net/core/rtnetlink.c:72 switchdev_deferred_process_work+0xe/0x20 net/switchdev/switchdev.c:74 process_one_work+0x7ef/0x10e0 kernel/workqueue.c:2269 worker_thread+0xc01/0x1630 kernel/workqueue.c:2415 kthread+0x332/0x350 kernel/kthread.c:255 ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:352 INFO: task syz-executor.0:20140 blocked for more than 143 seconds. Not tainted 5.3.0+ #0 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. syz-executor.0 D28352 20140 1 0x00004004 Call Trace: context_switch kernel/sched/core.c:3384 [inline] __schedule+0x74b/0xb80 kernel/sched/core.c:4069 schedule+0x131/0x1e0 kernel/sched/core.c:4136 schedule_preempt_disabled+0x13/0x20 kernel/sched/core.c:4195 __mutex_lock_common+0x1411/0x2e20 kernel/locking/mutex.c:1033 __mutex_lock kernel/locking/mutex.c:1103 [inline] mutex_lock_nested+0x1b/0x30 kernel/locking/mutex.c:1118 rtnl_lock net/core/rtnetlink.c:72 [inline] rtnetlink_rcv_msg+0x83c/0xd40 net/core/rtnetlink.c:5220 netlink_rcv_skb+0x19e/0x3d0 net/netlink/af_netlink.c:2477 rtnetlink_rcv+0x1c/0x20 net/core/rtnetlink.c:5241 netlink_unicast_kernel net/netlink/af_netlink.c:1302 [inline] netlink_unicast+0x787/0x8f0 net/netlink/af_netlink.c:1328 netlink_sendmsg+0x993/0xc50 net/netlink/af_netlink.c:1917 sock_sendmsg_nosec net/socket.c:637 [inline] sock_sendmsg net/socket.c:657 [inline] __sys_sendto+0x442/0x5e0 net/socket.c:1952 __do_sys_sendto net/socket.c:1964 [inline] __se_sys_sendto net/socket.c:1960 [inline] __x64_sys_sendto+0xe5/0x100 net/socket.c:1960 do_syscall_64+0xf7/0x1c0 arch/x86/entry/common.c:290 entry_SYSCALL_64_after_hwframe+0x49/0xbe RIP: 0033:0x413873 Code: ff ff ff 0f 1f 40 00 b8 18 fc ff ff e9 56 ff ff ff bf 97 30 44 00 b9 0d 00 00 00 48 89 ee f3 a6 75 0c 48 c7 03 80 39 41 00 e9 <37> ff ff ff bf a4 30 44 00 b9 11 00 00 00 48 89 ee f3 a6 75 0c 48 RSP: 002b:00007ffd00206368 EFLAGS: 00000246 ORIG_RAX: 000000000000002c RAX: ffffffffffffffda RBX: 0000000000000003 RCX: 0000000000413873 RDX: 0000000000000028 RSI: 0000000000a70070 RDI: 0000000000000003 RBP: 00007ffd002063d0 R08: 00007ffd00206370 R09: 000000000000000c R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000003 R13: 00007ffd002066d8 R14: 0000000000000000 R15: 0000000000000000 Showing all locks held in the system: 1 lock held by khungtaskd/1065: #0: ffffffff888d3cc0 (rcu_read_lock){....}, at: rcu_lock_acquire+0x4/0x30 include/linux/rcupdate.h:207 1 lock held by rsyslogd/7875: #0: ffff8880949bd3a0 (&f->f_pos_lock){+.+.}, at: __fdget_pos+0x243/0x2e0 fs/file.c:801 2 locks held by getty/7965: #0: ffff88808beeced0 (&tty->ldisc_sem){++++}, at: tty_ldisc_ref_wait+0x25/0x70 drivers/tty/tty_ldisc.c:272 #1: ffffc90005f252e0 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x221/0x1b00 drivers/tty/n_tty.c:2156 2 locks held by getty/7966: #0: ffff8880844d37d0 (&tty->ldisc_sem){++++}, at: tty_ldisc_ref_wait+0x25/0x70 drivers/tty/tty_ldisc.c:272 #1: ffffc90005f212e0 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x221/0x1b00 drivers/tty/n_tty.c:2156 2 locks held by getty/7967: #0: ffff88808beed750 (&tty->ldisc_sem){++++}, at: tty_ldisc_ref_wait+0x25/0x70 drivers/tty/tty_ldisc.c:272 #1: ffffc90005f192e0 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x221/0x1b00 drivers/tty/n_tty.c:2156 2 locks held by getty/7968: #0: ffff88808d6540d0 (&tty->ldisc_sem){++++}, at: tty_ldisc_ref_wait+0x25/0x70 drivers/tty/tty_ldisc.c:272 #1: ffffc90005f332e0 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x221/0x1b00 drivers/tty/n_tty.c:2156 2 locks held by getty/7969: #0: ffff88808d654950 (&tty->ldisc_sem){++++}, at: tty_ldisc_ref_wait+0x25/0x70 drivers/tty/tty_ldisc.c:272 #1: ffffc90005f2f2e0 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x221/0x1b00 drivers/tty/n_tty.c:2156 2 locks held by getty/7970: #0: ffff88809c358290 (&tty->ldisc_sem){++++}, at: tty_ldisc_ref_wait+0x25/0x70 drivers/tty/tty_ldisc.c:272 #1: ffffc90005f0d2e0 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x221/0x1b00 drivers/tty/n_tty.c:2156 2 locks held by getty/7971: #0: ffff88809c019450 (&tty->ldisc_sem){++++}, at: tty_ldisc_ref_wait+0x25/0x70 drivers/tty/tty_ldisc.c:272 #1: ffffc90005f012e0 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x221/0x1b00 drivers/tty/n_tty.c:2156 5 locks held by kworker/u4:26/18637: 3 locks held by kworker/0:1/2276: #0: ffff8880aa4278e8 ((wq_completion)events){+.+.}, at: spin_unlock_irq include/linux/spinlock.h:388 [inline] #0: ffff8880aa4278e8 ((wq_completion)events){+.+.}, at: process_one_work+0x75d/0x10e0 kernel/workqueue.c:2242 #1: ffff88818a067d78 ((linkwatch_work).work){+.+.}, at: process_one_work+0x79f/0x10e0 kernel/workqueue.c:2244 #2: ffffffff88b02950 (rtnl_mutex){+.+.}, at: rtnl_lock+0x17/0x20 net/core/rtnetlink.c:72 3 locks held by kworker/0:3/31987: #0: ffff8880aa4278e8 ((wq_completion)events){+.+.}, at: spin_unlock_irq include/linux/spinlock.h:388 [inline] #0: ffff8880aa4278e8 ((wq_completion)events){+.+.}, at: process_one_work+0x75d/0x10e0 kernel/workqueue.c:2242 #1: ffff888181a67d78 (deferred_process_work){+.+.}, at: process_one_work+0x79f/0x10e0 kernel/workqueue.c:2244 #2: ffffffff88b02950 (rtnl_mutex){+.+.}, at: rtnl_lock+0x17/0x20 net/core/rtnetlink.c:72 3 locks held by kworker/1:1/10577: #0: ffff88809c583968 ((wq_completion)ipv6_addrconf){+.+.}, at: spin_unlock_irq include/linux/spinlock.h:388 [inline] #0: ffff88809c583968 ((wq_completion)ipv6_addrconf){+.+.}, at: process_one_work+0x75d/0x10e0 kernel/workqueue.c:2242 #1: ffff8881d0dcfd78 ((addr_chk_work).work){+.+.}, at: process_one_work+0x79f/0x10e0 kernel/workqueue.c:2244 #2: ffffffff88b02950 (rtnl_mutex){+.+.}, at: rtnl_lock+0x17/0x20 net/core/rtnetlink.c:72 1 lock held by syz-executor.0/20140: #0: ffffffff88b02950 (rtnl_mutex){+.+.}, at: rtnl_lock net/core/rtnetlink.c:72 [inline] #0: ffffffff88b02950 (rtnl_mutex){+.+.}, at: rtnetlink_rcv_msg+0x83c/0xd40 net/core/rtnetlink.c:5220 ============================================= NMI backtrace for cpu 0 CPU: 0 PID: 1065 Comm: khungtaskd Not tainted 5.3.0+ #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011 Call Trace: __dump_stack lib/dump_stack.c:77 [inline] dump_stack+0x1d8/0x2f8 lib/dump_stack.c:113 nmi_cpu_backtrace+0xaf/0x1a0 lib/nmi_backtrace.c:101 nmi_trigger_cpumask_backtrace+0x174/0x290 lib/nmi_backtrace.c:62 arch_trigger_cpumask_backtrace+0x10/0x20 arch/x86/kernel/apic/hw_nmi.c:38 trigger_all_cpu_backtrace+0x17/0x20 include/linux/nmi.h:146 check_hung_uninterruptible_tasks kernel/hung_task.c:205 [inline] watchdog+0xbb9/0xbd0 kernel/hung_task.c:289 kthread+0x332/0x350 kernel/kthread.c:255 ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:352 Sending NMI from CPU 0 to CPUs 1: NMI backtrace for cpu 1 CPU: 1 PID: 18637 Comm: kworker/u4:26 Not tainted 5.3.0+ #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011 Workqueue: netns cleanup_net RIP: 0010:preempt_count arch/x86/include/asm/preempt.h:26 [inline] RIP: 0010:preempt_count_add+0x3c/0x160 kernel/sched/core.c:3786 Code: 48 c7 c0 40 8d 9e 89 48 c1 e8 03 49 bf 00 00 00 00 00 fc ff df 42 8a 04 38 84 c0 0f 85 ce 00 00 00 83 3d e6 9c 4e 08 00 75 11 <65> 8b 05 69 0d b2 7e 0f b6 c0 3d f5 00 00 00 73 6f 65 8b 05 58 0d RSP: 0018:ffff88805d637908 EFLAGS: 00000246 RAX: 1ffffffff133d100 RBX: 0000000000000001 RCX: ffffffff87718400 RDX: 0000000000000000 RSI: 0000000000000200 RDI: 0000000000000001 RBP: ffff88805d637920 R08: ffff88805d3dad58 R09: fffffbfff12bb6a0 R10: fffffbfff12bb6a0 R11: 0000000000000000 R12: dffffc0000000000 R13: ffff8880a8b2983f R14: 00000000000048e7 R15: dffffc0000000000 FS: 0000000000000000(0000) GS:ffff8880aeb00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 000000c42bb6c4f0 CR3: 0000000088211000 CR4: 00000000001426e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Call Trace: __raw_spin_lock include/linux/spinlock_api_smp.h:141 [inline] _raw_spin_lock+0x12/0x40 kernel/locking/spinlock.c:151 spin_lock include/linux/spinlock.h:338 [inline] nf_conntrack_lock net/netfilter/nf_conntrack_core.c:91 [inline] get_next_corpse net/netfilter/nf_conntrack_core.c:2002 [inline] nf_ct_iterate_cleanup+0xc2/0x390 net/netfilter/nf_conntrack_core.c:2036 nf_ct_iterate_cleanup_net+0xf9/0x150 net/netfilter/nf_conntrack_core.c:2121 masq_device_event+0x9f/0xd0 net/netfilter/nf_nat_masquerade.c:88 notifier_call_chain kernel/notifier.c:95 [inline] __raw_notifier_call_chain kernel/notifier.c:396 [inline] raw_notifier_call_chain+0xec/0x190 kernel/notifier.c:403 call_netdevice_notifiers_info net/core/dev.c:1749 [inline] call_netdevice_notifiers_extack net/core/dev.c:1761 [inline] call_netdevice_notifiers net/core/dev.c:1775 [inline] dev_close_many+0x347/0x4d0 net/core/dev.c:1518 rollback_registered_many+0x44a/0x11c0 net/core/dev.c:8231 unregister_netdevice_many net/core/dev.c:9364 [inline] default_device_exit_batch+0x40f/0x6a0 net/core/dev.c:9835 ops_exit_list net/core/net_namespace.c:175 [inline] cleanup_net+0x70b/0xaa0 net/core/net_namespace.c:594 process_one_work+0x7ef/0x10e0 kernel/workqueue.c:2269 worker_thread+0xc01/0x1630 kernel/workqueue.c:2415 kthread+0x332/0x350 kernel/kthread.c:255 ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:352