INFO: task kworker/1:0:20361 blocked for more than 143 seconds. Not tainted 5.3.0+ #0 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. kworker/1:0 D27000 20361 2 0x80004000 Workqueue: events linkwatch_event Call Trace: context_switch kernel/sched/core.c:3384 [inline] __schedule+0x94f/0x1e70 kernel/sched/core.c:4069 schedule+0xd9/0x260 kernel/sched/core.c:4136 schedule_preempt_disabled+0x13/0x20 kernel/sched/core.c:4195 __mutex_lock_common kernel/locking/mutex.c:1033 [inline] __mutex_lock+0x7b0/0x13c0 kernel/locking/mutex.c:1103 mutex_lock_nested+0x16/0x20 kernel/locking/mutex.c:1118 rtnl_lock+0x17/0x20 net/core/rtnetlink.c:72 linkwatch_event+0xf/0x70 net/core/link_watch.c:242 process_one_work+0x9af/0x1740 kernel/workqueue.c:2269 worker_thread+0x98/0xe40 kernel/workqueue.c:2415 kthread+0x361/0x430 kernel/kthread.c:255 ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:352 INFO: task kworker/1:3:22561 blocked for more than 143 seconds. Not tainted 5.3.0+ #0 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. kworker/1:3 D27000 22561 2 0x80004000 Workqueue: events switchdev_deferred_process_work Call Trace: context_switch kernel/sched/core.c:3384 [inline] __schedule+0x94f/0x1e70 kernel/sched/core.c:4069 schedule+0xd9/0x260 kernel/sched/core.c:4136 schedule_preempt_disabled+0x13/0x20 kernel/sched/core.c:4195 __mutex_lock_common kernel/locking/mutex.c:1033 [inline] __mutex_lock+0x7b0/0x13c0 kernel/locking/mutex.c:1103 mutex_lock_nested+0x16/0x20 kernel/locking/mutex.c:1118 rtnl_lock+0x17/0x20 net/core/rtnetlink.c:72 switchdev_deferred_process_work+0xe/0x20 net/switchdev/switchdev.c:74 process_one_work+0x9af/0x1740 kernel/workqueue.c:2269 worker_thread+0x98/0xe40 kernel/workqueue.c:2415 kthread+0x361/0x430 kernel/kthread.c:255 ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:352 INFO: task syz-executor.0:6694 blocked for more than 144 seconds. Not tainted 5.3.0+ #0 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. syz-executor.0 D28136 6694 1 0x00000004 Call Trace: context_switch kernel/sched/core.c:3384 [inline] __schedule+0x94f/0x1e70 kernel/sched/core.c:4069 schedule+0xd9/0x260 kernel/sched/core.c:4136 schedule_preempt_disabled+0x13/0x20 kernel/sched/core.c:4195 __mutex_lock_common kernel/locking/mutex.c:1033 [inline] __mutex_lock+0x7b0/0x13c0 kernel/locking/mutex.c:1103 mutex_lock_nested+0x16/0x20 kernel/locking/mutex.c:1118 rtnl_lock net/core/rtnetlink.c:72 [inline] rtnetlink_rcv_msg+0x40a/0xb00 net/core/rtnetlink.c:5383 netlink_rcv_skb+0x177/0x450 net/netlink/af_netlink.c:2477 rtnetlink_rcv+0x1d/0x30 net/core/rtnetlink.c:5404 netlink_unicast_kernel net/netlink/af_netlink.c:1302 [inline] netlink_unicast+0x531/0x710 net/netlink/af_netlink.c:1328 netlink_sendmsg+0x8a5/0xd60 net/netlink/af_netlink.c:1917 sock_sendmsg_nosec net/socket.c:637 [inline] sock_sendmsg+0xd7/0x130 net/socket.c:657 __sys_sendto+0x262/0x380 net/socket.c:1952 __do_sys_sendto net/socket.c:1964 [inline] __se_sys_sendto net/socket.c:1960 [inline] __x64_sys_sendto+0xe1/0x1a0 net/socket.c:1960 do_syscall_64+0xfa/0x760 arch/x86/entry/common.c:290 entry_SYSCALL_64_after_hwframe+0x49/0xbe RIP: 0033:0x4138a3 Code: 30 44 00 b9 11 00 00 00 48 89 ee f3 a6 75 0c 48 c7 03 b0 39 41 00 e9 1a ff ff ff bf b5 30 44 00 b9 18 00 00 00 48 89 ee f3 a6 <75> 0c 48 c7 03 10 37 41 00 e9 fd fe ff ff bf cd 30 44 00 b9 0a 00 RSP: 002b:00007fff94479b38 EFLAGS: 00000246 ORIG_RAX: 000000000000002c RAX: ffffffffffffffda RBX: 0000000000000003 RCX: 00000000004138a3 RDX: 0000000000000028 RSI: 0000000000a70070 RDI: 0000000000000003 RBP: 00007fff94479ba0 R08: 00007fff94479b40 R09: 000000000000000c R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000003 R13: 00007fff94479ea8 R14: 0000000000000000 R15: 0000000000000000 Showing all locks held in the system: 7 locks held by kworker/u4:0/7: #0: ffff8880a99abe68 ((wq_completion)netns){+.+.}, at: __write_once_size include/linux/compiler.h:226 [inline] #0: ffff8880a99abe68 ((wq_completion)netns){+.+.}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline] #0: ffff8880a99abe68 ((wq_completion)netns){+.+.}, at: atomic64_set include/asm-generic/atomic-instrumented.h:855 [inline] #0: ffff8880a99abe68 ((wq_completion)netns){+.+.}, at: atomic_long_set include/asm-generic/atomic-long.h:40 [inline] #0: ffff8880a99abe68 ((wq_completion)netns){+.+.}, at: set_work_data kernel/workqueue.c:620 [inline] #0: ffff8880a99abe68 ((wq_completion)netns){+.+.}, at: set_work_pool_and_clear_pending kernel/workqueue.c:647 [inline] #0: ffff8880a99abe68 ((wq_completion)netns){+.+.}, at: process_one_work+0x88b/0x1740 kernel/workqueue.c:2240 #1: ffff8880a98a7dc0 (net_cleanup_work){+.+.}, at: process_one_work+0x8c1/0x1740 kernel/workqueue.c:2244 #2: ffffffff8998aa88 (pernet_ops_rwsem){++++}, at: cleanup_net+0xae/0xa60 net/core/net_namespace.c:556 #3: ffffffff89997ce0 (rtnl_mutex){+.+.}, at: rtnl_lock+0x17/0x20 net/core/rtnetlink.c:72 #4: ffff8880ae834d18 (&rq->lock){-.-.}, at: rq_lock kernel/sched/sched.h:1215 [inline] #4: ffff8880ae834d18 (&rq->lock){-.-.}, at: __schedule+0x266/0x1e70 kernel/sched/core.c:4017 #5: ffffffff88faad00 (rcu_read_lock){....}, at: trace_sched_stat_runtime include/trace/events/sched.h:435 [inline] #5: ffffffff88faad00 (rcu_read_lock){....}, at: update_curr+0x2ea/0x8d0 kernel/sched/fair.c:860 #6: ffffffff88fa00b8 (console_owner_lock){-.-.}, at: console_lock_spinning_disable_and_check kernel/printk/printk.c:1676 [inline] #6: ffffffff88fa00b8 (console_owner_lock){-.-.}, at: console_unlock+0x9a3/0xf10 kernel/printk/printk.c:2476 1 lock held by khungtaskd/1064: #0: ffffffff88faad00 (rcu_read_lock){....}, at: debug_show_all_locks+0x5f/0x27e kernel/locking/lockdep.c:5337 1 lock held by rsyslogd/8453: #0: ffff8880a7fb2660 (&f->f_pos_lock){+.+.}, at: __fdget_pos+0xee/0x110 fs/file.c:801 2 locks held by getty/8543: #0: ffff8880905b31d0 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:340 #1: ffffc90005f112e0 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1c10 drivers/tty/n_tty.c:2156 2 locks held by getty/8544: #0: ffff88808d52f490 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:340 #1: ffffc90005f292e0 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1c10 drivers/tty/n_tty.c:2156 2 locks held by getty/8545: #0: ffff88808d01cbd0 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:340 #1: ffffc90005f252e0 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1c10 drivers/tty/n_tty.c:2156 2 locks held by getty/8546: #0: ffff8880a8a5b4d0 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:340 #1: ffffc90005f312e0 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1c10 drivers/tty/n_tty.c:2156 2 locks held by getty/8547: #0: ffff88808d01c350 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:340 #1: ffffc90005f2d2e0 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1c10 drivers/tty/n_tty.c:2156 2 locks held by getty/8548: #0: ffff8880a8a1e310 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:340 #1: ffffc90005f212e0 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1c10 drivers/tty/n_tty.c:2156 2 locks held by getty/8549: #0: ffff88808a6360d0 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:340 #1: ffffc90005f012e0 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1c10 drivers/tty/n_tty.c:2156 2 locks held by kworker/u4:5/28676: 3 locks held by kworker/1:0/20361: #0: ffff8880aa4278e8 ((wq_completion)events){+.+.}, at: __write_once_size include/linux/compiler.h:226 [inline] #0: ffff8880aa4278e8 ((wq_completion)events){+.+.}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline] #0: ffff8880aa4278e8 ((wq_completion)events){+.+.}, at: atomic64_set include/asm-generic/atomic-instrumented.h:855 [inline] #0: ffff8880aa4278e8 ((wq_completion)events){+.+.}, at: atomic_long_set include/asm-generic/atomic-long.h:40 [inline] #0: ffff8880aa4278e8 ((wq_completion)events){+.+.}, at: set_work_data kernel/workqueue.c:620 [inline] #0: ffff8880aa4278e8 ((wq_completion)events){+.+.}, at: set_work_pool_and_clear_pending kernel/workqueue.c:647 [inline] #0: ffff8880aa4278e8 ((wq_completion)events){+.+.}, at: process_one_work+0x88b/0x1740 kernel/workqueue.c:2240 #1: ffff8880414dfdc0 ((linkwatch_work).work){+.+.}, at: process_one_work+0x8c1/0x1740 kernel/workqueue.c:2244 #2: ffffffff89997ce0 (rtnl_mutex){+.+.}, at: rtnl_lock+0x17/0x20 net/core/rtnetlink.c:72 3 locks held by kworker/1:3/22561: #0: ffff8880aa4278e8 ((wq_completion)events){+.+.}, at: __write_once_size include/linux/compiler.h:226 [inline] #0: ffff8880aa4278e8 ((wq_completion)events){+.+.}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline] #0: ffff8880aa4278e8 ((wq_completion)events){+.+.}, at: atomic64_set include/asm-generic/atomic-instrumented.h:855 [inline] #0: ffff8880aa4278e8 ((wq_completion)events){+.+.}, at: atomic_long_set include/asm-generic/atomic-long.h:40 [inline] #0: ffff8880aa4278e8 ((wq_completion)events){+.+.}, at: set_work_data kernel/workqueue.c:620 [inline] #0: ffff8880aa4278e8 ((wq_completion)events){+.+.}, at: set_work_pool_and_clear_pending kernel/workqueue.c:647 [inline] #0: ffff8880aa4278e8 ((wq_completion)events){+.+.}, at: process_one_work+0x88b/0x1740 kernel/workqueue.c:2240 #1: ffff8880a1c2fdc0 (deferred_process_work){+.+.}, at: process_one_work+0x8c1/0x1740 kernel/workqueue.c:2244 #2: ffffffff89997ce0 (rtnl_mutex){+.+.}, at: rtnl_lock+0x17/0x20 net/core/rtnetlink.c:72 3 locks held by kworker/0:5/1063: #0: ffff88809cd4b3a8 ((wq_completion)ipv6_addrconf){+.+.}, at: __write_once_size include/linux/compiler.h:226 [inline] #0: ffff88809cd4b3a8 ((wq_completion)ipv6_addrconf){+.+.}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline] #0: ffff88809cd4b3a8 ((wq_completion)ipv6_addrconf){+.+.}, at: atomic64_set include/asm-generic/atomic-instrumented.h:855 [inline] #0: ffff88809cd4b3a8 ((wq_completion)ipv6_addrconf){+.+.}, at: atomic_long_set include/asm-generic/atomic-long.h:40 [inline] #0: ffff88809cd4b3a8 ((wq_completion)ipv6_addrconf){+.+.}, at: set_work_data kernel/workqueue.c:620 [inline] #0: ffff88809cd4b3a8 ((wq_completion)ipv6_addrconf){+.+.}, at: set_work_pool_and_clear_pending kernel/workqueue.c:647 [inline] #0: ffff88809cd4b3a8 ((wq_completion)ipv6_addrconf){+.+.}, at: process_one_work+0x88b/0x1740 kernel/workqueue.c:2240 #1: ffff88808ebc7dc0 ((addr_chk_work).work){+.+.}, at: process_one_work+0x8c1/0x1740 kernel/workqueue.c:2244 #2: ffffffff89997ce0 (rtnl_mutex){+.+.}, at: rtnl_lock+0x17/0x20 net/core/rtnetlink.c:72 1 lock held by syz-executor.0/6694: #0: ffffffff89997ce0 (rtnl_mutex){+.+.}, at: rtnl_lock net/core/rtnetlink.c:72 [inline] #0: ffffffff89997ce0 (rtnl_mutex){+.+.}, at: rtnetlink_rcv_msg+0x40a/0xb00 net/core/rtnetlink.c:5383 ============================================= NMI backtrace for cpu 1 CPU: 1 PID: 1064 Comm: khungtaskd Not tainted 5.3.0+ #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011 Call Trace: __dump_stack lib/dump_stack.c:77 [inline] dump_stack+0x172/0x1f0 lib/dump_stack.c:113 nmi_cpu_backtrace.cold+0x70/0xb2 lib/nmi_backtrace.c:101 nmi_trigger_cpumask_backtrace+0x23b/0x28b lib/nmi_backtrace.c:62 arch_trigger_cpumask_backtrace+0x14/0x20 arch/x86/kernel/apic/hw_nmi.c:38 trigger_all_cpu_backtrace include/linux/nmi.h:146 [inline] check_hung_uninterruptible_tasks kernel/hung_task.c:205 [inline] watchdog+0x9d0/0xef0 kernel/hung_task.c:289 kthread+0x361/0x430 kernel/kthread.c:255 ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:352 Sending NMI from CPU 1 to CPUs 0: NMI backtrace for cpu 0 CPU: 0 PID: 28676 Comm: kworker/u4:5 Not tainted 5.3.0+ #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011 Workqueue: bat_events batadv_nc_worker RIP: 0010:rol32 include/linux/bitops.h:83 [inline] RIP: 0010:iterate_chain_key kernel/locking/lockdep.c:368 [inline] RIP: 0010:__lock_acquire+0x6f5/0x4a00 kernel/locking/lockdep.c:3943 Code: 89 e0 41 01 cc c1 c0 06 31 d0 89 c2 29 c1 44 01 e0 c1 c2 08 31 d1 89 ca 41 29 cc c1 c2 10 41 31 d4 8d 14 01 44 89 e1 44 29 e0 c9 0d 89 d6 41 01 d4 31 c8 89 c1 29 c6 44 01 e0 c1 c1 04 31 f1 RSP: 0018:ffff88803e897b38 EFLAGS: 00000087 RAX: 00000000e4070487 RBX: 0000000000000000 RCX: 00000000d4370666 RDX: 00000000646fa7b0 RSI: 00000000c4d30c7e RDI: ffff88807aa35009 RBP: ffff88803e897c50 R08: 1ffffffff14ee12c R09: fffffbfff14ee12d R10: ffff88807aa34fe8 R11: ffff88807aa34700 R12: 00000000d4370666 R13: c4d30c7eba370655 R14: ffff88807aa34fc0 R15: 0000000000000000 FS: 0000000000000000(0000) GS:ffff8880ae800000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: ffffffffff600400 CR3: 000000008bb48000 CR4: 00000000001406f0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600 Call Trace: lock_acquire+0x190/0x410 kernel/locking/lockdep.c:4487 rcu_lock_acquire include/linux/rcupdate.h:208 [inline] rcu_read_lock include/linux/rcupdate.h:599 [inline] batadv_nc_purge_orig_hash net/batman-adv/network-coding.c:407 [inline] batadv_nc_worker+0x117/0x760 net/batman-adv/network-coding.c:718 process_one_work+0x9af/0x1740 kernel/workqueue.c:2269 worker_thread+0x98/0xe40 kernel/workqueue.c:2415 kthread+0x361/0x430 kernel/kthread.c:255 ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:352