BUG: workqueue lockup - pool cpus=0 node=0 flags=0x0 nice=0 stuck for 30s! BUG: workqueue lockup - pool cpus=1 node=0 flags=0x0 nice=0 stuck for 30s! Showing busy workqueues and worker pools: workqueue events: flags=0x0 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=6/256 refcnt=7 in-flight: 5480:nsim_fib_event_work nsim_fib_event_work, 1836:request_firmware_work_func, 5045:nsim_fib_event_work nsim_fib_event_work pending: rfkill_global_led_trigger_worker pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=14/256 refcnt=15 pending: 3*nsim_dev_hwstats_traffic_work, psi_avgs_work, nsim_dev_hwstats_traffic_work, 2*rht_deferred_worker, vmstat_shepherd, psi_avgs_work, 4*ovs_dp_masks_rebalance, kfree_rcu_monitor workqueue events_long: flags=0x0 pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=5/256 refcnt=6 pending: 5*defense_work_handler workqueue events_unbound: flags=0x2 pwq 4: cpus=0-1 flags=0x4 nice=0 active=2/512 refcnt=4 in-flight: 3770:fsnotify_connector_destroy_workfn, 6026:fsnotify_mark_destroy_workfn workqueue rcu_gp: flags=0x8 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 in-flight: 5903:wait_rcu_exp_gp pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=2/256 refcnt=3 pending: wait_rcu_exp_gp, process_srcu workqueue mm_percpu_wq: flags=0x8 pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: vmstat_update workqueue dm_bufio_cache: flags=0x8 pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: work_fn workqueue mld: flags=0x40008 pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/1 refcnt=38 pending: mld_ifc_work inactive: 10*mld_dad_work, 3*mld_ifc_work, 3*mld_dad_work, 2*mld_ifc_work, 3*mld_dad_work, 3*mld_ifc_work, 12*mld_dad_work workqueue ipv6_addrconf: flags=0x40008 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/1 refcnt=59 in-flight: 23:addrconf_dad_work inactive: 57*addrconf_dad_work pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/1 refcnt=85 in-flight: 5483:addrconf_dad_work inactive: 83*addrconf_dad_work workqueue wg-kex-wg0: flags=0x24 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker workqueue wg-crypt-wg0: flags=0x28 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_encrypt_worker pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_encrypt_worker workqueue wg-kex-wg1: flags=0x24 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker workqueue wg-crypt-wg1: flags=0x28 pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_encrypt_worker workqueue wg-kex-wg2: flags=0x24 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker workqueue wg-kex-wg0: flags=0x24 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker workqueue wg-crypt-wg0: flags=0x28 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_encrypt_worker workqueue wg-kex-wg1: flags=0x24 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker workqueue wg-crypt-wg1: flags=0x28 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_encrypt_worker workqueue wg-kex-wg2: flags=0x24 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker pool 0: cpus=0 node=0 flags=0x0 nice=0 hung=30s workers=10 idle: 5490 9 1426 7 5482 5948 5965 5958 5959 pool 2: cpus=1 node=0 flags=0x0 nice=0 hung=30s workers=8 idle: 5976 21 5481 pool 4: cpus=0-1 flags=0x4 nice=0 hung=0s workers=7 idle: 26 1598 40 142 10 Showing backtraces of running workers in stalled CPU-bound worker pools: pool 2: task:kworker/1:6 state:R running task stack:0 pid:5903 ppid:2 flags:0x00000008 Workqueue: rcu_gp wait_rcu_exp_gp Call trace: __switch_to+0x320/0x754 arch/arm64/kernel/process.c:556 context_switch kernel/sched/core.c:5343 [inline] __schedule+0x1368/0x23b8 kernel/sched/core.c:6669 preempt_schedule_common+0xe8/0x1dc kernel/sched/core.c:6838 preempt_schedule+0x60/0x80 kernel/sched/core.c:6862 __raw_spin_unlock_irqrestore include/linux/spinlock_api_smp.h:152 [inline] _raw_spin_unlock_irqrestore+0x94/0x98 kernel/locking/spinlock.c:194 spin_unlock_irqrestore include/linux/spinlock.h:405 [inline] __wake_up_common_lock kernel/sched/wait.c:140 [inline] __wake_up+0x11c/0x1a8 kernel/sched/wait.c:160 rcu_exp_wait_wake kernel/rcu/tree_exp.h:711 [inline] rcu_exp_sel_wait_wake+0x21c8/0x2c00 kernel/rcu/tree_exp.h:727 wait_rcu_exp_gp+0x38/0x48 kernel/rcu/tree_exp.h:513 process_one_work+0x788/0x12d4 kernel/workqueue.c:2405 worker_thread+0x8e0/0xfe8 kernel/workqueue.c:2552 kthread+0x288/0x310 kernel/kthread.c:379 ret_from_fork+0x10/0x20 arch/arm64/kernel/entry.S:870