INFO: task kworker/1:2:1476 blocked for more than 143 seconds. Not tainted 5.1.0-rc3+ #8 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. kworker/1:2 D23392 1476 2 0x80000000 Workqueue: events request_firmware_work_func Call Trace: schedule+0x8a/0x170 kernel/sched/core.c:3562 schedule_preempt_disabled+0xc/0x20 kernel/sched/core.c:3620 __mutex_lock_common kernel/locking/mutex.c:1002 [inline] __mutex_lock+0x7fb/0x12b0 kernel/locking/mutex.c:1072 device_lock include/linux/device.h:1207 [inline] p54u_load_firmware_cb.cold+0xf8/0x13a drivers/net/wireless/intersil/p54/p54usb.c:941 request_firmware_work_func+0x128/0x244 drivers/base/firmware_loader/main.c:785 process_one_work+0x90a/0x1580 kernel/workqueue.c:2269 worker_thread+0x96/0xe20 kernel/workqueue.c:2415 kthread+0x30e/0x420 kernel/kthread.c:253 ret_from_fork+0x3a/0x50 arch/x86/entry/entry_64.S:352 Showing all locks held in the system: 1 lock held by khungtaskd/1333: #0: 00000000cdb9567e (rcu_read_lock){....}, at: debug_show_all_locks+0x53/0x269 kernel/locking/lockdep.c:5059 3 locks held by kworker/1:2/1476: #0: 000000008eea486a ((wq_completion)events){+.+.}, at: __write_once_size include/linux/compiler.h:220 [inline] #0: 000000008eea486a ((wq_completion)events){+.+.}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline] #0: 000000008eea486a ((wq_completion)events){+.+.}, at: atomic64_set include/asm-generic/atomic-instrumented.h:855 [inline] #0: 000000008eea486a ((wq_completion)events){+.+.}, at: atomic_long_set include/asm-generic/atomic-long.h:40 [inline] #0: 000000008eea486a ((wq_completion)events){+.+.}, at: set_work_data kernel/workqueue.c:619 [inline] #0: 000000008eea486a ((wq_completion)events){+.+.}, at: set_work_pool_and_clear_pending kernel/workqueue.c:646 [inline] #0: 000000008eea486a ((wq_completion)events){+.+.}, at: process_one_work+0x81a/0x1580 kernel/workqueue.c:2240 #1: 00000000c5bed701 ((work_completion)(&fw_work->work)){+.+.}, at: process_one_work+0x84e/0x1580 kernel/workqueue.c:2244 #2: 00000000e89e23e6 (&dev->mutex){....}, at: device_lock include/linux/device.h:1207 [inline] #2: 00000000e89e23e6 (&dev->mutex){....}, at: p54u_load_firmware_cb.cold+0xf8/0x13a drivers/net/wireless/intersil/p54/p54usb.c:941 1 lock held by rsyslogd/4479: 2 locks held by getty/4568: #0: 00000000099dfdaa (&tty->ldisc_sem){++++}, at: tty_ldisc_ref_wait+0x22/0x80 drivers/tty/tty_ldisc.c:272 #1: 00000000e90b3978 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x217/0x1a50 drivers/tty/n_tty.c:2156 2 locks held by getty/4569: #0: 000000009a515eaa (&tty->ldisc_sem){++++}, at: tty_ldisc_ref_wait+0x22/0x80 drivers/tty/tty_ldisc.c:272 #1: 0000000012c52908 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x217/0x1a50 drivers/tty/n_tty.c:2156 2 locks held by getty/4570: #0: 000000002874ccc1 (&tty->ldisc_sem){++++}, at: tty_ldisc_ref_wait+0x22/0x80 drivers/tty/tty_ldisc.c:272 #1: 0000000057244130 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x217/0x1a50 drivers/tty/n_tty.c:2156 2 locks held by getty/4571: #0: 00000000b35a60ce (&tty->ldisc_sem){++++}, at: tty_ldisc_ref_wait+0x22/0x80 drivers/tty/tty_ldisc.c:272 #1: 0000000080164ab2 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x217/0x1a50 drivers/tty/n_tty.c:2156 2 locks held by getty/4572: #0: 000000007fb36900 (&tty->ldisc_sem){++++}, at: tty_ldisc_ref_wait+0x22/0x80 drivers/tty/tty_ldisc.c:272 #1: 0000000085399cf1 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x217/0x1a50 drivers/tty/n_tty.c:2156 2 locks held by getty/4573: #0: 000000002a1df872 (&tty->ldisc_sem){++++}, at: tty_ldisc_ref_wait+0x22/0x80 drivers/tty/tty_ldisc.c:272 #1: 000000009067388c (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x217/0x1a50 drivers/tty/n_tty.c:2156 2 locks held by getty/4574: #0: 00000000b9d3e353 (&tty->ldisc_sem){++++}, at: tty_ldisc_ref_wait+0x22/0x80 drivers/tty/tty_ldisc.c:272 #1: 00000000b595a26f (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x217/0x1a50 drivers/tty/n_tty.c:2156 6 locks held by kworker/0:2/4815: #0: 00000000619520bb ((wq_completion)usb_hub_wq){+.+.}, at: __write_once_size include/linux/compiler.h:220 [inline] #0: 00000000619520bb ((wq_completion)usb_hub_wq){+.+.}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline] #0: 00000000619520bb ((wq_completion)usb_hub_wq){+.+.}, at: atomic64_set include/asm-generic/atomic-instrumented.h:855 [inline] #0: 00000000619520bb ((wq_completion)usb_hub_wq){+.+.}, at: atomic_long_set include/asm-generic/atomic-long.h:40 [inline] #0: 00000000619520bb ((wq_completion)usb_hub_wq){+.+.}, at: set_work_data kernel/workqueue.c:619 [inline] #0: 00000000619520bb ((wq_completion)usb_hub_wq){+.+.}, at: set_work_pool_and_clear_pending kernel/workqueue.c:646 [inline] #0: 00000000619520bb ((wq_completion)usb_hub_wq){+.+.}, at: process_one_work+0x81a/0x1580 kernel/workqueue.c:2240 #1: 00000000c5fa77d0 ((work_completion)(&hub->events)){+.+.}, at: process_one_work+0x84e/0x1580 kernel/workqueue.c:2244 #2: 00000000d628bd17 (&dev->mutex){....}, at: device_lock include/linux/device.h:1207 [inline] #2: 00000000d628bd17 (&dev->mutex){....}, at: hub_event+0x179/0x35a0 drivers/usb/core/hub.c:5378 #3: 00000000c567f968 (&port_dev->status_lock){+.+.}, at: usb_lock_port drivers/usb/core/hub.c:2994 [inline] #3: 00000000c567f968 (&port_dev->status_lock){+.+.}, at: hub_port_connect drivers/usb/core/hub.c:5020 [inline] #3: 00000000c567f968 (&port_dev->status_lock){+.+.}, at: hub_port_connect_change drivers/usb/core/hub.c:5204 [inline] #3: 00000000c567f968 (&port_dev->status_lock){+.+.}, at: port_event drivers/usb/core/hub.c:5350 [inline] #3: 00000000c567f968 (&port_dev->status_lock){+.+.}, at: hub_event+0x18d7/0x35a0 drivers/usb/core/hub.c:5432 #4: 0000000035f59294 (hcd->address0_mutex){+.+.}, at: hub_port_init+0x1b6/0x2c20 drivers/usb/core/hub.c:4529 #5: 000000009fd95ab7 (ehci_cf_port_reset_rwsem){.+.+}, at: hub_port_reset+0x17a/0x1440 drivers/usb/core/hub.c:2856 7 locks held by kworker/1:4/5610: 6 locks held by kworker/1:5/5622: 6 locks held by kworker/0:5/5696: #0: 00000000619520bb ((wq_completion)usb_hub_wq){+.+.}, at: __write_once_size include/linux/compiler.h:220 [inline] #0: 00000000619520bb ((wq_completion)usb_hub_wq){+.+.}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline] #0: 00000000619520bb ((wq_completion)usb_hub_wq){+.+.}, at: atomic64_set include/asm-generic/atomic-instrumented.h:855 [inline] #0: 00000000619520bb ((wq_completion)usb_hub_wq){+.+.}, at: atomic_long_set include/asm-generic/atomic-long.h:40 [inline] #0: 00000000619520bb ((wq_completion)usb_hub_wq){+.+.}, at: set_work_data kernel/workqueue.c:619 [inline] #0: 00000000619520bb ((wq_completion)usb_hub_wq){+.+.}, at: set_work_pool_and_clear_pending kernel/workqueue.c:646 [inline] #0: 00000000619520bb ((wq_completion)usb_hub_wq){+.+.}, at: process_one_work+0x81a/0x1580 kernel/workqueue.c:2240 #1: 000000006a50d904 ((work_completion)(&hub->events)){+.+.}, at: process_one_work+0x84e/0x1580 kernel/workqueue.c:2244 #2: 00000000f6e0adb9 (&dev->mutex){....}, at: device_lock include/linux/device.h:1207 [inline] #2: 00000000f6e0adb9 (&dev->mutex){....}, at: hub_event+0x179/0x35a0 drivers/usb/core/hub.c:5378 #3: 000000007cc21c01 (&port_dev->status_lock){+.+.}, at: usb_lock_port drivers/usb/core/hub.c:2994 [inline] #3: 000000007cc21c01 (&port_dev->status_lock){+.+.}, at: hub_port_connect drivers/usb/core/hub.c:5020 [inline] #3: 000000007cc21c01 (&port_dev->status_lock){+.+.}, at: hub_port_connect_change drivers/usb/core/hub.c:5204 [inline] #3: 000000007cc21c01 (&port_dev->status_lock){+.+.}, at: port_event drivers/usb/core/hub.c:5350 [inline] #3: 000000007cc21c01 (&port_dev->status_lock){+.+.}, at: hub_event+0x18d7/0x35a0 drivers/usb/core/hub.c:5432 #4: 0000000005ca3edf (hcd->address0_mutex){+.+.}, at: hub_port_init+0x1b6/0x2c20 drivers/usb/core/hub.c:4529 #5: 000000009fd95ab7 (ehci_cf_port_reset_rwsem){.+.+}, at: hub_port_reset+0x17a/0x1440 drivers/usb/core/hub.c:2856 7 locks held by kworker/0:6/6233: #0: 00000000619520bb ((wq_completion)usb_hub_wq){+.+.}, at: __write_once_size include/linux/compiler.h:220 [inline] #0: 00000000619520bb ((wq_completion)usb_hub_wq){+.+.}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline] #0: 00000000619520bb ((wq_completion)usb_hub_wq){+.+.}, at: atomic64_set include/asm-generic/atomic-instrumented.h:855 [inline] #0: 00000000619520bb ((wq_completion)usb_hub_wq){+.+.}, at: atomic_long_set include/asm-generic/atomic-long.h:40 [inline] #0: 00000000619520bb ((wq_completion)usb_hub_wq){+.+.}, at: set_work_data kernel/workqueue.c:619 [inline] #0: 00000000619520bb ((wq_completion)usb_hub_wq){+.+.}, at: set_work_pool_and_clear_pending kernel/workqueue.c:646 [inline] #0: 00000000619520bb ((wq_completion)usb_hub_wq){+.+.}, at: process_one_work+0x81a/0x1580 kernel/workqueue.c:2240 #1: 0000000066c572c7 ((work_completion)(&hub->events)){+.+.}, at: process_one_work+0x84e/0x1580 kernel/workqueue.c:2244 #2: 00000000b1beae2f (&dev->mutex){....}, at: device_lock include/linux/device.h:1207 [inline] #2: 00000000b1beae2f (&dev->mutex){....}, at: hub_event+0x179/0x35a0 drivers/usb/core/hub.c:5378 #3: 00000000c2843911 (&port_dev->status_lock){+.+.}, at: usb_lock_port drivers/usb/core/hub.c:2994 [inline] #3: 00000000c2843911 (&port_dev->status_lock){+.+.}, at: hub_port_connect drivers/usb/core/hub.c:5020 [inline] #3: 00000000c2843911 (&port_dev->status_lock){+.+.}, at: hub_port_connect_change drivers/usb/core/hub.c:5204 [inline] #3: 00000000c2843911 (&port_dev->status_lock){+.+.}, at: port_event drivers/usb/core/hub.c:5350 [inline] #3: 00000000c2843911 (&port_dev->status_lock){+.+.}, at: hub_event+0x18d7/0x35a0 drivers/usb/core/hub.c:5432 #4: 00000000c24f2680 (hcd->address0_mutex){+.+.}, at: hub_port_init+0x1b6/0x2c20 drivers/usb/core/hub.c:4529 #5: 000000009fd95ab7 (ehci_cf_port_reset_rwsem){.+.+}, at: hub_port_reset+0x17a/0x1440 drivers/usb/core/hub.c:2856 #6: 000000007e9fefaa (&rq->lock){-.-.}, at: rq_lock kernel/sched/sched.h:1168 [inline] #6: 000000007e9fefaa (&rq->lock){-.-.}, at: __schedule+0x1e1/0x1b20 kernel/sched/core.c:3456 3 locks held by kworker/1:3/10826: ============================================= NMI backtrace for cpu 1 CPU: 1 PID: 1333 Comm: khungtaskd Not tainted 5.1.0-rc3+ #8 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011 Call Trace: __dump_stack lib/dump_stack.c:77 [inline] dump_stack+0xca/0x13e lib/dump_stack.c:113 nmi_cpu_backtrace.cold+0x48/0x87 lib/nmi_backtrace.c:101 nmi_trigger_cpumask_backtrace+0x1a6/0x1bd lib/nmi_backtrace.c:62 trigger_all_cpu_backtrace include/linux/nmi.h:146 [inline] check_hung_uninterruptible_tasks kernel/hung_task.c:204 [inline] watchdog+0x989/0xe20 kernel/hung_task.c:288 kthread+0x30e/0x420 kernel/kthread.c:253 ret_from_fork+0x3a/0x50 arch/x86/entry/entry_64.S:352 Sending NMI from CPU 1 to CPUs 0: NMI backtrace for cpu 0 skipped: idling at native_safe_halt arch/x86/include/asm/irqflags.h:57 [inline] NMI backtrace for cpu 0 skipped: idling at arch_safe_halt arch/x86/include/asm/irqflags.h:99 [inline] NMI backtrace for cpu 0 skipped: idling at default_idle+0x1c/0x2a0 arch/x86/kernel/process.c:576