A link change request failed with some changes committed already. Interface syz_tun may have been left with an inconsistent configuration, please check. A link change request failed with some changes committed already. Interface syz_tun may have been left with an inconsistent configuration, please check. BUG: workqueue lockup - pool cpus=0 INFO: task kworker/u4:0:5 blocked for more than 140 seconds. Not tainted 4.14.138+ #32 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. kworker/u4:0 D node=0 26112 5 2 0x80000000 flags=0x0 nice=0 Workqueue: events_unbound fsnotify_mark_destroy_workfn stuck for 187s! Showing busy workqueues and worker pools: Call Trace: workqueue events: flags=0x0 pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=4/256 in-flight: 7129:rtc_timer_do_work pending: vmstat_shepherd, key_garbage_collector, wait_rcu_exp_gp ====================================================== WARNING: possible circular locking dependency detected 4.14.138+ #32 Not tainted ------------------------------------------------------ kworker/0:0/7129 is trying to acquire lock: (console_owner){-.-.}, at: [<00000000d9eba3ee>] console_trylock_spinning kernel/printk/printk.c:1652 [inline] (console_owner){-.-.}, at: [<00000000d9eba3ee>] vprintk_emit+0x1b8/0x330 kernel/printk/printk.c:1916 but task is already holding lock: (&(&pool->lock)->rlock){-.-.}, at: [<00000000671923ad>] show_workqueue_state kernel/workqueue.c:4518 [inline] (&(&pool->lock)->rlock){-.-.}, at: [<00000000671923ad>] show_workqueue_state.cold+0x22f/0xeb3 kernel/workqueue.c:4491 which lock already depends on the new lock. the existing dependency chain (in reverse order) is: -> #4 (&(&pool->lock)->rlock){-.-.}: __raw_spin_lock include/linux/spinlock_api_smp.h:142 [inline] _raw_spin_lock+0x2a/0x40 kernel/locking/spinlock.c:152 spin_lock include/linux/spinlock.h:317 [inline] __queue_work+0x188/0xdd0 kernel/workqueue.c:1439 queue_work_on+0x8e/0xa0 kernel/workqueue.c:1508 queue_work include/linux/workqueue.h:491 [inline] schedule_work include/linux/workqueue.h:549 [inline] put_pwq kernel/workqueue.c:1112 [inline] put_pwq+0x129/0x180 kernel/workqueue.c:1097 put_pwq_unlocked.part.0+0x30/0x70 kernel/workqueue.c:1129 put_pwq_unlocked kernel/workqueue.c:1123 [inline] destroy_workqueue+0x4c3/0x5e0 kernel/workqueue.c:4173 ext4_fill_super+0x68f7/0xb210 fs/ext4/super.c:4493 mount_bdev+0x2b6/0x360 fs/super.c:1149 mount_fs+0x277/0x312 fs/super.c:1255 vfs_kern_mount.part.0+0xc7/0x4a0 fs/namespace.c:1056 vfs_kern_mount fs/namespace.c:1038 [inline] do_new_mount fs/namespace.c:2573 [inline] do_mount+0x3f6/0x26a0 fs/namespace.c:2903 SYSC_mount fs/namespace.c:3119 [inline] SyS_mount+0xa8/0x120 fs/namespace.c:3096 do_syscall_64+0x19b/0x520 arch/x86/entry/common.c:292 entry_SYSCALL_64_after_hwframe+0x42/0xb7 -> #3 (&pool->lock/1){..-.}: __raw_spin_lock include/linux/spinlock_api_smp.h:142 [inline] _raw_spin_lock+0x2a/0x40 kernel/locking/spinlock.c:152 spin_lock include/linux/spinlock.h:317 [inline] __queue_work+0x188/0xdd0 kernel/workqueue.c:1439 queue_work_on+0x8e/0xa0 kernel/workqueue.c:1508 pty_write+0x173/0x1c0 drivers/tty/pty.c:124 n_tty_write+0x8fc/0xe30 drivers/tty/n_tty.c:2356 do_tty_write drivers/tty/tty_io.c:959 [inline] tty_write+0x3f4/0x6f0 drivers/tty/tty_io.c:1043 __vfs_write+0xf9/0x5a0 fs/read_write.c:482 vfs_write+0x17f/0x4d0 fs/read_write.c:546 SYSC_write fs/read_write.c:594 [inline] SyS_write+0x102/0x250 fs/read_write.c:586 do_syscall_64+0x19b/0x520 arch/x86/entry/common.c:292 entry_SYSCALL_64_after_hwframe+0x42/0xb7 -> #2 (&(&port->lock)->rlock){-.-.}: __raw_spin_lock_irqsave include/linux/spinlock_api_smp.h:110 [inline] _raw_spin_lock_irqsave+0x42/0x60 kernel/locking/spinlock.c:160 tty_port_tty_get+0x1d/0x80 drivers/tty/tty_port.c:287 tty_port_default_wakeup+0x11/0x40 drivers/tty/tty_port.c:46 serial8250_tx_chars+0x409/0xa20 drivers/tty/serial/8250/8250_port.c:1810 serial8250_handle_irq.part.0+0x1ef/0x240 drivers/tty/serial/8250/8250_port.c:1883 serial8250_handle_irq drivers/tty/serial/8250/8250_port.c:1869 [inline] serial8250_default_handle_irq+0x9c/0x110 drivers/tty/serial/8250/8250_port.c:1899 serial8250_interrupt+0xea/0x1a0 drivers/tty/serial/8250/8250_core.c:129 __handle_irq_event_percpu+0xff/0x7a0 kernel/irq/handle.c:147 handle_irq_event_percpu+0x76/0x150 kernel/irq/handle.c:187 handle_irq_event+0xa2/0x12d kernel/irq/handle.c:204 handle_edge_irq+0x21b/0x820 kernel/irq/chip.c:770 generic_handle_irq_desc include/linux/irqdesc.h:159 [inline] handle_irq+0x225/0x2e2 arch/x86/kernel/irq_64.c:87 do_IRQ+0x7f/0x1c0 arch/x86/kernel/irq.c:230 ret_from_intr+0x0/0x22 arch_local_irq_restore arch/x86/include/asm/paravirt.h:779 [inline] __raw_spin_unlock_irqrestore include/linux/spinlock_api_smp.h:160 [inline] _raw_spin_unlock_irqrestore+0x59/0x70 kernel/locking/spinlock.c:192 spin_unlock_irqrestore include/linux/spinlock.h:372 [inline] uart_write+0x299/0x540 drivers/tty/serial/serial_core.c:625 process_output_block drivers/tty/n_tty.c:595 [inline] n_tty_write+0x38e/0xe30 drivers/tty/n_tty.c:2333 do_tty_write drivers/tty/tty_io.c:959 [inline] tty_write+0x3f4/0x6f0 drivers/tty/tty_io.c:1043 redirected_tty_write+0xaa/0xb0 drivers/tty/tty_io.c:1064 __vfs_write+0xf9/0x5a0 fs/read_write.c:482 vfs_write+0x17f/0x4d0 fs/read_write.c:546 SYSC_write fs/read_write.c:594 [inline] SyS_write+0x102/0x250 fs/read_write.c:586 do_syscall_64+0x19b/0x520 arch/x86/entry/common.c:292 entry_SYSCALL_64_after_hwframe+0x42/0xb7 -> #1 (&port_lock_key){-.-.}: __raw_spin_lock_irqsave include/linux/spinlock_api_smp.h:110 [inline] _raw_spin_lock_irqsave+0x42/0x60 kernel/locking/spinlock.c:160 serial8250_console_write+0x434/0x820 drivers/tty/serial/8250/8250_port.c:3232 call_console_drivers kernel/printk/printk.c:1719 [inline] console_unlock+0x6ea/0xc70 kernel/printk/printk.c:2391 vprintk_emit+0x128/0x330 kernel/printk/printk.c:1917 vprintk_func+0x58/0x152 kernel/printk/printk_safe.c:401 printk+0xba/0xed kernel/printk/printk.c:1990 register_console+0x5f4/0x9b0 kernel/printk/printk.c:2710 univ8250_console_init+0x2f/0x3a drivers/tty/serial/8250/8250_core.c:692 console_init+0x4d/0x56 kernel/printk/printk.c:2791 start_kernel+0x489/0x74a init/main.c:635 secondary_startup_64+0xa5/0xb0 arch/x86/kernel/head_64.S:240 -> #0 (console_owner){-.-.}: lock_acquire+0x12b/0x360 kernel/locking/lockdep.c:3991 console_trylock_spinning kernel/printk/printk.c:1673 [inline] vprintk_emit+0x1f5/0x330 kernel/printk/printk.c:1916 vprintk_func+0x58/0x152 kernel/printk/printk_safe.c:401 printk+0xba/0xed kernel/printk/printk.c:1990 show_pwq kernel/workqueue.c:4422 [inline] show_workqueue_state kernel/workqueue.c:4520 [inline] show_workqueue_state.cold+0x2b3/0xeb3 kernel/workqueue.c:4491 wq_watchdog_timer_fn+0x400/0x480 kernel/workqueue.c:5504 call_timer_fn+0x15b/0x6a0 kernel/time/timer.c:1279 expire_timers+0x227/0x4c0 kernel/time/timer.c:1318 __run_timers kernel/time/timer.c:1634 [inline] run_timer_softirq+0x3e3/0x5d0 kernel/time/timer.c:1649 __do_softirq+0x234/0x9ec kernel/softirq.c:288 invoke_softirq kernel/softirq.c:368 [inline] irq_exit+0x114/0x150 kernel/softirq.c:409 exiting_irq arch/x86/include/asm/apic.h:648 [inline] smp_apic_timer_interrupt+0x1a7/0x650 arch/x86/kernel/apic/apic.c:1064 apic_timer_interrupt+0x8c/0xa0 arch/x86/entry/entry_64.S:792 arch_local_irq_restore arch/x86/include/asm/paravirt.h:779 [inline] __raw_spin_unlock_irqrestore include/linux/spinlock_api_smp.h:160 [inline] _raw_spin_unlock_irqrestore+0x59/0x70 kernel/locking/spinlock.c:192 spin_unlock_irqrestore include/linux/spinlock.h:372 [inline] __wake_up_common_lock+0xe0/0x170 kernel/sched/wait.c:126 rtc_handle_legacy_irq+0x123/0x180 drivers/rtc/interface.c:523 rtc_timer_do_work+0x21d/0x610 drivers/rtc/interface.c:881 process_one_work+0x7f1/0x1580 kernel/workqueue.c:2134 worker_thread+0xdd/0xdf0 kernel/workqueue.c:2271 kthread+0x31f/0x430 kernel/kthread.c:232 ret_from_fork+0x3a/0x50 arch/x86/entry/entry_64.S:404 other info that might help us debug this: Chain exists of: console_owner --> &pool->lock/1 --> &(&pool->lock)->rlock Possible unsafe locking scenario: CPU0 CPU1 ---- ---- lock(&(&pool->lock)->rlock); lock(&pool->lock/1); lock(&(&pool->lock)->rlock); lock(console_owner); *** DEADLOCK *** 6 locks held by kworker/0:0/7129: #0: ("events"){+.+.}, at: [<00000000a24d4a6a>] process_one_work+0x6ff/0x1580 kernel/workqueue.c:2105 #1: ((&rtc->irqwork)){+.+.}, at: [<0000000091e8df47>] process_one_work+0x735/0x1580 kernel/workqueue.c:2109 #2: (&rtc->ops_lock){+.+.}, at: [<00000000e92c0184>] rtc_timer_do_work+0xc9/0x610 drivers/rtc/interface.c:868 #3: (kernel/workqueue.c:5442){+.-.}, at: [<00000000ecea986d>] lockdep_copy_map include/linux/lockdep.h:174 [inline] #3: (kernel/workqueue.c:5442){+.-.}, at: [<00000000ecea986d>] call_timer_fn+0xc6/0x6a0 kernel/time/timer.c:1269 #4: (rcu_read_lock_sched){....}, at: [<000000006eff9014>] show_workqueue_state+0x0/0x100 kernel/workqueue.c:4390 #5: (&(&pool->lock)->rlock){-.-.}, at: [<00000000671923ad>] show_workqueue_state kernel/workqueue.c:4518 [inline] #5: (&(&pool->lock)->rlock){-.-.}, at: [<00000000671923ad>] show_workqueue_state.cold+0x22f/0xeb3 kernel/workqueue.c:4491 stack backtrace: CPU: 0 PID: 7129 Comm: kworker/0:0 Not tainted 4.14.138+ #32 Workqueue: events rtc_timer_do_work Call Trace: __dump_stack lib/dump_stack.c:17 [inline] dump_stack+0xca/0x134 lib/dump_stack.c:53 print_circular_bug.isra.0.cold+0x2dc/0x425 kernel/locking/lockdep.c:1258 check_prev_add kernel/locking/lockdep.c:1901 [inline] check_prevs_add kernel/locking/lockdep.c:2018 [inline] validate_chain kernel/locking/lockdep.c:2460 [inline] __lock_acquire+0x2f5f/0x4320 kernel/locking/lockdep.c:3487 lock_acquire+0x12b/0x360 kernel/locking/lockdep.c:3991 console_trylock_spinning kernel/printk/printk.c:1673 [inline] vprintk_emit+0x1f5/0x330 kernel/printk/printk.c:1916 vprintk_func+0x58/0x152 kernel/printk/printk_safe.c:401 printk+0xba/0xed kernel/printk/printk.c:1990 show_pwq kernel/workqueue.c:4422 [inline] show_workqueue_state kernel/workqueue.c:4520 [inline] show_workqueue_state.cold+0x2b3/0xeb3 kernel/workqueue.c:4491 wq_watchdog_timer_fn+0x400/0x480 kernel/workqueue.c:5504 call_timer_fn+0x15b/0x6a0 kernel/time/timer.c:1279 expire_timers+0x227/0x4c0 kernel/time/timer.c:1318 __run_timers kernel/time/timer.c:1634 [inline] run_timer_softirq+0x3e3/0x5d0 kernel/time/timer.c:1649 __do_softirq+0x234/0x9ec kernel/softirq.c:288 invoke_softirq kernel/softirq.c:368 [inline] irq_exit+0x114/0x150 kernel/softirq.c:409 exiting_irq arch/x86/include/asm/apic.h:648 [inline] smp_apic_timer_interrupt+0x1a7/0x650 arch/x86/kernel/apic/apic.c:1064 apic_timer_interrupt+0x8c/0xa0 arch/x86/entry/entry_64.S:792 RIP: 0010:arch_local_irq_restore arch/x86/include/asm/paravirt.h:779 [inline] RIP: 0010:__raw_spin_unlock_irqrestore include/linux/spinlock_api_smp.h:160 [inline] RIP: 0010:_raw_spin_unlock_irqrestore+0x59/0x70 kernel/locking/spinlock.c:192 RSP: 0018:ffff8881a8a8fa78 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff10 RAX: 0000000000000007 RBX: 0000000000000246 RCX: 1ffff11034486404 RDX: 0000000000000000 RSI: ffff8881a2432000 RDI: 0000000000000246 RBP: ffff8881d633d1f0 R08: 0000000000000001 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000001 R13: 0000000000000000 R14: 0000000000000000 R15: 1ffff11035151f54 spin_unlock_irqrestore include/linux/spinlock.h:372 [inline] __wake_up_common_lock+0xe0/0x170 kernel/sched/wait.c:126 rtc_handle_legacy_irq+0x123/0x180 drivers/rtc/interface.c:523 rtc_timer_do_work+0x21d/0x610 drivers/rtc/interface.c:881 process_one_work+0x7f1/0x1580 kernel/workqueue.c:2134 worker_thread+0xdd/0xdf0 kernel/workqueue.c:2271 kthread+0x31f/0x430 kernel/kthread.c:232 ret_from_fork+0x3a/0x50 arch/x86/entry/entry_64.S:404 workqueue events_long: flags=0x0 pwq 0: schedule+0x92/0x1c0 kernel/sched/core.c:3498 cpus=0 schedule_timeout+0x752/0xe90 kernel/time/timer.c:1721 node=0 flags=0x0 nice=0 active=1/256 pending: gc_worker workqueue events_unbound: flags=0x2 pwq 4: do_wait_for_common kernel/sched/completion.c:91 [inline] __wait_for_common kernel/sched/completion.c:112 [inline] wait_for_common+0x29c/0x470 kernel/sched/completion.c:123 cpus=0-1 flags=0x4 nice=0 active=4/512 in-flight: 14034:fsnotify_connector_destroy_workfn fsnotify_connector_destroy_workfn, 5:fsnotify_mark_destroy_workfn fsnotify_mark_destroy_workfn workqueue events_power_efficient: flags=0x80 pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=3/256 pending: process_srcu , neigh_periodic_work __synchronize_srcu+0x12a/0x210 kernel/rcu/srcutree.c:898 , neigh_periodic_work workqueue mm_percpu_wq: flags=0x8 pwq 0: cpus=0 fsnotify_mark_destroy_workfn+0xfd/0x310 fs/notify/mark.c:757 node=0 flags=0x0 nice=0 active=1/256 pending: vmstat_update workqueue dm_bufio_cache: flags=0x8 process_one_work+0x7f1/0x1580 kernel/workqueue.c:2134 pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 pending: work_fn workqueue ipv6_addrconf: flags=0x40008 pwq 2: worker_thread+0xdd/0xdf0 kernel/workqueue.c:2271 cpus=1 node=0 kthread+0x31f/0x430 kernel/kthread.c:232 flags=0x0 nice=0 active=1/1 ret_from_fork+0x3a/0x50 arch/x86/entry/entry_64.S:404 in-flight: INFO: task kworker/u4:4:14034 blocked for more than 140 seconds. 2425:addrconf_verify_work Not tainted 4.14.138+ #32 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. pool 0: kworker/u4:4 D cpus=0 26560 14034 2 0x80000000 node=0 flags=0x0 nice=0 hung=188s workers=4 idle: 1080 19799 72 pool 2: Workqueue: events_unbound fsnotify_connector_destroy_workfn cpus=1 node=0 flags=0x0 nice=0 hung=20s workers=3 idle: 2690 18040 pool 4: cpus=0-1 flags=0x4 nice=0 hung=121s workers=12 idle: 1985 1998 23361 359 65 1941 1841 1950 1945 2664 Call Trace: schedule+0x92/0x1c0 kernel/sched/core.c:3498 schedule_timeout+0x752/0xe90 kernel/time/timer.c:1721 do_wait_for_common kernel/sched/completion.c:91 [inline] __wait_for_common kernel/sched/completion.c:112 [inline] wait_for_common+0x29c/0x470 kernel/sched/completion.c:123 __synchronize_srcu+0x12a/0x210 kernel/rcu/srcutree.c:898 fsnotify_connector_destroy_workfn+0x49/0xa0 fs/notify/mark.c:156 process_one_work+0x7f1/0x1580 kernel/workqueue.c:2134 worker_thread+0xdd/0xdf0 kernel/workqueue.c:2271 kthread+0x31f/0x430 kernel/kthread.c:232 ret_from_fork+0x3a/0x50 arch/x86/entry/entry_64.S:404 INFO: lockdep is turned off. NMI backtrace for cpu 1 CPU: 1 PID: 23 Comm: khungtaskd Not tainted 4.14.138+ #32 Call Trace: __dump_stack lib/dump_stack.c:17 [inline] dump_stack+0xca/0x134 lib/dump_stack.c:53 nmi_cpu_backtrace.cold+0x47/0x86 lib/nmi_backtrace.c:101 nmi_trigger_cpumask_backtrace+0x119/0x147 lib/nmi_backtrace.c:62 trigger_all_cpu_backtrace include/linux/nmi.h:140 [inline] check_hung_uninterruptible_tasks kernel/hung_task.c:195 [inline] watchdog+0x629/0xbe0 kernel/hung_task.c:274 kthread+0x31f/0x430 kernel/kthread.c:232 ret_from_fork+0x3a/0x50 arch/x86/entry/entry_64.S:404 Sending NMI from CPU 1 to CPUs 0: NMI backtrace for cpu 0 CPU: 0 PID: 7129 Comm: kworker/0:0 Not tainted 4.14.138+ #32 Workqueue: events rtc_timer_do_work task: 00000000b7268042 task.stack: 0000000031f58ca5 RIP: 0010:_raw_spin_lock_irqsave+0x0/0x60 kernel/locking/spinlock.c:159 RSP: 0018:ffff8881a8a8fb70 EFLAGS: 00000297 RAX: ffff8881a2431780 RBX: ffff8881d633cc80 RCX: 1ffff1103ac67a52 RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff8881d633d1b8 RBP: 0000000000000001 R08: 0000000000000000 R09: ffffed103ac67a3f R10: ffffed103ac67a3e R11: ffff8881d633d1f3 R12: 0000000000000010 R13: ffff8881d633d1b8 R14: ffff8881d633d310 R15: ffffffff85ec6270 FS: 0000000000000000(0000) GS:ffff8881db800000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00000000009cba28 CR3: 000000012b626002 CR4: 00000000001606b0 Call Trace: rtc_handle_legacy_irq+0x28/0x180 drivers/rtc/interface.c:513 rtc_timer_do_work+0x21d/0x610 drivers/rtc/interface.c:881 process_one_work+0x7f1/0x1580 kernel/workqueue.c:2134 worker_thread+0xdd/0xdf0 kernel/workqueue.c:2271 kthread+0x31f/0x430 kernel/kthread.c:232 ret_from_fork+0x3a/0x50 arch/x86/entry/entry_64.S:404 Code: 7d 18 45 31 c9 31 c9 ff 74 24 08 41 b8 01 00 00 00 31 d2 31 f6 e8 41 94 96 fe 48 89 ef 58 5d e9 17 54 97 fe 0f 1f 80 00 00 00 00 <41> 54 55 48 89 fd 9c 58 0f 1f 44 00 00 49 89 c4 fa 66 0f 1f 44