====================================================== WARNING: possible circular locking dependency detected 4.13.0-rc6-next-20170825+ #9 Not tainted ------------------------------------------------------ kworker/u8:1/1196 is trying to acquire lock: (cpu_hotplug_lock.rw_sem){++++}, at: [] get_online_cpus include/linux/cpu.h:126 [inline] (cpu_hotplug_lock.rw_sem){++++}, at: [] flush_all_backlogs net/core/dev.c:4592 [inline] (cpu_hotplug_lock.rw_sem){++++}, at: [] rollback_registered_many+0x587/0xe80 net/core/dev.c:7127 but task is already holding lock: (rtnl_mutex){+.+.}, at: [] rtnl_lock+0x17/0x20 net/core/rtnetlink.c:72 which lock already depends on the new lock. the existing dependency chain (in reverse order) is: -> #3 (rtnl_mutex){+.+.}: check_prevs_add kernel/locking/lockdep.c:2020 [inline] validate_chain kernel/locking/lockdep.c:2469 [inline] __lock_acquire+0x3286/0x4620 kernel/locking/lockdep.c:3498 lock_acquire+0x1d5/0x580 kernel/locking/lockdep.c:4002 __mutex_lock_common kernel/locking/mutex.c:756 [inline] __mutex_lock+0x16f/0x1870 kernel/locking/mutex.c:893 mutex_lock_nested+0x16/0x20 kernel/locking/mutex.c:908 rtnl_lock+0x17/0x20 net/core/rtnetlink.c:72 linkwatch_event+0x57/0xc0 net/core/link_watch.c:236 process_one_work+0xbfd/0x1be0 kernel/workqueue.c:2098 worker_thread+0x223/0x1860 kernel/workqueue.c:2233 kthread+0x39c/0x470 kernel/kthread.c:231 ret_from_fork+0x2a/0x40 arch/x86/entry/entry_64.S:431 -> #2 ((linkwatch_work).work){+.+.}: process_one_work+0xba5/0x1be0 kernel/workqueue.c:2095 worker_thread+0x223/0x1860 kernel/workqueue.c:2233 kthread+0x39c/0x470 kernel/kthread.c:231 ret_from_fork+0x2a/0x40 arch/x86/entry/entry_64.S:431 0xffffffffffffffff -> #1 ((complete)&rcu.completion){+.+.}: check_prevs_add kernel/locking/lockdep.c:2020 [inline] validate_chain kernel/locking/lockdep.c:2469 [inline] __lock_acquire+0x3286/0x4620 kernel/locking/lockdep.c:3498 lock_acquire+0x1d5/0x580 kernel/locking/lockdep.c:4002 complete_acquire include/linux/completion.h:39 [inline] __wait_for_common kernel/sched/completion.c:108 [inline] wait_for_common kernel/sched/completion.c:122 [inline] wait_for_completion+0xc8/0x770 kernel/sched/completion.c:143 __synchronize_srcu+0x1b5/0x250 kernel/rcu/srcutree.c:898 synchronize_srcu_expedited kernel/rcu/srcutree.c:923 [inline] synchronize_srcu+0x1a3/0x560 kernel/rcu/srcutree.c:974 quarantine_remove_cache+0xd7/0xf0 mm/kasan/quarantine.c:327 kasan_cache_shrink+0x9/0x10 mm/kasan/kasan.c:380 kmem_cache_shrink+0x15/0x30 mm/slab_common.c:857 acpi_os_purge_cache+0x15/0x20 drivers/acpi/osl.c:1560 acpi_purge_cached_objects+0x38/0xc9 drivers/acpi/acpica/utxface.c:271 acpi_initialize_objects+0xc5/0x112 drivers/acpi/acpica/utxfinit.c:302 acpi_bus_init drivers/acpi/bus.c:1131 [inline] acpi_init+0x23c/0x8e6 drivers/acpi/bus.c:1220 do_one_initcall+0x9e/0x330 init/main.c:826 do_initcall_level init/main.c:892 [inline] do_initcalls init/main.c:900 [inline] do_basic_setup init/main.c:918 [inline] kernel_init_freeable+0x469/0x521 init/main.c:1066 kernel_init+0x13/0x172 init/main.c:993 ret_from_fork+0x2a/0x40 arch/x86/entry/entry_64.S:431 -> #0 (cpu_hotplug_lock.rw_sem){++++}: check_prev_add+0x865/0x1520 kernel/locking/lockdep.c:1894 check_prevs_add kernel/locking/lockdep.c:2020 [inline] validate_chain kernel/locking/lockdep.c:2469 [inline] __lock_acquire+0x3286/0x4620 kernel/locking/lockdep.c:3498 lock_acquire+0x1d5/0x580 kernel/locking/lockdep.c:4002 percpu_down_read_preempt_disable include/linux/percpu-rwsem.h:35 [inline] percpu_down_read include/linux/percpu-rwsem.h:58 [inline] cpus_read_lock+0x42/0x90 kernel/cpu.c:218 get_online_cpus include/linux/cpu.h:126 [inline] flush_all_backlogs net/core/dev.c:4592 [inline] rollback_registered_many+0x587/0xe80 net/core/dev.c:7127 unregister_netdevice_many.part.107+0x87/0x420 net/core/dev.c:8190 unregister_netdevice_many+0xbb/0x100 net/core/dev.c:8189 sit_exit_net+0x470/0x690 net/ipv6/sit.c:1857 ops_exit_list.isra.6+0xae/0x150 net/core/net_namespace.c:142 cleanup_net+0x5c7/0xb60 net/core/net_namespace.c:483 process_one_work+0xbfd/0x1be0 kernel/workqueue.c:2098 worker_thread+0x223/0x1860 kernel/workqueue.c:2233 kthread+0x39c/0x470 kernel/kthread.c:231 ret_from_fork+0x2a/0x40 arch/x86/entry/entry_64.S:431 other info that might help us debug this: Chain exists of: cpu_hotplug_lock.rw_sem --> (linkwatch_work).work --> rtnl_mutex Possible unsafe locking scenario: CPU0 CPU1 ---- ---- QAT: Invalid ioctl lock(rtnl_mutex); lock((linkwatch_work).work); lock(rtnl_mutex); lock(cpu_hotplug_lock.rw_sem); *** DEADLOCK *** 4 locks held by kworker/u8:1/1196: #0: ("%s""netns"){.+.+}, at: [] __write_once_size include/linux/compiler.h:305 [inline] #0: ("%s""netns"){.+.+}, at: [] atomic64_set arch/x86/include/asm/atomic64_64.h:33 [inline] #0: ("%s""netns"){.+.+}, at: [] atomic_long_set include/asm-generic/atomic-long.h:56 [inline] #0: ("%s""netns"){.+.+}, at: [] set_work_data kernel/workqueue.c:617 [inline] #0: ("%s""netns"){.+.+}, at: [] set_work_pool_and_clear_pending kernel/workqueue.c:644 [inline] #0: ("%s""netns"){.+.+}, at: [] process_one_work+0xad4/0x1be0 kernel/workqueue.c:2090 #1: (net_cleanup_work){+.+.}, at: [] process_one_work+0xb2c/0x1be0 kernel/workqueue.c:2094 #2: (net_mutex){+.+.}, at: [] cleanup_net+0x247/0xb60 net/core/net_namespace.c:449 #3: (rtnl_mutex){+.+.}, at: [] rtnl_lock+0x17/0x20 net/core/rtnetlink.c:72 stack backtrace: CPU: 2 PID: 1196 Comm: kworker/u8:1 Not tainted 4.13.0-rc6-next-20170825+ #9 Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS Bochs 01/01/2011 Workqueue: netns cleanup_net Call Trace: __dump_stack lib/dump_stack.c:16 [inline] dump_stack+0x194/0x257 lib/dump_stack.c:52 print_circular_bug+0x503/0x710 kernel/locking/lockdep.c:1259 check_prev_add+0x865/0x1520 kernel/locking/lockdep.c:1894 check_prevs_add kernel/locking/lockdep.c:2020 [inline] validate_chain kernel/locking/lockdep.c:2469 [inline] __lock_acquire+0x3286/0x4620 kernel/locking/lockdep.c:3498 lock_acquire+0x1d5/0x580 kernel/locking/lockdep.c:4002 percpu_down_read_preempt_disable include/linux/percpu-rwsem.h:35 [inline] percpu_down_read include/linux/percpu-rwsem.h:58 [inline] cpus_read_lock+0x42/0x90 kernel/cpu.c:218 get_online_cpus include/linux/cpu.h:126 [inline] flush_all_backlogs net/core/dev.c:4592 [inline] rollback_registered_many+0x587/0xe80 net/core/dev.c:7127 unregister_netdevice_many.part.107+0x87/0x420 net/core/dev.c:8190 unregister_netdevice_many+0xbb/0x100 net/core/dev.c:8189 sit_exit_net+0x470/0x690 net/ipv6/sit.c:1857 ops_exit_list.isra.6+0xae/0x150 net/core/net_namespace.c:142 cleanup_net+0x5c7/0xb60 net/core/net_namespace.c:483 process_one_work+0xbfd/0x1be0 kernel/workqueue.c:2098 worker_thread+0x223/0x1860 kernel/workqueue.c:2233 kthread+0x39c/0x470 kernel/kthread.c:231 ret_from_fork+0x2a/0x40 arch/x86/entry/entry_64.S:431 sd 0:0:0:0: tag#0 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE sd 0:0:0:0: tag#0 Sense Key : No Sense [current] sd 0:0:0:0: tag#0 Add. Sense: No additional sense information sd 0:0:0:0: tag#0 CDB: Request Sense 03 00 00 00 71 75 sd 0:0:0:0: tag#0 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE sd 0:0:0:0: tag#0 Sense Key : No Sense [current] sd 0:0:0:0: tag#0 Add. Sense: No additional sense information sd 0:0:0:0: tag#0 CDB: Request Sense 03 00 00 00 71 75 kvm: MWAIT instruction emulated as NOP! kvm [4134]: vcpu0, guest rIP: 0x9138 Hyper-V uhandled wrmsr: 0x40000020 data 0x400 kvm [4134]: vcpu0, guest rIP: 0x9138 Hyper-V uhandled wrmsr: 0x40000020 data 0x400 audit: type=1326 audit(1503863108.574:3): auid=4294967295 uid=0 gid=0 ses=4294967295 subj=kernel pid=4211 comm="syz-executor5" exe="/syz-executor5" sig=31 arch=c000003e syscall=202 compat=0 ip=0x446749 code=0xffff0000 QAT: Invalid ioctl QAT: Invalid ioctl TCP: request_sock_TCP: Possible SYN flooding on port 20028. Sending cookies. Check SNMP counters. audit: type=1326 audit(1503863108.643:4): auid=4294967295 uid=0 gid=0 ses=4294967295 subj=kernel pid=4211 comm="syz-executor5" exe="/syz-executor5" sig=31 arch=c000003e syscall=202 compat=0 ip=0x446749 code=0xffff0000 SELinux: unrecognized netlink message: protocol=0 nlmsg_type=0 sclass=netlink_route_socket pig=4292 comm=syz-executor2 9pnet_virtio: no channels available for device ./bus 9pnet_virtio: no channels available for device ./bus device lo entered promiscuous mode device lo left promiscuous mode SELinux: unrecognized netlink message: protocol=0 nlmsg_type=47729 sclass=netlink_route_socket pig=4410 comm=syz-executor0 device lo entered promiscuous mode device lo left promiscuous mode sctp: [Deprecated]: syz-executor5 (pid 4421) Use of int in maxseg socket option. Use struct sctp_assoc_value instead sctp: [Deprecated]: syz-executor5 (pid 4453) Use of int in maxseg socket option. Use struct sctp_assoc_value instead QAT: Invalid ioctl pit: kvm: requested 2514 ns i8254 timer period limited to 500000 ns SELinux: unrecognized netlink message: protocol=0 nlmsg_type=123 sclass=netlink_route_socket pig=4456 comm=syz-executor3 QAT: Invalid ioctl pit: kvm: requested 2514 ns i8254 timer period limited to 500000 ns IPv6: NLM_F_REPLACE set, but no existing node found! IPv6: NLM_F_REPLACE set, but no existing node found! QAT: Invalid ioctl QAT: Invalid ioctl device lo entered promiscuous mode device lo left promiscuous mode device lo entered promiscuous mode device lo left promiscuous mode PF_BRIDGE: RTM_NEWNEIGH with unknown ifindex PF_BRIDGE: RTM_NEWNEIGH with unknown ifindex nla_parse: 22 callbacks suppressed netlink: 3 bytes leftover after parsing attributes in process `syz-executor5'. netlink: 3 bytes leftover after parsing attributes in process `syz-executor5'. netlink: 3 bytes leftover after parsing attributes in process `syz-executor5'. netlink: 3 bytes leftover after parsing attributes in process `syz-executor5'. netlink: 1 bytes leftover after parsing attributes in process `syz-executor7'. IPv6: Can't replace route, no match found netlink: 1 bytes leftover after parsing attributes in process `syz-executor7'. IPv6: Can't replace route, no match found netlink: 1 bytes leftover after parsing attributes in process `syz-executor1'. IPv6: NLM_F_REPLACE set, but no existing node found! netlink: 11 bytes leftover after parsing attributes in process `syz-executor2'. netlink: 11 bytes leftover after parsing attributes in process `syz-executor2'. audit: type=1326 audit(1503863111.601:5): auid=4294967295 uid=0 gid=0 ses=4294967295 subj=kernel pid=5117 comm="syz-executor5" exe="/syz-executor5" sig=31 arch=c000003e syscall=202 compat=0 ip=0x446749 code=0xffff0000 audit: type=1326 audit(1503863111.762:6): auid=4294967295 uid=0 gid=0 ses=4294967295 subj=kernel pid=5117 comm="syz-executor5" exe="/syz-executor5" sig=31 arch=c000003e syscall=202 compat=0 ip=0x446749 code=0xffff0000 sg_write: data in/out 327773/154 bytes for SCSI command 0x57-- guessing data in; program syz-executor0 not setting count and/or reply_len properly sg_write: data in/out 327773/154 bytes for SCSI command 0x57-- guessing data in; program syz-executor0 not setting count and/or reply_len properly sctp: [Deprecated]: syz-executor3 (pid 5291) Use of struct sctp_assoc_value in delayed_ack socket option. Use struct sctp_sack_info instead sctp: [Deprecated]: syz-executor3 (pid 5320) Use of struct sctp_assoc_value in delayed_ack socket option. Use struct sctp_sack_info instead device lo entered promiscuous mode PF_BRIDGE: RTM_NEWNEIGH with invalid address netlink: 13 bytes leftover after parsing attributes in process `syz-executor3'. kvm: MONITOR instruction emulated as NOP! kvm [5492]: vcpu0, guest rIP: 0x9114 disabled perfctr wrmsr: 0xc2 data 0x1047 kvm [5492]: vcpu0, guest rIP: 0x9114 disabled perfctr wrmsr: 0xc1 data 0x1047 kvm [5492]: vcpu0, guest rIP: 0x9114 disabled perfctr wrmsr: 0xc2 data 0x1047 kvm [5492]: vcpu0, guest rIP: 0x9114 disabled perfctr wrmsr: 0xc1 data 0x1047 audit: type=1326 audit(1503863112.376:7): auid=4294967295 uid=0 gid=0 ses=4294967295 subj=kernel pid=5516 comm="syz-executor3" exe="/syz-executor3" sig=31 arch=c000003e syscall=202 compat=0 ip=0x446749 code=0xffff0000 audit: type=1326 audit(1503863112.417:8): auid=4294967295 uid=0 gid=0 ses=4294967295 subj=kernel pid=5516 comm="syz-executor3" exe="/syz-executor3" sig=31 arch=c000003e syscall=202 compat=0 ip=0x446749 code=0xffff0000 kvm [5513]: vcpu2, guest rIP: 0x9115 Hyper-V uhandled wrmsr: 0x4000008f data 0x0 kvm [5513]: vcpu2, guest rIP: 0x9115 Hyper-V uhandled wrmsr: 0x4000008e data 0x0 kvm [5513]: vcpu2, guest rIP: 0x9115 Hyper-V uhandled wrmsr: 0x4000008d data 0x0 kvm [5513]: vcpu2, guest rIP: 0x9115 Hyper-V uhandled wrmsr: 0x4000008c data 0x0 kvm [5513]: vcpu2, guest rIP: 0x9115 Hyper-V uhandled wrmsr: 0x4000008b data 0x0 kvm [5513]: vcpu2, guest rIP: 0x9115 Hyper-V uhandled wrmsr: 0x4000008a data 0x0 kvm [5513]: vcpu2, guest rIP: 0x9115 Hyper-V uhandled wrmsr: 0x40000089 data 0x0 kvm [5513]: vcpu2, guest rIP: 0x9115 Hyper-V uhandled wrmsr: 0x40000088 data 0x0 kvm [5513]: vcpu2, guest rIP: 0x9115 Hyper-V uhandled wrmsr: 0x40000087 data 0x0 kvm [5513]: vcpu2, guest rIP: 0x9115 Hyper-V uhandled wrmsr: 0x40000086 data 0x0 sit0: Invalid MTU 16777220 requested, hw max 65508 sit0: Invalid MTU 16777220 requested, hw max 65508 audit: type=1326 audit(1503863112.509:9): auid=4294967295 uid=0 gid=0 ses=4294967295 subj=kernel pid=5516 comm="syz-executor3" exe="/syz-executor3" sig=31 arch=c000003e syscall=202 compat=0 ip=0x446749 code=0xffff0000 audit: type=1326 audit(1503863112.571:10): auid=4294967295 uid=0 gid=0 ses=4294967295 subj=kernel pid=5516 comm="syz-executor3" exe="/syz-executor3" sig=31 arch=c000003e syscall=202 compat=0 ip=0x446749 code=0xffff0000 selinux_nlmsg_perm: 3 callbacks suppressed SELinux: unrecognized netlink message: protocol=0 nlmsg_type=0 sclass=netlink_route_socket pig=5654 comm=syz-executor5 SELinux: unrecognized netlink message: protocol=0 nlmsg_type=0 sclass=netlink_route_socket pig=5636 comm=syz-executor5 SELinux: unrecognized netlink message: protocol=0 nlmsg_type=0 sclass=netlink_route_socket pig=5654 comm=syz-executor5 SELinux: unrecognized netlink message: protocol=0 nlmsg_type=0 sclass=netlink_route_socket pig=5660 comm=syz-executor5 ata1.00: invalid multi_count 64 ignored ata1.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0 ata1.00: failed command: WRITE MULTIPLE FUA EXT ata1.00: cmd ce/07:00:00:00:03/00:00:00:00:00/09 tag 0 ncq nodata 188 out res 50/00:00:78:10:18/00:00:78:10:18/a0 Emask 0x40 (internal error) ata1.00: status: { DRDY } ata1.00: ATA Identify Device Log not supported ata1.00: Security Log not supported ata1.00: ATA Identify Device Log not supported ata1.00: Security Log not supported ata1.00: configured for MWDMA2 ata1: EH complete ata1.00: invalid multi_count 64 ignored ata1.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0 ata1.00: failed command: WRITE MULTIPLE FUA EXT ata1.00: cmd ce/07:00:00:00:03/00:00:00:00:00/09 tag 0 ncq nodata 188 out res 41/04:01:00:00:00/04:01:00:00:00/a0 Emask 0x41 (internal error) ata1.00: status: { DRDY ERR } ata1.00: error: { ABRT } ata1.00: ATA Identify Device Log not supported ata1.00: Security Log not supported ata1.00: ATA Identify Device Log not supported ata1.00: Security Log not supported ata1.00: configured for MWDMA2 ata1: EH complete device lo entered promiscuous mode sctp: [Deprecated]: syz-executor2 (pid 5790) Use of struct sctp_assoc_value in delayed_ack socket option. Use struct sctp_sack_info instead sctp: [Deprecated]: syz-executor2 (pid 5790) Use of struct sctp_assoc_value in delayed_ack socket option. Use struct sctp_sack_info instead device lo left promiscuous mode sctp: [Deprecated]: syz-executor2 (pid 5790) Use of struct sctp_assoc_value in delayed_ack socket option. Use struct sctp_sack_info instead sctp: [Deprecated]: syz-executor2 (pid 5790) Use of struct sctp_assoc_value in delayed_ack socket option. Use struct sctp_sack_info instead QAT: Invalid ioctl QAT: Invalid ioctl QAT: Invalid ioctl QAT: Invalid ioctl QAT: Invalid ioctl QAT: Invalid ioctl audit: type=1326 audit(1503863115.368:11): auid=4294967295 uid=0 gid=0 ses=4294967295 subj=kernel pid=5987 comm="syz-executor6" exe="/syz-executor6" sig=31 arch=c000003e syscall=202 compat=0 ip=0x446749 code=0xffff0000 audit: type=1326 audit(1503863115.368:12): auid=4294967295 uid=0 gid=0 ses=4294967295 subj=kernel pid=5987 comm="syz-executor6" exe="/syz-executor6" sig=31 arch=c000003e syscall=228 compat=0 ip=0x448f3a code=0xffff0000 TCP: request_sock_TCP: Possible SYN flooding on port 20004. Sending cookies. Check SNMP counters. TCP: tcp_parse_options: Illegal window scaling value 205 > 14 received TCP: tcp_parse_options: Illegal window scaling value 205 > 14 received QAT: Invalid ioctl device lo entered promiscuous mode