ci starts bisection 2023-09-16 16:01:18.70532284 +0000 UTC m=+277022.724446835 bisecting cause commit starting from 727dbda16b83600379061c4ca8270ef3e2f51922 building syzkaller on 7ba13a158b1ad89a23920bb64208ba34fed27b08 ensuring issue is reproducible on original commit 727dbda16b83600379061c4ca8270ef3e2f51922 testing commit 727dbda16b83600379061c4ca8270ef3e2f51922 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: b61d3f1e255e7a6760bfa73372dedcf500f35a6a4f5f3385fb59a41cf2af5525 all runs: crashed: WARNING in __cfg80211_ibss_joined representative crash: WARNING in __cfg80211_ibss_joined, types: [WARNING] check whether we can drop unnecessary instrumentation disabling configs for [KASAN LOCKDEP ATOMIC_SLEEP HANG LEAK UBSAN], they are not needed testing commit 727dbda16b83600379061c4ca8270ef3e2f51922 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 1ec9e8e8f422f46a2d103e0a0e1a5cb9b3afcd9b816ebf94187de22fded99d9d all runs: crashed: WARNING in __cfg80211_ibss_joined representative crash: WARNING in __cfg80211_ibss_joined, types: [WARNING] the bug reproduces without the instrumentation disabling configs for [KASAN LOCKDEP ATOMIC_SLEEP HANG LEAK UBSAN], they are not needed kconfig minimization: base=3876 full=7635 leaves diff=1999 split chunks (needed=false): <1999> split chunk #0 of len 1999 into 5 parts testing without sub-chunk 1/5 disabling configs for [KASAN LOCKDEP ATOMIC_SLEEP HANG LEAK UBSAN], they are not needed testing commit 727dbda16b83600379061c4ca8270ef3e2f51922 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 9b4348205923c4b827c31fe78ee7dcda6ee692f200a2c9dc737b42c6d47b0464 all runs: crashed: WARNING in __cfg80211_ibss_joined representative crash: WARNING in __cfg80211_ibss_joined, types: [WARNING] the chunk can be dropped testing without sub-chunk 2/5 disabling configs for [ATOMIC_SLEEP HANG LEAK UBSAN KASAN LOCKDEP], they are not needed testing commit 727dbda16b83600379061c4ca8270ef3e2f51922 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 01ee49f243d77b15aac2ee899e3a1ac0d66951f8330c220a8033fcef64a8ef16 all runs: crashed: WARNING in __cfg80211_ibss_joined representative crash: WARNING in __cfg80211_ibss_joined, types: [WARNING] the chunk can be dropped testing without sub-chunk 3/5 disabling configs for [ATOMIC_SLEEP HANG LEAK UBSAN KASAN LOCKDEP], they are not needed testing commit 727dbda16b83600379061c4ca8270ef3e2f51922 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 8a195bca29e7b38f8834bead3e958798a263934d6cef4f2ff498253fc5ded914 all runs: OK false negative chance: 0.000 testing without sub-chunk 4/5 disabling configs for [ATOMIC_SLEEP HANG LEAK UBSAN KASAN LOCKDEP], they are not needed testing commit 727dbda16b83600379061c4ca8270ef3e2f51922 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 239c422680dc10418d1c49639f85a381308b8297da356269a27903e1b2c14543 run #0: crashed: WARNING in __cfg80211_ibss_joined run #1: crashed: WARNING in __cfg80211_ibss_joined run #2: crashed: WARNING in __cfg80211_ibss_joined run #3: crashed: WARNING in __cfg80211_ibss_joined run #4: crashed: WARNING in __cfg80211_ibss_joined run #5: crashed: BUG: workqueue lockup run #6: crashed: BUG: workqueue lockup run #7: crashed: WARNING in __cfg80211_ibss_joined run #8: crashed: BUG: workqueue lockup run #9: OK representative crash: WARNING in __cfg80211_ibss_joined, types: [WARNING UNKNOWN] the chunk can be dropped testing without sub-chunk 5/5 disabling configs for [KASAN LOCKDEP ATOMIC_SLEEP HANG LEAK UBSAN], they are not needed testing commit 727dbda16b83600379061c4ca8270ef3e2f51922 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: bf9e65eeb40c92b2907f087a18e6643f074ec7b27d5ea707f966b502facb75ee run #0: crashed: WARNING in __cfg80211_ibss_joined run #1: crashed: WARNING in __cfg80211_ibss_joined run #2: crashed: WARNING in __cfg80211_ibss_joined run #3: crashed: WARNING in __cfg80211_ibss_joined run #4: crashed: WARNING in __cfg80211_ibss_joined run #5: crashed: WARNING in __cfg80211_ibss_joined run #6: crashed: WARNING in __cfg80211_ibss_joined run #7: crashed: BUG: workqueue lockup run #8: crashed: BUG: workqueue lockup run #9: crashed: BUG: workqueue lockup representative crash: WARNING in __cfg80211_ibss_joined, types: [WARNING UNKNOWN] the chunk can be dropped minimized to 400 configs; suspects: [AX25 BRIDGE BRIDGE_NETFILTER CAN CFG80211 CHECKPOINT_RESTORE DVB_CORE FB FSCACHE HAMRADIO HSR INFINIBAND INFINIBAND_ADDR_TRANS INFINIBAND_USER_ACCESS INPUT_JOYSTICK INPUT_MOUSE IP6_NF_RAW IPV6_MULTIPLE_TABLES IP_NF_RAW IP_SET IP_VS IP_VS_OVF IP_VS_PE_SIP IP_VS_PROTO_AH IP_VS_PROTO_AH_ESP IP_VS_PROTO_ESP IP_VS_PROTO_SCTP IP_VS_PROTO_UDP IP_VS_RR IP_VS_SED IP_VS_SH IP_VS_TWOS IP_VS_WLC IP_VS_WRR IRQ_BYPASS_MANAGER IRQ_POLL IR_IGORPLUGUSB IR_IGUANA IR_IMON IR_MCEUSB IR_REDRAT3 IR_STREAMZAP IR_TTUSBIR ISDN ISDN_CAPI_MIDDLEWARE JFFS2_CMODE_PRIORITY JFFS2_COMPRESSION_OPTIONS JFFS2_FS JFFS2_FS_POSIX_ACL JFFS2_FS_SECURITY JFFS2_FS_WRITEBUFFER JFFS2_FS_XATTR JFFS2_LZO JFFS2_RTIME JFFS2_RUBIN JFFS2_SUMMARY JFFS2_ZLIB JFS_DEBUG JFS_FS JFS_POSIX_ACL JFS_SECURITY JOYSTICK_IFORCE JOYSTICK_IFORCE_USB JOYSTICK_XPAD JOYSTICK_XPAD_FF JOYSTICK_XPAD_LEDS KARMA_PARTITION KCOV KCOV_ENABLE_COMPARISONS KCOV_INSTRUMENT_ALL KEYS_REQUEST_CACHE KEY_DH_OPERATIONS KEY_NOTIFICATIONS KSM KVM KVM_AMD KVM_ASYNC_PF KVM_COMPAT KVM_GENERIC_DIRTYLOG_READ_PROTECT KVM_GENERIC_HARDWARE_ENABLING KVM_MMIO KVM_VFIO KVM_XEN KVM_XFER_TO_GUEST_WORK L2TP L2TP_ETH L2TP_IP L2TP_V3 LAPB LAPBETHER LDM_PARTITION LEDS_TRIGGER_AUDIO LEGACY_PTYS LIBCRC32C LIBNVDIMM LINEAR_RANGES LIST_HARDENED LLC LLC2 LOGIG940_FF LOGIRUMBLEPAD2_FF LOGO LOGO_LINUX_MONO LOGO_LINUX_VGA16 LPC_ICH LWTUNNEL LWTUNNEL_BPF LZ4HC_COMPRESS LZ4_COMPRESS MAC80211 MAC80211_DEBUGFS MAC80211_HAS_RC MAC80211_HWSIM MAC80211_MESH MAC80211_RC_DEFAULT_MINSTREL MAC80211_RC_MINSTREL MACSEC MACVLAN MACVTAP MAC_PARTITION MAPPING_DIRTY_HELPERS MD_LINEAR MD_MULTIPATH MD_RAID0 MD_RAID1 MD_RAID10 MD_RAID456 MEDIA_ANALOG_TV_SUPPORT MEDIA_ATTACH MEDIA_CONTROLLER MEDIA_CONTROLLER_DVB MEDIA_CONTROLLER_REQUEST_API MEDIA_DIGITAL_TV_SUPPORT MEDIA_RADIO_SUPPORT MEDIA_SDR_SUPPORT MEDIA_SUPPORT MEDIA_SUPPORT_FILTER MEDIA_TUNER MEDIA_TUNER_MSI001 MEMORY_BALLOON MEMORY_HOTPLUG MEMORY_HOTPLUG_DEFAULT_ONLINE MEMORY_ISOLATION MEMREGION MEMSTICK MEMSTICK_REALTEK_USB MEM_SOFT_DIRTY MFD_CORE MFD_SYSCON MHI_BUS MHI_WWAN_CTRL MHP_MEMMAP_ON_MEMORY MICROCHIP_PHY MINIX_FS MINIX_SUBPARTITION MISC_RTSX MISC_RTSX_USB MISDN MISDN_DSP MISDN_HFCUSB MISDN_L1OIP MKISS MLX4_CORE MLX4_INFINIBAND MMC MMC_REALTEK_USB MMC_USHC MMC_VUB300 MMU_NOTIFIER MODULE_SRCVERSION_ALL MODVERSIONS MOST MOUSE_APPLETOUCH MOUSE_BCM5974 MOUSE_PS2 MOUSE_PS2_ALPS MOUSE_PS2_BYD MOUSE_PS2_CYPRESS MOUSE_PS2_FOCALTECH MOUSE_PS2_LIFEBOOK MOUSE_PS2_LOGIPS2PP MOUSE_PS2_SMBUS MOUSE_PS2_SYNAPTICS MOUSE_PS2_SYNAPTICS_SMBUS MOUSE_PS2_TRACKPOINT MOUSE_SYNAPTICS_USB MPLS MPLS_IPTUNNEL MPLS_ROUTING MPTCP MPTCP_IPV6 MRP MTD MTD_BLKDEVS MTD_BLOCK MTD_BLOCK2MTD MTD_CFI_I1 MTD_CFI_I2 MTD_MAP_BANK_WIDTH_1 MTD_MAP_BANK_WIDTH_2 MTD_MAP_BANK_WIDTH_4 MTD_MTDRAM MTD_PHRAM MTD_SLRAM MUSB_PIO_ONLY ND_BTT ND_CLAIM ND_PFN NETDEVSIM NETFILTER_ADVANCED NETFILTER_BPF_LINK NETFILTER_FAMILY_ARP NETFILTER_FAMILY_BRIDGE NETFILTER_NETLINK_ACCT NETFILTER_NETLINK_GLUE_CT NETFILTER_NETLINK_OSF NETFILTER_NETLINK_QUEUE NETFILTER_SYNPROXY NETFILTER_XTABLES_COMPAT NETFILTER_XT_CONNMARK NETFILTER_XT_MATCH_BPF NETFILTER_XT_MATCH_CGROUP NETFILTER_XT_MATCH_CLUSTER NETFILTER_XT_MATCH_COMMENT NETFILTER_XT_MATCH_CONNBYTES NETFILTER_XT_MATCH_CONNLABEL NETFILTER_XT_MATCH_CONNLIMIT NETFILTER_XT_MATCH_CONNMARK NETFILTER_XT_MATCH_CPU NETFILTER_XT_MATCH_DCCP NETFILTER_XT_MATCH_DEVGROUP NETFILTER_XT_MATCH_DSCP NETFILTER_XT_MATCH_ECN NETFILTER_XT_MATCH_ESP NETFILTER_XT_MATCH_HASHLIMIT NETFILTER_XT_MATCH_HELPER NETFILTER_XT_MATCH_HL NETFILTER_XT_MATCH_IPCOMP NETFILTER_XT_MATCH_IPRANGE NETFILTER_XT_MATCH_IPVS NETFILTER_XT_MATCH_L2TP NETFILTER_XT_MATCH_LENGTH NETFILTER_XT_MATCH_LIMIT NETFILTER_XT_MATCH_MAC NETFILTER_XT_MATCH_MARK NETFILTER_XT_MATCH_MULTIPORT NETFILTER_XT_MATCH_NFACCT NETFILTER_XT_MATCH_OSF NETFILTER_XT_MATCH_OWNER NETFILTER_XT_MATCH_PHYSDEV NETFILTER_XT_MATCH_PKTTYPE NETFILTER_XT_MATCH_QUOTA NETFILTER_XT_MATCH_RATEEST NETFILTER_XT_MATCH_REALM NETFILTER_XT_MATCH_RECENT NETFILTER_XT_MATCH_SCTP NETFILTER_XT_MATCH_SOCKET NETFILTER_XT_MATCH_STATISTIC NETFILTER_XT_MATCH_STRING NETFILTER_XT_MATCH_TCPMSS NETFILTER_XT_MATCH_TIME NETFILTER_XT_MATCH_U32 NETFILTER_XT_SET NETFILTER_XT_TARGET_AUDIT NETFILTER_XT_TARGET_CHECKSUM NETFILTER_XT_TARGET_CLASSIFY NETFILTER_XT_TARGET_CONNMARK NETFILTER_XT_TARGET_CT NETFILTER_XT_TARGET_DSCP NETFILTER_XT_TARGET_HL NETFILTER_XT_TARGET_HMARK NETFILTER_XT_TARGET_IDLETIMER NETFILTER_XT_TARGET_LED NETFILTER_XT_TARGET_MARK NETFILTER_XT_TARGET_NETMAP NETFILTER_XT_TARGET_NFQUEUE NETFILTER_XT_TARGET_NOTRACK NETFILTER_XT_TARGET_RATEEST NETFILTER_XT_TARGET_REDIRECT NETFILTER_XT_TARGET_TCPOPTSTRIP NETFILTER_XT_TARGET_TEE NETFILTER_XT_TARGET_TPROXY NETFILTER_XT_TARGET_TRACE NETLINK_DIAG NETROM NET_9P_RDMA NET_ACT_BPF NET_ACT_CONNMARK NET_ACT_CSUM NET_ACT_CT NET_ACT_CTINFO NET_ACT_GATE NET_ACT_IFE NET_ACT_IPT NET_ACT_MPLS NET_ACT_NAT NET_ACT_PEDIT NET_ACT_POLICE NET_ACT_SAMPLE NET_ACT_SIMP NET_ACT_SKBEDIT NET_ACT_SKBMOD NET_ACT_TUNNEL_KEY NET_ACT_VLAN NET_CLS_BASIC NET_CLS_BPF NET_CLS_FLOW NET_CLS_FLOWER NET_CLS_FW NET_CLS_MATCHALL NET_CLS_ROUTE4 NET_DEVLINK NET_DROP_MONITOR NET_DSA NET_DSA_TAG_BRCM NET_DSA_TAG_BRCM_COMMON NET_DSA_TAG_BRCM_PREPEND NET_DSA_TAG_MTK NET_DSA_TAG_QCA NET_DSA_TAG_RTL4_A NET_EMATCH_CANID NET_EMATCH_CMP NET_EMATCH_IPSET NET_EMATCH_IPT NET_EMATCH_META NET_EMATCH_NBYTE NET_EMATCH_TEXT NET_EMATCH_U32 NET_FC NET_FOU NET_FOU_IP_TUNNELS NET_IFE NET_IFE_SKBMARK NET_IFE_SKBPRIO NET_IFE_SKBTCINDEX NET_IPGRE NET_IPGRE_BROADCAST NET_IPGRE_DEMUX NET_IPIP NET_IPVTI NET_KEY NET_KEY_MIGRATE NET_L3_MASTER_DEV NET_MPLS_GSO NET_NCSI NET_NSH NET_REDIRECT NET_SCH_CAKE NET_SCH_CBS NET_SCH_CHOKE NET_SCH_CODEL NET_SCH_DRR NET_SCH_ETF NET_SCH_ETS NET_SCH_FQ NET_SCH_FQ_CODEL NET_SCH_FQ_PIE NET_SCH_GRED NET_SCH_HFSC NET_SCH_HHF NET_SCH_HTB NET_SCH_INGRESS NET_SCH_MQPRIO NET_SCH_MQPRIO_LIB NET_SCH_MULTIQ NET_SCH_NETEM NET_SCH_PIE NET_SCH_PLUG NET_SCH_PRIO NET_SCH_QFQ NET_SCH_RED NET_SCH_SFB NET_SCH_SFQ NET_SCH_SKBPRIO NET_SCH_TAPRIO NET_SCH_TBF NET_SCH_TEQL NET_SOCK_MSG NET_SWITCHDEV NET_TC_SKB_EXT NET_TEAM NET_TEAM_MODE_ACTIVEBACKUP NET_TEAM_MODE_BROADCAST NET_TEAM_MODE_LOADBALANCE NET_TEAM_MODE_RANDOM NET_TEAM_MODE_ROUNDROBIN NET_UDP_TUNNEL NET_VRF NFC NFC_DIGITAL NFC_FDP NFC_HCI NFC_MRVL NFC_MRVL_USB NFC_NCI NFC_NCI_UART NFC_PN533 NFC_PN533_USB NFC_PORT100 NFC_SHDLC NFC_SIM NFC_VIRTUAL_NCI NFSD NFSD_BLOCKLAYOUT NFSD_FLEXFILELAYOUT NFSD_PNFS NFSD_SCSILAYOUT NFSD_V3_ACL NFSD_V4 NFSD_V4_2_INTER_SSC NFSD_V4_SECURITY_LABEL NFS_FSCACHE NFS_V4_1 NFS_V4_2 NFS_V4_2_READ_PLUS NFS_V4_2_SSC_HELPER NFS_V4_SECURITY_LABEL NFT_BRIDGE_META NFT_BRIDGE_REJECT NFT_COMPAT NFT_CONNLIMIT NFT_CT NFT_DUP_IPV4 NFT_DUP_IPV6 NFT_DUP_NETDEV NFT_FIB NFT_FIB_INET NFT_FIB_IPV4 NFT_FIB_IPV6 NFT_FIB_NETDEV NFT_FLOW_OFFLOAD NFT_HASH NFT_LIMIT NFT_LOG NFT_MASQ NFT_NAT NFT_NUMGEN NFT_OSF NFT_QUEUE NFT_QUOTA NFT_REDIR NFT_REJECT NFT_REJECT_INET NFT_REJECT_IPV4 NFT_REJECT_IPV6 NFT_REJECT_NETDEV NFT_SOCKET NFT_SYNPROXY NFT_TPROXY NFT_TUNNEL NFT_XFRM NF_CONNTRACK_AMANDA NF_CONNTRACK_BRIDGE NF_CONNTRACK_BROADCAST NF_CONNTRACK_EVENTS NF_CONNTRACK_H323 NF_CONNTRACK_LABELS NF_CONNTRACK_MARK NF_CONNTRACK_NETBIOS_NS NF_CONNTRACK_OVS NF_CONNTRACK_PPTP NF_CONNTRACK_SANE NF_CONNTRACK_SNMP NF_CONNTRACK_TFTP NF_CONNTRACK_TIMEOUT NF_CONNTRACK_TIMESTAMP NF_CONNTRACK_ZONES NF_CT_NETLINK_HELPER NF_CT_NETLINK_TIMEOUT NF_CT_PROTO_DCCP NF_CT_PROTO_GRE NF_CT_PROTO_SCTP NF_CT_PROTO_UDPLITE NF_DUP_IPV4 NF_DUP_IPV6 NF_DUP_NETDEV NF_FLOW_TABLE NF_FLOW_TABLE_INET NF_NAT_AMANDA NF_NAT_H323 NF_NAT_OVS NF_NAT_PPTP NF_NAT_REDIRECT NF_NAT_SNMP_BASIC NF_NAT_TFTP NF_SOCKET_IPV4 NF_TABLES NF_TABLES_BRIDGE NF_TABLES_INET NF_TABLES_IPV4 NF_TABLES_IPV6 NF_TABLES_NETDEV PARTITION_ADVANCED PSAMPLE RC_CORE RC_DEVICES RFKILL SPI USB_GADGET USB_MUSB_HDRC VIDEO_DEV WAN WATCH_QUEUE WIRELESS WLAN WWAN X25 X86_X32_ABI] disabling configs for [KASAN LOCKDEP ATOMIC_SLEEP HANG LEAK UBSAN], they are not needed picked [v6.5 v6.4 v6.3 v6.1 v5.19 v5.17 v5.15 v5.13 v5.10 v5.7 v5.4 v5.1 v4.19] out of 28 release tags testing release v6.5 testing commit 2dde18cd1d8fac735875f2e4987f11817cc0bc2c gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 92bc38007beda267d00bfb558c61408f67782c841559e64d7ab0016dea8c7ada run #0: crashed: WARNING in __cfg80211_ibss_joined run #1: crashed: WARNING in __cfg80211_ibss_joined run #2: crashed: WARNING in __cfg80211_ibss_joined run #3: crashed: WARNING in __cfg80211_ibss_joined run #4: crashed: WARNING in __cfg80211_ibss_joined run #5: crashed: WARNING in __cfg80211_ibss_joined run #6: crashed: WARNING in __cfg80211_ibss_joined run #7: crashed: BUG: workqueue lockup run #8: crashed: BUG: workqueue lockup run #9: OK representative crash: WARNING in __cfg80211_ibss_joined, types: [WARNING] testing release v6.4 testing commit 6995e2de6891c724bfeb2db33d7b87775f913ad1 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: fa729bc2d67079284e7117abc1a8aba5145fb284a52ad07499f98b3ee8a44067 all runs: OK false negative chance: 0.000 # git bisect start 2dde18cd1d8fac735875f2e4987f11817cc0bc2c 6995e2de6891c724bfeb2db33d7b87775f913ad1 Bisecting: 7364 revisions left to test after this (roughly 13 steps) [b775d6c5859affe00527cbe74263de05cfe6b9f9] Merge tag 'mips_6.5' of git://git.kernel.org/pub/scm/linux/kernel/git/mips/linux testing commit b775d6c5859affe00527cbe74263de05cfe6b9f9 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 6b8b4bed637235a02528a2120c66ad85ee43a2fad5d42d9c462ce4667176eff4 run #0: crashed: WARNING in __cfg80211_ibss_joined run #1: crashed: WARNING in __cfg80211_ibss_joined run #2: crashed: WARNING in __cfg80211_ibss_joined run #3: crashed: WARNING in __cfg80211_ibss_joined run #4: crashed: BUG: workqueue lockup run #5: crashed: WARNING in __cfg80211_ibss_joined run #6: crashed: BUG: workqueue lockup run #7: OK run #8: OK run #9: crashed: BUG: workqueue lockup representative crash: WARNING in __cfg80211_ibss_joined, types: [WARNING UNKNOWN] # git bisect bad b775d6c5859affe00527cbe74263de05cfe6b9f9 Bisecting: 3061 revisions left to test after this (roughly 12 steps) [3a8a670eeeaa40d87bd38a587438952741980c18] Merge tag 'net-next-6.5' of git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net-next testing commit 3a8a670eeeaa40d87bd38a587438952741980c18 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: d8079a040a553fb997bee73b0403c5880820f020571c503407d036aeda67901d run #0: crashed: WARNING in __cfg80211_ibss_joined run #1: crashed: WARNING in __cfg80211_ibss_joined run #2: crashed: WARNING in __cfg80211_ibss_joined run #3: crashed: WARNING in __cfg80211_ibss_joined run #4: crashed: WARNING in __cfg80211_ibss_joined run #5: crashed: WARNING in __cfg80211_ibss_joined run #6: crashed: WARNING in __cfg80211_ibss_joined run #7: OK run #8: OK run #9: OK representative crash: WARNING in __cfg80211_ibss_joined, types: [WARNING] # git bisect bad 3a8a670eeeaa40d87bd38a587438952741980c18 Bisecting: 2103 revisions left to test after this (roughly 11 steps) [6e17c6de3ddf3073741d9c91a796ee696914d8a0] Merge tag 'mm-stable-2023-06-24-19-15' of git://git.kernel.org/pub/scm/linux/kernel/git/akpm/mm testing commit 6e17c6de3ddf3073741d9c91a796ee696914d8a0 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 1e1fe5c360b2a4479816117ec165fe254e759b3a26b557130f37e641b88a2f8f run #0: crashed: BUG: workqueue lockup run #1: crashed: BUG: workqueue lockup run #2: crashed: BUG: workqueue lockup run #3: crashed: BUG: workqueue lockup run #4: crashed: BUG: workqueue lockup run #5: crashed: BUG: workqueue lockup run #6: crashed: BUG: workqueue lockup run #7: crashed: BUG: workqueue lockup run #8: crashed: BUG: workqueue lockup run #9: OK representative crash: BUG: workqueue lockup, types: [UNKNOWN] # git bisect bad 6e17c6de3ddf3073741d9c91a796ee696914d8a0 Bisecting: 1048 revisions left to test after this (roughly 10 steps) [2605e80d3438c77190f55b821c6575048c68268e] Merge tag 'arm64-upstream' of git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux testing commit 2605e80d3438c77190f55b821c6575048c68268e gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 7c2ba80b75257cacef50aa4ab629eb4b640faf935a21b1e6ddb418b623d9b515 run #0: crashed: BUG: workqueue lockup run #1: crashed: BUG: workqueue lockup run #2: crashed: BUG: workqueue lockup run #3: crashed: BUG: workqueue lockup run #4: crashed: BUG: workqueue lockup run #5: crashed: BUG: workqueue lockup run #6: OK run #7: crashed: BUG: workqueue lockup run #8: crashed: BUG: workqueue lockup run #9: OK representative crash: BUG: workqueue lockup, types: [UNKNOWN] # git bisect bad 2605e80d3438c77190f55b821c6575048c68268e Bisecting: 665 revisions left to test after this (roughly 9 steps) [0aa69d53ac7c30f6184f88f2e310d808b32b35a5] Merge tag 'for-6.5/io_uring-2023-06-23' of git://git.kernel.dk/linux testing commit 0aa69d53ac7c30f6184f88f2e310d808b32b35a5 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: fd4106f3ff5229e8a6255ef1a5b1fdeab55cd28728a3e0dbf148af310efde1eb run #0: basic kernel testing failed: failed to copy binary to VM: failed to run ["scp" "-P" "22" "-F" "/dev/null" "-o" "UserKnownHostsFile=/dev/null" "-o" "BatchMode=yes" "-o" "IdentitiesOnly=yes" "-o" "StrictHostKeyChecking=no" "-o" "ConnectTimeout=10" "-v" "/tmp/syz-executor2639015027" "root@10.128.1.166:./syz-executor2639015027"]: exit status 255 Executing: program /usr/bin/ssh host 10.128.1.166, user root, command sftp OpenSSH_9.2p1 Debian-2, OpenSSL 3.0.9 30 May 2023 debug1: Reading configuration data /dev/null debug1: Connecting to 10.128.1.166 [10.128.1.166] port 22. debug1: connect to address 10.128.1.166 port 22: Connection timed out ssh: connect to host 10.128.1.166 port 22: Connection timed out scp: Connection closed run #1: basic kernel testing failed: failed to copy binary to VM: failed to run ["scp" "-P" "22" "-F" "/dev/null" "-o" "UserKnownHostsFile=/dev/null" "-o" "BatchMode=yes" "-o" "IdentitiesOnly=yes" "-o" "StrictHostKeyChecking=no" "-o" "ConnectTimeout=10" "-v" "/tmp/syz-executor197659760" "root@10.128.1.169:./syz-executor197659760"]: exit status 255 Executing: program /usr/bin/ssh host 10.128.1.169, user root, command sftp OpenSSH_9.2p1 Debian-2, OpenSSL 3.0.9 30 May 2023 debug1: Reading configuration data /dev/null debug1: Connecting to 10.128.1.169 [10.128.1.169] port 22. debug1: connect to address 10.128.1.169 port 22: Connection timed out ssh: connect to host 10.128.1.169 port 22: Connection timed out scp: Connection closed run #2: OK run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK false negative chance: 0.000 # git bisect good 0aa69d53ac7c30f6184f88f2e310d808b32b35a5 Bisecting: 341 revisions left to test after this (roughly 8 steps) [7cffdbe3607a6cc2dc02d135e13732ec36bc4e28] Merge tag 'x86-boot-2023-06-26' of ssh://gitolite.kernel.org/pub/scm/linux/kernel/git/tip/tip testing commit 7cffdbe3607a6cc2dc02d135e13732ec36bc4e28 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: ff249a49fb3da463c9dde2df748a63b7a3c67e091de7e87bb8c39f9035cced21 run #0: crashed: BUG: workqueue lockup run #1: crashed: BUG: workqueue lockup run #2: crashed: BUG: workqueue lockup run #3: crashed: BUG: workqueue lockup run #4: crashed: BUG: workqueue lockup run #5: crashed: BUG: workqueue lockup run #6: crashed: BUG: workqueue lockup run #7: OK run #8: crashed: BUG: workqueue lockup run #9: OK representative crash: BUG: workqueue lockup, types: [UNKNOWN] # git bisect bad 7cffdbe3607a6cc2dc02d135e13732ec36bc4e28 Bisecting: 161 revisions left to test after this (roughly 7 steps) [658afed19ceed54a52b9e9e69c0791c8868ff55d] mtd: block: use a simple bool to track open for write testing commit 658afed19ceed54a52b9e9e69c0791c8868ff55d gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 0ac77af26fd99914a970b04345d6d4d6583fafbcd6ce91c9e8e03b85c5d413f3 run #0: basic kernel testing failed: failed to copy binary to VM: failed to run ["scp" "-P" "22" "-F" "/dev/null" "-o" "UserKnownHostsFile=/dev/null" "-o" "BatchMode=yes" "-o" "IdentitiesOnly=yes" "-o" "StrictHostKeyChecking=no" "-o" "ConnectTimeout=10" "-v" "/tmp/syz-executor4027622822" "root@10.128.1.41:./syz-executor4027622822"]: exit status 255 Executing: program /usr/bin/ssh host 10.128.1.41, user root, command sftp OpenSSH_9.2p1 Debian-2, OpenSSL 3.0.9 30 May 2023 debug1: Reading configuration data /dev/null debug1: Connecting to 10.128.1.41 [10.128.1.41] port 22. debug1: fd 3 clearing O_NONBLOCK debug1: Connection established. debug1: identity file /root/.ssh/id_rsa type -1 debug1: identity file /root/.ssh/id_rsa-cert type -1 debug1: identity file /root/.ssh/id_ecdsa type -1 debug1: identity file /root/.ssh/id_ecdsa-cert type -1 debug1: identity file /root/.ssh/id_ecdsa_sk type -1 debug1: identity file /root/.ssh/id_ecdsa_sk-cert type -1 debug1: identity file /root/.ssh/id_ed25519 type -1 debug1: identity file /root/.ssh/id_ed25519-cert type -1 debug1: identity file /root/.ssh/id_ed25519_sk type -1 debug1: identity file /root/.ssh/id_ed25519_sk-cert type -1 debug1: identity file /root/.ssh/id_xmss type -1 debug1: identity file /root/.ssh/id_xmss-cert type -1 debug1: identity file /root/.ssh/id_dsa type -1 debug1: identity file /root/.ssh/id_dsa-cert type -1 debug1: kex_exchange_identification: write: Connection reset by peer Connection reset by 10.128.1.41 port 22 scp: Connection closed run #1: basic kernel testing failed: failed to copy binary to VM: failed to run ["scp" "-P" "22" "-F" "/dev/null" "-o" "UserKnownHostsFile=/dev/null" "-o" "BatchMode=yes" "-o" "IdentitiesOnly=yes" "-o" "StrictHostKeyChecking=no" "-o" "ConnectTimeout=10" "-v" "/tmp/syz-executor93657698" "root@10.128.0.209:./syz-executor93657698"]: exit status 255 Executing: program /usr/bin/ssh host 10.128.0.209, user root, command sftp OpenSSH_9.2p1 Debian-2, OpenSSL 3.0.9 30 May 2023 debug1: Reading configuration data /dev/null debug1: Connecting to 10.128.0.209 [10.128.0.209] port 22. debug1: connect to address 10.128.0.209 port 22: Connection timed out ssh: connect to host 10.128.0.209 port 22: Connection timed out scp: Connection closed run #2: OK run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK false negative chance: 0.000 # git bisect good 658afed19ceed54a52b9e9e69c0791c8868ff55d Bisecting: 80 revisions left to test after this (roughly 6 steps) [0b24be4691c9e6ea13ca70050d42a9f9032fa788] splice: don't call file_accessed in copy_splice_read testing commit 0b24be4691c9e6ea13ca70050d42a9f9032fa788 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 02c615fba76ec30717a1105779bff6ba4deed13d85748efe800380bcd4e3a286 run #0: basic kernel testing failed: failed to copy binary to VM: failed to run ["scp" "-P" "22" "-F" "/dev/null" "-o" "UserKnownHostsFile=/dev/null" "-o" "BatchMode=yes" "-o" "IdentitiesOnly=yes" "-o" "StrictHostKeyChecking=no" "-o" "ConnectTimeout=10" "-v" "/tmp/syz-executor1952126707" "root@10.128.0.39:./syz-executor1952126707"]: exit status 255 Executing: program /usr/bin/ssh host 10.128.0.39, user root, command sftp OpenSSH_9.2p1 Debian-2, OpenSSL 3.0.9 30 May 2023 debug1: Reading configuration data /dev/null debug1: Connecting to 10.128.0.39 [10.128.0.39] port 22. debug1: connect to address 10.128.0.39 port 22: Connection timed out ssh: connect to host 10.128.0.39 port 22: Connection timed out scp: Connection closed run #1: basic kernel testing failed: failed to copy binary to VM: failed to run ["scp" "-P" "22" "-F" "/dev/null" "-o" "UserKnownHostsFile=/dev/null" "-o" "BatchMode=yes" "-o" "IdentitiesOnly=yes" "-o" "StrictHostKeyChecking=no" "-o" "ConnectTimeout=10" "-v" "/tmp/syz-executor168022420" "root@10.128.1.84:./syz-executor168022420"]: exit status 255 Executing: program /usr/bin/ssh host 10.128.1.84, user root, command sftp OpenSSH_9.2p1 Debian-2, OpenSSL 3.0.9 30 May 2023 debug1: Reading configuration data /dev/null debug1: Connecting to 10.128.1.84 [10.128.1.84] port 22. debug1: connect to address 10.128.1.84 port 22: Connection timed out ssh: connect to host 10.128.1.84 port 22: Connection timed out scp: Connection closed run #2: basic kernel testing failed: failed to copy binary to VM: failed to run ["scp" "-P" "22" "-F" "/dev/null" "-o" "UserKnownHostsFile=/dev/null" "-o" "BatchMode=yes" "-o" "IdentitiesOnly=yes" "-o" "StrictHostKeyChecking=no" "-o" "ConnectTimeout=10" "-v" "/tmp/syz-executor1989648361" "root@10.128.1.125:./syz-executor1989648361"]: exit status 255 Executing: program /usr/bin/ssh host 10.128.1.125, user root, command sftp OpenSSH_9.2p1 Debian-2, OpenSSL 3.0.9 30 May 2023 debug1: Reading configuration data /dev/null debug1: Connecting to 10.128.1.125 [10.128.1.125] port 22. debug1: connect to address 10.128.1.125 port 22: Connection timed out ssh: connect to host 10.128.1.125 port 22: Connection timed out scp: Connection closed run #3: basic kernel testing failed: failed to copy binary to VM: failed to run ["scp" "-P" "22" "-F" "/dev/null" "-o" "UserKnownHostsFile=/dev/null" "-o" "BatchMode=yes" "-o" "IdentitiesOnly=yes" "-o" "StrictHostKeyChecking=no" "-o" "ConnectTimeout=10" "-v" "/tmp/syz-executor3312332339" "root@10.128.1.133:./syz-executor3312332339"]: exit status 255 Executing: program /usr/bin/ssh host 10.128.1.133, user root, command sftp OpenSSH_9.2p1 Debian-2, OpenSSL 3.0.9 30 May 2023 debug1: Reading configuration data /dev/null debug1: Connecting to 10.128.1.133 [10.128.1.133] port 22. debug1: connect to address 10.128.1.133 port 22: Connection timed out ssh: connect to host 10.128.1.133 port 22: Connection timed out scp: Connection closed run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK false negative chance: 0.000 # git bisect good 0b24be4691c9e6ea13ca70050d42a9f9032fa788 Bisecting: 48 revisions left to test after this (roughly 5 steps) [f121ab7f4ac32ed2aa51035534926f9507a8308b] Merge tag 'irqchip-6.5' of git://git.kernel.org/pub/scm/linux/kernel/git/maz/arm-platforms into irq/core testing commit f121ab7f4ac32ed2aa51035534926f9507a8308b gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 06b44d669142f85674ffae9f8f459a2e2bc1d242418be3e44133e23b7bd57569 all runs: crashed: BUG: workqueue lockup representative crash: BUG: workqueue lockup, types: [UNKNOWN] # git bisect bad f121ab7f4ac32ed2aa51035534926f9507a8308b Bisecting: 15 revisions left to test after this (roughly 4 steps) [e0b78e9fa34102ce82ef03c71eb13f0b79954ba3] Merge branch irq/loongarch-fixes-6.5 into irq/irqchip-next testing commit e0b78e9fa34102ce82ef03c71eb13f0b79954ba3 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 73765eab8c9660309fce0d81ff9db39b6e2be8e0b662554f93a0e732cda52428 all runs: OK false negative chance: 0.000 # git bisect good e0b78e9fa34102ce82ef03c71eb13f0b79954ba3 Bisecting: 7 revisions left to test after this (roughly 3 steps) [48f31e496488a25f443c0df52464da446fb1d10c] irqchip/stm32-exti: Fix warning on initialized field overwritten testing commit 48f31e496488a25f443c0df52464da446fb1d10c gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 83b0e8da3a914e492af5a3e79afdde64e82f6d02660ffc2a8fb4cf38568a0c91 run #0: basic kernel testing failed: failed to copy binary to VM: failed to run ["scp" "-P" "22" "-F" "/dev/null" "-o" "UserKnownHostsFile=/dev/null" "-o" "BatchMode=yes" "-o" "IdentitiesOnly=yes" "-o" "StrictHostKeyChecking=no" "-o" "ConnectTimeout=10" "-v" "/tmp/syz-executor487060286" "root@10.128.1.150:./syz-executor487060286"]: exit status 255 Executing: program /usr/bin/ssh host 10.128.1.150, user root, command sftp OpenSSH_9.2p1 Debian-2, OpenSSL 3.0.9 30 May 2023 debug1: Reading configuration data /dev/null debug1: Connecting to 10.128.1.150 [10.128.1.150] port 22. debug1: connect to address 10.128.1.150 port 22: Connection timed out ssh: connect to host 10.128.1.150 port 22: Connection timed out scp: Connection closed run #1: basic kernel testing failed: failed to copy binary to VM: failed to run ["scp" "-P" "22" "-F" "/dev/null" "-o" "UserKnownHostsFile=/dev/null" "-o" "BatchMode=yes" "-o" "IdentitiesOnly=yes" "-o" "StrictHostKeyChecking=no" "-o" "ConnectTimeout=10" "-v" "/tmp/syz-executor4034735608" "root@10.128.1.185:./syz-executor4034735608"]: exit status 255 Executing: program /usr/bin/ssh host 10.128.1.185, user root, command sftp OpenSSH_9.2p1 Debian-2, OpenSSL 3.0.9 30 May 2023 debug1: Reading configuration data /dev/null debug1: Connecting to 10.128.1.185 [10.128.1.185] port 22. debug1: connect to address 10.128.1.185 port 22: Connection timed out ssh: connect to host 10.128.1.185 port 22: Connection timed out scp: Connection closed run #2: basic kernel testing failed: failed to copy binary to VM: failed to run ["scp" "-P" "22" "-F" "/dev/null" "-o" "UserKnownHostsFile=/dev/null" "-o" "BatchMode=yes" "-o" "IdentitiesOnly=yes" "-o" "StrictHostKeyChecking=no" "-o" "ConnectTimeout=10" "-v" "/tmp/syz-executor3466246748" "root@10.128.1.191:./syz-executor3466246748"]: exit status 255 Executing: program /usr/bin/ssh host 10.128.1.191, user root, command sftp OpenSSH_9.2p1 Debian-2, OpenSSL 3.0.9 30 May 2023 debug1: Reading configuration data /dev/null debug1: Connecting to 10.128.1.191 [10.128.1.191] port 22. debug1: connect to address 10.128.1.191 port 22: Connection timed out ssh: connect to host 10.128.1.191 port 22: Connection timed out scp: Connection closed run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK false negative chance: 0.000 # git bisect good 48f31e496488a25f443c0df52464da446fb1d10c Bisecting: 3 revisions left to test after this (roughly 2 steps) [721255b9826bd11c7a38b585905fc2dd0fb94e52] genirq: Use a maple tree for interrupt descriptor management testing commit 721255b9826bd11c7a38b585905fc2dd0fb94e52 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: b1ed8f4dee1d485562982a883b72f8dc6574839f438fc2dc404c87ad2268cf08 run #0: crashed: BUG: workqueue lockup run #1: crashed: BUG: workqueue lockup run #2: crashed: BUG: workqueue lockup run #3: crashed: BUG: workqueue lockup run #4: crashed: BUG: workqueue lockup run #5: crashed: BUG: workqueue lockup run #6: crashed: BUG: workqueue lockup run #7: crashed: BUG: workqueue lockup run #8: crashed: BUG: workqueue lockup run #9: OK representative crash: BUG: workqueue lockup, types: [UNKNOWN] # git bisect bad 721255b9826bd11c7a38b585905fc2dd0fb94e52 Bisecting: 1 revision left to test after this (roughly 1 step) [bc06a9e0874239cb6d4eebcb0ecd1a91ad9272db] genirq: Use hlist for managing resend handlers testing commit bc06a9e0874239cb6d4eebcb0ecd1a91ad9272db gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 0bccbf00ad5bc0afdb79270b3ec1120f49ddbf340e1d30a2dc3121e9b3da5ea2 all runs: crashed: BUG: workqueue lockup representative crash: BUG: workqueue lockup, types: [UNKNOWN] # git bisect bad bc06a9e0874239cb6d4eebcb0ecd1a91ad9272db Bisecting: 0 revisions left to test after this (roughly 0 steps) [d15121be7485655129101f3960ae6add40204463] Revert "softirq: Let ksoftirqd do its job" testing commit d15121be7485655129101f3960ae6add40204463 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 26ad835af43d9a2dc18592809a7cf73bc6473b965a4c028d87f3678e6a822309 all runs: crashed: BUG: workqueue lockup representative crash: BUG: workqueue lockup, types: [UNKNOWN] # git bisect bad d15121be7485655129101f3960ae6add40204463 d15121be7485655129101f3960ae6add40204463 is the first bad commit commit d15121be7485655129101f3960ae6add40204463 Author: Paolo Abeni Date: Mon May 8 08:17:44 2023 +0200 Revert "softirq: Let ksoftirqd do its job" This reverts the following commits: 4cd13c21b207 ("softirq: Let ksoftirqd do its job") 3c53776e29f8 ("Mark HI and TASKLET softirq synchronous") 1342d8080f61 ("softirq: Don't skip softirq execution when softirq thread is parking") in a single change to avoid known bad intermediate states introduced by a patch series reverting them individually. Due to the mentioned commit, when the ksoftirqd threads take charge of softirq processing, the system can experience high latencies. In the past a few workarounds have been implemented for specific side-effects of the initial ksoftirqd enforcement commit: commit 1ff688209e2e ("watchdog: core: make sure the watchdog_worker is not deferred") commit 8d5755b3f77b ("watchdog: softdog: fire watchdog even if softirqs do not get to run") commit 217f69743681 ("net: busy-poll: allow preemption in sk_busy_loop()") commit 3c53776e29f8 ("Mark HI and TASKLET softirq synchronous") But the latency problem still exists in real-life workloads, see the link below. The reverted commit intended to solve a live-lock scenario that can now be addressed with the NAPI threaded mode, introduced with commit 29863d41bb6e ("net: implement threaded-able napi poll loop support"), which is nowadays in a pretty stable status. While a complete solution to put softirq processing under nice resource control would be preferable, that has proven to be a very hard task. In the short term, remove the main pain point, and also simplify a bit the current softirq implementation. Signed-off-by: Paolo Abeni Signed-off-by: Thomas Gleixner Tested-by: Jason Xing Reviewed-by: Jakub Kicinski Reviewed-by: Eric Dumazet Reviewed-by: Sebastian Andrzej Siewior Cc: "Paul E. McKenney" Cc: Peter Zijlstra Cc: netdev@vger.kernel.org Link: https://lore.kernel.org/netdev/305d7742212cbe98621b16be782b0562f1012cb6.camel@redhat.com Link: https://lore.kernel.org/r/57e66b364f1b6f09c9bc0316742c3b14f4ce83bd.1683526542.git.pabeni@redhat.com kernel/softirq.c | 22 ++-------------------- 1 file changed, 2 insertions(+), 20 deletions(-) accumulated error probability: 0.00 parent commit ac9a78681b921877518763ba0e89202254349d1b wasn't tested testing commit ac9a78681b921877518763ba0e89202254349d1b gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: bcc07687e2daf9c1115c690ad1d277dd1878748f7ecad0b3c10f6f0c8d6537c7 culprit signature: 26ad835af43d9a2dc18592809a7cf73bc6473b965a4c028d87f3678e6a822309 parent signature: bcc07687e2daf9c1115c690ad1d277dd1878748f7ecad0b3c10f6f0c8d6537c7 revisions tested: 23, total time: 6h43m39.750438259s (build: 2h38m5.403251669s, test: 3h46m59.479779124s) first bad commit: d15121be7485655129101f3960ae6add40204463 Revert "softirq: Let ksoftirqd do its job" recipients (to): ["bigeasy@linutronix.de" "edumazet@google.com" "kerneljasonxing@gmail.com" "kuba@kernel.org" "pabeni@redhat.com" "tglx@linutronix.de"] recipients (cc): [] crash: BUG: workqueue lockup BUG: workqueue lockup - pool cpus=0 node=0 flags=0x0 nice=0 stuck for 229s! BUG: workqueue lockup - pool cpus=0 node=0 flags=0x0 nice=-20 stuck for 225s! Showing busy workqueues and worker pools: workqueue events: flags=0x0 pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=3/256 refcnt=4 pending: vmstat_shepherd, kfree_rcu_monitor, free_obj_work workqueue events_unbound: flags=0x2 pwq 4: cpus=0-1 flags=0x4 nice=0 active=2/512 refcnt=4 in-flight: 32:fsnotify_mark_destroy_workfn, 3458:fsnotify_connector_destroy_workfn workqueue events_power_efficient: flags=0x80 pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=6/256 refcnt=7 pending: 2*neigh_managed_work, neigh_periodic_work, do_cache_clean, neigh_periodic_work, reg_check_chans_work workqueue rcu_gp: flags=0x8 pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: srcu_invoke_callbacks workqueue mm_percpu_wq: flags=0x8 pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: vmstat_update workqueue kblockd: flags=0x18 pwq 1: cpus=0 node=0 flags=0x0 nice=-20 active=1/256 refcnt=2 pending: blk_mq_timeout_work workqueue phy4: flags=0xa0002 pwq 4: cpus=0-1 flags=0x4 nice=0 active=1/1 refcnt=5 in-flight: 12:ieee80211_iface_work inactive: ieee80211_iface_work, ieee80211_csa_connection_drop_work pool 4: cpus=0-1 flags=0x4 nice=0 hung=0s workers=7 idle: 767 10 11664 33 Showing backtraces of running workers in stalled CPU-bound worker pools: