ci2 starts bisection 2025-04-07 17:32:04.750892747 +0000 UTC m=+16606.327265034 bisecting fixing commit since 344a09659766c83c42cdd4943318deabde89a9c3 building syzkaller on e28266709dd2a1d1452d4a5bbf271700e10335c6 ensuring issue is reproducible on original commit 344a09659766c83c42cdd4943318deabde89a9c3 testing commit 344a09659766c83c42cdd4943318deabde89a9c3 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 07ba5b36a9690590db6f2da979fc0b61cb07ca81ef5858b5a566abb88caa0b17 run #0: crashed: INFO: rcu detected stall in sys_perf_event_open run #1: crashed: INFO: rcu detected stall in sys_futex run #2: crashed: INFO: rcu detected stall in sys_perf_event_open run #3: crashed: INFO: rcu detected stall in sys_futex run #4: crashed: INFO: rcu detected stall in sys_futex run #5: crashed: INFO: rcu detected stall in syscall_enter_from_user_mode run #6: crashed: INFO: rcu detected stall in corrupted run #7: crashed: INFO: rcu detected stall in sys_perf_event_open run #8: crashed: INFO: rcu detected stall in syscall_enter_from_user_mode run #9: crashed: INFO: rcu detected stall in syscall_enter_from_user_mode run #10: crashed: INFO: rcu detected stall in corrupted run #11: crashed: INFO: rcu detected stall in corrupted run #12: crashed: INFO: rcu detected stall in sys_perf_event_open run #13: crashed: INFO: rcu detected stall in sys_perf_event_open run #14: crashed: INFO: rcu detected stall in irqentry_exit run #15: crashed: INFO: rcu detected stall in sys_perf_event_open run #16: crashed: INFO: rcu detected stall in syscall_enter_from_user_mode run #17: crashed: INFO: rcu detected stall in sys_futex run #18: crashed: INFO: rcu detected stall in corrupted run #19: OK representative crash: INFO: rcu detected stall in sys_perf_event_open, types: [HANG] check whether we can drop unnecessary instrumentation disabling configs for [LEAK UBSAN BUG KASAN LOCKDEP ATOMIC_SLEEP], they are not needed testing commit 344a09659766c83c42cdd4943318deabde89a9c3 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: edd3b9360d14075e0feaf5876a038f35232ac20e0ca596c51d76a51681069af0 all runs: OK false negative chance: 0.000 kconfig minimization: base=3823 full=7499 leaves diff=2071 split chunks (needed=false): <2071> split chunk #0 of len 2071 into 5 parts testing without sub-chunk 1/5 testing commit 344a09659766c83c42cdd4943318deabde89a9c3 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 1465253a4bd1c95622403110d5fb63f83ccb996bc043a3abaad38aac0007988e run #0: crashed: INFO: rcu detected stall in sys_perf_event_open run #1: crashed: INFO: rcu detected stall in corrupted run #2: crashed: INFO: rcu detected stall in corrupted run #3: crashed: INFO: rcu detected stall in corrupted run #4: crashed: INFO: rcu detected stall in sys_futex run #5: crashed: INFO: rcu detected stall in sys_futex run #6: crashed: INFO: rcu detected stall in corrupted run #7: crashed: INFO: rcu detected stall in sys_futex run #8: crashed: INFO: rcu detected stall in corrupted run #9: crashed: INFO: rcu detected stall in sys_futex representative crash: INFO: rcu detected stall in sys_perf_event_open, types: [HANG] the chunk can be dropped testing without sub-chunk 2/5 testing commit 344a09659766c83c42cdd4943318deabde89a9c3 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 24a78d010fa56293b2ccaea8d35be4eaed982ce5fe26af9efdeb6202f03bcdc3 run #0: crashed: INFO: rcu detected stall in syscall_enter_from_user_mode run #1: crashed: INFO: rcu detected stall in smp_call_function run #2: crashed: INFO: rcu detected stall in irqentry_exit run #3: crashed: INFO: rcu detected stall in corrupted run #4: crashed: INFO: rcu detected stall in irqentry_exit run #5: crashed: INFO: rcu detected stall in syscall_enter_from_user_mode run #6: crashed: INFO: rcu detected stall in irqentry_exit run #7: crashed: INFO: rcu detected stall in sys_perf_event_open run #8: crashed: INFO: rcu detected stall in sys_futex run #9: OK representative crash: INFO: rcu detected stall in syscall_enter_from_user_mode, types: [HANG] the chunk can be dropped testing without sub-chunk 3/5 testing commit 344a09659766c83c42cdd4943318deabde89a9c3 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 62c73b4c5bceb52a0181af187cbeda9482c6088c8c60219ecd1a6fa2ee2fbfc6 run #0: crashed: INFO: rcu detected stall in sys_perf_event_open run #1: crashed: INFO: rcu detected stall in sys_perf_event_open run #2: OK run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK representative crash: INFO: rcu detected stall in sys_perf_event_open, types: [HANG] testing without sub-chunk 4/5 testing commit 344a09659766c83c42cdd4943318deabde89a9c3 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 084fb487f6f97d565c2b8d73436adf32fed2505b3ef41a506d7ffb79b13c3537 run #0: crashed: INFO: rcu detected stall in syscall_enter_from_user_mode run #1: crashed: INFO: rcu detected stall in syscall_exit_to_user_mode run #2: crashed: INFO: rcu detected stall in corrupted run #3: crashed: INFO: rcu detected stall in sys_futex run #4: crashed: INFO: rcu detected stall in corrupted run #5: crashed: INFO: rcu detected stall in corrupted run #6: crashed: INFO: rcu detected stall in corrupted run #7: crashed: INFO: rcu detected stall in corrupted run #8: crashed: INFO: rcu detected stall in sys_perf_event_open run #9: crashed: INFO: rcu detected stall in corrupted run #10: crashed: INFO: rcu detected stall in sys_perf_event_open run #11: crashed: INFO: rcu detected stall in syscall_enter_from_user_mode run #12: crashed: INFO: rcu detected stall in sys_perf_event_open run #13: crashed: INFO: rcu detected stall in syscall_enter_from_user_mode run #14: crashed: INFO: rcu detected stall in sys_futex run #15: crashed: INFO: rcu detected stall in sys_perf_event_open run #16: crashed: INFO: rcu detected stall in gettid run #17: crashed: INFO: rcu detected stall in corrupted run #18: crashed: INFO: rcu detected stall in sys_perf_event_open run #19: OK representative crash: INFO: rcu detected stall in syscall_enter_from_user_mode, types: [HANG] the chunk can be dropped testing without sub-chunk 5/5 testing commit 344a09659766c83c42cdd4943318deabde89a9c3 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 7a9dfd5b266efef365e062424584b96e6f2aaf3705d1df926f3a8e37eef4a18c run #0: crashed: INFO: rcu detected stall in syscall_enter_from_user_mode run #1: crashed: INFO: rcu detected stall in corrupted run #2: crashed: INFO: rcu detected stall in syscall_enter_from_user_mode run #3: OK run #4: OK run #5: OK run #6: crashed: INFO: rcu detected stall in corrupted run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK representative crash: INFO: rcu detected stall in syscall_enter_from_user_mode, types: [HANG] minimized to 826 configs; suspects: [ARCH_ENABLE_MEMORY_HOTREMOVE ATM AX25 BCMA BLK_DEV_ZONED BPF_SYSCALL BRIDGE BRIDGE_NETFILTER CAN CARDBUS CFG80211 CFG80211_WEXT CHECKPOINT_RESTORE CMA COMMON_CLK CONTIG_ALLOC CRYPTO_842 CRYPTO_LZ4 CRYPTO_LZ4HC CRYPTO_LZO CRYPTO_ZSTD DVB_CORE EXTCON FB FSCACHE GPIOLIB HAMRADIO HID_NINTENDO HID_ZEROPLUS HSR I2C_MUX IIO INFINIBAND INFINIBAND_ADDR_TRANS INFINIBAND_USER_ACCESS INPUT_JOYSTICK INPUT_MOUSE IP6_NF_RAW IPV6_MULTIPLE_TABLES IP_NF_RAW IP_SET IP_VS IP_VS_OVF IP_VS_PE_SIP IP_VS_PROTO_AH IP_VS_PROTO_AH_ESP IP_VS_PROTO_ESP IP_VS_PROTO_SCTP IP_VS_PROTO_UDP IP_VS_RR IP_VS_SED IP_VS_SH IP_VS_TWOS IP_VS_WLC IP_VS_WRR IRQ_BYPASS_MANAGER IRQ_POLL IRQ_REMAP IR_IGORPLUGUSB IR_IGUANA IR_IMON IR_IMON_RAW IR_MCEUSB IR_REDRAT3 IR_STREAMZAP IR_TOY IR_TTUSBIR ISDN ISDN_CAPI_MIDDLEWARE JFFS2_CMODE_PRIORITY JFFS2_COMPRESSION_OPTIONS JFFS2_FS JFFS2_FS_POSIX_ACL JFFS2_FS_SECURITY JFFS2_FS_WRITEBUFFER JFFS2_FS_XATTR JFFS2_LZO JFFS2_RTIME JFFS2_RUBIN JFFS2_SUMMARY JFFS2_ZLIB JFS_DEBUG JFS_FS JFS_POSIX_ACL JFS_SECURITY JOYSTICK_IFORCE JOYSTICK_IFORCE_USB JOYSTICK_PXRC JOYSTICK_XPAD JOYSTICK_XPAD_FF JOYSTICK_XPAD_LEDS KARMA_PARTITION KCOV KCOV_ENABLE_COMPARISONS KCOV_INSTRUMENT_ALL KEYS_REQUEST_CACHE KEY_DH_OPERATIONS KEY_NOTIFICATIONS KSM KVM KVM_AMD KVM_ASYNC_PF KVM_COMPAT KVM_GENERIC_DIRTYLOG_READ_PROTECT KVM_INTEL KVM_MMIO KVM_VFIO KVM_XEN KVM_XFER_TO_GUEST_WORK L2TP L2TP_ETH L2TP_IP L2TP_V3 LAPB LAPBETHER LDM_PARTITION LEDS_TRIGGER_AUDIO LEGACY_PTYS LIBCRC32C LIBNVDIMM LINEAR_RANGES LLC LLC2 LOCALVERSION_AUTO LOGIG940_FF LOGIRUMBLEPAD2_FF LOGO LOGO_LINUX_MONO LOGO_LINUX_VGA16 LPC_ICH LWTUNNEL LWTUNNEL_BPF LZ4HC_COMPRESS LZ4_COMPRESS MAC80211 MAC80211_DEBUGFS MAC80211_HAS_RC MAC80211_HWSIM MAC80211_MESH MAC80211_RC_DEFAULT_MINSTREL MAC80211_RC_MINSTREL MACSEC MACVLAN MACVTAP MAC_PARTITION MAPPING_DIRTY_HELPERS MDIO_MVUSB MD_LINEAR MD_MULTIPATH MD_RAID0 MD_RAID1 MD_RAID10 MD_RAID456 MEDIA_ANALOG_TV_SUPPORT MEDIA_ATTACH MEDIA_CAMERA_SUPPORT MEDIA_CEC_SUPPORT MEDIA_CONTROLLER MEDIA_CONTROLLER_DVB MEDIA_CONTROLLER_REQUEST_API MEDIA_DIGITAL_TV_SUPPORT MEDIA_RADIO_SUPPORT MEDIA_SDR_SUPPORT MEDIA_SUPPORT MEDIA_SUPPORT_FILTER MEDIA_TEST_SUPPORT MEDIA_TUNER MEDIA_TUNER_MSI001 MEDIA_USB_SUPPORT MEMORY_BALLOON MEMORY_HOTPLUG MEMORY_HOTPLUG_DEFAULT_ONLINE MEMORY_HOTREMOVE MEMORY_ISOLATION MEMREGION MEMSTICK MEMSTICK_REALTEK_USB MEM_SOFT_DIRTY MFD_CORE MFD_SYSCON MFD_VIPERBOARD MHI_BUS MHI_WWAN_CTRL MHP_MEMMAP_ON_MEMORY MICROCHIP_PHY MINIX_FS MINIX_SUBPARTITION MISC_RTSX MISC_RTSX_USB MISDN MISDN_DSP MISDN_HFCUSB MISDN_L1OIP MKISS MLX4_CORE MLX4_INFINIBAND MMC MMC_REALTEK_USB MMC_USHC MMC_VUB300 MMU_NOTIFIER MODULE_SRCVERSION_ALL MODVERSIONS MOST MOST_USB_HDM MOUSE_APPLETOUCH MOUSE_BCM5974 MOUSE_PS2 MOUSE_PS2_ALPS MOUSE_PS2_BYD MOUSE_PS2_CYPRESS MOUSE_PS2_FOCALTECH MOUSE_PS2_LIFEBOOK MOUSE_PS2_LOGIPS2PP MOUSE_PS2_SMBUS MOUSE_PS2_SYNAPTICS MOUSE_PS2_SYNAPTICS_SMBUS MOUSE_PS2_TRACKPOINT MOUSE_SYNAPTICS_USB MPLS MPLS_IPTUNNEL MPLS_ROUTING MPTCP MPTCP_IPV6 MRP MTD MTD_BLKDEVS MTD_BLOCK MTD_BLOCK2MTD MTD_CFI_I1 MTD_CFI_I2 MTD_MAP_BANK_WIDTH_1 MTD_MAP_BANK_WIDTH_2 MTD_MAP_BANK_WIDTH_4 MTD_MTDRAM MTD_PHRAM MTD_SLRAM MUSB_PIO_ONLY ND_BTT ND_CLAIM ND_PFN NETDEVSIM NETFILTER_ADVANCED NETFILTER_FAMILY_ARP NETFILTER_FAMILY_BRIDGE NETFILTER_NETLINK_ACCT NETFILTER_NETLINK_GLUE_CT NETFILTER_NETLINK_OSF NETFILTER_NETLINK_QUEUE NETFILTER_SYNPROXY NETFILTER_XT_CONNMARK NETFILTER_XT_MATCH_BPF NETFILTER_XT_MATCH_CGROUP NETFILTER_XT_MATCH_CLUSTER NETFILTER_XT_MATCH_COMMENT NETFILTER_XT_MATCH_CONNBYTES NETFILTER_XT_MATCH_CONNLABEL NETFILTER_XT_MATCH_CONNLIMIT NETFILTER_XT_MATCH_CONNMARK NETFILTER_XT_MATCH_CPU NETFILTER_XT_MATCH_DCCP NETFILTER_XT_MATCH_DEVGROUP NETFILTER_XT_MATCH_DSCP NETFILTER_XT_MATCH_ECN NETFILTER_XT_MATCH_ESP NETFILTER_XT_MATCH_HASHLIMIT NETFILTER_XT_MATCH_HELPER NETFILTER_XT_MATCH_HL NETFILTER_XT_MATCH_IPCOMP NETFILTER_XT_MATCH_IPRANGE NETFILTER_XT_MATCH_IPVS NETFILTER_XT_MATCH_L2TP NETFILTER_XT_MATCH_LENGTH NETFILTER_XT_MATCH_LIMIT NETFILTER_XT_MATCH_MAC NETFILTER_XT_MATCH_MARK NETFILTER_XT_MATCH_MULTIPORT NETFILTER_XT_MATCH_NFACCT NETFILTER_XT_MATCH_OSF NETFILTER_XT_MATCH_OWNER NETFILTER_XT_MATCH_PHYSDEV NETFILTER_XT_MATCH_PKTTYPE NETFILTER_XT_MATCH_QUOTA NETFILTER_XT_MATCH_RATEEST NETFILTER_XT_MATCH_REALM NETFILTER_XT_MATCH_RECENT NETFILTER_XT_MATCH_SCTP NETFILTER_XT_MATCH_SOCKET NETFILTER_XT_MATCH_STATISTIC NETFILTER_XT_MATCH_STRING NETFILTER_XT_MATCH_TCPMSS NETFILTER_XT_MATCH_TIME NETFILTER_XT_MATCH_U32 NETFILTER_XT_SET NETFILTER_XT_TARGET_AUDIT NETFILTER_XT_TARGET_CHECKSUM NETFILTER_XT_TARGET_CLASSIFY NETFILTER_XT_TARGET_CONNMARK NETFILTER_XT_TARGET_CT NETFILTER_XT_TARGET_DSCP NETFILTER_XT_TARGET_HL NETFILTER_XT_TARGET_HMARK NETFILTER_XT_TARGET_IDLETIMER NETFILTER_XT_TARGET_LED NETFILTER_XT_TARGET_MARK NETFILTER_XT_TARGET_NETMAP NETFILTER_XT_TARGET_NFQUEUE NETFILTER_XT_TARGET_NOTRACK NETFILTER_XT_TARGET_RATEEST NETFILTER_XT_TARGET_REDIRECT NETFILTER_XT_TARGET_TCPOPTSTRIP NETFILTER_XT_TARGET_TEE NETFILTER_XT_TARGET_TPROXY NETFILTER_XT_TARGET_TRACE NETLABEL NETLINK_DIAG NETROM NET_9P_RDMA NET_ACT_BPF NET_ACT_CONNMARK NET_ACT_CSUM NET_ACT_CT NET_ACT_CTINFO NET_ACT_GATE NET_ACT_IFE NET_ACT_IPT NET_ACT_MPLS NET_ACT_NAT NET_ACT_PEDIT NET_ACT_POLICE NET_ACT_SAMPLE NET_ACT_SIMP NET_ACT_SKBEDIT NET_ACT_SKBMOD NET_ACT_TUNNEL_KEY NET_ACT_VLAN NET_CLS_BASIC NET_CLS_BPF NET_CLS_FLOW NET_CLS_FLOWER NET_CLS_FW NET_CLS_MATCHALL NET_CLS_ROUTE4 NET_DEVLINK NET_DROP_MONITOR NET_DSA NET_DSA_TAG_BRCM NET_DSA_TAG_BRCM_COMMON NET_DSA_TAG_BRCM_PREPEND NET_DSA_TAG_MTK NET_DSA_TAG_QCA NET_DSA_TAG_RTL4_A NET_EMATCH_CANID NET_EMATCH_CMP NET_EMATCH_IPSET NET_EMATCH_IPT NET_EMATCH_META NET_EMATCH_NBYTE NET_EMATCH_TEXT NET_EMATCH_U32 NET_FC NET_FOU NET_FOU_IP_TUNNELS NET_IFE NET_IFE_SKBMARK NET_IFE_SKBPRIO NET_IFE_SKBTCINDEX NET_IPGRE NET_IPGRE_BROADCAST NET_IPGRE_DEMUX NET_IPIP NET_IPVTI NET_KEY NET_KEY_MIGRATE NET_L3_MASTER_DEV NET_MPLS_GSO NET_NCSI NET_NSH NET_REDIRECT NET_SCH_CAKE NET_SCH_CBS NET_SCH_CHOKE NET_SCH_CODEL NET_SCH_DRR NET_SCH_ETF NET_SCH_ETS NET_SCH_FQ NET_SCH_FQ_CODEL NET_SCH_FQ_PIE NET_SCH_GRED NET_SCH_HFSC NET_SCH_HHF NET_SCH_HTB NET_SCH_INGRESS NET_SCH_MQPRIO NET_SCH_MULTIQ NET_SCH_NETEM NET_SCH_PIE NET_SCH_PLUG NET_SCH_PRIO NET_SCH_QFQ NET_SCH_RED NET_SCH_SFB NET_SCH_SFQ NET_SCH_SKBPRIO NET_SCH_TAPRIO NET_SCH_TBF NET_SCH_TEQL NET_SOCK_MSG NET_SWITCHDEV NET_TC_SKB_EXT NET_TEAM NET_TEAM_MODE_ACTIVEBACKUP NET_TEAM_MODE_BROADCAST NET_TEAM_MODE_LOADBALANCE NET_TEAM_MODE_RANDOM NET_TEAM_MODE_ROUNDROBIN NET_UDP_TUNNEL NET_VRF NFC NFC_DIGITAL NFC_FDP NFC_HCI NFC_MRVL NFC_MRVL_USB NFC_NCI NFC_NCI_UART NFC_PN533 NFC_PN533_USB NFC_PORT100 NFC_SHDLC NFC_SIM NFC_VIRTUAL_NCI NFSD NFSD_BLOCKLAYOUT NFSD_FLEXFILELAYOUT NFSD_PNFS NFSD_SCSILAYOUT NFSD_V3_ACL NFSD_V4 NFSD_V4_2_INTER_SSC NFSD_V4_SECURITY_LABEL NFS_FSCACHE NFS_V4_1 NFS_V4_2 NFS_V4_2_READ_PLUS NFS_V4_2_SSC_HELPER NFS_V4_SECURITY_LABEL NFT_BRIDGE_META NFT_BRIDGE_REJECT NFT_COMPAT NFT_CONNLIMIT NFT_CT NFT_DUP_IPV4 NFT_DUP_IPV6 NFT_DUP_NETDEV NFT_FIB NFT_FIB_INET NFT_FIB_IPV4 NFT_FIB_IPV6 NFT_FIB_NETDEV NFT_FLOW_OFFLOAD NFT_HASH NFT_LIMIT NFT_LOG NFT_MASQ NFT_NAT NFT_NUMGEN NFT_OSF NFT_QUEUE NFT_QUOTA NFT_REDIR NFT_REJECT NFT_REJECT_INET NFT_REJECT_IPV4 NFT_REJECT_IPV6 NFT_REJECT_NETDEV NFT_SOCKET NFT_SYNPROXY NFT_TPROXY NFT_TUNNEL NFT_XFRM NF_CONNTRACK_AMANDA NF_CONNTRACK_BRIDGE NF_CONNTRACK_BROADCAST NF_CONNTRACK_EVENTS NF_CONNTRACK_H323 NF_CONNTRACK_LABELS NF_CONNTRACK_MARK NF_CONNTRACK_NETBIOS_NS NF_CONNTRACK_PPTP NF_CONNTRACK_SANE NF_CONNTRACK_SNMP NF_CONNTRACK_TFTP NF_CONNTRACK_TIMEOUT NF_CONNTRACK_TIMESTAMP NF_CONNTRACK_ZONES NF_CT_NETLINK_HELPER NF_CT_NETLINK_TIMEOUT NF_CT_PROTO_DCCP NF_CT_PROTO_GRE NF_CT_PROTO_SCTP NF_CT_PROTO_UDPLITE NF_DUP_IPV4 NF_DUP_IPV6 NF_DUP_NETDEV NF_FLOW_TABLE NF_FLOW_TABLE_INET NF_NAT_AMANDA NF_NAT_H323 NF_NAT_PPTP NF_NAT_REDIRECT NF_NAT_SNMP_BASIC NF_NAT_TFTP NF_SOCKET_IPV4 NF_SOCKET_IPV6 NF_TABLES NF_TABLES_ARP NF_TABLES_BRIDGE NF_TABLES_INET NF_TABLES_IPV4 NF_TABLES_IPV6 NF_TABLES_NETDEV NF_TPROXY_IPV4 NF_TPROXY_IPV6 NILFS2_FS NINTENDO_FF NLMON NLS_CODEPAGE_1250 NLS_CODEPAGE_1251 NLS_CODEPAGE_737 NLS_CODEPAGE_775 NLS_CODEPAGE_850 NLS_CODEPAGE_852 NLS_CODEPAGE_855 NLS_CODEPAGE_857 NLS_CODEPAGE_860 PARPORT PARTITION_ADVANCED PCCARD PCMCIA PHONET PSAMPLE RADIO_ADAPTERS RADIO_SI470X RADIO_SI4713 RC_CORE RC_DEVICES RFKILL SND SOUND SPI SSB TAP TARGET_CORE TUN USB_AMD5536UDC USB_ATM USB_CONFIGFS USB_CONFIGFS_ECM_SUBSET USB_CONFIGFS_EEM USB_CONFIGFS_F_FS USB_CONFIGFS_F_HID USB_CONFIGFS_F_LB_SS USB_CONFIGFS_F_MIDI USB_CONFIGFS_F_PRINTER USB_CONFIGFS_F_TCM USB_CONFIGFS_F_UAC1 USB_CONFIGFS_F_UAC1_LEGACY USB_CONFIGFS_F_UAC2 USB_CONFIGFS_F_UVC USB_CONFIGFS_MASS_STORAGE USB_CONFIGFS_NCM USB_CONFIGFS_OBEX USB_CONFIGFS_PHONET USB_CONFIGFS_RNDIS USB_CONFIGFS_SERIAL USB_CONN_GPIO USB_CXACRU USB_CYPRESS_CY7C63 USB_CYTHERM USB_DSBR USB_DUMMY_HCD USB_DWC2 USB_DWC2_HOST USB_DWC2_PCI USB_DWC3 USB_DWC3_GADGET USB_DWC3_HAPS USB_DWC3_OF_SIMPLE USB_DWC3_PCI USB_DWC3_ULPI USB_DYNAMIC_MINORS USB_EG20T USB_EHCI_FSL USB_EHCI_HCD_PLATFORM USB_EHCI_ROOT_HUB_TT USB_EHSET_TEST_FIXTURE USB_EMI26 USB_EMI62 USB_EPSON2888 USB_EZUSB_FX2 USB_FEW_INIT_RETRIES USB_FOTG210_HCD USB_FOTG210_UDC USB_FTDI_ELAN USB_F_ACM USB_F_ECM USB_F_EEM USB_F_FS USB_F_HID USB_F_MASS_STORAGE USB_F_MIDI USB_F_NCM USB_F_OBEX USB_F_PHONET USB_F_PRINTER USB_F_RNDIS USB_F_SERIAL USB_F_SS_LB USB_F_SUBSET USB_F_TCM USB_F_UAC1 USB_F_UAC1_LEGACY USB_F_UAC2 USB_F_UVC USB_GADGET USB_GADGETFS USB_GADGET_DEBUG_FILES USB_GADGET_DEBUG_FS USB_GL860 USB_GOKU USB_GPIO_VBUS USB_GR_UDC USB_GSPCA USB_GSPCA_BENQ USB_GSPCA_CONEX USB_GSPCA_CPIA1 USB_GSPCA_DTCS033 USB_GSPCA_ETOMS USB_GSPCA_FINEPIX USB_GSPCA_JEILINJ USB_GSPCA_JL2005BCD USB_GSPCA_KINECT USB_GSPCA_KONICA USB_GSPCA_MARS USB_GSPCA_MR97310A USB_GSPCA_NW80X USB_GSPCA_OV519 USB_GSPCA_OV534 USB_GSPCA_OV534_9 USB_GSPCA_PAC207 USB_GSPCA_PAC7302 USB_GSPCA_PAC7311 USB_GSPCA_SE401 USB_GSPCA_SN9C2028 USB_GSPCA_SN9C20X USB_GSPCA_SONIXB USB_GSPCA_SONIXJ USB_GSPCA_SPCA1528 USB_GSPCA_SPCA500 USB_GSPCA_SPCA501 USB_GSPCA_SPCA505 USB_GSPCA_SPCA506 USB_GSPCA_SPCA508 USB_GSPCA_SPCA561 USB_GSPCA_SQ905 USB_GSPCA_SQ905C USB_GSPCA_SQ930X USB_GSPCA_STK014 USB_GSPCA_STK1135 USB_GSPCA_STV0680 USB_GSPCA_SUNPLUS USB_GSPCA_T613 USB_GSPCA_TOPRO USB_GSPCA_TOUPTEK USB_GSPCA_TV8532 USB_GSPCA_VC032X USB_GSPCA_VICAM USB_GSPCA_XIRLINK_CIT USB_GSPCA_ZC3XX USB_HACKRF USB_HCD_BCMA USB_HCD_SSB USB_HSIC_USB3503 USB_HSIC_USB4604 USB_HSO USB_HUB_USB251XB USB_IDMOUSE USB_IOWARRIOR USB_IPHETH USB_ISIGHTFW USB_ISP116X_HCD USB_ISP1301 USB_ISP1760 USB_ISP1760_DUAL_ROLE USB_ISP1760_HCD USB_ISP1761_UDC USB_KAWETH USB_KC2190 USB_KEENE USB_LAN78XX USB_LCD USB_LD USB_LEDS_TRIGGER_USBPORT USB_LED_TRIG USB_LEGOTOWER USB_LGM_PHY USB_LIBCOMPOSITE USB_LINK_LAYER_TEST USB_M5602 USB_MA901 USB_MAX3420_UDC USB_MAX3421_HCD USB_MDC800 USB_MICROTEK USB_MR800 USB_MSI2500 USB_MUSB_DUAL_ROLE USB_MUSB_HDRC USB_MV_U3D USB_MV_UDC USB_NET2272 USB_NET2272_DMA USB_NET2280 USB_NET_AQC111 USB_NET_AX88179_178A USB_NET_AX8817X USB_NET_CDCETHER USB_NET_CDC_EEM USB_NET_CDC_MBIM USB_NET_CDC_NCM USB_NET_CDC_SUBSET USB_NET_CDC_SUBSET_ENABLE USB_NET_CH9200 USB_NET_CX82310_ETH USB_NET_DM9601 USB_NET_GL620A USB_NET_HUAWEI_CDC_NCM USB_NET_INT51X1 USB_NET_KALMIA USB_NET_MCS7830 USB_NET_NET1080 USB_NET_PLUSB USB_NET_QMI_WWAN USB_NET_RNDIS_HOST USB_NET_RNDIS_WLAN USB_NET_SMSC75XX USB_NET_SMSC95XX USB_NET_SR9700 USB_NET_SR9800 USB_NET_ZAURUS USB_OHCI_HCD_PLATFORM USB_OTG USB_OTG_FSM USB_OXU210HP_HCD USB_PEGASUS USB_PULSE8_CEC USB_PWC USB_PWC_INPUT_EVDEV USB_PXA27X USB_R8A66597 USB_R8A66597_HCD USB_RAINSHADOW_CEC USB_RAREMONO USB_RAW_GADGET USB_RTL8150 USB_RTL8152 USB_RTL8153_ECM USB_S2255 USB_SERIAL USB_SERIAL_AIRCABLE USB_SERIAL_ARK3116 USB_SERIAL_BELKIN USB_SERIAL_CH341 USB_SERIAL_CONSOLE USB_SERIAL_CP210X USB_SERIAL_CYBERJACK USB_SERIAL_CYPRESS_M8 USB_SERIAL_DEBUG USB_SERIAL_DIGI_ACCELEPORT USB_SERIAL_EDGEPORT USB_SERIAL_EDGEPORT_TI USB_SERIAL_EMPEG USB_SERIAL_F81232 USB_SERIAL_F8153X USB_SERIAL_FTDI_SIO USB_SERIAL_GARMIN USB_SERIAL_GENERIC USB_SERIAL_IPAQ USB_SERIAL_IPW USB_SERIAL_IR USB_SERIAL_IUU USB_SERIAL_KEYSPAN USB_SERIAL_KEYSPAN_PDA USB_SERIAL_KLSI USB_SERIAL_KOBIL_SCT USB_SERIAL_MCT_U232 USB_SERIAL_METRO USB_SERIAL_MOS7715_PARPORT USB_SERIAL_MOS7720 USB_SERIAL_MOS7840 USB_SERIAL_MXUPORT USB_SERIAL_NAVMAN USB_SERIAL_OMNINET USB_SERIAL_OPTICON USB_SERIAL_OPTION USB_SERIAL_OTI6858 USB_SERIAL_PL2303 USB_SERIAL_QCAUX USB_SERIAL_QT2 USB_SERIAL_QUALCOMM USB_SERIAL_SAFE USB_SERIAL_SIERRAWIRELESS USB_SERIAL_SIMPLE USB_SERIAL_SPCP8X5 USB_SERIAL_SSU100 USB_SERIAL_SYMBOL USB_SERIAL_TI USB_SERIAL_UPD78F0730 USB_SERIAL_VISOR USB_SERIAL_WHITEHEAT USB_SERIAL_WISHBONE USB_SERIAL_WWAN USB_SERIAL_XR USB_SERIAL_XSENS_MT USB_SEVSEG USB_SI470X USB_SI4713 USB_SIERRA_NET USB_SISUSBVGA USB_SL811_CS USB_SL811_HCD USB_SL811_HCD_ISO USB_SNP_CORE USB_SPEEDTOUCH USB_STORAGE_ALAUDA USB_STORAGE_CYPRESS_ATACB USB_STORAGE_DATAFAB USB_STORAGE_ENE_UB6250 USB_STORAGE_FREECOM USB_STORAGE_ISD200 USB_STORAGE_JUMPSHOT USB_STORAGE_KARMA USB_STORAGE_ONETOUCH USB_STORAGE_SDDR09 USB_STORAGE_SDDR55 USB_STORAGE_USBAT USB_STV06XX USB_TEST USB_TMC USB_TRANCEVIBRATOR USB_U132_HCD USB_UAS USB_UEAGLEATM USB_ULPI_BUS USB_USBNET USB_USS720 USB_U_AUDIO USB_U_ETHER USB_U_SERIAL USB_VIDEO_CLASS USB_VIDEO_CLASS_INPUT_EVDEV USB_VL600 USB_WDM USB_XHCI_DBGCAP USB_XHCI_PCI_RENESAS USB_XHCI_PLATFORM USB_XUSBATM USB_YUREX USERFAULTFD USERIO USERMODE_DRIVER USER_RETURN_NOTIFIER U_SERIAL_CONSOLE V4L2_MEM2MEM_DEV V4L_TEST_DRIVERS VALIDATE_FS_PARSER VDPA VDPA_SIM VDPA_SIM_BLOCK VDPA_SIM_NET VDPA_USER VETH VFIO VFIO_IOMMU_TYPE1 VFIO_PCI VFIO_PCI_CORE VFIO_PCI_INTX VFIO_PCI_MMAP VFIO_VIRQFD VGASTATE VHOST VHOST_CROSS_ENDIAN_LEGACY VHOST_IOTLB VHOST_NET VHOST_RING VHOST_VDPA VHOST_VSOCK VIDEOBUF2_CORE VIDEOBUF2_DMA_CONTIG VIDEOBUF2_DMA_SG VIDEOBUF2_MEMOPS VIDEOBUF2_V4L2 VIDEOBUF2_VMALLOC VIDEOMODE_HELPERS VIDEO_AU0828 VIDEO_AU0828_RC VIDEO_AU0828_V4L2 VIDEO_CS53L32A VIDEO_CX231XX VIDEO_CX231XX_ALSA VIDEO_CX231XX_DVB VIDEO_CX231XX_RC VIDEO_CX2341X VIDEO_CX25840 VIDEO_DEV VIDEO_EM28XX VIDEO_EM28XX_ALSA VIDEO_EM28XX_DVB VIDEO_EM28XX_RC VIDEO_EM28XX_V4L2 VIDEO_GO7007 VIDEO_GO7007_LOADER VIDEO_GO7007_USB VIDEO_GO7007_USB_S2250_BOARD VIDEO_HDPVR VIDEO_MSP3400 VIDEO_PVRUSB2 VIDEO_PVRUSB2_DVB VIDEO_PVRUSB2_SYSFS VIDEO_SAA711X VIDEO_STK1160 VIDEO_STK1160_COMMON VIDEO_TUNER VIDEO_TVEEPROM VIDEO_USBTV VIDEO_V4L2_I2C VIDEO_V4L2_SUBDEV_API VIDEO_V4L2_TPG VIDEO_VICODEC VIDEO_VIM2M VIDEO_VIMC VIDEO_VIVID VIDEO_VIVID_CEC VIDEO_WM8775 VIPERBOARD_ADC VIRTIO_BALLOON VIRTIO_DMA_SHARED_BUFFER VIRTIO_MEM VIRTIO_MMIO VIRTIO_MMIO_CMDLINE_DEVICES VIRTIO_PMEM VIRTIO_VDPA VIRTIO_VSOCKETS VIRTIO_VSOCKETS_COMMON VIRT_WIFI VLAN_8021Q VLAN_8021Q_GVRP VLAN_8021Q_MVRP VMAP_PFN VMWARE_VMCI VMXNET3 VP_VDPA VSOCKETS VSOCKETS_DIAG VSOCKETS_LOOPBACK VSOCKMON VT_HW_CONSOLE_BINDING VXFS_FS WAN WANT_DEV_COREDUMP WATCH_QUEUE WEXT_CORE WEXT_PRIV WEXT_PROC WIREGUARD WIRELESS WIRELESS_EXT WLAN WLAN_VENDOR_ADMTEK WLAN_VENDOR_SILABS WWAN X25 X86_SGX X86_SGX_KVM X86_X2APIC X86_X32_ABI XARRAY_MULTI XDP_SOCKETS XDP_SOCKETS_DIAG XFRM_ESPINTCP XFRM_INTERFACE XFRM_IPCOMP XFRM_MIGRATE XFRM_OFFLOAD XFRM_STATISTICS XFRM_SUB_POLICY XFRM_USER_COMPAT XFS_FS XFS_POSIX_ACL XFS_QUOTA XFS_RT XILLYBUS_CLASS XILLYUSB XOR_BLOCKS YENTA YENTA_ENE_TUNE YENTA_O2 YENTA_RICOH YENTA_TI YENTA_TOSHIBA ZBUD ZEROPLUS_FF ZLIB_DEFLATE ZONEFS_FS ZPOOL ZRAM ZRAM_DEF_COMP_LZORLE ZSMALLOC ZSTD_COMPRESS ZSWAP ZSWAP_COMPRESSOR_DEFAULT_LZO ZSWAP_DEFAULT_ON ZSWAP_ZPOOL_DEFAULT_ZBUD] determining the merge base between 344a09659766c83c42cdd4943318deabde89a9c3 and 0af2f6be1b4281385b618cb86ad946eded089ac8 830b3c68c1fb1e9176028d02ef86f3cf76aa2476/Linux 6.1 is a merge base, check if it has the bug testing commit 830b3c68c1fb1e9176028d02ef86f3cf76aa2476 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 1581bbb881e34eb2905da6bc97a69898cd7951e33a276e8ba2aeeb04492f2284 run #0: crashed: INFO: rcu detected stall in corrupted run #1: crashed: INFO: rcu detected stall in corrupted run #2: crashed: INFO: rcu detected stall in corrupted run #3: crashed: INFO: rcu detected stall in corrupted run #4: crashed: INFO: rcu detected stall in corrupted run #5: crashed: INFO: rcu detected stall in sys_perf_event_open run #6: crashed: INFO: rcu detected stall in corrupted run #7: crashed: INFO: rcu detected stall in sys_futex run #8: crashed: INFO: rcu detected stall in syscall_enter_from_user_mode run #9: crashed: INFO: rcu detected stall in corrupted run #10: crashed: INFO: rcu detected stall in sys_perf_event_open run #11: crashed: INFO: rcu detected stall in corrupted run #12: crashed: INFO: rcu detected stall in sys_perf_event_open run #13: crashed: INFO: rcu detected stall in sys_perf_event_open run #14: crashed: INFO: rcu detected stall in sys_perf_event_open run #15: crashed: INFO: rcu detected stall in sys_perf_event_open run #16: crashed: INFO: rcu detected stall in syscall_enter_from_user_mode run #17: crashed: INFO: rcu detected stall in sys_futex run #18: crashed: INFO: rcu detected stall in sys_futex run #19: crashed: INFO: rcu detected stall in sys_futex representative crash: INFO: rcu detected stall in corrupted, types: [HANG] testing current HEAD 0af2f6be1b4281385b618cb86ad946eded089ac8 testing commit 0af2f6be1b4281385b618cb86ad946eded089ac8 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 2ce028d6e7221de6383b2714d33b6f9a9e26ec316732466403bd2014dc7976c6 run #0: ignore: lost connection to test machine run #1: OK run #2: OK run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK false negative chance: 0.000 # git bisect start 0af2f6be1b4281385b618cb86ad946eded089ac8 830b3c68c1fb1e9176028d02ef86f3cf76aa2476 Bisecting: 106190 revisions left to test after this (roughly 17 steps) [c736c9a9553f9cfcb1b03e65f91bc29fc6446fd3] Merge tag 'clk-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/clk/linux determine whether the revision contains the guilty commit revision 830b3c68c1fb1e9176028d02ef86f3cf76aa2476 crashed and is reachable testing commit c736c9a9553f9cfcb1b03e65f91bc29fc6446fd3 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 328916dae60cca4d33d9169aa8a6d5c0819ce517e0d7f173dd6890b135837a07 run #0: ignore: lost connection to test machine run #1: OK run #2: OK run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK false negative chance: 0.000 # git bisect bad c736c9a9553f9cfcb1b03e65f91bc29fc6446fd3 Bisecting: 53093 revisions left to test after this (roughly 16 steps) [e5476f57b32621eb8eab892a908df4d0b4808835] Merge tag 'gpio-updates-for-v6.5' of git://git.kernel.org/pub/scm/linux/kernel/git/brgl/linux determine whether the revision contains the guilty commit revision 830b3c68c1fb1e9176028d02ef86f3cf76aa2476 crashed and is reachable testing commit e5476f57b32621eb8eab892a908df4d0b4808835 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: d0cda613fbc9657d3e5a8af506f1f82d9d6ff911620f7af91bfc3c82ff1be685 all runs: basic kernel testing failed: UBSAN: array-index-out-of-bounds in alloc_pid unable to determine the verdict: 0 good runs (wanted 15), for bad wanted 10 in total, got 0 # git bisect skip e5476f57b32621eb8eab892a908df4d0b4808835 Bisecting: 53044 revisions left to test after this (roughly 16 steps) [0e382fa72bbf0610be40af9af9b03b0cd149df82] Merge tag 'for-linus-2023062701' of git://git.kernel.org/pub/scm/linux/kernel/git/hid/hid determine whether the revision contains the guilty commit revision e5476f57b32621eb8eab892a908df4d0b4808835 crashed and is reachable testing commit 0e382fa72bbf0610be40af9af9b03b0cd149df82 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: bae13ffdabc643e774d261969e56513aabc9ae607dc6d7b8d306891395d013bd all runs: basic kernel testing failed: UBSAN: array-index-out-of-bounds in alloc_pid unable to determine the verdict: 0 good runs (wanted 15), for bad wanted 10 in total, got 0 # git bisect skip 0e382fa72bbf0610be40af9af9b03b0cd149df82 Bisecting: 53044 revisions left to test after this (roughly 16 steps) [f9abdcc617dad5f14bbc2ebe96ee99f3e6de0c4e] selftests: hid: fix vmtests.sh not running make headers determine whether the revision contains the guilty commit revision 830b3c68c1fb1e9176028d02ef86f3cf76aa2476 crashed and is reachable testing commit f9abdcc617dad5f14bbc2ebe96ee99f3e6de0c4e gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 50407d13455eed0276d91445beab7304d4910a169c116dacb6025fac9b2035fe all runs: basic kernel testing failed: UBSAN: array-index-out-of-bounds in alloc_pid unable to determine the verdict: 0 good runs (wanted 15), for bad wanted 10 in total, got 0 # git bisect skip f9abdcc617dad5f14bbc2ebe96ee99f3e6de0c4e Bisecting: 53044 revisions left to test after this (roughly 16 steps) [22f407278ea43df46f90cece6595e5e8a0d5447c] spi: mt65xx: Properly handle failures in .remove() determine whether the revision contains the guilty commit revision 830b3c68c1fb1e9176028d02ef86f3cf76aa2476 crashed and is reachable testing commit 22f407278ea43df46f90cece6595e5e8a0d5447c gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 98718ea44379a09e0ef00181c3b937621b8eba60bba02af0895c79a7130b6850 all runs: OK false negative chance: 0.000 # git bisect bad 22f407278ea43df46f90cece6595e5e8a0d5447c Bisecting: 23180 revisions left to test after this (roughly 15 steps) [6861eaf79155f0a5544ff989754159f806795c31] Merge tag 'ata-6.3-rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/dlemoal/libata determine whether the revision contains the guilty commit revision 830b3c68c1fb1e9176028d02ef86f3cf76aa2476 crashed and is reachable testing commit 6861eaf79155f0a5544ff989754159f806795c31 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 5ffa7455f3d8f34505eca6d7311fc73d82a9487c55ae2ce32fdf2928b6d44c1b run #0: crashed: INFO: rcu detected stall in sys_perf_event_open run #1: crashed: INFO: rcu detected stall in sys_futex run #2: crashed: INFO: rcu detected stall in sys_perf_event_open run #3: crashed: INFO: rcu detected stall in sys_perf_event_open run #4: crashed: INFO: rcu detected stall in sys_perf_event_open run #5: crashed: INFO: rcu detected stall in sys_perf_event_open run #6: crashed: INFO: rcu detected stall in corrupted run #7: crashed: INFO: rcu detected stall in corrupted run #8: crashed: INFO: rcu detected stall in sys_perf_event_open run #9: crashed: INFO: rcu detected stall in corrupted run #10: crashed: INFO: rcu detected stall in corrupted run #11: crashed: INFO: rcu detected stall in syscall_exit_to_user_mode run #12: crashed: INFO: rcu detected stall in sys_futex run #13: crashed: INFO: rcu detected stall in sys_perf_event_open run #14: crashed: INFO: rcu detected stall in sys_perf_event_open run #15: crashed: INFO: rcu detected stall in syscall_enter_from_user_mode run #16: crashed: INFO: rcu detected stall in corrupted run #17: crashed: INFO: rcu detected stall in syscall_exit_to_user_mode run #18: crashed: INFO: rcu detected stall in sys_perf_event_open run #19: crashed: INFO: rcu detected stall in syscall_enter_from_user_mode representative crash: INFO: rcu detected stall in sys_perf_event_open, types: [HANG] # git bisect good 6861eaf79155f0a5544ff989754159f806795c31 Bisecting: 11627 revisions left to test after this (roughly 14 steps) [9280c577431401544e63dfb489a830a42bee25eb] NFSD: Handle new xprtsec= export option determine whether the revision contains the guilty commit revision 830b3c68c1fb1e9176028d02ef86f3cf76aa2476 crashed and is reachable testing commit 9280c577431401544e63dfb489a830a42bee25eb gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 548c4b7f0e1188565656fff462aa14511db4f2de342942ad1bf8027ca4bfe6e9 run #0: crashed: INFO: rcu detected stall in corrupted run #1: crashed: INFO: rcu detected stall in sys_perf_event_open run #2: crashed: INFO: rcu detected stall in syscall_enter_from_user_mode run #3: crashed: INFO: rcu detected stall in corrupted run #4: crashed: INFO: rcu detected stall in sys_futex run #5: crashed: INFO: rcu detected stall in corrupted run #6: crashed: INFO: rcu detected stall in corrupted run #7: crashed: INFO: rcu detected stall in syscall_enter_from_user_mode run #8: crashed: INFO: rcu detected stall in sys_futex run #9: crashed: INFO: rcu detected stall in sys_futex run #10: crashed: INFO: rcu detected stall in corrupted run #11: ignore: lost connection to test machine run #12: crashed: INFO: rcu detected stall in corrupted run #13: crashed: INFO: rcu detected stall in syscall_enter_from_user_mode run #14: crashed: INFO: rcu detected stall in sys_perf_event_open run #15: crashed: INFO: rcu detected stall in sys_perf_event_open run #16: crashed: INFO: rcu detected stall in corrupted run #17: OK run #18: OK run #19: OK representative crash: INFO: rcu detected stall in corrupted, types: [HANG] # git bisect good 9280c577431401544e63dfb489a830a42bee25eb Bisecting: 5807 revisions left to test after this (roughly 13 steps) [cb6fe2ceb667eb78f252d473b03deb23999ab1cf] Merge tag 'devicetree-for-6.4-2' of git://git.kernel.org/pub/scm/linux/kernel/git/robh/linux determine whether the revision contains the guilty commit revision 830b3c68c1fb1e9176028d02ef86f3cf76aa2476 crashed and is reachable testing commit cb6fe2ceb667eb78f252d473b03deb23999ab1cf gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: e323a47bd0f9b9b69565a43149fc9b29d8189b6e0078f6acaaa6721ddb15682b all runs: OK false negative chance: 0.000 # git bisect bad cb6fe2ceb667eb78f252d473b03deb23999ab1cf Bisecting: 2410 revisions left to test after this (roughly 12 steps) [c8cc58e289ed3b5bc50258f52776cf3dfa3bad66] Merge tag 'drm-next-2023-04-24' of git://anongit.freedesktop.org/drm/drm determine whether the revision contains the guilty commit revision 830b3c68c1fb1e9176028d02ef86f3cf76aa2476 crashed and is reachable testing commit c8cc58e289ed3b5bc50258f52776cf3dfa3bad66 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 314fa555d56b466ef826d1346d53e20543fb6254b1b95004195f41c73dbc2852 run #0: ignore: lost connection to test machine run #1: OK run #2: OK run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK false negative chance: 0.000 # git bisect bad c8cc58e289ed3b5bc50258f52776cf3dfa3bad66 Bisecting: 1641 revisions left to test after this (roughly 11 steps) [d53c3eaaef6a05fec04e8b5990d97d7216eb5e42] Merge tag 'soc-dt-6.4' of git://git.kernel.org/pub/scm/linux/kernel/git/soc/soc determine whether the revision contains the guilty commit revision 830b3c68c1fb1e9176028d02ef86f3cf76aa2476 crashed and is reachable testing commit d53c3eaaef6a05fec04e8b5990d97d7216eb5e42 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: d6f818ead801d0d16a6992cde7f4b74621fc71632ab193e77890082226bbf182 all runs: OK false negative chance: 0.000 # git bisect bad d53c3eaaef6a05fec04e8b5990d97d7216eb5e42 Bisecting: 880 revisions left to test after this (roughly 10 steps) [672d2dae19012cb2c40fdf36711ee3b5f5420724] Merge tag 'soc-defconfig-6.4' of git://git.kernel.org/pub/scm/linux/kernel/git/soc/soc determine whether the revision contains the guilty commit revision 6861eaf79155f0a5544ff989754159f806795c31 crashed and is reachable testing commit 672d2dae19012cb2c40fdf36711ee3b5f5420724 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 8a248112c86c7168173a90259b6c7471dafa8ab60ccd244b45e53727b710b7a4 all runs: OK false negative chance: 0.000 # git bisect bad 672d2dae19012cb2c40fdf36711ee3b5f5420724 Bisecting: 441 revisions left to test after this (roughly 9 steps) [7bcff5a3969b0e396087516ba4131596296a4478] Merge tag 'v6.4/vfs.acl' of git://git.kernel.org/pub/scm/linux/kernel/git/vfs/vfs determine whether the revision contains the guilty commit revision 6861eaf79155f0a5544ff989754159f806795c31 crashed and is reachable testing commit 7bcff5a3969b0e396087516ba4131596296a4478 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 3f4a4007e5cc098f96ab1c4fb0e5d1087302a3439388b5863478ec655e80f390 run #0: crashed: INFO: rcu detected stall in syscall_enter_from_user_mode run #1: crashed: INFO: rcu detected stall in corrupted run #2: crashed: INFO: rcu detected stall in syscall_exit_to_user_mode run #3: crashed: INFO: rcu detected stall in sys_perf_event_open run #4: crashed: INFO: rcu detected stall in corrupted run #5: crashed: INFO: rcu detected stall in sys_perf_event_open run #6: crashed: INFO: rcu detected stall in sys_perf_event_open run #7: crashed: INFO: rcu detected stall in smp_call_function run #8: crashed: INFO: rcu detected stall in sys_perf_event_open run #9: crashed: INFO: rcu detected stall in corrupted run #10: crashed: INFO: rcu detected stall in syscall_enter_from_user_mode run #11: crashed: INFO: rcu detected stall in sys_perf_event_open run #12: crashed: INFO: rcu detected stall in corrupted run #13: crashed: INFO: rcu detected stall in sys_futex run #14: crashed: INFO: rcu detected stall in sys_perf_event_open run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK representative crash: INFO: rcu detected stall in syscall_enter_from_user_mode, types: [HANG] # git bisect good 7bcff5a3969b0e396087516ba4131596296a4478 Bisecting: 228 revisions left to test after this (roughly 8 steps) [18032df5ef5c0eec2adf120142bd95a3a8807866] Merge tag 'soc-arm-6.4' of git://git.kernel.org/pub/scm/linux/kernel/git/soc/soc determine whether the revision contains the guilty commit revision 7bcff5a3969b0e396087516ba4131596296a4478 crashed and is reachable testing commit 18032df5ef5c0eec2adf120142bd95a3a8807866 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 659633ef451b18ad9b8684cb58a130108d3005b1613eac21240f4dc760c87fdf run #0: basic kernel testing failed: lost connection to test machine run #1: ignore: lost connection to test machine run #2: OK run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK false negative chance: 0.000 # git bisect bad 18032df5ef5c0eec2adf120142bd95a3a8807866 Bisecting: 107 revisions left to test after this (roughly 7 steps) [4a4a28fca6966ff2aee7d8313db6defcc8fcf70b] Merge tag 'x86_misc_for_v6.4_rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip determine whether the revision contains the guilty commit revision 7bcff5a3969b0e396087516ba4131596296a4478 crashed and is reachable testing commit 4a4a28fca6966ff2aee7d8313db6defcc8fcf70b gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 68dbea41eb470e54e8b3a831fea223de3ecaa2d071c8c6863165d18317979ceb run #0: crashed: INFO: rcu detected stall in sys_futex run #1: crashed: INFO: rcu detected stall in syscall_enter_from_user_mode run #2: crashed: INFO: rcu detected stall in sys_perf_event_open run #3: crashed: INFO: rcu detected stall in sys_futex run #4: crashed: INFO: rcu detected stall in sys_perf_event_open run #5: crashed: INFO: rcu detected stall in corrupted run #6: crashed: INFO: rcu detected stall in sys_perf_event_open run #7: crashed: INFO: rcu detected stall in syscall_enter_from_user_mode run #8: crashed: INFO: rcu detected stall in corrupted run #9: crashed: INFO: rcu detected stall in corrupted run #10: crashed: INFO: rcu detected stall in sys_perf_event_open run #11: crashed: INFO: rcu detected stall in smp_call_function run #12: crashed: INFO: rcu detected stall in sys_futex run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK representative crash: INFO: rcu detected stall in sys_futex, types: [HANG] # git bisect good 4a4a28fca6966ff2aee7d8313db6defcc8fcf70b Bisecting: 59 revisions left to test after this (roughly 6 steps) [3f614ab563c44fa443cbb6a7f355bdd04a5a4450] Merge tag 'irq-core-2023-04-24' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip determine whether the revision contains the guilty commit revision 6861eaf79155f0a5544ff989754159f806795c31 crashed and is reachable testing commit 3f614ab563c44fa443cbb6a7f355bdd04a5a4450 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: aee3433c83393ebd58deae60d33a18f9d326487958b21267cfba51f8bd694599 all runs: OK false negative chance: 0.000 # git bisect bad 3f614ab563c44fa443cbb6a7f355bdd04a5a4450 Bisecting: 24 revisions left to test after this (roughly 5 steps) [2ff1b0839ddd514be4752c64c1c6facf91ff3a56] Merge branch irq/misc-6.4 into irq/irqchip-next determine whether the revision contains the guilty commit revision 830b3c68c1fb1e9176028d02ef86f3cf76aa2476 crashed and is reachable testing commit 2ff1b0839ddd514be4752c64c1c6facf91ff3a56 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: a24d8f87e90f4ab1e600f8ea13283368d0292580fe1edf8a41f7578514b6ebf0 run #0: crashed: INFO: rcu detected stall in syscall_enter_from_user_mode run #1: crashed: INFO: rcu detected stall in sys_perf_event_open run #2: crashed: INFO: rcu detected stall in corrupted run #3: crashed: INFO: rcu detected stall in corrupted run #4: crashed: INFO: rcu detected stall in smp_call_function run #5: crashed: INFO: rcu detected stall in corrupted run #6: crashed: INFO: rcu detected stall in sys_futex run #7: crashed: INFO: rcu detected stall in sys_perf_event_open run #8: crashed: INFO: rcu detected stall in syscall_enter_from_user_mode run #9: crashed: INFO: rcu detected stall in sys_perf_event_open run #10: crashed: INFO: rcu detected stall in smp_call_function run #11: crashed: INFO: rcu detected stall in sys_perf_event_open run #12: OK run #13: crashed: INFO: rcu detected stall in syscall_enter_from_user_mode run #14: crashed: INFO: rcu detected stall in corrupted run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK representative crash: INFO: rcu detected stall in syscall_enter_from_user_mode, types: [HANG] # git bisect good 2ff1b0839ddd514be4752c64c1c6facf91ff3a56 Bisecting: 10 revisions left to test after this (roughly 4 steps) [bc1bb2a49bae915107fd58705edb1e32db92c635] Merge tag 'x86_sev_for_v6.4_rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip determine whether the revision contains the guilty commit revision 7bcff5a3969b0e396087516ba4131596296a4478 crashed and is reachable testing commit bc1bb2a49bae915107fd58705edb1e32db92c635 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 3ec1fedf715ef001001803652034c32ba9f7a48db5f204ee79c7139f476dbf54 run #0: crashed: INFO: rcu detected stall in syscall_exit_to_user_mode run #1: crashed: INFO: rcu detected stall in corrupted run #2: crashed: INFO: rcu detected stall in sys_futex run #3: crashed: INFO: rcu detected stall in syscall_enter_from_user_mode run #4: crashed: INFO: rcu detected stall in corrupted run #5: crashed: INFO: rcu detected stall in sys_futex run #6: crashed: INFO: rcu detected stall in sys_perf_event_open run #7: crashed: INFO: rcu detected stall in sys_perf_event_open run #8: crashed: INFO: rcu detected stall in sys_perf_event_open run #9: crashed: INFO: rcu detected stall in sys_futex run #10: crashed: INFO: rcu detected stall in sys_perf_event_open run #11: crashed: INFO: rcu detected stall in corrupted run #12: crashed: INFO: rcu detected stall in corrupted run #13: crashed: INFO: rcu detected stall in corrupted run #14: crashed: INFO: rcu detected stall in syscall_exit_to_user_mode run #15: crashed: INFO: rcu detected stall in corrupted run #16: OK run #17: OK run #18: OK run #19: OK representative crash: INFO: rcu detected stall in syscall_exit_to_user_mode, types: [HANG] # git bisect good bc1bb2a49bae915107fd58705edb1e32db92c635 Bisecting: 3 revisions left to test after this (roughly 3 steps) [15bbeec0fe9f1e910cb6a173005a02b6b4582f3c] Merge tag 'core-entry-2023-04-24' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip determine whether the revision contains the guilty commit revision 6861eaf79155f0a5544ff989754159f806795c31 crashed and is reachable testing commit 15bbeec0fe9f1e910cb6a173005a02b6b4582f3c gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 65f8aeb99828c665acc06eabafbdada35f056c09309fc7aa56b336b8fa26398f run #0: crashed: INFO: rcu detected stall in sys_futex run #1: crashed: INFO: rcu detected stall in sys_perf_event_open run #2: crashed: INFO: rcu detected stall in sys_futex run #3: crashed: INFO: rcu detected stall in syscall_exit_to_user_mode run #4: crashed: INFO: rcu detected stall in syscall_enter_from_user_mode run #5: crashed: INFO: rcu detected stall in sys_perf_event_open run #6: crashed: INFO: rcu detected stall in sys_perf_event_open run #7: crashed: INFO: rcu detected stall in syscall_enter_from_user_mode run #8: crashed: INFO: rcu detected stall in syscall_exit_to_user_mode run #9: crashed: INFO: rcu detected stall in sys_perf_event_open run #10: crashed: INFO: rcu detected stall in syscall_exit_to_user_mode run #11: crashed: INFO: rcu detected stall in corrupted run #12: crashed: INFO: rcu detected stall in sys_futex run #13: crashed: INFO: rcu detected stall in sys_perf_event_open run #14: crashed: INFO: rcu detected stall in syscall_exit_to_user_mode run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK representative crash: INFO: rcu detected stall in sys_futex, types: [HANG] # git bisect good 15bbeec0fe9f1e910cb6a173005a02b6b4582f3c Bisecting: 1 revision left to test after this (roughly 1 step) [803235982b8c086184d04798d9079d236f352f88] genirq: Update affinity of secondary threads determine whether the revision contains the guilty commit revision 830b3c68c1fb1e9176028d02ef86f3cf76aa2476 crashed and is reachable testing commit 803235982b8c086184d04798d9079d236f352f88 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 246b4b45e8937929ed2e5f40f757bd9a5db6cb9a15bb7e1ca502fb6387d85391 all runs: OK false negative chance: 0.000 # git bisect bad 803235982b8c086184d04798d9079d236f352f88 Bisecting: 0 revisions left to test after this (roughly 0 steps) [f4bf3ca2e5cba655824b6e0893a98dfb33ed24e5] softirq: Add trace points for tasklet entry/exit determine whether the revision contains the guilty commit revision 830b3c68c1fb1e9176028d02ef86f3cf76aa2476 crashed and is reachable testing commit f4bf3ca2e5cba655824b6e0893a98dfb33ed24e5 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 832c9aaf50861dc13ded426e9a235aba92bb268a08df87cfe16e5323f2f05a40 run #0: ignore: lost connection to test machine run #1: OK run #2: OK run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK false negative chance: 0.000 # git bisect bad f4bf3ca2e5cba655824b6e0893a98dfb33ed24e5 f4bf3ca2e5cba655824b6e0893a98dfb33ed24e5 is the first bad commit commit f4bf3ca2e5cba655824b6e0893a98dfb33ed24e5 Author: Lingutla Chandrasekhar Date: Fri Apr 7 23:05:26 2023 +0000 softirq: Add trace points for tasklet entry/exit Tasklets are supposed to finish their work quickly and should not block the current running process, but it is not guaranteed that they do so. Currently softirq_entry/exit can be used to analyse the total tasklets execution time, but that's not helpful to track individual tasklets execution time. That makes it hard to identify tasklet functions, which take more time than expected. Add tasklet_entry/exit trace point support to track individual tasklet execution. Trivial usage example: # echo 1 > /sys/kernel/debug/tracing/events/irq/tasklet_entry/enable # echo 1 > /sys/kernel/debug/tracing/events/irq/tasklet_exit/enable # cat /sys/kernel/debug/tracing/trace # tracer: nop # # entries-in-buffer/entries-written: 4/4 #P:4 # # _-----=> irqs-off/BH-disabled # / _----=> need-resched # | / _---=> hardirq/softirq # || / _--=> preempt-depth # ||| / _-=> migrate-disable # |||| / delay # TASK-PID CPU# ||||| TIMESTAMP FUNCTION # | | | ||||| | | -0 [003] ..s1. 314.011428: tasklet_entry: tasklet=0xffffa01ef8db2740 function=tcp_tasklet_func -0 [003] ..s1. 314.011432: tasklet_exit: tasklet=0xffffa01ef8db2740 function=tcp_tasklet_func -0 [003] ..s1. 314.017369: tasklet_entry: tasklet=0xffffa01ef8db2740 function=tcp_tasklet_func -0 [003] ..s1. 314.017371: tasklet_exit: tasklet=0xffffa01ef8db2740 function=tcp_tasklet_func Signed-off-by: Lingutla Chandrasekhar Signed-off-by: J. Avila Signed-off-by: John Stultz Signed-off-by: Thomas Gleixner Reviewed-by: Steven Rostedt (Google) Link: https://lore.kernel.org/r/20230407230526.1685443-1-jstultz@google.com [elavila: Port to android-mainline] [jstultz: Rebased to upstream, cut unused trace points, added comments for the tracepoints, reworded commit] include/trace/events/irq.h | 47 ++++++++++++++++++++++++++++++++++++++++++++++ kernel/softirq.c | 9 +++++++-- 2 files changed, 54 insertions(+), 2 deletions(-) accumulated error probability: 0.00 parent commit 7e364e56293bb98cae1b55fd835f5991c4e96e7d wasn't tested testing commit 7e364e56293bb98cae1b55fd835f5991c4e96e7d gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 115f9f2793fb5ebefe5cd6beafdf3d92e9569e2e1c128d5be53428cce1967ce6 culprit signature: 832c9aaf50861dc13ded426e9a235aba92bb268a08df87cfe16e5323f2f05a40 parent signature: 115f9f2793fb5ebefe5cd6beafdf3d92e9569e2e1c128d5be53428cce1967ce6 reproducer is flaky (0.72 repro chance estimate) revisions tested: 29, total time: 7h35m24.521989091s (build: 2h40m38.074178403s, test: 4h34m2.399349307s) first good commit: f4bf3ca2e5cba655824b6e0893a98dfb33ed24e5 softirq: Add trace points for tasklet entry/exit recipients (to): ["clingutla@codeaurora.org" "elavila@google.com" "jstultz@google.com" "rostedt@goodmis.org" "tglx@linutronix.de"] recipients (cc): []