ci2 starts bisection 2024-04-21 16:54:15.327989805 +0000 UTC m=+293178.816928395
bisecting fixing commit since f67653019430833d5003f16817d7fa85272a6a76
building syzkaller on 79782afcff30fd0c0af8c2725d508b2c7150f3ed
ensuring issue is reproducible on original commit f67653019430833d5003f16817d7fa85272a6a76
testing commit f67653019430833d5003f16817d7fa85272a6a76 gcc
compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40
kernel signature: 9ca8d915bbc10d0ca8493a5596e52874e606af9cb436c350bcc27ee3d675ecae
run #0: crashed: INFO: rcu detected stall in tc_modify_qdisc
run #1: crashed: INFO: rcu detected stall in net_tx_action
run #2: crashed: BUG: soft lockup in tc_modify_qdisc
run #3: crashed: INFO: rcu detected stall in net_tx_action
run #4: crashed: BUG: soft lockup in net_tx_action
run #5: crashed: INFO: rcu detected stall in kthread
run #6: crashed: INFO: rcu detected stall in sys_epoll_wait
run #7: crashed: INFO: rcu detected stall in net_tx_action
run #8: crashed: INFO: rcu detected stall in rtnl_newlink
run #9: crashed: INFO: task hung in corrupted
run #10: crashed: INFO: rcu detected stall in addrconf_rs_timer
run #11: crashed: INFO: rcu detected stall in inet_sendmsg
run #12: crashed: INFO: rcu detected stall in gc_worker
run #13: crashed: INFO: rcu detected stall in syscall_exit_to_user_mode
run #14: crashed: INFO: rcu detected stall in do_idle
run #15: crashed: BUG: soft lockup in smp_call_function
run #16: crashed: INFO: rcu detected stall in gc_worker
run #17: crashed: BUG: soft lockup in clone
run #18: crashed: INFO: rcu detected stall in wb_workfn
run #19: crashed: BUG: soft lockup in smp_call_function
representative crash: INFO: rcu detected stall in tc_modify_qdisc, types: [HANG]
check whether we can drop unnecessary instrumentation
disabling configs for [UBSAN BUG KASAN LOCKDEP ATOMIC_SLEEP LEAK], they are not needed
testing commit f67653019430833d5003f16817d7fa85272a6a76 gcc
compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40
kernel signature: 25b8a55c506ac4f136f9128e2bc101ef1d8cce92291e0f3d66aecbd065865537
run #0: crashed: INFO: rcu detected stall in sys_unshare
run #1: crashed: INFO: rcu detected stall in sys_unlinkat
run #2: OK
run #3: OK
run #4: OK
run #5: OK
run #6: OK
run #7: OK
run #8: OK
run #9: OK
representative crash: INFO: rcu detected stall in sys_unshare, types: [HANG]
kconfig minimization: base=3703 full=7269 leaves diff=1988
split chunks (needed=false): <1988>
split chunk #0 of len 1988 into 5 parts
testing without sub-chunk 1/5
testing commit f67653019430833d5003f16817d7fa85272a6a76 gcc
compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40
kernel signature: 353ed110e105f70fcf4f1a980c6f0a24ddaf9c4a93b65edc24298b1afcb968b6
run #0: crashed: INFO: rcu detected stall in net_tx_action
run #1: crashed: INFO: rcu detected stall in net_tx_action
run #2: crashed: INFO: rcu detected stall in net_tx_action
run #3: crashed: INFO: rcu detected stall in net_tx_action
run #4: crashed: INFO: rcu detected stall in wb_workfn
run #5: crashed: INFO: rcu detected stall in smp_call_function
run #6: crashed: BUG: soft lockup in smp_call_function
run #7: crashed: INFO: rcu detected stall in wb_workfn
run #8: crashed: INFO: task hung in corrupted
run #9: crashed: INFO: rcu detected stall in linkwatch_event
run #10: crashed: INFO: rcu detected stall in gc_worker
run #11: crashed: BUG: soft lockup in net_tx_action
run #12: crashed: INFO: rcu detected stall in addrconf_rs_timer
run #13: crashed: INFO: rcu detected stall in gc_worker
run #14: crashed: BUG: soft lockup in smp_call_function
run #15: crashed: INFO: rcu detected stall in smp_call_function
run #16: crashed: INFO: rcu detected stall in gc_worker
run #17: crashed: INFO: rcu detected stall in addrconf_rs_timer
run #18: crashed: INFO: task hung in corrupted
run #19: basic kernel testing failed: failed to copy binary to VM: failed to run ["scp" "-P" "22" "-F" "/dev/null" "-o" "UserKnownHostsFile=/dev/null" "-o" "IdentitiesOnly=yes" "-o" "BatchMode=yes" "-o" "StrictHostKeyChecking=no" "-o" "ConnectTimeout=10" "-v" "/tmp/syz-executor35984834" "root@10.128.1.188:./syz-executor35984834"]: exit status 255
Executing: program /usr/bin/ssh host 10.128.1.188, user root, command sftp
OpenSSH_9.2p1 Debian-2+deb12u1, OpenSSL 3.0.11 19 Sep 2023
debug1: Reading configuration data /dev/null
debug1: Connecting to 10.128.1.188 [10.128.1.188] port 22.
debug1: connect to address 10.128.1.188 port 22: Connection timed out
ssh: connect to host 10.128.1.188 port 22: Connection timed out
scp: Connection closed
representative crash: INFO: rcu detected stall in net_tx_action, types: [HANG]
the chunk can be dropped
testing without sub-chunk 2/5
testing commit f67653019430833d5003f16817d7fa85272a6a76 gcc
compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40
kernel signature: 6acb62804bf6f6312efe60803991a2e30ba6edb0cd0d3eaac4efa01754ae70b3
run #0: crashed: INFO: rcu detected stall in tc_modify_qdisc
run #1: crashed: INFO: rcu detected stall in net_tx_action
run #2: crashed: INFO: rcu detected stall in tc_modify_qdisc
run #3: crashed: INFO: rcu detected stall in smp_call_function
run #4: crashed: INFO: rcu detected stall in smp_call_function
run #5: crashed: INFO: rcu detected stall in net_tx_action
run #6: crashed: INFO: rcu detected stall in tc_modify_qdisc
run #7: crashed: INFO: rcu detected stall in do_idle
run #8: crashed: INFO: rcu detected stall in wb_workfn
run #9: crashed: INFO: rcu detected stall in gc_worker
run #10: crashed: INFO: rcu detected stall in corrupted
run #11: crashed: INFO: rcu detected stall in vfs_readlink
run #12: crashed: INFO: task hung in corrupted
run #13: crashed: INFO: rcu detected stall in neigh_periodic_work
run #14: crashed: INFO: rcu detected stall in corrupted
run #15: crashed: INFO: rcu detected stall in sys_exit_group
run #16: crashed: BUG: workqueue lockup
run #17: crashed: INFO: task hung in corrupted
run #18: crashed: INFO: rcu detected stall in smp_call_function
run #19: basic kernel testing failed: failed to copy binary to VM: failed to run ["scp" "-P" "22" "-F" "/dev/null" "-o" "UserKnownHostsFile=/dev/null" "-o" "IdentitiesOnly=yes" "-o" "BatchMode=yes" "-o" "StrictHostKeyChecking=no" "-o" "ConnectTimeout=10" "-v" "/tmp/syz-executor419365165" "root@10.128.1.44:./syz-executor419365165"]: exit status 255
Executing: program /usr/bin/ssh host 10.128.1.44, user root, command sftp
OpenSSH_9.2p1 Debian-2+deb12u1, OpenSSL 3.0.11 19 Sep 2023
debug1: Reading configuration data /dev/null
debug1: Connecting to 10.128.1.44 [10.128.1.44] port 22.
debug1: connect to address 10.128.1.44 port 22: Connection timed out
ssh: connect to host 10.128.1.44 port 22: Connection timed out
scp: Connection closed
representative crash: INFO: rcu detected stall in tc_modify_qdisc, types: [HANG]
the chunk can be dropped
testing without sub-chunk 3/5
testing commit f67653019430833d5003f16817d7fa85272a6a76 gcc
compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40
kernel signature: 47cf58107ffa4e5bbf8c594c28214c5214503175f975d2b665bc808cb3a3b364
all runs: OK
false negative chance: 0.000
testing without sub-chunk 4/5
testing commit f67653019430833d5003f16817d7fa85272a6a76 gcc
compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40
kernel signature: 83211b6b599e3f5d584acd1b376c2d6b345a26f5c96ab6dd1d786c5f2f5a7c68
run #0: crashed: INFO: rcu detected stall in tc_modify_qdisc
run #1: crashed: INFO: rcu detected stall in tc_modify_qdisc
run #2: crashed: INFO: rcu detected stall in smp_call_function
run #3: crashed: INFO: rcu detected stall in wb_workfn
run #4: crashed: BUG: soft lockup in smp_call_function
run #5: crashed: BUG: soft lockup in net_tx_action
run #6: crashed: INFO: rcu detected stall in clone
run #7: crashed: INFO: rcu detected stall in do_idle
run #8: crashed: INFO: rcu detected stall in wb_workfn
run #9: crashed: INFO: rcu detected stall in gc_worker
run #10: crashed: INFO: rcu detected stall in gc_worker
run #11: crashed: INFO: rcu detected stall in sys_execve
run #12: crashed: INFO: rcu detected stall in clone
run #13: crashed: INFO: rcu detected stall in gc_worker
run #14: crashed: INFO: task hung in netdev_run_todo
run #15: crashed: INFO: rcu detected stall in smp_call_function
run #16: crashed: INFO: rcu detected stall in gc_worker
run #17: crashed: BUG: soft lockup in gc_worker
run #18: crashed: INFO: task hung in rtnetlink_rcv_msg
run #19: crashed: INFO: rcu detected stall in sched_yield
representative crash: INFO: rcu detected stall in tc_modify_qdisc, types: [HANG]
the chunk can be dropped
testing without sub-chunk 5/5
testing commit f67653019430833d5003f16817d7fa85272a6a76 gcc
compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40
kernel signature: d99b4c3f942893e1f7a5ee5f9c81ee3460d12167eac1b8e32875ea9382ddffc4
run #0: crashed: INFO: rcu detected stall in do_idle
run #1: crashed: INFO: rcu detected stall in do_idle
run #2: crashed: INFO: rcu detected stall in do_idle
run #3: crashed: INFO: rcu detected stall in do_idle
run #4: crashed: INFO: rcu detected stall in gc_worker
run #5: crashed: INFO: rcu detected stall in do_idle
run #6: crashed: INFO: rcu detected stall in do_idle
run #7: crashed: INFO: rcu detected stall in do_idle
run #8: crashed: INFO: rcu detected stall in do_idle
run #9: crashed: INFO: rcu detected stall in gc_worker
run #10: crashed: INFO: rcu detected stall in smp_call_function
run #11: crashed: INFO: rcu detected stall in smp_call_function
run #12: crashed: BUG: soft lockup in gc_worker
run #13: crashed: INFO: rcu detected stall in do_idle
run #14: crashed: INFO: rcu detected stall in do_idle
run #15: crashed: INFO: rcu detected stall in do_idle
run #16: crashed: INFO: rcu detected stall in ext4_end_io_rsv_work
run #17: crashed: no output from test machine
run #18: basic kernel testing failed: failed to copy binary to VM: failed to run ["scp" "-P" "22" "-F" "/dev/null" "-o" "UserKnownHostsFile=/dev/null" "-o" "IdentitiesOnly=yes" "-o" "BatchMode=yes" "-o" "StrictHostKeyChecking=no" "-o" "ConnectTimeout=10" "-v" "/tmp/syz-executor1123404061" "root@10.128.1.182:./syz-executor1123404061"]: exit status 255
Executing: program /usr/bin/ssh host 10.128.1.182, user root, command sftp
OpenSSH_9.2p1 Debian-2+deb12u1, OpenSSL 3.0.11 19 Sep 2023
debug1: Reading configuration data /dev/null
debug1: Connecting to 10.128.1.182 [10.128.1.182] port 22.
debug1: fd 3 clearing O_NONBLOCK
debug1: Connection established.
debug1: identity file /root/.ssh/id_rsa type -1
debug1: identity file /root/.ssh/id_rsa-cert type -1
debug1: identity file /root/.ssh/id_ecdsa type -1
debug1: identity file /root/.ssh/id_ecdsa-cert type -1
debug1: identity file /root/.ssh/id_ecdsa_sk type -1
debug1: identity file /root/.ssh/id_ecdsa_sk-cert type -1
debug1: identity file /root/.ssh/id_ed25519 type -1
debug1: identity file /root/.ssh/id_ed25519-cert type -1
debug1: identity file /root/.ssh/id_ed25519_sk type -1
debug1: identity file /root/.ssh/id_ed25519_sk-cert type -1
debug1: identity file /root/.ssh/id_xmss type -1
debug1: identity file /root/.ssh/id_xmss-cert type -1
debug1: identity file /root/.ssh/id_dsa type -1
debug1: identity file /root/.ssh/id_dsa-cert type -1
debug1: Local version string SSH-2.0-OpenSSH_9.2p1 Debian-2+deb12u1
Connection timed out during banner exchange
Connection to 10.128.1.182 port 22 timed out
scp: Connection closed
run #19: basic kernel testing failed: failed to copy binary to VM: failed to run ["scp" "-P" "22" "-F" "/dev/null" "-o" "UserKnownHostsFile=/dev/null" "-o" "IdentitiesOnly=yes" "-o" "BatchMode=yes" "-o" "StrictHostKeyChecking=no" "-o" "ConnectTimeout=10" "-v" "/tmp/syz-executor4278724176" "root@10.128.0.219:./syz-executor4278724176"]: exit status 255
Executing: program /usr/bin/ssh host 10.128.0.219, user root, command sftp
OpenSSH_9.2p1 Debian-2+deb12u1, OpenSSL 3.0.11 19 Sep 2023
debug1: Reading configuration data /dev/null
debug1: Connecting to 10.128.0.219 [10.128.0.219] port 22.
debug1: connect to address 10.128.0.219 port 22: Connection timed out
ssh: connect to host 10.128.0.219 port 22: Connection timed out
scp: Connection closed
representative crash: INFO: rcu detected stall in do_idle, types: [HANG]
the chunk can be dropped
minimized to 398 configs; suspects: [ATM AX25 BRIDGE BRIDGE_NETFILTER CAN CFG80211 CHECKPOINT_RESTORE DVB_CORE FB FSCACHE HAMRADIO HSR INFINIBAND INFINIBAND_ADDR_TRANS INFINIBAND_USER_ACCESS INPUT_JOYSTICK INPUT_MOUSE IP6_NF_RAW IPV6_MULTIPLE_TABLES IP_NF_RAW IP_SET IP_VS ISDN ISDN_CAPI_MIDDLEWARE JFFS2_CMODE_PRIORITY JFFS2_COMPRESSION_OPTIONS JFFS2_FS JFFS2_FS_POSIX_ACL JFFS2_FS_SECURITY JFFS2_FS_WRITEBUFFER JFFS2_FS_XATTR JFFS2_LZO JFFS2_RTIME JFFS2_RUBIN JFFS2_SUMMARY JFFS2_ZLIB JFS_DEBUG JFS_FS JFS_POSIX_ACL JFS_SECURITY JOYSTICK_IFORCE JOYSTICK_IFORCE_USB JOYSTICK_XPAD JOYSTICK_XPAD_FF JOYSTICK_XPAD_LEDS KARMA_PARTITION KCOV KCOV_ENABLE_COMPARISONS KCOV_INSTRUMENT_ALL KEYS_REQUEST_CACHE KEY_DH_OPERATIONS KEY_NOTIFICATIONS KSM KVM KVM_AMD KVM_ASYNC_PF KVM_COMPAT KVM_GENERIC_DIRTYLOG_READ_PROTECT KVM_INTEL KVM_MMIO KVM_VFIO KVM_XEN KVM_XFER_TO_GUEST_WORK L2TP L2TP_ETH L2TP_IP L2TP_V3 LAPB LAPBETHER LDM_PARTITION LEDS_TRIGGER_AUDIO LEGACY_PTYS LIBNVDIMM LINEAR_RANGES LLC LLC2 LOGIG940_FF LOGIRUMBLEPAD2_FF LOGO LOGO_LINUX_MONO LOGO_LINUX_VGA16 LPC_ICH LWTUNNEL LWTUNNEL_BPF LZ4HC_COMPRESS LZ4_COMPRESS MAC80211 MAC80211_DEBUGFS MAC80211_HAS_RC MAC80211_HWSIM MAC80211_MESH MAC80211_RC_DEFAULT_MINSTREL MAC80211_RC_MINSTREL MACSEC MACVLAN MACVTAP MAC_PARTITION MAPPING_DIRTY_HELPERS MD_LINEAR MD_MULTIPATH MD_RAID0 MD_RAID1 MD_RAID10 MD_RAID456 MEDIA_ANALOG_TV_SUPPORT MEDIA_ATTACH MEDIA_CONTROLLER MEDIA_CONTROLLER_DVB MEDIA_CONTROLLER_REQUEST_API MEDIA_DIGITAL_TV_SUPPORT MEDIA_RADIO_SUPPORT MEDIA_SDR_SUPPORT MEDIA_SUPPORT MEDIA_SUPPORT_FILTER MEDIA_TUNER MEDIA_TUNER_MSI001 MEDIA_TUNER_XC2028 MEDIA_TUNER_XC5000 MEMORY_BALLOON MEMORY_HOTPLUG MEMORY_HOTPLUG_DEFAULT_ONLINE MEMORY_ISOLATION MEMREGION MEMSTICK MEMSTICK_REALTEK_USB MEM_SOFT_DIRTY MFD_CORE MFD_SYSCON MHI_BUS MHI_WWAN_CTRL MHP_MEMMAP_ON_MEMORY MICROCHIP_PHY MINIX_FS MINIX_SUBPARTITION MISC_RTSX MISC_RTSX_USB MISDN MISDN_DSP MISDN_HFCUSB MISDN_L1OIP MKISS MLX4_CORE MLX4_INFINIBAND MMC MMC_REALTEK_USB MMC_USHC MMC_VUB300 MMU_NOTIFIER MODULE_SRCVERSION_ALL MODVERSIONS MOST MOUSE_APPLETOUCH MOUSE_BCM5974 MOUSE_PS2 MOUSE_PS2_ALPS MOUSE_PS2_BYD MOUSE_PS2_CYPRESS MOUSE_PS2_FOCALTECH MOUSE_PS2_LIFEBOOK MOUSE_PS2_LOGIPS2PP MOUSE_PS2_SMBUS MOUSE_PS2_SYNAPTICS MOUSE_PS2_SYNAPTICS_SMBUS MOUSE_PS2_TRACKPOINT MOUSE_SYNAPTICS_USB MPLS MPLS_IPTUNNEL MPLS_ROUTING MPTCP MPTCP_IPV6 MRP MTD MTD_BLKDEVS MTD_BLOCK MTD_BLOCK2MTD MTD_CFI_I1 MTD_CFI_I2 MTD_MAP_BANK_WIDTH_1 MTD_MAP_BANK_WIDTH_2 MTD_MAP_BANK_WIDTH_4 MTD_MTDRAM MTD_PHRAM MTD_SLRAM MUSB_PIO_ONLY ND_BLK ND_BTT ND_CLAIM ND_PFN NETDEVSIM NETFILTER_ADVANCED NETFILTER_FAMILY_ARP NETFILTER_FAMILY_BRIDGE NETFILTER_NETLINK_ACCT NETFILTER_NETLINK_GLUE_CT NETFILTER_NETLINK_OSF NETFILTER_NETLINK_QUEUE NETFILTER_SYNPROXY NETFILTER_XT_CONNMARK NETFILTER_XT_MATCH_BPF NETFILTER_XT_MATCH_CGROUP NETFILTER_XT_MATCH_CLUSTER NETFILTER_XT_MATCH_COMMENT NETFILTER_XT_MATCH_CONNBYTES NETFILTER_XT_MATCH_CONNLABEL NETFILTER_XT_MATCH_CONNLIMIT NETFILTER_XT_MATCH_CONNMARK NETFILTER_XT_MATCH_CPU NETFILTER_XT_MATCH_DCCP NETFILTER_XT_MATCH_DEVGROUP NETFILTER_XT_MATCH_DSCP NETFILTER_XT_MATCH_ECN NETFILTER_XT_MATCH_ESP NETFILTER_XT_MATCH_HASHLIMIT NETFILTER_XT_MATCH_HELPER NETFILTER_XT_MATCH_HL NETFILTER_XT_MATCH_IPCOMP NETFILTER_XT_MATCH_IPRANGE NETFILTER_XT_MATCH_IPVS NETFILTER_XT_MATCH_L2TP NETFILTER_XT_MATCH_LENGTH NETFILTER_XT_MATCH_LIMIT NETFILTER_XT_MATCH_MAC NETFILTER_XT_MATCH_MARK NETFILTER_XT_MATCH_MULTIPORT NETFILTER_XT_MATCH_NFACCT NETFILTER_XT_MATCH_OSF NETFILTER_XT_MATCH_OWNER NETFILTER_XT_MATCH_PHYSDEV NETFILTER_XT_MATCH_PKTTYPE NETFILTER_XT_MATCH_QUOTA NETFILTER_XT_MATCH_RATEEST NETFILTER_XT_MATCH_REALM NETFILTER_XT_MATCH_RECENT NETFILTER_XT_MATCH_SCTP NETFILTER_XT_MATCH_SOCKET NETFILTER_XT_MATCH_STATISTIC NETFILTER_XT_MATCH_STRING NETFILTER_XT_MATCH_TCPMSS NETFILTER_XT_MATCH_TIME NETFILTER_XT_MATCH_U32 NETFILTER_XT_SET NETFILTER_XT_TARGET_AUDIT NETFILTER_XT_TARGET_CHECKSUM NETFILTER_XT_TARGET_CLASSIFY NETFILTER_XT_TARGET_CONNMARK NETFILTER_XT_TARGET_CT NETFILTER_XT_TARGET_DSCP NETFILTER_XT_TARGET_HL NETFILTER_XT_TARGET_HMARK NETFILTER_XT_TARGET_IDLETIMER NETFILTER_XT_TARGET_LED NETFILTER_XT_TARGET_MARK NETFILTER_XT_TARGET_NETMAP NETFILTER_XT_TARGET_NFQUEUE NETFILTER_XT_TARGET_NOTRACK NETFILTER_XT_TARGET_RATEEST NETFILTER_XT_TARGET_REDIRECT NETFILTER_XT_TARGET_TCPOPTSTRIP NETFILTER_XT_TARGET_TEE NETFILTER_XT_TARGET_TPROXY NETFILTER_XT_TARGET_TRACE NETFS_SUPPORT NETLABEL NETLINK_DIAG NETROM NET_9P_RDMA NET_ACT_BPF NET_ACT_CONNMARK NET_ACT_CSUM NET_ACT_CT NET_ACT_CTINFO NET_ACT_GATE NET_ACT_IFE NET_ACT_IPT NET_ACT_MPLS NET_ACT_NAT NET_ACT_PEDIT NET_ACT_POLICE NET_ACT_SAMPLE NET_ACT_SIMP NET_ACT_SKBEDIT NET_ACT_SKBMOD NET_ACT_TUNNEL_KEY NET_ACT_VLAN NET_CLS_BASIC NET_CLS_BPF NET_CLS_CGROUP NET_CLS_FLOW NET_CLS_FLOWER NET_CLS_FW NET_CLS_MATCHALL NET_CLS_ROUTE4 NET_CLS_RSVP NET_CLS_RSVP6 NET_DEVLINK NET_DROP_MONITOR NET_DSA NET_DSA_TAG_BRCM NET_DSA_TAG_BRCM_COMMON NET_DSA_TAG_BRCM_PREPEND NET_DSA_TAG_MTK NET_DSA_TAG_QCA NET_DSA_TAG_RTL4_A NET_EGRESS NET_EMATCH_CANID NET_EMATCH_CMP NET_EMATCH_IPSET NET_EMATCH_IPT NET_EMATCH_META NET_EMATCH_NBYTE NET_EMATCH_TEXT NET_EMATCH_U32 NET_FC NET_FOU NET_FOU_IP_TUNNELS NET_IFE NET_IFE_SKBMARK NET_IFE_SKBPRIO NET_IFE_SKBTCINDEX NET_IPGRE NET_IPGRE_BROADCAST NET_IPGRE_DEMUX NET_IPIP NET_IPVTI NET_KEY NET_KEY_MIGRATE NET_L3_MASTER_DEV NET_MPLS_GSO NET_NCSI NET_NSH NET_REDIRECT NET_SCH_ATM NET_SCH_CAKE NET_SCH_CBQ NET_SCH_CBS NET_SCH_CHOKE NET_SCH_CODEL NET_SCH_DRR NET_SCH_DSMARK NET_SCH_ETF NET_SCH_ETS NET_SCH_FQ NET_SCH_FQ_CODEL NET_SCH_FQ_PIE NET_SCH_GRED NET_SCH_HFSC NET_SCH_HHF NET_SCH_HTB NET_SCH_INGRESS NET_SCH_MQPRIO NET_SCH_MULTIQ NET_SCH_NETEM NET_SCH_PIE NET_SCH_PLUG NET_SCH_PRIO NET_SCH_QFQ NET_SCH_RED NET_SCH_SFB NET_SCH_SFQ NET_SCH_SKBPRIO NET_SCH_TAPRIO NET_SCH_TBF NET_SCH_TEQL NET_SOCK_MSG NET_SWITCHDEV NET_TC_SKB_EXT NET_TEAM NET_TEAM_MODE_ACTIVEBACKUP NET_TEAM_MODE_BROADCAST NET_TEAM_MODE_LOADBALANCE NET_TEAM_MODE_RANDOM NET_TEAM_MODE_ROUNDROBIN NET_UDP_TUNNEL NET_VRF NFC NFC_DIGITAL NFC_FDP NFC_HCI NFC_MRVL NFC_MRVL_USB NFC_NCI NFC_NCI_UART NFC_PN533 NFC_PN533_USB NFC_PORT100 NFC_SHDLC NFC_SIM NFC_VIRTUAL_NCI NFSD NFSD_BLOCKLAYOUT NFSD_FLEXFILELAYOUT NFSD_PNFS NFSD_SCSILAYOUT NFSD_V2_ACL NFSD_V3 NFSD_V3_ACL NFSD_V4 NFSD_V4_2_INTER_SSC NFSD_V4_SECURITY_LABEL NFS_FSCACHE NFS_V4_1 NFS_V4_2 NFS_V4_2_READ_PLUS NFS_V4_2_SSC_HELPER NFS_V4_SECURITY_LABEL NFT_BRIDGE_META NFT_BRIDGE_REJECT NFT_COMPAT NFT_CONNLIMIT NFT_COUNTER NFT_CT NFT_DUP_IPV4 NFT_DUP_IPV6 NFT_DUP_NETDEV NFT_FIB NFT_FIB_INET NFT_FIB_IPV4 NFT_FIB_IPV6 NFT_FIB_NETDEV NFT_FLOW_OFFLOAD NFT_HASH NFT_LIMIT NFT_LOG NFT_MASQ NFT_NAT NFT_NUMGEN NFT_OBJREF NFT_OSF NFT_QUEUE NFT_QUOTA NFT_REDIR NFT_REJECT NFT_REJECT_INET NFT_REJECT_IPV4 NFT_REJECT_IPV6 NFT_REJECT_NETDEV NFT_SOCKET NFT_SYNPROXY NFT_TPROXY NFT_TUNNEL NFT_XFRM NF_CONNTRACK_AMANDA NF_CONNTRACK_BRIDGE NF_CONNTRACK_BROADCAST NF_CONNTRACK_EVENTS NF_CONNTRACK_H323 NF_CONNTRACK_LABELS NF_CONNTRACK_MARK NF_CONNTRACK_NETBIOS_NS NF_CONNTRACK_PPTP NF_CONNTRACK_SANE NF_CONNTRACK_SNMP NF_CONNTRACK_TFTP NF_CONNTRACK_TIMEOUT NF_CONNTRACK_TIMESTAMP NF_CONNTRACK_ZONES NF_CT_NETLINK_HELPER NF_CT_NETLINK_TIMEOUT NF_CT_PROTO_DCCP NF_CT_PROTO_GRE NF_CT_PROTO_SCTP NF_CT_PROTO_UDPLITE NF_DUP_IPV4 NF_DUP_IPV6 NF_DUP_NETDEV NF_FLOW_TABLE NF_FLOW_TABLE_INET NF_FLOW_TABLE_IPV4 NF_FLOW_TABLE_IPV6 NF_NAT_AMANDA NF_NAT_H323 NF_NAT_PPTP NF_NAT_REDIRECT NF_NAT_SNMP_BASIC NF_NAT_TFTP NF_SOCKET_IPV4 NF_SOCKET_IPV6 NF_TABLES NF_TABLES_ARP NF_TABLES_BRIDGE NF_TABLES_INET NF_TABLES_IPV4 NF_TABLES_IPV6 NF_TABLES_NETDEV NF_TPROXY_IPV4 NF_TPROXY_IPV6 NILFS2_FS NLMON NLS_CODEPAGE_1250 NLS_CODEPAGE_1251 NLS_CODEPAGE_737 PARTITION_ADVANCED PSAMPLE RFKILL SPI USB_GADGET USB_MUSB_HDRC VIDEO_DEV VIDEO_V4L2 WAN WATCH_QUEUE WIRELESS WLAN WWAN X25 X86_X32]
testing current HEAD c52b9710c83d3b8ab63bb217cc7c8b61e13f12cd
testing commit c52b9710c83d3b8ab63bb217cc7c8b61e13f12cd gcc
compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40
kernel signature: 82aef47e7b551a56d5fb4819168ab4b73c9a300d1da479992369c211328399ad
run #0: crashed: INFO: rcu detected stall in do_idle
run #1: crashed: INFO: rcu detected stall in smp_call_function
run #2: crashed: INFO: rcu detected stall in sys_getsockopt
run #3: crashed: INFO: rcu detected stall in sys_getsockopt
run #4: crashed: INFO: rcu detected stall in wb_workfn
run #5: crashed: INFO: rcu detected stall in do_idle
run #6: crashed: INFO: rcu detected stall in wb_workfn
run #7: crashed: INFO: rcu detected stall in wb_workfn
run #8: crashed: INFO: rcu detected stall in corrupted
run #9: crashed: INFO: rcu detected stall in do_idle
run #10: crashed: INFO: rcu detected stall in wb_workfn
run #11: crashed: INFO: rcu detected stall in wb_workfn
run #12: crashed: INFO: rcu detected stall in gc_worker
run #13: crashed: INFO: rcu detected stall in gc_worker
run #14: crashed: INFO: rcu detected stall in gc_worker
run #15: crashed: BUG: soft lockup in task_work_run
run #16: crashed: INFO: rcu detected stall in do_idle
run #17: crashed: INFO: rcu detected stall in sys_openat
run #18: crashed: INFO: rcu detected stall in corrupted
run #19: crashed: INFO: rcu detected stall in corrupted
representative crash: INFO: rcu detected stall in do_idle, types: [HANG]
crash still not fixed/happens on the oldest tested release
reproducer is flaky (1.00 repro chance estimate)
revisions tested: 8, total time: 2h28m18.75859253s (build: 58m1.463813645s, test: 1h28m22.795969489s)
crash still not fixed or there were kernel test errors
commit msg: Linux 5.15.156
crash: INFO: rcu detected stall in do_idle
rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
rcu: 0-...0: (1 GPs behind) idle=5cd/0/0x1 softirq=9262/9264 fqs=14
(detected by 1, t=10708 jiffies, g=9433, q=745)
Sending NMI from CPU 1 to CPUs 0:
NMI backtrace for cpu 0
CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.15.156-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 03/27/2024
RIP: 0010:rcu_is_watching+0x0/0x60 kernel/rcu/tree.c:1119
Code: 24 08 48 89 34 24 e8 bf 06 45 00 48 8b 54 24 08 48 8b 34 24 eb ba 48 89 d7 48 89 14 24 e8 c8 06 45 00 48 8b 14 24 eb c8 66 90 <53> 65 ff 05 68 2d b2 7e 48 c7 c3 c8 8b 03 00 65 48 03 1d d1 d2 b1
RSP: 0018:ffffc90000007cf8 EFLAGS: 00000047
RAX: 0000000000000001 RBX: 0000000000000000 RCX: ffffffff814a4a21
RDX: fffffbfff0dd8feb RSI: 0000000000000008 RDI: ffffffff86ec7f50
RBP: 1ffff92000000fa2 R08: 0000000000000000 R09: ffffffff86ec7f57
R10: fffffbfff0dd8fea R11: 0000000000000001 R12: ffff8881147b5300
R13: 17c861b7bd67b3e2 R14: ffff88810ab23820 R15: 17c861b7bd67b3e2
FS: 0000000000000000(0000) GS:ffff8881f6c00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f5a2fc2e095 CR3: 00000001117d0000 CR4: 00000000003506f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
trace_lock_release include/trace/events/lock.h:58 [inline]
lock_release+0x4f1/0x6c0 kernel/locking/lockdep.c:5634
__raw_spin_unlock include/linux/spinlock_api_smp.h:150 [inline]
_raw_spin_unlock+0x12/0x30 kernel/locking/spinlock.c:186
spin_unlock include/linux/spinlock.h:403 [inline]
advance_sched+0x419/0xa40 net/sched/sch_taprio.c:765
__run_hrtimer kernel/time/hrtimer.c:1686 [inline]
__hrtimer_run_queues+0x609/0xb90 kernel/time/hrtimer.c:1750
hrtimer_interrupt+0x2e8/0x740 kernel/time/hrtimer.c:1812
local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1085 [inline]
__sysvec_apic_timer_interrupt+0xf5/0x340 arch/x86/kernel/apic/apic.c:1102
sysvec_apic_timer_interrupt+0x6a/0x90 arch/x86/kernel/apic/apic.c:1096
asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:638
RIP: 0010:native_save_fl arch/x86/include/asm/irqflags.h:29 [inline]
RIP: 0010:arch_local_save_flags arch/x86/include/asm/irqflags.h:70 [inline]
RIP: 0010:arch_irqs_disabled arch/x86/include/asm/irqflags.h:132 [inline]
RIP: 0010:acpi_safe_halt drivers/acpi/processor_idle.c:110 [inline]
RIP: 0010:acpi_idle_do_entry+0x1fd/0x2a0 drivers/acpi/processor_idle.c:570
Code: 89 de e8 26 83 9f fc 84 db 75 ac e8 ed 8a 9f fc e8 88 bd a5 fc 66 90 e8 e1 8a 9f fc 0f 00 2d aa 17 8e 00 e8 d5 8a 9f fc fb f4 <9c> 5b 81 e3 00 02 00 00 fa 31 ff 48 89 de e8 50 83 9f fc 48 85 db
RSP: 0018:ffffffff86007d68 EFLAGS: 00000293
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 1ffffffff0dd8a79
RDX: ffffffff8606c640 RSI: ffffffff84c4931b RDI: ffffffff84c49308
RBP: ffff8881003c9864 R08: 0000000000000001 R09: 0000000000000001
R10: 0000000000000000 R11: 0000000000000001 R12: 0000000000000001
R13: ffff8881003c9800 R14: ffff8881003c9864 R15: ffff888104195804
acpi_idle_enter+0x35d/0x500 drivers/acpi/processor_idle.c:705
cpuidle_enter_state+0x1b1/0xc80 drivers/cpuidle/cpuidle.c:237
cpuidle_enter+0x4a/0xa0 drivers/cpuidle/cpuidle.c:351
call_cpuidle kernel/sched/idle.c:158 [inline]
cpuidle_idle_call kernel/sched/idle.c:239 [inline]
do_idle+0x3dd/0x580 kernel/sched/idle.c:306
cpu_startup_entry+0x14/0x20 kernel/sched/idle.c:403
start_kernel+0x3d2/0x3f1 init/main.c:1138
secondary_startup_64_no_verify+0xb0/0xbb
rcu: rcu_sched kthread timer wakeup didn't happen for 848 jiffies! g9433 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402
rcu: Possible timer handling issue on cpu=1 timer-softirq=1809
rcu: rcu_sched kthread starved for 849 jiffies! g9433 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=1
rcu: Unless rcu_sched kthread gets sufficient CPU time, OOM is now expected behavior.
rcu: RCU grace-period kthread stack dump:
task:rcu_sched state:I stack:28776 pid: 12 ppid: 2 flags:0x00004000
Call Trace:
context_switch kernel/sched/core.c:5030 [inline]
__schedule+0x92b/0x23d0 kernel/sched/core.c:6376
schedule+0x106/0x230 kernel/sched/core.c:6459
schedule_timeout+0x14a/0x2a0 kernel/time/timer.c:1914
rcu_gp_fqs_loop+0x164/0x620 kernel/rcu/tree.c:1972
rcu_gp_kthread+0x138/0x1d0 kernel/rcu/tree.c:2145
kthread+0x3c2/0x4a0 kernel/kthread.c:334
ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:300
rcu: Stack dump where RCU GP kthread last ran:
NMI backtrace for cpu 1
CPU: 1 PID: 0 Comm: swapper/1 Not tainted 5.15.156-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 03/27/2024
Call Trace:
__dump_stack lib/dump_stack.c:88 [inline]
dump_stack_lvl+0xcd/0x134 lib/dump_stack.c:106
nmi_cpu_backtrace.cold+0x49/0x148 lib/nmi_backtrace.c:111
nmi_trigger_cpumask_backtrace+0x20b/0x260 lib/nmi_backtrace.c:62
trigger_single_cpu_backtrace include/linux/nmi.h:166 [inline]
rcu_check_gp_kthread_starvation+0x1d2/0x1ef kernel/rcu/tree_stall.h:487
print_other_cpu_stall kernel/rcu/tree_stall.h:592 [inline]
check_cpu_stall kernel/rcu/tree_stall.h:745 [inline]
rcu_pending kernel/rcu/tree.c:3932 [inline]
rcu_sched_clock_irq.cold+0x308/0x3d4 kernel/rcu/tree.c:2619
update_process_times+0x139/0x1b0 kernel/time/timer.c:1818
tick_sched_handle+0x9b/0x180 kernel/time/tick-sched.c:254
tick_sched_timer+0xe2/0x110 kernel/time/tick-sched.c:1473
__run_hrtimer kernel/time/hrtimer.c:1686 [inline]
__hrtimer_run_queues+0x1c0/0xb90 kernel/time/hrtimer.c:1750
hrtimer_interrupt+0x2e8/0x740 kernel/time/hrtimer.c:1812
local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1085 [inline]
__sysvec_apic_timer_interrupt+0xf5/0x340 arch/x86/kernel/apic/apic.c:1102
sysvec_apic_timer_interrupt+0x6a/0x90 arch/x86/kernel/apic/apic.c:1096
asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:638
RIP: 0010:native_save_fl arch/x86/include/asm/irqflags.h:29 [inline]
RIP: 0010:arch_local_save_flags arch/x86/include/asm/irqflags.h:70 [inline]
RIP: 0010:arch_irqs_disabled arch/x86/include/asm/irqflags.h:132 [inline]
RIP: 0010:acpi_safe_halt drivers/acpi/processor_idle.c:110 [inline]
RIP: 0010:acpi_idle_do_entry+0x1fd/0x2a0 drivers/acpi/processor_idle.c:570
Code: 89 de e8 26 83 9f fc 84 db 75 ac e8 ed 8a 9f fc e8 88 bd a5 fc 66 90 e8 e1 8a 9f fc 0f 00 2d aa 17 8e 00 e8 d5 8a 9f fc fb f4 <9c> 5b 81 e3 00 02 00 00 fa 31 ff 48 89 de e8 50 83 9f fc 48 85 db
RSP: 0018:ffffc900000ffd18 EFLAGS: 00000293
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 1ffffffff0dd8a79
RDX: ffff8881002e3980 RSI: ffffffff84c4931b RDI: ffffffff84c49308
RBP: ffff8881003ca064 R08: 0000000000000001 R09: 0000000000000001
R10: 0000000000000000 R11: 0000000000000001 R12: 0000000000000001
R13: ffff8881003ca000 R14: ffff8881003ca064 R15: ffff888104196004
acpi_idle_enter+0x35d/0x500 drivers/acpi/processor_idle.c:705
cpuidle_enter_state+0x1b1/0xc80 drivers/cpuidle/cpuidle.c:237
cpuidle_enter+0x4a/0xa0 drivers/cpuidle/cpuidle.c:351
call_cpuidle kernel/sched/idle.c:158 [inline]
cpuidle_idle_call kernel/sched/idle.c:239 [inline]
do_idle+0x3dd/0x580 kernel/sched/idle.c:306
cpu_startup_entry+0x14/0x20 kernel/sched/idle.c:403
start_secondary+0x229/0x2f0 arch/x86/kernel/smpboot.c:281
secondary_startup_64_no_verify+0xb0/0xbb