ci2 starts bisection 2024-01-10 06:15:15.454662848 +0000 UTC m=+21530.667349502
bisecting fixing commit since f67653019430833d5003f16817d7fa85272a6a76
building syzkaller on 79782afcff30fd0c0af8c2725d508b2c7150f3ed
ensuring issue is reproducible on original commit f67653019430833d5003f16817d7fa85272a6a76
testing commit f67653019430833d5003f16817d7fa85272a6a76 gcc
compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40
kernel signature: 9ca8d915bbc10d0ca8493a5596e52874e606af9cb436c350bcc27ee3d675ecae
run #0: crashed: INFO: rcu detected stall in net_tx_action
run #1: crashed: INFO: rcu detected stall in addrconf_rs_timer
run #2: crashed: INFO: rcu detected stall in tc_modify_qdisc
run #3: crashed: INFO: rcu detected stall in do_idle
run #4: crashed: INFO: rcu detected stall in syscall_exit_to_user_mode
run #5: crashed: INFO: rcu detected stall in smp_call_function
run #6: crashed: INFO: rcu detected stall in net_tx_action
run #7: crashed: INFO: rcu detected stall in neigh_periodic_work
run #8: crashed: INFO: rcu detected stall in sys_clock_nanosleep
run #9: crashed: INFO: rcu detected stall in smp_call_function
run #10: crashed: INFO: rcu detected stall in gc_worker
run #11: crashed: INFO: rcu detected stall in mld_ifc_work
run #12: crashed: INFO: task hung in corrupted
run #13: crashed: INFO: rcu detected stall in bpf_prog_free_deferred
run #14: crashed: INFO: task hung in corrupted
run #15: crashed: INFO: rcu detected stall in tc_modify_qdisc
run #16: crashed: INFO: rcu detected stall in corrupted
run #17: crashed: INFO: rcu detected stall in smp_call_function
run #18: crashed: BUG: workqueue lockup
run #19: basic kernel testing failed: failed to copy binary to VM: failed to run ["scp" "-P" "22" "-F" "/dev/null" "-o" "UserKnownHostsFile=/dev/null" "-o" "BatchMode=yes" "-o" "IdentitiesOnly=yes" "-o" "StrictHostKeyChecking=no" "-o" "ConnectTimeout=10" "-v" "/tmp/syz-executor3265651030" "root@10.128.10.55:./syz-executor3265651030"]: exit status 255
Executing: program /usr/bin/ssh host 10.128.10.55, user root, command sftp
OpenSSH_9.2p1 Debian-2, OpenSSL 3.0.9 30 May 2023
debug1: Reading configuration data /dev/null
debug1: Connecting to 10.128.10.55 [10.128.10.55] port 22.
debug1: fd 3 clearing O_NONBLOCK
debug1: Connection established.
debug1: identity file /root/.ssh/id_rsa type -1
debug1: identity file /root/.ssh/id_rsa-cert type -1
debug1: identity file /root/.ssh/id_ecdsa type -1
debug1: identity file /root/.ssh/id_ecdsa-cert type -1
debug1: identity file /root/.ssh/id_ecdsa_sk type -1
debug1: identity file /root/.ssh/id_ecdsa_sk-cert type -1
debug1: identity file /root/.ssh/id_ed25519 type -1
debug1: identity file /root/.ssh/id_ed25519-cert type -1
debug1: identity file /root/.ssh/id_ed25519_sk type -1
debug1: identity file /root/.ssh/id_ed25519_sk-cert type -1
debug1: identity file /root/.ssh/id_xmss type -1
debug1: identity file /root/.ssh/id_xmss-cert type -1
debug1: identity file /root/.ssh/id_dsa type -1
debug1: identity file /root/.ssh/id_dsa-cert type -1
debug1: Local version string SSH-2.0-OpenSSH_9.2p1 Debian-2
Connection timed out during banner exchange
Connection to 10.128.10.55 port 22 timed out
scp: Connection closed
representative crash: INFO: rcu detected stall in net_tx_action, types: [HANG]
check whether we can drop unnecessary instrumentation
disabling configs for [ATOMIC_SLEEP LEAK UBSAN BUG KASAN LOCKDEP], they are not needed
testing commit f67653019430833d5003f16817d7fa85272a6a76 gcc
compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40
kernel signature: 25b8a55c506ac4f136f9128e2bc101ef1d8cce92291e0f3d66aecbd065865537
run #0: crashed: INFO: rcu detected stall in do_idle
run #1: crashed: INFO: task hung in regdb_fw_cb
run #2: basic kernel testing failed: failed to copy binary to VM: failed to run ["scp" "-P" "22" "-F" "/dev/null" "-o" "UserKnownHostsFile=/dev/null" "-o" "BatchMode=yes" "-o" "IdentitiesOnly=yes" "-o" "StrictHostKeyChecking=no" "-o" "ConnectTimeout=10" "-v" "/tmp/syz-executor860761078" "root@10.128.0.245:./syz-executor860761078"]: exit status 255
Executing: program /usr/bin/ssh host 10.128.0.245, user root, command sftp
OpenSSH_9.2p1 Debian-2, OpenSSL 3.0.9 30 May 2023
debug1: Reading configuration data /dev/null
debug1: Connecting to 10.128.0.245 [10.128.0.245] port 22.
debug1: fd 3 clearing O_NONBLOCK
debug1: Connection established.
debug1: identity file /root/.ssh/id_rsa type -1
debug1: identity file /root/.ssh/id_rsa-cert type -1
debug1: identity file /root/.ssh/id_ecdsa type -1
debug1: identity file /root/.ssh/id_ecdsa-cert type -1
debug1: identity file /root/.ssh/id_ecdsa_sk type -1
debug1: identity file /root/.ssh/id_ecdsa_sk-cert type -1
debug1: identity file /root/.ssh/id_ed25519 type -1
debug1: identity file /root/.ssh/id_ed25519-cert type -1
debug1: identity file /root/.ssh/id_ed25519_sk type -1
debug1: identity file /root/.ssh/id_ed25519_sk-cert type -1
debug1: identity file /root/.ssh/id_xmss type -1
debug1: identity file /root/.ssh/id_xmss-cert type -1
debug1: identity file /root/.ssh/id_dsa type -1
debug1: identity file /root/.ssh/id_dsa-cert type -1
debug1: Local version string SSH-2.0-OpenSSH_9.2p1 Debian-2
Connection timed out during banner exchange
Connection to 10.128.0.245 port 22 timed out
scp: Connection closed
run #3: basic kernel testing failed: failed to copy binary to VM: failed to run ["scp" "-P" "22" "-F" "/dev/null" "-o" "UserKnownHostsFile=/dev/null" "-o" "BatchMode=yes" "-o" "IdentitiesOnly=yes" "-o" "StrictHostKeyChecking=no" "-o" "ConnectTimeout=10" "-v" "/tmp/syz-executor1331744963" "root@10.128.10.36:./syz-executor1331744963"]: exit status 255
Executing: program /usr/bin/ssh host 10.128.10.36, user root, command sftp
OpenSSH_9.2p1 Debian-2, OpenSSL 3.0.9 30 May 2023
debug1: Reading configuration data /dev/null
debug1: Connecting to 10.128.10.36 [10.128.10.36] port 22.
debug1: fd 3 clearing O_NONBLOCK
debug1: Connection established.
debug1: identity file /root/.ssh/id_rsa type -1
debug1: identity file /root/.ssh/id_rsa-cert type -1
debug1: identity file /root/.ssh/id_ecdsa type -1
debug1: identity file /root/.ssh/id_ecdsa-cert type -1
debug1: identity file /root/.ssh/id_ecdsa_sk type -1
debug1: identity file /root/.ssh/id_ecdsa_sk-cert type -1
debug1: identity file /root/.ssh/id_ed25519 type -1
debug1: identity file /root/.ssh/id_ed25519-cert type -1
debug1: identity file /root/.ssh/id_ed25519_sk type -1
debug1: identity file /root/.ssh/id_ed25519_sk-cert type -1
debug1: identity file /root/.ssh/id_xmss type -1
debug1: identity file /root/.ssh/id_xmss-cert type -1
debug1: identity file /root/.ssh/id_dsa type -1
debug1: identity file /root/.ssh/id_dsa-cert type -1
debug1: Local version string SSH-2.0-OpenSSH_9.2p1 Debian-2
Connection timed out during banner exchange
Connection to 10.128.10.36 port 22 timed out
scp: Connection closed
run #4: OK
run #5: OK
run #6: OK
run #7: OK
run #8: OK
run #9: OK
representative crash: INFO: rcu detected stall in do_idle, types: [HANG]
kconfig minimization: base=3703 full=7269 leaves diff=1988
split chunks (needed=false): <1988>
split chunk #0 of len 1988 into 5 parts
testing without sub-chunk 1/5
testing commit f67653019430833d5003f16817d7fa85272a6a76 gcc
compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40
kernel signature: 353ed110e105f70fcf4f1a980c6f0a24ddaf9c4a93b65edc24298b1afcb968b6
run #0: crashed: INFO: rcu detected stall in wb_workfn
run #1: crashed: BUG: soft lockup in net_tx_action
run #2: crashed: INFO: rcu detected stall in net_tx_action
run #3: crashed: INFO: rcu detected stall in net_tx_action
run #4: crashed: INFO: rcu detected stall in smp_call_function
run #5: crashed: BUG: soft lockup in net_tx_action
run #6: crashed: BUG: soft lockup in net_tx_action
run #7: crashed: INFO: rcu detected stall in smp_call_function
run #8: crashed: INFO: rcu detected stall in wb_workfn
run #9: crashed: BUG: soft lockup in smp_call_function
run #10: crashed: INFO: rcu detected stall in corrupted
run #11: crashed: INFO: task hung in corrupted
run #12: crashed: INFO: rcu detected stall in gc_worker
run #13: crashed: INFO: rcu detected stall in gc_worker
run #14: crashed: INFO: task hung in corrupted
run #15: crashed: INFO: rcu detected stall in wb_workfn
run #16: crashed: INFO: rcu detected stall in addrconf_rs_timer
run #17: crashed: INFO: rcu detected stall in smp_call_function
run #18: crashed: INFO: task hung in corrupted
run #19: crashed: no output from test machine
representative crash: INFO: rcu detected stall in wb_workfn, types: [HANG]
the chunk can be dropped
testing without sub-chunk 2/5
testing commit f67653019430833d5003f16817d7fa85272a6a76 gcc
compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40
kernel signature: 6acb62804bf6f6312efe60803991a2e30ba6edb0cd0d3eaac4efa01754ae70b3
run #0: crashed: INFO: rcu detected stall in wb_workfn
run #1: crashed: INFO: rcu detected stall in net_tx_action
run #2: crashed: INFO: rcu detected stall in clone
run #3: crashed: INFO: rcu detected stall in ext4_end_io_rsv_work
run #4: crashed: INFO: rcu detected stall in wb_workfn
run #5: crashed: INFO: rcu detected stall in do_idle
run #6: crashed: INFO: task hung in corrupted
run #7: crashed: INFO: rcu detected stall in wb_workfn
run #8: crashed: INFO: rcu detected stall in gc_worker
run #9: crashed: INFO: rcu detected stall in gc_worker
run #10: crashed: INFO: task hung in corrupted
run #11: crashed: INFO: rcu detected stall in gc_worker
run #12: crashed: INFO: rcu detected stall in linkwatch_event
run #13: crashed: INFO: rcu detected stall in sys_openat
run #14: crashed: INFO: rcu detected stall in wg_packet_handshake_receive_worker
run #15: crashed: INFO: rcu detected stall in addrconf_rs_timer
run #16: crashed: INFO: task hung in corrupted
run #17: crashed: INFO: rcu detected stall in smp_call_function
run #18: crashed: INFO: rcu detected stall in neigh_periodic_work
run #19: crashed: INFO: task hung in corrupted
representative crash: INFO: rcu detected stall in wb_workfn, types: [HANG]
the chunk can be dropped
testing without sub-chunk 3/5
testing commit f67653019430833d5003f16817d7fa85272a6a76 gcc
compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40
kernel signature: 47cf58107ffa4e5bbf8c594c28214c5214503175f975d2b665bc808cb3a3b364
all runs: OK
false negative chance: 0.000
testing without sub-chunk 4/5
testing commit f67653019430833d5003f16817d7fa85272a6a76 gcc
compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40
kernel signature: 83211b6b599e3f5d584acd1b376c2d6b345a26f5c96ab6dd1d786c5f2f5a7c68
run #0: crashed: INFO: rcu detected stall in clone
run #1: crashed: INFO: rcu detected stall in tc_modify_qdisc
run #2: crashed: INFO: rcu detected stall in smp_call_function
run #3: crashed: INFO: rcu detected stall in tc_modify_qdisc
run #4: crashed: INFO: rcu detected stall in wb_workfn
run #5: crashed: INFO: rcu detected stall in gc_worker
run #6: crashed: INFO: rcu detected stall in ext4_end_io_rsv_work
run #7: crashed: INFO: rcu detected stall in wb_workfn
run #8: crashed: INFO: task hung in __netlink_dump_start
run #9: crashed: INFO: rcu detected stall in sys_getsockopt
run #10: crashed: INFO: rcu detected stall in smp_call_function
run #11: crashed: INFO: rcu detected stall in wb_workfn
run #12: crashed: INFO: rcu detected stall in gc_worker
run #13: crashed: INFO: rcu detected stall in do_idle
run #14: crashed: INFO: task hung in rtnetlink_rcv_msg
run #15: crashed: INFO: rcu detected stall in do_idle
run #16: crashed: INFO: rcu detected stall in corrupted
run #17: crashed: INFO: rcu detected stall in ipv6_rcv
run #18: crashed: INFO: rcu detected stall in do_idle
run #19: crashed: INFO: rcu detected stall in do_idle
representative crash: INFO: rcu detected stall in clone, types: [HANG]
the chunk can be dropped
testing without sub-chunk 5/5
testing commit f67653019430833d5003f16817d7fa85272a6a76 gcc
compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40
kernel signature: d99b4c3f942893e1f7a5ee5f9c81ee3460d12167eac1b8e32875ea9382ddffc4
run #0: crashed: INFO: rcu detected stall in tc_modify_qdisc
run #1: crashed: INFO: rcu detected stall in do_idle
run #2: crashed: INFO: rcu detected stall in tc_modify_qdisc
run #3: crashed: BUG: soft lockup in corrupted
run #4: crashed: INFO: rcu detected stall in do_idle
run #5: crashed: INFO: rcu detected stall in do_idle
run #6: crashed: BUG: soft lockup in smp_call_function
run #7: crashed: INFO: rcu detected stall in do_idle
run #8: crashed: INFO: rcu detected stall in clone
run #9: crashed: INFO: rcu detected stall in gc_worker
run #10: crashed: INFO: rcu detected stall in wb_workfn
run #11: crashed: INFO: rcu detected stall in corrupted
run #12: crashed: INFO: rcu detected stall in gc_worker
run #13: crashed: INFO: rcu detected stall in do_idle
run #14: crashed: INFO: rcu detected stall in do_idle
run #15: crashed: INFO: rcu detected stall in do_idle
run #16: crashed: INFO: rcu detected stall in do_idle
run #17: crashed: INFO: rcu detected stall in do_idle
run #18: crashed: INFO: rcu detected stall in wb_workfn
run #19: crashed: INFO: rcu detected stall in corrupted
representative crash: INFO: rcu detected stall in tc_modify_qdisc, types: [HANG]
the chunk can be dropped
minimized to 398 configs; suspects: [ATM AX25 BRIDGE BRIDGE_NETFILTER CAN CFG80211 CHECKPOINT_RESTORE DVB_CORE FB FSCACHE HAMRADIO HSR INFINIBAND INFINIBAND_ADDR_TRANS INFINIBAND_USER_ACCESS INPUT_JOYSTICK INPUT_MOUSE IP6_NF_RAW IPV6_MULTIPLE_TABLES IP_NF_RAW IP_SET IP_VS ISDN ISDN_CAPI_MIDDLEWARE JFFS2_CMODE_PRIORITY JFFS2_COMPRESSION_OPTIONS JFFS2_FS JFFS2_FS_POSIX_ACL JFFS2_FS_SECURITY JFFS2_FS_WRITEBUFFER JFFS2_FS_XATTR JFFS2_LZO JFFS2_RTIME JFFS2_RUBIN JFFS2_SUMMARY JFFS2_ZLIB JFS_DEBUG JFS_FS JFS_POSIX_ACL JFS_SECURITY JOYSTICK_IFORCE JOYSTICK_IFORCE_USB JOYSTICK_XPAD JOYSTICK_XPAD_FF JOYSTICK_XPAD_LEDS KARMA_PARTITION KCOV KCOV_ENABLE_COMPARISONS KCOV_INSTRUMENT_ALL KEYS_REQUEST_CACHE KEY_DH_OPERATIONS KEY_NOTIFICATIONS KSM KVM KVM_AMD KVM_ASYNC_PF KVM_COMPAT KVM_GENERIC_DIRTYLOG_READ_PROTECT KVM_INTEL KVM_MMIO KVM_VFIO KVM_XEN KVM_XFER_TO_GUEST_WORK L2TP L2TP_ETH L2TP_IP L2TP_V3 LAPB LAPBETHER LDM_PARTITION LEDS_TRIGGER_AUDIO LEGACY_PTYS LIBNVDIMM LINEAR_RANGES LLC LLC2 LOGIG940_FF LOGIRUMBLEPAD2_FF LOGO LOGO_LINUX_MONO LOGO_LINUX_VGA16 LPC_ICH LWTUNNEL LWTUNNEL_BPF LZ4HC_COMPRESS LZ4_COMPRESS MAC80211 MAC80211_DEBUGFS MAC80211_HAS_RC MAC80211_HWSIM MAC80211_MESH MAC80211_RC_DEFAULT_MINSTREL MAC80211_RC_MINSTREL MACSEC MACVLAN MACVTAP MAC_PARTITION MAPPING_DIRTY_HELPERS MD_LINEAR MD_MULTIPATH MD_RAID0 MD_RAID1 MD_RAID10 MD_RAID456 MEDIA_ANALOG_TV_SUPPORT MEDIA_ATTACH MEDIA_CONTROLLER MEDIA_CONTROLLER_DVB MEDIA_CONTROLLER_REQUEST_API MEDIA_DIGITAL_TV_SUPPORT MEDIA_RADIO_SUPPORT MEDIA_SDR_SUPPORT MEDIA_SUPPORT MEDIA_SUPPORT_FILTER MEDIA_TUNER MEDIA_TUNER_MSI001 MEDIA_TUNER_XC2028 MEDIA_TUNER_XC5000 MEMORY_BALLOON MEMORY_HOTPLUG MEMORY_HOTPLUG_DEFAULT_ONLINE MEMORY_ISOLATION MEMREGION MEMSTICK MEMSTICK_REALTEK_USB MEM_SOFT_DIRTY MFD_CORE MFD_SYSCON MHI_BUS MHI_WWAN_CTRL MHP_MEMMAP_ON_MEMORY MICROCHIP_PHY MINIX_FS MINIX_SUBPARTITION MISC_RTSX MISC_RTSX_USB MISDN MISDN_DSP MISDN_HFCUSB MISDN_L1OIP MKISS MLX4_CORE MLX4_INFINIBAND MMC MMC_REALTEK_USB MMC_USHC MMC_VUB300 MMU_NOTIFIER MODULE_SRCVERSION_ALL MODVERSIONS MOST MOUSE_APPLETOUCH MOUSE_BCM5974 MOUSE_PS2 MOUSE_PS2_ALPS MOUSE_PS2_BYD MOUSE_PS2_CYPRESS MOUSE_PS2_FOCALTECH MOUSE_PS2_LIFEBOOK MOUSE_PS2_LOGIPS2PP MOUSE_PS2_SMBUS MOUSE_PS2_SYNAPTICS MOUSE_PS2_SYNAPTICS_SMBUS MOUSE_PS2_TRACKPOINT MOUSE_SYNAPTICS_USB MPLS MPLS_IPTUNNEL MPLS_ROUTING MPTCP MPTCP_IPV6 MRP MTD MTD_BLKDEVS MTD_BLOCK MTD_BLOCK2MTD MTD_CFI_I1 MTD_CFI_I2 MTD_MAP_BANK_WIDTH_1 MTD_MAP_BANK_WIDTH_2 MTD_MAP_BANK_WIDTH_4 MTD_MTDRAM MTD_PHRAM MTD_SLRAM MUSB_PIO_ONLY ND_BLK ND_BTT ND_CLAIM ND_PFN NETDEVSIM NETFILTER_ADVANCED NETFILTER_FAMILY_ARP NETFILTER_FAMILY_BRIDGE NETFILTER_NETLINK_ACCT NETFILTER_NETLINK_GLUE_CT NETFILTER_NETLINK_OSF NETFILTER_NETLINK_QUEUE NETFILTER_SYNPROXY NETFILTER_XT_CONNMARK NETFILTER_XT_MATCH_BPF NETFILTER_XT_MATCH_CGROUP NETFILTER_XT_MATCH_CLUSTER NETFILTER_XT_MATCH_COMMENT NETFILTER_XT_MATCH_CONNBYTES NETFILTER_XT_MATCH_CONNLABEL NETFILTER_XT_MATCH_CONNLIMIT NETFILTER_XT_MATCH_CONNMARK NETFILTER_XT_MATCH_CPU NETFILTER_XT_MATCH_DCCP NETFILTER_XT_MATCH_DEVGROUP NETFILTER_XT_MATCH_DSCP NETFILTER_XT_MATCH_ECN NETFILTER_XT_MATCH_ESP NETFILTER_XT_MATCH_HASHLIMIT NETFILTER_XT_MATCH_HELPER NETFILTER_XT_MATCH_HL NETFILTER_XT_MATCH_IPCOMP NETFILTER_XT_MATCH_IPRANGE NETFILTER_XT_MATCH_IPVS NETFILTER_XT_MATCH_L2TP NETFILTER_XT_MATCH_LENGTH NETFILTER_XT_MATCH_LIMIT NETFILTER_XT_MATCH_MAC NETFILTER_XT_MATCH_MARK NETFILTER_XT_MATCH_MULTIPORT NETFILTER_XT_MATCH_NFACCT NETFILTER_XT_MATCH_OSF NETFILTER_XT_MATCH_OWNER NETFILTER_XT_MATCH_PHYSDEV NETFILTER_XT_MATCH_PKTTYPE NETFILTER_XT_MATCH_QUOTA NETFILTER_XT_MATCH_RATEEST NETFILTER_XT_MATCH_REALM NETFILTER_XT_MATCH_RECENT NETFILTER_XT_MATCH_SCTP NETFILTER_XT_MATCH_SOCKET NETFILTER_XT_MATCH_STATISTIC NETFILTER_XT_MATCH_STRING NETFILTER_XT_MATCH_TCPMSS NETFILTER_XT_MATCH_TIME NETFILTER_XT_MATCH_U32 NETFILTER_XT_SET NETFILTER_XT_TARGET_AUDIT NETFILTER_XT_TARGET_CHECKSUM NETFILTER_XT_TARGET_CLASSIFY NETFILTER_XT_TARGET_CONNMARK NETFILTER_XT_TARGET_CT NETFILTER_XT_TARGET_DSCP NETFILTER_XT_TARGET_HL NETFILTER_XT_TARGET_HMARK NETFILTER_XT_TARGET_IDLETIMER NETFILTER_XT_TARGET_LED NETFILTER_XT_TARGET_MARK NETFILTER_XT_TARGET_NETMAP NETFILTER_XT_TARGET_NFQUEUE NETFILTER_XT_TARGET_NOTRACK NETFILTER_XT_TARGET_RATEEST NETFILTER_XT_TARGET_REDIRECT NETFILTER_XT_TARGET_TCPOPTSTRIP NETFILTER_XT_TARGET_TEE NETFILTER_XT_TARGET_TPROXY NETFILTER_XT_TARGET_TRACE NETFS_SUPPORT NETLABEL NETLINK_DIAG NETROM NET_9P_RDMA NET_ACT_BPF NET_ACT_CONNMARK NET_ACT_CSUM NET_ACT_CT NET_ACT_CTINFO NET_ACT_GATE NET_ACT_IFE NET_ACT_IPT NET_ACT_MPLS NET_ACT_NAT NET_ACT_PEDIT NET_ACT_POLICE NET_ACT_SAMPLE NET_ACT_SIMP NET_ACT_SKBEDIT NET_ACT_SKBMOD NET_ACT_TUNNEL_KEY NET_ACT_VLAN NET_CLS_BASIC NET_CLS_BPF NET_CLS_CGROUP NET_CLS_FLOW NET_CLS_FLOWER NET_CLS_FW NET_CLS_MATCHALL NET_CLS_ROUTE4 NET_CLS_RSVP NET_CLS_RSVP6 NET_DEVLINK NET_DROP_MONITOR NET_DSA NET_DSA_TAG_BRCM NET_DSA_TAG_BRCM_COMMON NET_DSA_TAG_BRCM_PREPEND NET_DSA_TAG_MTK NET_DSA_TAG_QCA NET_DSA_TAG_RTL4_A NET_EGRESS NET_EMATCH_CANID NET_EMATCH_CMP NET_EMATCH_IPSET NET_EMATCH_IPT NET_EMATCH_META NET_EMATCH_NBYTE NET_EMATCH_TEXT NET_EMATCH_U32 NET_FC NET_FOU NET_FOU_IP_TUNNELS NET_IFE NET_IFE_SKBMARK NET_IFE_SKBPRIO NET_IFE_SKBTCINDEX NET_IPGRE NET_IPGRE_BROADCAST NET_IPGRE_DEMUX NET_IPIP NET_IPVTI NET_KEY NET_KEY_MIGRATE NET_L3_MASTER_DEV NET_MPLS_GSO NET_NCSI NET_NSH NET_REDIRECT NET_SCH_ATM NET_SCH_CAKE NET_SCH_CBQ NET_SCH_CBS NET_SCH_CHOKE NET_SCH_CODEL NET_SCH_DRR NET_SCH_DSMARK NET_SCH_ETF NET_SCH_ETS NET_SCH_FQ NET_SCH_FQ_CODEL NET_SCH_FQ_PIE NET_SCH_GRED NET_SCH_HFSC NET_SCH_HHF NET_SCH_HTB NET_SCH_INGRESS NET_SCH_MQPRIO NET_SCH_MULTIQ NET_SCH_NETEM NET_SCH_PIE NET_SCH_PLUG NET_SCH_PRIO NET_SCH_QFQ NET_SCH_RED NET_SCH_SFB NET_SCH_SFQ NET_SCH_SKBPRIO NET_SCH_TAPRIO NET_SCH_TBF NET_SCH_TEQL NET_SOCK_MSG NET_SWITCHDEV NET_TC_SKB_EXT NET_TEAM NET_TEAM_MODE_ACTIVEBACKUP NET_TEAM_MODE_BROADCAST NET_TEAM_MODE_LOADBALANCE NET_TEAM_MODE_RANDOM NET_TEAM_MODE_ROUNDROBIN NET_UDP_TUNNEL NET_VRF NFC NFC_DIGITAL NFC_FDP NFC_HCI NFC_MRVL NFC_MRVL_USB NFC_NCI NFC_NCI_UART NFC_PN533 NFC_PN533_USB NFC_PORT100 NFC_SHDLC NFC_SIM NFC_VIRTUAL_NCI NFSD NFSD_BLOCKLAYOUT NFSD_FLEXFILELAYOUT NFSD_PNFS NFSD_SCSILAYOUT NFSD_V2_ACL NFSD_V3 NFSD_V3_ACL NFSD_V4 NFSD_V4_2_INTER_SSC NFSD_V4_SECURITY_LABEL NFS_FSCACHE NFS_V4_1 NFS_V4_2 NFS_V4_2_READ_PLUS NFS_V4_2_SSC_HELPER NFS_V4_SECURITY_LABEL NFT_BRIDGE_META NFT_BRIDGE_REJECT NFT_COMPAT NFT_CONNLIMIT NFT_COUNTER NFT_CT NFT_DUP_IPV4 NFT_DUP_IPV6 NFT_DUP_NETDEV NFT_FIB NFT_FIB_INET NFT_FIB_IPV4 NFT_FIB_IPV6 NFT_FIB_NETDEV NFT_FLOW_OFFLOAD NFT_HASH NFT_LIMIT NFT_LOG NFT_MASQ NFT_NAT NFT_NUMGEN NFT_OBJREF NFT_OSF NFT_QUEUE NFT_QUOTA NFT_REDIR NFT_REJECT NFT_REJECT_INET NFT_REJECT_IPV4 NFT_REJECT_IPV6 NFT_REJECT_NETDEV NFT_SOCKET NFT_SYNPROXY NFT_TPROXY NFT_TUNNEL NFT_XFRM NF_CONNTRACK_AMANDA NF_CONNTRACK_BRIDGE NF_CONNTRACK_BROADCAST NF_CONNTRACK_EVENTS NF_CONNTRACK_H323 NF_CONNTRACK_LABELS NF_CONNTRACK_MARK NF_CONNTRACK_NETBIOS_NS NF_CONNTRACK_PPTP NF_CONNTRACK_SANE NF_CONNTRACK_SNMP NF_CONNTRACK_TFTP NF_CONNTRACK_TIMEOUT NF_CONNTRACK_TIMESTAMP NF_CONNTRACK_ZONES NF_CT_NETLINK_HELPER NF_CT_NETLINK_TIMEOUT NF_CT_PROTO_DCCP NF_CT_PROTO_GRE NF_CT_PROTO_SCTP NF_CT_PROTO_UDPLITE NF_DUP_IPV4 NF_DUP_IPV6 NF_DUP_NETDEV NF_FLOW_TABLE NF_FLOW_TABLE_INET NF_FLOW_TABLE_IPV4 NF_FLOW_TABLE_IPV6 NF_NAT_AMANDA NF_NAT_H323 NF_NAT_PPTP NF_NAT_REDIRECT NF_NAT_SNMP_BASIC NF_NAT_TFTP NF_SOCKET_IPV4 NF_SOCKET_IPV6 NF_TABLES NF_TABLES_ARP NF_TABLES_BRIDGE NF_TABLES_INET NF_TABLES_IPV4 NF_TABLES_IPV6 NF_TABLES_NETDEV NF_TPROXY_IPV4 NF_TPROXY_IPV6 NILFS2_FS NLMON NLS_CODEPAGE_1250 NLS_CODEPAGE_1251 NLS_CODEPAGE_737 PARTITION_ADVANCED PSAMPLE RFKILL SPI USB_GADGET USB_MUSB_HDRC VIDEO_DEV VIDEO_V4L2 WAN WATCH_QUEUE WIRELESS WLAN WWAN X25 X86_X32]
testing current HEAD 26c690eff0a56293e0b6911a38e406c211b35547
testing commit 26c690eff0a56293e0b6911a38e406c211b35547 gcc
compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40
kernel signature: 2548329837e669f53d89767fe28b0e3c3a7bf866808505593a23d178a4e30126
run #0: crashed: INFO: rcu detected stall in wb_workfn
run #1: crashed: INFO: rcu detected stall in smp_call_function
run #2: crashed: INFO: rcu detected stall in do_idle
run #3: crashed: INFO: rcu detected stall in syscall_enter_from_user_mode
run #4: crashed: INFO: rcu detected stall in sys_mkdirat
run #5: crashed: INFO: rcu detected stall in do_idle
run #6: crashed: INFO: rcu detected stall in do_idle
run #7: crashed: INFO: rcu detected stall in do_idle
run #8: crashed: INFO: rcu detected stall in gc_worker
run #9: crashed: INFO: rcu detected stall in call_usermodehelper_exec_async
run #10: crashed: INFO: rcu detected stall in do_idle
run #11: crashed: BUG: soft lockup in do_idle
run #12: crashed: INFO: rcu detected stall in gc_worker
run #13: crashed: BUG: soft lockup in wb_workfn
run #14: crashed: INFO: rcu detected stall in gc_worker
run #15: crashed: INFO: rcu detected stall in smp_call_function
run #16: crashed: INFO: rcu detected stall in gc_worker
run #17: crashed: INFO: rcu detected stall in gc_worker
run #18: crashed: no output from test machine
run #19: basic kernel testing failed: failed to copy binary to VM: failed to run ["scp" "-P" "22" "-F" "/dev/null" "-o" "UserKnownHostsFile=/dev/null" "-o" "BatchMode=yes" "-o" "IdentitiesOnly=yes" "-o" "StrictHostKeyChecking=no" "-o" "ConnectTimeout=10" "-v" "/tmp/syz-executor1378528960" "root@10.128.1.165:./syz-executor1378528960"]: exit status 255
Executing: program /usr/bin/ssh host 10.128.1.165, user root, command sftp
OpenSSH_9.2p1 Debian-2, OpenSSL 3.0.9 30 May 2023
debug1: Reading configuration data /dev/null
debug1: Connecting to 10.128.1.165 [10.128.1.165] port 22.
debug1: connect to address 10.128.1.165 port 22: Connection timed out
ssh: connect to host 10.128.1.165 port 22: Connection timed out
scp: Connection closed
representative crash: INFO: rcu detected stall in wb_workfn, types: [HANG]
crash still not fixed/happens on the oldest tested release
reproducer is flaky (1.00 repro chance estimate)
revisions tested: 8, total time: 2h1m46.149091379s (build: 45m25.492371934s, test: 1h14m41.265365409s)
crash still not fixed or there were kernel test errors
commit msg: Linux 5.15.146
crash: INFO: rcu detected stall in wb_workfn
rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
rcu: 0-...!: (1 GPs behind) idle=8b5/1/0x4000000000000000 softirq=9139/9187 fqs=0
(detected by 1, t=11376 jiffies, g=9297, q=1548)
Sending NMI from CPU 1 to CPUs 0:
NMI backtrace for cpu 0
CPU: 0 PID: 66 Comm: kworker/u4:2 Not tainted 5.15.146-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 11/17/2023
Workqueue: writeback wb_workfn (flush-8:0)
RIP: 0010:match_held_lock+0x0/0xc0 kernel/locking/lockdep.c:5070
Code: 5b 5d 41 5c c3 8b 05 37 7f 2a 02 85 c0 75 ae 48 c7 c6 80 2c 2b 85 48 c7 c7 c0 2c 2b 85 e8 ae cc e7 ff 0f 0b eb 97 0f 1f 40 00 <53> 48 89 fb 48 83 ec 08 48 39 77 10 74 6a 66 f7 47 22 f0 ff 74 5a
RSP: 0018:ffffc90000007d90 EFLAGS: 00000097
RAX: 000000000000000f RBX: 0000000000000003 RCX: 0000000000000001
RDX: 0000000000000000 RSI: ffff88811324e300 RDI: ffff888101b80b08
RBP: ffff88811324e300 R08: 0000000000000001 R09: 0000000000000003
R10: 0000000000000000 R11: 0000000000000001 R12: ffff888101b80000
R13: ffff888101b80a90 R14: 00000000ffffffff R15: ffff888101b80b08
FS: 0000000000000000(0000) GS:ffff8881f6c00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00005555559b4da8 CR3: 000000011388c000 CR4: 00000000003506f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
__lock_is_held kernel/locking/lockdep.c:5366 [inline]
lock_is_held_type+0x98/0x110 kernel/locking/lockdep.c:5666
lock_is_held include/linux/lockdep.h:287 [inline]
advance_sched+0x570/0xa40 net/sched/sch_taprio.c:717
__run_hrtimer kernel/time/hrtimer.c:1685 [inline]
__hrtimer_run_queues+0x609/0xb90 kernel/time/hrtimer.c:1749
hrtimer_interrupt+0x2e8/0x740 kernel/time/hrtimer.c:1811
local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1085 [inline]
__sysvec_apic_timer_interrupt+0xf5/0x340 arch/x86/kernel/apic/apic.c:1102
sysvec_apic_timer_interrupt+0x6a/0x90 arch/x86/kernel/apic/apic.c:1096
asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:638
RIP: 0010:get_current arch/x86/include/asm/current.h:15 [inline]
RIP: 0010:__sanitizer_cov_trace_pc+0x0/0x60 kernel/kcov.c:196
Code: ff b9 ff ff ff ff ba 08 00 00 00 4d 8b 03 48 0f bd ca 49 8b 45 00 48 63 c9 e9 64 ff ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 90 <65> 48 8b 14 25 40 70 02 00 65 8b 05 d0 7a 9e 7e a9 00 01 ff 00 48
RSP: 0018:ffffc900009d71c8 EFLAGS: 00000293
RAX: 0000000000000000 RBX: 0000000000000200 RCX: ffffffff817a337e
RDX: ffff888101b80000 RSI: ffffffff817a3388 RDI: 0000000000000007
RBP: ffffea000481aac0 R08: 0000000000000001 R09: ffffffff88f3010f
R10: 0000000000000000 R11: 0000000000000001 R12: 1ffff9200013ae3f
R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
__test_set_page_writeback+0x2ae/0xe80 mm/page-writeback.c:2865
set_page_writeback include/linux/page-flags.h:582 [inline]
ext4_bio_write_page+0x27a/0x1970 fs/ext4/page-io.c:459
mpage_submit_page+0x127/0x220 fs/ext4/inode.c:2101
mpage_map_and_submit_buffers fs/ext4/inode.c:2349 [inline]
mpage_map_and_submit_extent fs/ext4/inode.c:2488 [inline]
ext4_writepages+0x21e6/0x3770 fs/ext4/inode.c:2817
do_writepages+0x224/0x760 mm/page-writeback.c:2364
__writeback_single_inode+0x126/0xc50 fs/fs-writeback.c:1647
writeback_sb_inodes+0x56f/0x1030 fs/fs-writeback.c:1930
__writeback_inodes_wb+0xc6/0x280 fs/fs-writeback.c:2001
wb_writeback+0x795/0xa00 fs/fs-writeback.c:2106
wb_check_old_data_flush fs/fs-writeback.c:2206 [inline]
wb_do_writeback fs/fs-writeback.c:2259 [inline]
wb_workfn+0x802/0xf60 fs/fs-writeback.c:2288
process_one_work+0x965/0x14c0 kernel/workqueue.c:2310
worker_thread+0x65d/0x1130 kernel/workqueue.c:2457
kthread+0x3c2/0x4a0 kernel/kthread.c:319
ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:298
rcu: rcu_sched kthread starved for 11376 jiffies! g9297 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=1
rcu: Unless rcu_sched kthread gets sufficient CPU time, OOM is now expected behavior.
rcu: RCU grace-period kthread stack dump:
task:rcu_sched state:R running task stack:28936 pid: 12 ppid: 2 flags:0x00004000
Call Trace:
context_switch kernel/sched/core.c:5030 [inline]
__schedule+0x92b/0x23d0 kernel/sched/core.c:6376
schedule+0x106/0x230 kernel/sched/core.c:6459
schedule_timeout+0x14a/0x2a0 kernel/time/timer.c:1884
rcu_gp_fqs_loop+0x164/0x620 kernel/rcu/tree.c:1972
rcu_gp_kthread+0x138/0x1d0 kernel/rcu/tree.c:2145
kthread+0x3c2/0x4a0 kernel/kthread.c:319
ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:298
rcu: Stack dump where RCU GP kthread last ran:
NMI backtrace for cpu 1
CPU: 1 PID: 2683 Comm: kworker/1:4 Not tainted 5.15.146-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 11/17/2023
Workqueue: events_power_efficient gc_worker
Call Trace:
__dump_stack lib/dump_stack.c:88 [inline]
dump_stack_lvl+0xcd/0x134 lib/dump_stack.c:106
nmi_cpu_backtrace.cold+0x49/0x148 lib/nmi_backtrace.c:111
nmi_trigger_cpumask_backtrace+0x20b/0x260 lib/nmi_backtrace.c:62
trigger_single_cpu_backtrace include/linux/nmi.h:166 [inline]
rcu_check_gp_kthread_starvation+0x1d2/0x1ef kernel/rcu/tree_stall.h:487
print_other_cpu_stall kernel/rcu/tree_stall.h:592 [inline]
check_cpu_stall kernel/rcu/tree_stall.h:745 [inline]
rcu_pending kernel/rcu/tree.c:3932 [inline]
rcu_sched_clock_irq.cold+0x308/0x3d4 kernel/rcu/tree.c:2619
update_process_times+0x139/0x1b0 kernel/time/timer.c:1788
tick_sched_handle+0x9b/0x180 kernel/time/tick-sched.c:254
tick_sched_timer+0xe2/0x110 kernel/time/tick-sched.c:1473
__run_hrtimer kernel/time/hrtimer.c:1685 [inline]
__hrtimer_run_queues+0x1c0/0xb90 kernel/time/hrtimer.c:1749
hrtimer_interrupt+0x2e8/0x740 kernel/time/hrtimer.c:1811
local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1085 [inline]
__sysvec_apic_timer_interrupt+0xf5/0x340 arch/x86/kernel/apic/apic.c:1102
sysvec_apic_timer_interrupt+0x6a/0x90 arch/x86/kernel/apic/apic.c:1096
asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:638
RIP: 0010:get_current arch/x86/include/asm/current.h:15 [inline]
RIP: 0010:__sanitizer_cov_trace_pc+0x0/0x60 kernel/kcov.c:196
Code: ff b9 ff ff ff ff ba 08 00 00 00 4d 8b 03 48 0f bd ca 49 8b 45 00 48 63 c9 e9 64 ff ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 90 <65> 48 8b 14 25 40 70 02 00 65 8b 05 d0 7a 9e 7e a9 00 01 ff 00 48
RSP: 0018:ffffc90001be7c18 EFLAGS: 00000293
RAX: 0000000000000000 RBX: 0000000000000200 RCX: ffffffff83bedc8b
RDX: ffff88811875b980 RSI: ffffffff83bedc95 RDI: 0000000000000007
RBP: 0000000000000000 R08: 0000000000000001 R09: ffffffff88f30117
R10: 0000000000000000 R11: 0000000000000001 R12: dffffc0000000000
R13: 0000000000000000 R14: 0000000000040000 R15: 0000000000000000
__seqprop_spinlock_sequence include/linux/seqlock.h:277 [inline]
nf_conntrack_get_ht include/net/netfilter/nf_conntrack.h:330 [inline]
gc_worker+0x2fb/0x16f0 net/netfilter/nf_conntrack_core.c:1472
process_one_work+0x965/0x14c0 kernel/workqueue.c:2310
worker_thread+0x65d/0x1130 kernel/workqueue.c:2457
kthread+0x3c2/0x4a0 kernel/kthread.c:319
ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:298