ci starts bisection 2024-09-20 08:57:35.137994388 +0000 UTC m=+65803.371335035 bisecting cause commit starting from 4a39ac5b7d62679c07a3e3d12b0f6982377d8a7d building syzkaller on c673ca06b23cea94091ab496ef62c3513e434585 ensuring issue is reproducible on original commit 4a39ac5b7d62679c07a3e3d12b0f6982377d8a7d testing commit 4a39ac5b7d62679c07a3e3d12b0f6982377d8a7d gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 28b90d06156d19d9345608c557a869d4d7464419afb86f7e623d40a76680947d run #0: crashed: lost connection to test machine run #1: crashed: INFO: task hung in ext4_stop_mmpd run #2: crashed: INFO: task hung in ext4_stop_mmpd run #3: crashed: INFO: task hung in ext4_stop_mmpd run #4: crashed: INFO: task hung in ext4_stop_mmpd run #5: crashed: INFO: task hung in ext4_stop_mmpd run #6: crashed: INFO: task hung in ext4_stop_mmpd run #7: crashed: INFO: task hung in ext4_stop_mmpd run #8: crashed: INFO: task hung in ext4_stop_mmpd run #9: crashed: INFO: task hung in ext4_stop_mmpd run #10: crashed: INFO: task hung in ext4_stop_mmpd run #11: crashed: INFO: task hung in ext4_stop_mmpd run #12: crashed: INFO: task hung in ext4_stop_mmpd run #13: crashed: INFO: task hung in ext4_stop_mmpd run #14: crashed: INFO: task hung in ext4_stop_mmpd run #15: crashed: INFO: task hung in ext4_stop_mmpd run #16: crashed: INFO: task hung in ext4_stop_mmpd run #17: crashed: INFO: task hung in ext4_stop_mmpd run #18: crashed: INFO: task hung in ext4_stop_mmpd run #19: crashed: INFO: task hung in ext4_stop_mmpd representative crash: INFO: task hung in ext4_stop_mmpd, types: [HANG] check whether we can drop unnecessary instrumentation disabling configs for [LEAK UBSAN BUG KASAN LOCKDEP ATOMIC_SLEEP], they are not needed testing commit 4a39ac5b7d62679c07a3e3d12b0f6982377d8a7d gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 816d123ee6ab3f7da6599386357ba839cc7862219e0f34528aaf40b9699c07e4 run #0: crashed: INFO: task hung in ext4_stop_mmpd run #1: crashed: INFO: task hung in ext4_stop_mmpd run #2: crashed: INFO: task hung in ext4_stop_mmpd run #3: crashed: INFO: task hung in ext4_stop_mmpd run #4: crashed: INFO: task hung in ext4_stop_mmpd run #5: crashed: INFO: task hung in ext4_stop_mmpd run #6: crashed: INFO: task hung in ext4_stop_mmpd run #7: crashed: INFO: task hung in ext4_stop_mmpd run #8: OK run #9: crashed: INFO: task hung in ext4_stop_mmpd representative crash: INFO: task hung in ext4_stop_mmpd, types: [HANG] the bug reproduces without the instrumentation disabling configs for [UBSAN BUG KASAN LOCKDEP ATOMIC_SLEEP LEAK], they are not needed kconfig minimization: base=4045 full=8161 leaves diff=2106 split chunks (needed=false): <2106> split chunk #0 of len 2106 into 5 parts testing without sub-chunk 1/5 disabling configs for [BUG KASAN LOCKDEP ATOMIC_SLEEP LEAK UBSAN], they are not needed testing commit 4a39ac5b7d62679c07a3e3d12b0f6982377d8a7d gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 8a8966a6df49cd57ca54516566f027f523547fb21ac598afed4ff5f79357b3e4 run #0: crashed: INFO: task hung in ext4_stop_mmpd run #1: crashed: INFO: task hung in ext4_stop_mmpd run #2: crashed: INFO: task hung in ext4_stop_mmpd run #3: crashed: INFO: task hung in ext4_stop_mmpd run #4: crashed: INFO: task hung in ext4_stop_mmpd run #5: crashed: INFO: task hung in ext4_stop_mmpd run #6: OK run #7: OK run #8: OK run #9: OK representative crash: INFO: task hung in ext4_stop_mmpd, types: [HANG] the chunk can be dropped testing without sub-chunk 2/5 disabling configs for [KASAN LOCKDEP ATOMIC_SLEEP LEAK UBSAN BUG], they are not needed testing commit 4a39ac5b7d62679c07a3e3d12b0f6982377d8a7d gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: df7e7512027c097d9fe618016496e6cfa1efda68984b47b4c9dc00a15057bbe2 run #0: crashed: INFO: task hung in ext4_stop_mmpd run #1: crashed: INFO: task hung in ext4_stop_mmpd run #2: crashed: INFO: task hung in ext4_stop_mmpd run #3: crashed: INFO: task hung in ext4_stop_mmpd run #4: crashed: INFO: task hung in ext4_stop_mmpd run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK representative crash: INFO: task hung in ext4_stop_mmpd, types: [HANG] the chunk can be dropped testing without sub-chunk 3/5 disabling configs for [LEAK UBSAN BUG KASAN LOCKDEP ATOMIC_SLEEP], they are not needed testing commit 4a39ac5b7d62679c07a3e3d12b0f6982377d8a7d gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 2d8ea3a32c822912cc86979fff20f02f5e5d8de518f0454e7555e963c291d6d6 run #0: crashed: INFO: task hung in ext4_stop_mmpd run #1: crashed: INFO: task hung in ext4_stop_mmpd run #2: crashed: INFO: task hung in ext4_stop_mmpd run #3: crashed: INFO: task hung in ext4_stop_mmpd run #4: crashed: INFO: task hung in ext4_stop_mmpd run #5: crashed: INFO: task hung in ext4_stop_mmpd run #6: crashed: INFO: task hung in ext4_stop_mmpd run #7: OK run #8: OK run #9: OK representative crash: INFO: task hung in ext4_stop_mmpd, types: [HANG] the chunk can be dropped testing without sub-chunk 4/5 disabling configs for [LEAK UBSAN BUG KASAN LOCKDEP ATOMIC_SLEEP], they are not needed testing commit 4a39ac5b7d62679c07a3e3d12b0f6982377d8a7d gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 359d15ee48cdc794912b9f14ddb4532ec5a0048e6e4767961a16c9dd8c044dd2 run #0: crashed: INFO: task hung in ext4_stop_mmpd run #1: crashed: INFO: task hung in ext4_stop_mmpd run #2: crashed: INFO: task hung in ext4_stop_mmpd run #3: crashed: INFO: task hung in ext4_stop_mmpd run #4: crashed: INFO: task hung in ext4_stop_mmpd run #5: crashed: INFO: task hung in ext4_stop_mmpd run #6: crashed: INFO: task hung in ext4_stop_mmpd run #7: crashed: INFO: task hung in ext4_stop_mmpd run #8: crashed: INFO: task hung in ext4_stop_mmpd run #9: OK representative crash: INFO: task hung in ext4_stop_mmpd, types: [HANG] the chunk can be dropped testing without sub-chunk 5/5 disabling configs for [ATOMIC_SLEEP LEAK UBSAN BUG KASAN LOCKDEP], they are not needed testing commit 4a39ac5b7d62679c07a3e3d12b0f6982377d8a7d gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: aa75d5bc774e22013edec79b3fc2ff22be64fcb74ae78b34588d4d2c1a097c9b run #0: crashed: INFO: task hung in ext4_stop_mmpd run #1: crashed: INFO: task hung in ext4_stop_mmpd run #2: crashed: INFO: task hung in ext4_stop_mmpd run #3: crashed: INFO: task hung in ext4_stop_mmpd run #4: crashed: INFO: task hung in ext4_stop_mmpd run #5: crashed: INFO: task hung in ext4_stop_mmpd run #6: crashed: INFO: task hung in ext4_stop_mmpd run #7: OK run #8: OK run #9: OK representative crash: INFO: task hung in ext4_stop_mmpd, types: [HANG] the chunk can be dropped disabling configs for [UBSAN BUG KASAN LOCKDEP ATOMIC_SLEEP LEAK], they are not needed picked [v6.11 v6.10 v6.9 v6.7 v6.5 v6.3 v6.1 v5.19 v5.16 v5.13 v5.10 v5.7 v5.4 v5.1 v4.19] out of 34 release tags testing release v6.11 testing commit 98f7e32f20d28ec452afb208f9cffc08448a2652 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 7fc5ec02e5fa2f57edf5ee4f61a4de8fd72805724114c6beaf5e82456501035a run #0: crashed: lost connection to test machine run #1: crashed: INFO: task hung in ext4_stop_mmpd run #2: crashed: INFO: task hung in ext4_stop_mmpd run #3: crashed: INFO: task hung in ext4_stop_mmpd run #4: crashed: INFO: task hung in ext4_stop_mmpd run #5: crashed: INFO: task hung in ext4_stop_mmpd run #6: crashed: INFO: task hung in ext4_stop_mmpd run #7: OK run #8: OK run #9: OK representative crash: INFO: task hung in ext4_stop_mmpd, types: [HANG] testing release v6.10 testing commit 0c3836482481200ead7b416ca80c68a29cfdaabd gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 442fe7cee5b2e474c203056af6c912e87874605bd480b94f1dff7749a8bd9efe run #0: crashed: INFO: task hung in ext4_stop_mmpd run #1: crashed: INFO: task hung in ext4_stop_mmpd run #2: crashed: INFO: task hung in ext4_stop_mmpd run #3: crashed: INFO: task hung in ext4_stop_mmpd run #4: crashed: INFO: task hung in ext4_stop_mmpd run #5: crashed: INFO: task hung in ext4_stop_mmpd run #6: crashed: INFO: task hung in ext4_stop_mmpd run #7: OK run #8: OK run #9: OK representative crash: INFO: task hung in ext4_stop_mmpd, types: [HANG] testing release v6.9 testing commit a38297e3fb012ddfa7ce0321a7e5a8daeb1872b6 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 893a79555f2361a124fcaef90167c794ecc2f8137f7b451ffcffe38bf87bdb8a run #0: crashed: INFO: task hung in ext4_stop_mmpd run #1: crashed: INFO: task hung in ext4_stop_mmpd run #2: crashed: INFO: task hung in ext4_stop_mmpd run #3: crashed: INFO: task hung in ext4_stop_mmpd run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK representative crash: INFO: task hung in ext4_stop_mmpd, types: [HANG] testing release v6.7 testing commit 0dd3ee31125508cd67f7e7172247f05b7fd1753a gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: a140115ce1d177ac3ebb7dcbf9d49f3d0096d4d801a6d8d441309161530cccd6 run #0: crashed: INFO: task hung in ext4_stop_mmpd run #1: crashed: INFO: task hung in ext4_stop_mmpd run #2: crashed: INFO: task hung in ext4_stop_mmpd run #3: crashed: INFO: task hung in ext4_stop_mmpd run #4: crashed: INFO: task hung in ext4_stop_mmpd run #5: crashed: INFO: task hung in ext4_stop_mmpd run #6: crashed: INFO: task hung in ext4_stop_mmpd run #7: crashed: INFO: task hung in ext4_stop_mmpd run #8: crashed: INFO: task hung in ext4_stop_mmpd run #9: crashed: INFO: task hung in ext4_stop_mmpd run #10: crashed: INFO: task hung in ext4_stop_mmpd run #11: crashed: INFO: task hung in ext4_stop_mmpd run #12: crashed: INFO: task hung in ext4_stop_mmpd run #13: OK run #14: OK run #15: OK run #16: crashed: INFO: task hung in ext4_stop_mmpd run #17: OK run #18: OK run #19: OK representative crash: INFO: task hung in ext4_stop_mmpd, types: [HANG] testing release v6.5 testing commit 2dde18cd1d8fac735875f2e4987f11817cc0bc2c gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 02ec8f820903edc73c5222c7ec3493fd881699789ef794577fdf8299ded4eb20 run #0: crashed: INFO: task hung in ext4_stop_mmpd run #1: crashed: INFO: task hung in ext4_stop_mmpd run #2: crashed: INFO: task hung in ext4_stop_mmpd run #3: crashed: INFO: task hung in ext4_stop_mmpd run #4: crashed: INFO: task hung in ext4_stop_mmpd run #5: crashed: INFO: task hung in ext4_stop_mmpd run #6: crashed: INFO: task hung in ext4_stop_mmpd run #7: crashed: INFO: task hung in ext4_stop_mmpd run #8: crashed: INFO: task hung in ext4_stop_mmpd run #9: crashed: INFO: task hung in ext4_stop_mmpd run #10: crashed: INFO: task hung in ext4_stop_mmpd run #11: crashed: INFO: task hung in ext4_stop_mmpd run #12: crashed: INFO: task hung in ext4_stop_mmpd run #13: crashed: INFO: task hung in ext4_stop_mmpd run #14: crashed: INFO: task hung in ext4_stop_mmpd run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK representative crash: INFO: task hung in ext4_stop_mmpd, types: [HANG] testing release v6.3 testing commit 457391b0380335d5e9a5babdec90ac53928b23b4 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 7008a10dcb2373d688947fb51a247aec8fc5939cd436a63eb66042edb44dd9b8 run #0: crashed: INFO: task hung in ext4_stop_mmpd run #1: crashed: INFO: task hung in ext4_stop_mmpd run #2: crashed: INFO: task hung in ext4_stop_mmpd run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK representative crash: INFO: task hung in ext4_stop_mmpd, types: [HANG] testing release v6.1 testing commit 830b3c68c1fb1e9176028d02ef86f3cf76aa2476 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: ed86d2e60ad04499dc813304a9b31fe3bee3aabd6203e4423d09447c9c196712 run #0: crashed: lost connection to test machine run #1: OK run #2: OK run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK representative crash: lost connection to test machine, types: [UNKNOWN] unable to determine the verdict: 19 good runs (wanted 15), for bad wanted 10 in total, got 20 testing release v5.19 testing commit 3d7cb6b04c3f3115719235cc6866b10326de34cd gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: e065c400abb6b323438a7017fbf760f1efe8ab5e075a22932a426747256f02eb run #0: crashed: INFO: task hung in ext4_stop_mmpd run #1: OK run #2: OK run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK representative crash: INFO: task hung in ext4_stop_mmpd, types: [HANG] unable to determine the verdict: 19 good runs (wanted 15), for bad wanted 10 in total, got 20 testing release v5.16 testing commit df0cc57e057f18e44dac8e6c18aba47ab53202f9 gcc compiler: Debian clang version 15.0.6, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: fc6371abba466a53ac95d7005acc6055de708f8d545e11240e1e06d793927181 run #0: crashed: INFO: task hung in ext4_stop_mmpd run #1: crashed: lost connection to test machine run #2: crashed: lost connection to test machine run #3: crashed: INFO: task hung in ext4_stop_mmpd run #4: crashed: INFO: task hung in ext4_stop_mmpd run #5: crashed: INFO: task hung in ext4_stop_mmpd run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK representative crash: INFO: task hung in ext4_stop_mmpd, types: [HANG UNKNOWN] testing release v5.13 testing commit 62fb9874f5da54fdb243003b386128037319b219 gcc compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 21599a80cb73bb7b0b5ed37b0b13720432012cce8c6a5612f773da280fbd588d run #0: crashed: INFO: task hung in ext4_put_super run #1: crashed: INFO: task hung in ext4_put_super run #2: crashed: INFO: task hung in ext4_put_super run #3: crashed: INFO: task hung in ext4_put_super run #4: crashed: INFO: task hung in ext4_put_super run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK representative crash: INFO: task hung in ext4_put_super, types: [HANG] testing release v5.10 testing commit 2c85ebc57b3e1817b6ce1a6b703928e113a90442 gcc compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: cb211890da3f91b18dfe497a6e23b600de55b920680e494e46450c6953c5e510 all runs: OK false negative chance: 0.000 # git bisect start 62fb9874f5da54fdb243003b386128037319b219 2c85ebc57b3e1817b6ce1a6b703928e113a90442 Bisecting: 23399 revisions left to test after this (roughly 15 steps) [d6560052c2f73db59834e9a3c0aba20579aa7059] Merge tag 'regulator-v5.12' of git://git.kernel.org/pub/scm/linux/kernel/git/broonie/regulator testing commit d6560052c2f73db59834e9a3c0aba20579aa7059 gcc compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: dcac36e8cd6977b6e9837ed0b6ea53135b53d1753d5b9522aa63898c4e7c8afd all runs: OK false negative chance: 0.000 # git bisect good d6560052c2f73db59834e9a3c0aba20579aa7059 Bisecting: 12060 revisions left to test after this (roughly 14 steps) [3aa139aa9fdc138a84243dc49dc18d9b40e1c6e4] Merge tag 'media/v5.13-1' of git://git.kernel.org/pub/scm/linux/kernel/git/mchehab/linux-media testing commit 3aa139aa9fdc138a84243dc49dc18d9b40e1c6e4 gcc compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 2a617e69e1efd356f7d043a57d56d8c758c97b5497e9e1123bcf8ad618b52530 all runs: OK false negative chance: 0.000 # git bisect good 3aa139aa9fdc138a84243dc49dc18d9b40e1c6e4 Bisecting: 6025 revisions left to test after this (roughly 13 steps) [437d1a5b66ca60f209e25f469b395741cc10b731] Merge tag 'xtensa-20210429' of git://github.com/jcmvbkbc/linux-xtensa testing commit 437d1a5b66ca60f209e25f469b395741cc10b731 gcc compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: d57ac57d5070e867dffe502566705bc596e2296be25e2cb939a45e0caca4ab56 all runs: OK false negative chance: 0.000 # git bisect good 437d1a5b66ca60f209e25f469b395741cc10b731 Bisecting: 3018 revisions left to test after this (roughly 12 steps) [57151b502cbc0fa6ff9074a76883fa9d9eda322e] Merge tag 'pci-v5.13-changes' of git://git.kernel.org/pub/scm/linux/kernel/git/helgaas/pci testing commit 57151b502cbc0fa6ff9074a76883fa9d9eda322e gcc compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 50c3dadb3160b05a0e4e8e13d13714973906f4fc8a6a69e6843b55eee1e8cef3 run #0: crashed: INFO: task hung in ext4_put_super run #1: crashed: INFO: task hung in ext4_put_super run #2: crashed: INFO: task hung in ext4_put_super run #3: crashed: INFO: task hung in ext4_put_super run #4: OK run #5: crashed: INFO: task hung in ext4_put_super run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK representative crash: INFO: task hung in ext4_put_super, types: [HANG] # git bisect bad 57151b502cbc0fa6ff9074a76883fa9d9eda322e Bisecting: 1497 revisions left to test after this (roughly 11 steps) [d652502ef46895820533aada50ddfd94abe078fe] Merge tag 'ovl-update-5.13' of git://git.kernel.org/pub/scm/linux/kernel/git/mszeredi/vfs testing commit d652502ef46895820533aada50ddfd94abe078fe gcc compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: ae37f43162ef62a7c2712709c4ccc8d48e862e3d30e43c4f44d6ed531dd75381 all runs: OK false negative chance: 0.000 # git bisect good d652502ef46895820533aada50ddfd94abe078fe Bisecting: 765 revisions left to test after this (roughly 10 steps) [22650f148126571be1098d34160eb4931fc77241] afs: Fix speculative status fetches testing commit 22650f148126571be1098d34160eb4931fc77241 gcc compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: b5d49d41010d904ec8e24cbf9456ebf2d89d7a1620eda71928c9c5027b2bb404 run #0: crashed: INFO: task hung in ext4_put_super run #1: crashed: INFO: task hung in ext4_put_super run #2: crashed: INFO: task hung in ext4_put_super run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK representative crash: INFO: task hung in ext4_put_super, types: [HANG] # git bisect bad 22650f148126571be1098d34160eb4931fc77241 Bisecting: 364 revisions left to test after this (roughly 9 steps) [c4f71901d53b6d8a4703389459d9f99fbd80ffd2] Merge tag 'kvmarm-5.13' of git://git.kernel.org/pub/scm/linux/kernel/git/kvmarm/kvmarm into HEAD testing commit c4f71901d53b6d8a4703389459d9f99fbd80ffd2 gcc compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: db635e62ebd7d7897a0d60d471b5c5dfe1850f98081deff5100a58bd1804b02d all runs: OK false negative chance: 0.001 # git bisect good c4f71901d53b6d8a4703389459d9f99fbd80ffd2 Bisecting: 153 revisions left to test after this (roughly 8 steps) [f34b2cf17825d69ae1e227871059ab18c2f57817] Merge tag 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/rdma/rdma testing commit f34b2cf17825d69ae1e227871059ab18c2f57817 gcc compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: be550dc30346dfc65b31f848011620858122c289416b339869e1c6a09552878f run #0: crashed: INFO: task hung in ext4_put_super run #1: crashed: INFO: task hung in ext4_put_super run #2: crashed: INFO: task hung in ext4_put_super run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: crashed: INFO: task hung in ext4_put_super run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK representative crash: INFO: task hung in ext4_put_super, types: [HANG] # git bisect bad f34b2cf17825d69ae1e227871059ab18c2f57817 Bisecting: 108 revisions left to test after this (roughly 7 steps) [780278c2c8bb50fc01b70a7392af6ab3ba360074] IB/hfi1: Rework AIP and VNIC dummy netdev usage testing commit 780278c2c8bb50fc01b70a7392af6ab3ba360074 gcc compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: bbdea9b3183643563a8076c962c53009c0ce2c582cb349c8755a64eeed225994 all runs: OK false negative chance: 0.003 # git bisect good 780278c2c8bb50fc01b70a7392af6ab3ba360074 Bisecting: 45 revisions left to test after this (roughly 6 steps) [9f67672a817ec046f7554a885f0fe0d60e1bf99f] Merge tag 'ext4_for_linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tytso/ext4 testing commit 9f67672a817ec046f7554a885f0fe0d60e1bf99f gcc compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: be550dc30346dfc65b31f848011620858122c289416b339869e1c6a09552878f run #0: crashed: INFO: task hung in ext4_put_super run #1: crashed: INFO: task hung in ext4_put_super run #2: crashed: INFO: task hung in ext4_put_super run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK representative crash: INFO: task hung in ext4_put_super, types: [HANG] # git bisect bad 9f67672a817ec046f7554a885f0fe0d60e1bf99f Bisecting: 31 revisions left to test after this (roughly 5 steps) [5899593f51e63dde2f07c67358bd65a641585abb] ext4: Fix occasional generic/418 failure testing commit 5899593f51e63dde2f07c67358bd65a641585abb gcc compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 24f6c796e70791d37b33c10bdddc1e6589746e71ee0e1dddfae85c3f39f67576 run #0: crashed: INFO: task hung in ext4_put_super run #1: crashed: INFO: task hung in ext4_put_super run #2: crashed: INFO: task hung in ext4_put_super run #3: crashed: INFO: task hung in ext4_put_super run #4: crashed: INFO: task hung in ext4_put_super run #5: crashed: INFO: task hung in ext4_put_super run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK representative crash: INFO: task hung in ext4_put_super, types: [HANG] # git bisect bad 5899593f51e63dde2f07c67358bd65a641585abb Bisecting: 15 revisions left to test after this (roughly 4 steps) [196e402adf2e4cd66f101923409f1970ec5f1af3] ext4: improve cr 0 / cr 1 group scanning testing commit 196e402adf2e4cd66f101923409f1970ec5f1af3 gcc compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 73e0b8285f69bced1efa4d40b432cb53b7c675fb44433d552e968e89f811f877 all runs: OK false negative chance: 0.011 # git bisect good 196e402adf2e4cd66f101923409f1970ec5f1af3 Bisecting: 7 revisions left to test after this (roughly 3 steps) [3b1833e92baba135923af4a07e73fe6e54be5a2f] ext4: annotate data race in start_this_handle() testing commit 3b1833e92baba135923af4a07e73fe6e54be5a2f gcc compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: afdd79f738b6b9db959458a7f0387e9f45059e8fcacd94438a707b5315cac7aa run #0: crashed: INFO: task hung in ext4_put_super run #1: crashed: INFO: task hung in ext4_put_super run #2: crashed: INFO: task hung in ext4_put_super run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK representative crash: INFO: task hung in ext4_put_super, types: [HANG] # git bisect bad 3b1833e92baba135923af4a07e73fe6e54be5a2f Bisecting: 3 revisions left to test after this (roughly 2 steps) [3cd461712cb450ea6aa8a8200f35f24eb296bfb2] ext4: delete redundant uptodate check for buffer testing commit 3cd461712cb450ea6aa8a8200f35f24eb296bfb2 gcc compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: ed44d58476d156c2c4fa5e72c5c5db0a5014348720e1abd23f17e59630d561af run #0: crashed: INFO: task hung in ext4_put_super run #1: crashed: INFO: task hung in ext4_put_super run #2: crashed: INFO: task hung in ext4_put_super run #3: OK run #4: OK run #5: crashed: INFO: task hung in ext4_put_super run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK representative crash: INFO: task hung in ext4_put_super, types: [HANG] # git bisect bad 3cd461712cb450ea6aa8a8200f35f24eb296bfb2 Bisecting: 1 revision left to test after this (roughly 1 step) [21175ca434c5d49509b73cf473618b01b0b85437] ext4: make prefetch_block_bitmaps default testing commit 21175ca434c5d49509b73cf473618b01b0b85437 gcc compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 4d391941edd9e9a5466b5e1ffe8e5e18f72f8d20c4858432184c2e327f88c5ab run #0: crashed: INFO: task hung in ext4_put_super run #1: crashed: INFO: task hung in ext4_put_super run #2: crashed: INFO: task hung in ext4_put_super run #3: crashed: INFO: task hung in ext4_put_super run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK representative crash: INFO: task hung in ext4_put_super, types: [HANG] # git bisect bad 21175ca434c5d49509b73cf473618b01b0b85437 Bisecting: 0 revisions left to test after this (roughly 0 steps) [f68f4063855903fd3a279e646451eab04db0655f] ext4: add proc files to monitor new structures testing commit f68f4063855903fd3a279e646451eab04db0655f gcc compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.40 kernel signature: 396a92d3409772b9fef584e2787dfa8893903056953737ba61949bc022e4f3af all runs: OK false negative chance: 0.021 # git bisect good f68f4063855903fd3a279e646451eab04db0655f 21175ca434c5d49509b73cf473618b01b0b85437 is the first bad commit commit 21175ca434c5d49509b73cf473618b01b0b85437 Author: Harshad Shirwadkar Date: Thu Apr 1 10:21:29 2021 -0700 ext4: make prefetch_block_bitmaps default Block bitmap prefetching is needed for these allocator optimization data structures to get populated and provide better group scanning order. So, turn it on bu default. prefetch_block_bitmaps mount option is now marked as removed and a new option no_prefetch_block_bitmaps is added to disable block bitmap prefetching. Signed-off-by: Harshad Shirwadkar Link: https://lore.kernel.org/r/20210401172129.189766-8-harshadshirwadkar@gmail.com Signed-off-by: Theodore Ts'o fs/ext4/ext4.h | 2 +- fs/ext4/super.c | 15 ++++++++------- 2 files changed, 9 insertions(+), 8 deletions(-) accumulated error probability: 0.03 culprit signature: 4d391941edd9e9a5466b5e1ffe8e5e18f72f8d20c4858432184c2e327f88c5ab parent signature: 396a92d3409772b9fef584e2787dfa8893903056953737ba61949bc022e4f3af reproducer is flaky (0.18 repro chance estimate) revisions tested: 34, total time: 10h7m17.020271013s (build: 3h1m41.249821908s, test: 6h50m38.946472411s) first bad commit: 21175ca434c5d49509b73cf473618b01b0b85437 ext4: make prefetch_block_bitmaps default recipients (to): ["adilger.kernel@dilger.ca" "harshadshirwadkar@gmail.com" "linux-ext4@vger.kernel.org" "tytso@mit.edu" "tytso@mit.edu"] recipients (cc): ["linux-kernel@vger.kernel.org"] crash: INFO: task hung in ext4_put_super INFO: task syz-executor:25033 blocked for more than 143 seconds. Not tainted 5.12.0-rc4-syzkaller #0 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. task:syz-executor state:D stack:12272 pid:25033 ppid: 1 flags:0x00004004 Call Trace: context_switch kernel/sched/core.c:4322 [inline] __schedule+0x2bf/0x7c0 kernel/sched/core.c:5073 schedule+0x41/0xa0 kernel/sched/core.c:5152 schedule_timeout+0x100/0x140 kernel/time/timer.c:1868 do_wait_for_common kernel/sched/completion.c:85 [inline] __wait_for_common kernel/sched/completion.c:106 [inline] wait_for_common kernel/sched/completion.c:117 [inline] wait_for_completion+0x7f/0xe0 kernel/sched/completion.c:138 kthread_stop+0x6e/0x170 kernel/kthread.c:621 ext4_put_super+0x2e6/0x3f0 fs/ext4/super.c:1248 generic_shutdown_super+0x67/0x100 fs/super.c:464 kill_block_super+0x1c/0x40 fs/super.c:1394 deactivate_locked_super+0x2c/0xa0 fs/super.c:335 cleanup_mnt+0x109/0x150 fs/namespace.c:1136 task_work_run+0x57/0x90 kernel/task_work.c:140 tracehook_notify_resume include/linux/tracehook.h:189 [inline] exit_to_user_mode_loop kernel/entry/common.c:174 [inline] exit_to_user_mode_prepare+0x139/0x140 kernel/entry/common.c:208 __syscall_exit_to_user_mode_work kernel/entry/common.c:290 [inline] syscall_exit_to_user_mode+0x13/0x40 kernel/entry/common.c:301 entry_SYSCALL_64_after_hwframe+0x44/0xae RIP: 0033:0x7f1d672d4227 RSP: 002b:00007ffe2a9ee528 EFLAGS: 00000246 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 00007f1d67345a14 RCX: 00007f1d672d4227 RDX: 0000000000000000 RSI: 0000000000000009 RDI: 00007ffe2a9ee5e0 RBP: 00007ffe2a9ee5e0 R08: 0000000000000000 R09: 0000000000000000 R10: 00000000ffffffff R11: 0000000000000246 R12: 00007ffe2a9ef660 R13: 00007f1d67345a14 R14: 00000000000321eb R15: 00007ffe2a9ef6a0 INFO: task kmmpd-loop2:32514 blocked for more than 143 seconds. Not tainted 5.12.0-rc4-syzkaller #0 "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. task:kmmpd-loop2 state:D stack:14920 pid:32514 ppid: 2 flags:0x00004000 Call Trace: context_switch kernel/sched/core.c:4322 [inline] __schedule+0x2bf/0x7c0 kernel/sched/core.c:5073 schedule+0x41/0xa0 kernel/sched/core.c:5152 percpu_rwsem_wait+0x13e/0x180 kernel/locking/percpu-rwsem.c:160 __percpu_down_read kernel/locking/percpu-rwsem.c:174 [inline] __percpu_down_read+0x47/0x50 kernel/locking/percpu-rwsem.c:165 percpu_down_read include/linux/percpu-rwsem.h:65 [inline] __sb_start_write include/linux/fs.h:1640 [inline] sb_start_write include/linux/fs.h:1710 [inline] write_mmp_block+0x102/0x130 fs/ext4/mmp.c:50 kmmpd+0x2e0/0x430 fs/ext4/mmp.c:245 kthread+0x119/0x130 kernel/kthread.c:292 ret_from_fork+0x22/0x30 arch/x86/entry/entry_64.S:294 Showing all locks held in the system: 2 locks held by kworker/0:2/13: #0: ffff888100056738 ((wq_completion)events){....}-{0:0}, at: wake_up_worker kernel/workqueue.c:837 [inline] #0: ffff888100056738 ((wq_completion)events){....}-{0:0}, at: process_one_work+0x1bc/0x430 kernel/workqueue.c:2238 #1: ffffc90000073e70 ((kfence_timer).work){....}-{0:0}, at: wake_up_worker kernel/workqueue.c:837 [inline] #1: ffffc90000073e70 ((kfence_timer).work){....}-{0:0}, at: process_one_work+0x1bc/0x430 kernel/workqueue.c:2238 2 locks held by kworker/u4:2/27: #0: ffff888100058938 ((wq_completion)events_unbound){....}-{0:0}, at: wake_up_worker kernel/workqueue.c:837 [inline] #0: ffff888100058938 ((wq_completion)events_unbound){....}-{0:0}, at: process_one_work+0x1bc/0x430 kernel/workqueue.c:2238 #1: ffffc900000efe70 ((work_completion)(&sub_info->work)){....}-{0:0}, at: wake_up_worker kernel/workqueue.c:837 [inline] #1: ffffc900000efe70 ((work_completion)(&sub_info->work)){....}-{0:0}, at: process_one_work+0x1bc/0x430 kernel/workqueue.c:2238 1 lock held by khungtaskd/235: #0: ffffffff82374a80 (rcu_read_lock){....}-{1:2}, at: debug_show_all_locks+0x15/0xf2 kernel/locking/lockdep.c:6328 1 lock held by udevd/917: #0: ffff888108df80a0 (&bdev->bd_mutex){....}-{3:3}, at: blkdev_get_by_dev fs/block_dev.c:1453 [inline] #0: ffff888108df80a0 (&bdev->bd_mutex){....}-{3:3}, at: blkdev_get_by_dev+0x13d/0x250 fs/block_dev.c:1422 2 locks held by getty/977: #0: ffff8881057d1898 (&tty->ldisc_sem){....}-{0:0}, at: tty_ldisc_ref_wait+0x1f/0x50 drivers/tty/tty_ldisc.c:266 #1: ffffc90001abb2e8 (&ldata->atomic_read_lock){....}-{3:3}, at: n_tty_read+0x478/0x5a0 drivers/tty/n_tty.c:2178 1 lock held by udevd/4901: #0: ffff888108df80a0 (&bdev->bd_mutex){....}-{3:3}, at: blkdev_get_by_dev fs/block_dev.c:1453 [inline] #0: ffff888108df80a0 (&bdev->bd_mutex){....}-{3:3}, at: blkdev_get_by_dev+0x13d/0x250 fs/block_dev.c:1422 2 locks held by kworker/0:5/11868: #0: ffff888100057338 ((wq_completion)rcu_gp){....}-{0:0}, at: wake_up_worker kernel/workqueue.c:837 [inline] #0: ffff888100057338 ((wq_completion)rcu_gp){....}-{0:0}, at: process_one_work+0x1bc/0x430 kernel/workqueue.c:2238 #1: ffffc900024d7e70 ((work_completion)(&rew.rew_work)){....}-{0:0}, at: wake_up_worker kernel/workqueue.c:837 [inline] #1: ffffc900024d7e70 ((work_completion)(&rew.rew_work)){....}-{0:0}, at: process_one_work+0x1bc/0x430 kernel/workqueue.c:2238 1 lock held by syz-executor/25033: #0: ffff8881155f10e0 (&type->s_umount_key#26){....}-{3:3}, at: deactivate_super+0x27/0x30 fs/super.c:365 1 lock held by kmmpd-loop2/32514: #0: ffff8881155f1438 (sb_writers#4){....}-{0:0}, at: kmmpd+0x2e0/0x430 fs/ext4/mmp.c:245 2 locks held by syz.0.19934/21818: #0: ffff8881152f30e0 (&type->s_umount_key#22/1){....}-{3:3}, at: alloc_super+0xd0/0x3b0 fs/super.c:229 #1: ffffffff82375368 (rcu_state.exp_mutex){....}-{3:3}, at: exp_funnel_lock kernel/rcu/tree_exp.h:290 [inline] #1: ffffffff82375368 (rcu_state.exp_mutex){....}-{3:3}, at: synchronize_rcu_expedited+0x2f1/0x390 kernel/rcu/tree_exp.h:836 3 locks held by syz.5.19935/21820: #0: ffff888100449a90 (&bdev->bd_fsfreeze_mutex){....}-{3:3}, at: freeze_bdev+0x1a/0xc0 fs/block_dev.c:569 #1: ffff88811583f438 (sb_writers#4){....}-{0:0}, at: sb_wait_write fs/super.c:1592 [inline] #1: ffff88811583f438 (sb_writers#4){....}-{0:0}, at: freeze_super+0x73/0x160 fs/super.c:1685 #2: ffffffff82375368 (rcu_state.exp_mutex){....}-{3:3}, at: exp_funnel_lock kernel/rcu/tree_exp.h:322 [inline] #2: ffffffff82375368 (rcu_state.exp_mutex){....}-{3:3}, at: synchronize_rcu_expedited+0xe6/0x390 kernel/rcu/tree_exp.h:836 2 locks held by syz.4.19936/21827: #0: ffff888108dfa4d0 (&bdev->bd_fsfreeze_mutex){....}-{3:3}, at: freeze_bdev+0x1a/0xc0 fs/block_dev.c:569 #1: ffff888118be9438 (sb_writers#4){....}-{0:0}, at: sb_wait_write fs/super.c:1592 [inline] #1: ffff888118be9438 (sb_writers#4){....}-{0:0}, at: freeze_super+0x73/0x160 fs/super.c:1685 2 locks held by syz.1.19938/21834: #0: ffff888108df80a0 (&bdev->bd_mutex){....}-{3:3}, at: __blkdev_put+0x4a/0x230 fs/block_dev.c:1574 #1: ffff888104b7dbf0 (&lo->lo_mutex){....}-{3:3}, at: lo_release+0x1b/0x90 drivers/block/loop.c:1910 ============================================= NMI backtrace for cpu 1 CPU: 1 PID: 235 Comm: khungtaskd Not tainted 5.12.0-rc4-syzkaller #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 08/06/2024 Call Trace: __dump_stack lib/dump_stack.c:79 [inline] dump_stack+0x69/0x8e lib/dump_stack.c:120 nmi_cpu_backtrace.cold+0x32/0x69 lib/nmi_backtrace.c:105 nmi_trigger_cpumask_backtrace+0x81/0x90 lib/nmi_backtrace.c:62 trigger_all_cpu_backtrace include/linux/nmi.h:146 [inline] check_hung_uninterruptible_tasks kernel/hung_task.c:209 [inline] watchdog+0x4b1/0x4c0 kernel/hung_task.c:294 kthread+0x119/0x130 kernel/kthread.c:292 ret_from_fork+0x22/0x30 arch/x86/entry/entry_64.S:294 Sending NMI from CPU 1 to CPUs 0: NMI backtrace for cpu 0 CPU: 0 PID: 13 Comm: kworker/0:2 Not tainted 5.12.0-rc4-syzkaller #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 08/06/2024 Workqueue: events toggle_allocation_gate RIP: 0010:kmap_local_sched_out kernel/sched/core.c:4092 [inline] RIP: 0010:prepare_task_switch kernel/sched/core.c:4127 [inline] RIP: 0010:context_switch kernel/sched/core.c:4274 [inline] RIP: 0010:__schedule+0x225/0x7c0 kernel/sched/core.c:5073 Code: 00 00 49 0f ba ad 30 13 00 00 00 49 83 bd 20 13 00 00 00 74 06 f0 41 80 4d 00 02 65 48 8b 04 25 c0 6e 01 00 8b 80 e0 13 00 00 <85> c0 0f 85 a9 04 00 00 49 8b b7 38 04 00 00 41 c7 47 34 01 00 00 RSP: 0018:ffffc90000073df8 EFLAGS: 00000046 RAX: 0000000000000000 RBX: ffffffff82177da8 RCX: 000000000296e009 RDX: 00000052476d74ec RSI: ffff888237c2a918 RDI: ffff888100208928 RBP: ffffc90000073e48 R08: ffff8881075600e8 R09: ffff8881075600e8 R10: 0000000000000016 R11: 0000000000004721 R12: ffff888237c2a900 R13: ffff888100208000 R14: ffff888237c2a918 R15: ffff8881152dcd40 FS: 0000000000000000(0000) GS:ffff888237c00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007fc9e4293000 CR3: 0000000002222000 CR4: 0000000000350ef0 Call Trace: preempt_schedule_common kernel/sched/core.c:5233 [inline] __cond_resched+0x28/0x40 kernel/sched/core.c:6982 _cond_resched include/linux/sched.h:1893 [inline] process_one_work+0x2c2/0x430 kernel/workqueue.c:2301 worker_thread+0x4d/0x330 kernel/workqueue.c:2421 kthread+0x119/0x130 kernel/kthread.c:292 ret_from_fork+0x22/0x30 arch/x86/entry/entry_64.S:294