ci starts bisection 2022-07-26 10:14:36.829180404 +0000 UTC m=+30276.140455912 bisecting fixing commit since d6765985a42a660f078896d5c5b27f97c580a490 building syzkaller on 9d2ab5dfe7727dfea4b9b279f4edf731acb386ef testing commit d6765985a42a660f078896d5c5b27f97c580a490 compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 584cdbed6025e734e28f73948f0a58add6a0fd2273e111c582898cde758bbfe5 run #0: crashed: INFO: rcu detected stall in net_tx_action run #1: crashed: INFO: rcu detected stall in tc_modify_qdisc run #2: crashed: INFO: rcu detected stall in net_tx_action run #3: crashed: INFO: rcu detected stall in tc_modify_qdisc run #4: crashed: INFO: rcu detected stall in tc_modify_qdisc run #5: crashed: INFO: rcu detected stall in tc_modify_qdisc run #6: crashed: INFO: rcu detected stall in tc_modify_qdisc run #7: crashed: INFO: rcu detected stall in tc_modify_qdisc run #8: crashed: INFO: rcu detected stall in net_tx_action run #9: crashed: BUG: soft lockup in tc_modify_qdisc run #10: crashed: INFO: rcu detected stall in tc_modify_qdisc run #11: crashed: INFO: rcu detected stall in net_tx_action run #12: crashed: INFO: rcu detected stall in net_tx_action run #13: crashed: BUG: soft lockup in tc_modify_qdisc run #14: crashed: INFO: rcu detected stall in do_idle run #15: crashed: INFO: rcu detected stall in net_tx_action run #16: crashed: BUG: soft lockup in net_tx_action run #17: OK run #18: OK run #19: OK testing current HEAD b89fc26f741d9f9efb51cba3e9b241cf1380ec5a testing commit b89fc26f741d9f9efb51cba3e9b241cf1380ec5a compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: d9f97483198d0835629b6798c64a95c2152130e79d8185318db16acbf3ab1963 all runs: OK # git bisect start b89fc26f741d9f9efb51cba3e9b241cf1380ec5a d6765985a42a660f078896d5c5b27f97c580a490 Bisecting: 45682 revisions left to test after this (roughly 16 steps) [bc11517bc8219314948780570ec92814d14d6602] Merge tag 'iwlwifi-next-for-kalle-2021-12-21-v2' of git://git.kernel.org/pub/scm/linux/kernel/git/iwlwifi/iwlwifi-next testing commit bc11517bc8219314948780570ec92814d14d6602 compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 4a6a98a816ccb860cf25447f7e0b455533d994ef88489cdd90bd647df23f160c run #0: crashed: INFO: rcu detected stall in net_tx_action run #1: crashed: INFO: rcu detected stall in net_tx_action run #2: crashed: INFO: rcu detected stall in tc_modify_qdisc run #3: crashed: BUG: soft lockup in tc_modify_qdisc run #4: crashed: INFO: rcu detected stall in net_tx_action run #5: crashed: INFO: rcu detected stall in net_tx_action run #6: crashed: BUG: soft lockup in net_tx_action run #7: crashed: INFO: rcu detected stall in net_tx_action run #8: basic kernel testing failed: failed to copy binary to VM: failed to run ["scp" "-P" "22" "-F" "/dev/null" "-o" "UserKnownHostsFile=/dev/null" "-o" "BatchMode=yes" "-o" "IdentitiesOnly=yes" "-o" "StrictHostKeyChecking=no" "-o" "ConnectTimeout=10" "/tmp/syz-executor3861184248" "root@10.128.10.4:./syz-executor3861184248"]: exit status 1 ssh: connect to host 10.128.10.4 port 22: Connection timed out lost connection run #9: basic kernel testing failed: failed to copy binary to VM: failed to run ["scp" "-P" "22" "-F" "/dev/null" "-o" "UserKnownHostsFile=/dev/null" "-o" "BatchMode=yes" "-o" "IdentitiesOnly=yes" "-o" "StrictHostKeyChecking=no" "-o" "ConnectTimeout=10" "/tmp/syz-executor2471259686" "root@10.128.10.3:./syz-executor2471259686"]: exit status 1 ssh: connect to host 10.128.10.3 port 22: Connection timed out lost connection # git bisect good bc11517bc8219314948780570ec92814d14d6602 Bisecting: 22722 revisions left to test after this (roughly 15 steps) [6f2689a7662809ff39f2b24e452d11569c21ea2f] Merge tag 'scsi-misc' of git://git.kernel.org/pub/scm/linux/kernel/git/jejb/scsi testing commit 6f2689a7662809ff39f2b24e452d11569c21ea2f compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 799e4e26a4044c6b9633e563a2d8b044c261118541c701d7fab49fb88a96f0c5 all runs: OK # git bisect bad 6f2689a7662809ff39f2b24e452d11569c21ea2f Bisecting: 11482 revisions left to test after this (roughly 14 steps) [83a18b8e69542e1a1107218afa4b0f6d95d4dda0] Merge branch 'mptcp-next' testing commit 83a18b8e69542e1a1107218afa4b0f6d95d4dda0 compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: ff36d1c54a3b2f68a3c9915f5608ef817e805ee1783cd41ae39674b8c6f9cfad run #0: basic kernel testing failed: failed to copy binary to VM: failed to run ["scp" "-P" "22" "-F" "/dev/null" "-o" "UserKnownHostsFile=/dev/null" "-o" "BatchMode=yes" "-o" "IdentitiesOnly=yes" "-o" "StrictHostKeyChecking=no" "-o" "ConnectTimeout=10" "/tmp/syz-executor2115758451" "root@10.128.0.116:./syz-executor2115758451"]: exit status 1 ssh: connect to host 10.128.0.116 port 22: Connection timed out lost connection run #1: crashed: INFO: rcu detected stall in net_tx_action run #2: crashed: INFO: rcu detected stall in tc_modify_qdisc run #3: crashed: INFO: rcu detected stall in net_tx_action run #4: crashed: INFO: rcu detected stall in net_tx_action run #5: crashed: INFO: rcu detected stall in net_tx_action run #6: crashed: INFO: rcu detected stall in net_tx_action run #7: crashed: INFO: rcu detected stall in corrupted run #8: crashed: INFO: rcu detected stall in gc_worker run #9: OK # git bisect good 83a18b8e69542e1a1107218afa4b0f6d95d4dda0 Bisecting: 5729 revisions left to test after this (roughly 13 steps) [8ffa5709e577385a1c8d20fb434cb02732f1d991] Merge tag 'arm-defconfig-5.18' of git://git.kernel.org/pub/scm/linux/kernel/git/soc/soc testing commit 8ffa5709e577385a1c8d20fb434cb02732f1d991 compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 9479a6b7e20a0a4b50fb0a306be7f967d8f0dc72db2baa917a953a2ba75566b2 run #0: basic kernel testing failed: BUG: program execution failed: executor NUM: failed to write control pipe: write |NUM: broken pipe run #1: basic kernel testing failed: BUG: program execution failed: executor NUM: exit status NUM run #2: OK run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK # git bisect bad 8ffa5709e577385a1c8d20fb434cb02732f1d991 Bisecting: 2858 revisions left to test after this (roughly 12 steps) [5628b8de1228436d47491c662dc521bc138a3d43] Merge tag 'random-5.18-rc1-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/crng/random testing commit 5628b8de1228436d47491c662dc521bc138a3d43 compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: efe0a044bc06deb342f910991035ed4db511d79afcda2cd73146916ba7522b6c run #0: crashed: INFO: rcu detected stall in net_tx_action run #1: crashed: BUG: soft lockup in net_tx_action run #2: crashed: BUG: soft lockup in net_tx_action run #3: crashed: BUG: soft lockup in tc_modify_qdisc run #4: crashed: INFO: rcu detected stall in net_tx_action run #5: crashed: BUG: soft lockup in tc_modify_qdisc run #6: crashed: INFO: rcu detected stall in tc_modify_qdisc run #7: basic kernel testing failed: failed to copy binary to VM: timedout after 1m0s ["scp" "-P" "22" "-F" "/dev/null" "-o" "UserKnownHostsFile=/dev/null" "-o" "BatchMode=yes" "-o" "IdentitiesOnly=yes" "-o" "StrictHostKeyChecking=no" "-o" "ConnectTimeout=10" "/tmp/syz-executor2986218853" "root@10.128.0.171:./syz-executor2986218853"] run #8: crashed: INFO: rcu detected stall in do_idle run #9: OK # git bisect good 5628b8de1228436d47491c662dc521bc138a3d43 Bisecting: 1433 revisions left to test after this (roughly 11 steps) [9030fb0bb9d607908d51f9ee02efdbe01da355ee] Merge tag 'folio-5.18c' of git://git.infradead.org/users/willy/pagecache testing commit 9030fb0bb9d607908d51f9ee02efdbe01da355ee compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 39dcd43ad3a710aacce4ea27b21d0bdf96c84d54a0016f95f49154579fc2b0c0 run #0: basic kernel testing failed: BUG: program execution failed: executor NUM: failed to write control pipe: write |NUM: broken pipe run #1: OK run #2: OK run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK # git bisect bad 9030fb0bb9d607908d51f9ee02efdbe01da355ee Bisecting: 712 revisions left to test after this (roughly 10 steps) [6ca014cd2ddb5c56f962ec68f220be049fdcd7a3] Merge branch 'keys-fixes' of git://git.kernel.org/pub/scm/linux/kernel/git/dhowells/linux-fs testing commit 6ca014cd2ddb5c56f962ec68f220be049fdcd7a3 compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: ea03f2678a7ae1ba5115ec35914b1487e5deca065b947c694093690e186a960a all runs: OK # git bisect bad 6ca014cd2ddb5c56f962ec68f220be049fdcd7a3 Bisecting: 318 revisions left to test after this (roughly 9 steps) [69d1dea852b54eecd8ad2ec92a7fd371e9aec4bd] Merge tag 'for-5.18/drivers-2022-03-18' of git://git.kernel.dk/linux-block testing commit 69d1dea852b54eecd8ad2ec92a7fd371e9aec4bd compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 3c2403d25d85ac9c36f5d60f8392801f4dd1bfafca0ccc59ed5db647f18ad465 run #0: basic kernel testing failed: BUG: program execution failed: executor NUM: failed to write control pipe: write |NUM: broken pipe run #1: OK run #2: OK run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK # git bisect bad 69d1dea852b54eecd8ad2ec92a7fd371e9aec4bd Bisecting: 209 revisions left to test after this (roughly 8 steps) [b080cee72ef355669cbc52ff55dc513d37433600] Merge tag 'for-5.18/io_uring-statx-2022-03-18' of git://git.kernel.dk/linux-block testing commit b080cee72ef355669cbc52ff55dc513d37433600 compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 99321d5e072e171760b1823b7db08fe07add78fc2c115e538129b40d417e29be run #0: crashed: INFO: rcu detected stall in tc_modify_qdisc run #1: crashed: INFO: rcu detected stall in tc_modify_qdisc run #2: crashed: INFO: rcu detected stall in tc_modify_qdisc run #3: crashed: INFO: rcu detected stall in net_tx_action run #4: crashed: INFO: rcu detected stall in tc_modify_qdisc run #5: crashed: INFO: rcu detected stall in net_tx_action run #6: crashed: BUG: soft lockup in tc_modify_qdisc run #7: crashed: INFO: rcu detected stall in net_tx_action run #8: crashed: BUG: soft lockup in net_tx_action run #9: OK # git bisect good b080cee72ef355669cbc52ff55dc513d37433600 Bisecting: 104 revisions left to test after this (roughly 7 steps) [22027a9811349de28f81e13e20e83299099acd3a] nvmet: replace ida_simple[get|remove] with the simler ida_[alloc|free] testing commit 22027a9811349de28f81e13e20e83299099acd3a compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 9019ebf94835f077a1cfcb625ed47451aa4b3014c0fbb17426a94136769df4e6 run #0: crashed: INFO: rcu detected stall in net_tx_action run #1: crashed: INFO: rcu detected stall in net_tx_action run #2: crashed: INFO: rcu detected stall in tc_modify_qdisc run #3: crashed: INFO: rcu detected stall in tc_modify_qdisc run #4: crashed: INFO: rcu detected stall in net_tx_action run #5: crashed: INFO: rcu detected stall in net_tx_action run #6: crashed: INFO: rcu detected stall in tc_modify_qdisc run #7: crashed: BUG: soft lockup in tc_modify_qdisc run #8: crashed: INFO: rcu detected stall in tc_modify_qdisc run #9: crashed: BUG: soft lockup in net_tx_action # git bisect good 22027a9811349de28f81e13e20e83299099acd3a Bisecting: 52 revisions left to test after this (roughly 6 steps) [da7837339641601f202f27515771dc0646083938] nvmet: move the call to nvmet_ns_changed out of nvmet_ns_revalidate testing commit da7837339641601f202f27515771dc0646083938 compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 53a9f9119833dd74050f56e558451e12cc774cc4c65e119eca18e30f6f382a68 run #0: crashed: INFO: rcu detected stall in net_tx_action run #1: crashed: INFO: rcu detected stall in net_tx_action run #2: crashed: INFO: rcu detected stall in net_tx_action run #3: crashed: BUG: soft lockup in tc_modify_qdisc run #4: crashed: BUG: soft lockup in tc_modify_qdisc run #5: crashed: INFO: rcu detected stall in tc_modify_qdisc run #6: crashed: BUG: soft lockup in net_tx_action run #7: crashed: BUG: soft lockup in tc_modify_qdisc run #8: basic kernel testing failed: failed to copy binary to VM: failed to run ["scp" "-P" "22" "-F" "/dev/null" "-o" "UserKnownHostsFile=/dev/null" "-o" "BatchMode=yes" "-o" "IdentitiesOnly=yes" "-o" "StrictHostKeyChecking=no" "-o" "ConnectTimeout=10" "/tmp/syz-executor984850202" "root@10.128.1.81:./syz-executor984850202"]: exit status 1 ssh: connect to host 10.128.1.81 port 22: Connection timed out lost connection run #9: OK # git bisect good da7837339641601f202f27515771dc0646083938 Bisecting: 26 revisions left to test after this (roughly 5 steps) [fad45c3007a18064da759b4dba35eb722bc64e97] sd: rename the scsi_disk.dev field testing commit fad45c3007a18064da759b4dba35eb722bc64e97 compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 79f7a88b6fb524de17f1b1fbc4bf5ba48bab9c12709ddfb9ebc4e764022df288 run #0: crashed: INFO: rcu detected stall in net_tx_action run #1: crashed: INFO: rcu detected stall in tc_modify_qdisc run #2: crashed: INFO: rcu detected stall in net_tx_action run #3: crashed: INFO: rcu detected stall in net_tx_action run #4: crashed: INFO: rcu detected stall in tc_modify_qdisc run #5: crashed: BUG: soft lockup in net_tx_action run #6: crashed: BUG: soft lockup in tc_modify_qdisc run #7: crashed: INFO: rcu detected stall in do_idle run #8: OK run #9: OK # git bisect good fad45c3007a18064da759b4dba35eb722bc64e97 Bisecting: 13 revisions left to test after this (roughly 4 steps) [aa1b46dcdc7baaf5fec0be25782ef24b26aa209e] block: fix rq-qos breakage from skipping rq_qos_done_bio() testing commit aa1b46dcdc7baaf5fec0be25782ef24b26aa209e compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 570dd21e9e73b3fb43d69e0b548f05b7f979f8da3376152435bc4ba4dcdbf499 run #0: crashed: INFO: rcu detected stall in tc_modify_qdisc run #1: crashed: INFO: rcu detected stall in net_tx_action run #2: crashed: INFO: rcu detected stall in tc_modify_qdisc run #3: crashed: INFO: rcu detected stall in net_tx_action run #4: crashed: INFO: rcu detected stall in net_tx_action run #5: crashed: INFO: rcu detected stall in tc_modify_qdisc run #6: crashed: INFO: rcu detected stall in net_tx_action run #7: crashed: INFO: rcu detected stall in net_tx_action run #8: basic kernel testing failed: failed to copy binary to VM: failed to run ["scp" "-P" "22" "-F" "/dev/null" "-o" "UserKnownHostsFile=/dev/null" "-o" "BatchMode=yes" "-o" "IdentitiesOnly=yes" "-o" "StrictHostKeyChecking=no" "-o" "ConnectTimeout=10" "/tmp/syz-executor1551361016" "root@10.128.0.201:./syz-executor1551361016"]: exit status 1 ssh: connect to host 10.128.0.201 port 22: Connection timed out lost connection run #9: OK # git bisect good aa1b46dcdc7baaf5fec0be25782ef24b26aa209e Bisecting: 6 revisions left to test after this (roughly 3 steps) [8f9e7b65f833cb9a4b2e2f54a049d74df394d906] block: cancel all throttled bios in del_gendisk() testing commit 8f9e7b65f833cb9a4b2e2f54a049d74df394d906 compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 51cb488dd838be67a84fe3fdc89849de5bc2fed56c060986e33b98a87d539b77 all runs: OK # git bisect bad 8f9e7b65f833cb9a4b2e2f54a049d74df394d906 Bisecting: 3 revisions left to test after this (roughly 2 steps) [8ef22dc4a7cbef5870e612edfbf9cd058ddaaa50] block/bfq-iosched: Fix spelling mistake "tenative" -> "tentative" testing commit 8ef22dc4a7cbef5870e612edfbf9cd058ddaaa50 compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 5174362018593512d8f764d755cf4ca4a589b8a7d0818dd2a21f1c1348139083 run #0: crashed: INFO: rcu detected stall in net_tx_action run #1: crashed: INFO: rcu detected stall in tc_modify_qdisc run #2: crashed: INFO: rcu detected stall in tc_modify_qdisc run #3: crashed: INFO: rcu detected stall in tc_modify_qdisc run #4: crashed: BUG: soft lockup in corrupted run #5: crashed: BUG: soft lockup in tc_modify_qdisc run #6: crashed: INFO: rcu detected stall in net_tx_action run #7: crashed: BUG: soft lockup in net_tx_action run #8: crashed: INFO: rcu detected stall in net_tx_action run #9: OK # git bisect good 8ef22dc4a7cbef5870e612edfbf9cd058ddaaa50 Bisecting: 1 revision left to test after this (roughly 1 step) [ee37eddbfa9e0401f13a01691cf4bbbacd2d16c9] block: avoid use-after-free on throttle data testing commit ee37eddbfa9e0401f13a01691cf4bbbacd2d16c9 compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: c914fc23b282f5e5df44bd9e315c9e467bd326c19d99d800ca56a753fe4fbba3 run #0: crashed: INFO: rcu detected stall in net_tx_action run #1: crashed: INFO: rcu detected stall in tc_modify_qdisc run #2: crashed: BUG: soft lockup in tc_modify_qdisc run #3: crashed: INFO: rcu detected stall in tc_modify_qdisc run #4: crashed: BUG: soft lockup in tc_modify_qdisc run #5: crashed: BUG: soft lockup in tc_modify_qdisc run #6: crashed: INFO: rcu detected stall in corrupted run #7: crashed: INFO: rcu detected stall in net_tx_action run #8: crashed: INFO: rcu detected stall in tc_modify_qdisc run #9: OK # git bisect good ee37eddbfa9e0401f13a01691cf4bbbacd2d16c9 Bisecting: 0 revisions left to test after this (roughly 0 steps) [0a9a25ca78437b39e691bcc3dc8240455b803d8d] block: let blkcg_gq grab request queue's refcnt testing commit 0a9a25ca78437b39e691bcc3dc8240455b803d8d compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 4af79e2180889a29bd0433e6bf99cf079d25be11a42e747617085da854096694 run #0: basic kernel testing failed: BUG: program execution failed: executor NUM: failed to write control pipe: write |NUM: broken pipe run #1: OK run #2: OK run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK # git bisect bad 0a9a25ca78437b39e691bcc3dc8240455b803d8d 0a9a25ca78437b39e691bcc3dc8240455b803d8d is the first bad commit commit 0a9a25ca78437b39e691bcc3dc8240455b803d8d Author: Ming Lei Date: Fri Mar 18 21:01:43 2022 +0800 block: let blkcg_gq grab request queue's refcnt In the whole lifetime of blkcg_gq instance, ->q will be referred, such as, ->pd_free_fn() is called in blkg_free, and throtl_pd_free() still may touch the request queue via &tg->service_queue.pending_timer which is handled by throtl_pending_timer_fn(), so it is reasonable to grab request queue's refcnt by blkcg_gq instance. Previously blkcg_exit_queue() is called from blk_release_queue, and it is hard to avoid the use-after-free. But recently commit 1059699f87eb ("block: move blkcg initialization/destroy into disk allocation/release handler") is merged to for-5.18/block, it becomes simple to fix the issue by simply grabbing request queue's refcnt. Reported-by: Christoph Hellwig Signed-off-by: Ming Lei Link: https://lore.kernel.org/r/20220318130144.1066064-3-ming.lei@redhat.com Signed-off-by: Jens Axboe block/blk-cgroup.c | 5 +++++ 1 file changed, 5 insertions(+) culprit signature: 4af79e2180889a29bd0433e6bf99cf079d25be11a42e747617085da854096694 parent signature: c914fc23b282f5e5df44bd9e315c9e467bd326c19d99d800ca56a753fe4fbba3 revisions tested: 19, total time: 5h34m47.074044197s (build: 2h8m59.025691093s, test: 3h23m7.377798875s) first good commit: 0a9a25ca78437b39e691bcc3dc8240455b803d8d block: let blkcg_gq grab request queue's refcnt recipients (to): ["axboe@kernel.dk" "linux-kernel@vger.kernel.org" "ming.lei@redhat.com"] recipients (cc): ["axboe@kernel.dk" "cgroups@vger.kernel.org" "linux-block@vger.kernel.org" "tj@kernel.org"]