bisecting cause commit starting from 9eaa88c7036eda3f6c215f87ca693594cf90559b building syzkaller on 44068e196185e2f5a7c94629b6245cdde008b140 testing commit 9eaa88c7036eda3f6c215f87ca693594cf90559b compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 7a9b72c64c410f6a065a00d99894b9066d5beb991dc6e1d0b07b5caac63b6901 run #0: OK run #1: OK run #2: OK run #3: OK run #4: OK run #5: OK run #6: OK run #7: crashed: INFO: rcu detected stall in corrupted run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK reproducer seems to be flaky testing release v5.15 testing commit 8bb7eca972ad531c9b149c0a51ab43a417385813 compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 53939f81e4116e6b5d0b10eb15bd738ec99ef6582e484bd47df394efa7593ee9 run #0: crashed: INFO: rcu detected stall in ext4_file_write_iter run #1: OK run #2: OK run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: crashed: INFO: rcu detected stall in ext4_file_write_iter run #18: OK run #19: OK testing release v5.14 testing commit 7d2a07b769330c34b4deabeed939325c77a7ec2f compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 1938b55f609edd08ee6d5a0d940a96f1493727a7927e8db4af2ea6efbc3f92fc all runs: OK # git bisect start 8bb7eca972ad531c9b149c0a51ab43a417385813 7d2a07b769330c34b4deabeed939325c77a7ec2f Bisecting: 6693 revisions left to test after this (roughly 13 steps) warning: unable to access '/syzkaller/.config/git/ignore': Permission denied warning: unable to access '/syzkaller/.config/git/attributes': Permission denied [477f70cd2a67904e04c2c2b9bd0fa2e95222f2f6] Merge tag 'drm-next-2021-08-31-1' of git://anongit.freedesktop.org/drm/drm testing commit 477f70cd2a67904e04c2c2b9bd0fa2e95222f2f6 compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 3e1958589eb2837a91e3c77a5cb4f0068032617aaa93c8dd36259436685e227c all runs: OK # git bisect good 477f70cd2a67904e04c2c2b9bd0fa2e95222f2f6 Bisecting: 3317 revisions left to test after this (roughly 12 steps) warning: unable to access '/syzkaller/.config/git/ignore': Permission denied warning: unable to access '/syzkaller/.config/git/attributes': Permission denied [626bf91a292e2035af5b9d9cce35c5c138dfe06d] Merge tag 'net-5.15-rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net testing commit 626bf91a292e2035af5b9d9cce35c5c138dfe06d compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: f365b4e69662c6a87799775013e1870f5ace5a7835fb2b2542e89108c7f4bce8 run #0: crashed: INFO: rcu detected stall in ext4_file_write_iter run #1: OK run #2: OK run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK # git bisect bad 626bf91a292e2035af5b9d9cce35c5c138dfe06d Bisecting: 1702 revisions left to test after this (roughly 11 steps) warning: unable to access '/syzkaller/.config/git/ignore': Permission denied warning: unable to access '/syzkaller/.config/git/attributes': Permission denied [23852bec534a1633dc08f4df88b8493ae99953a9] Merge tag 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/rdma/rdma testing commit 23852bec534a1633dc08f4df88b8493ae99953a9 compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 9844b9e56f88bc5fdf5636453991b093a2999ebe4a0d50427d85bd0bd16c041d all runs: OK # git bisect good 23852bec534a1633dc08f4df88b8493ae99953a9 Bisecting: 869 revisions left to test after this (roughly 10 steps) warning: unable to access '/syzkaller/.config/git/ignore': Permission denied warning: unable to access '/syzkaller/.config/git/attributes': Permission denied [55d1308bdff7341b778e5cf36220616a0dd6ab8f] cdrom: update uniform CD-ROM maintainership in MAINTAINERS file testing commit 55d1308bdff7341b778e5cf36220616a0dd6ab8f compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: f96c7c5f1e03bd7658a61ae4be764b81037cccaab2137dbb099e9422f7f2e760 all runs: OK # git bisect good 55d1308bdff7341b778e5cf36220616a0dd6ab8f Bisecting: 434 revisions left to test after this (roughly 9 steps) warning: unable to access '/syzkaller/.config/git/ignore': Permission denied warning: unable to access '/syzkaller/.config/git/attributes': Permission denied [3754707bcc3e190e5dadc978d172b61e809cb3bd] Revert "memcg: enable accounting for file lock caches" testing commit 3754707bcc3e190e5dadc978d172b61e809cb3bd compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 9d354823ab02197d1e5abef5cfe8c785b7973cbcc925cf480bab9483c01fc4e9 all runs: OK # git bisect good 3754707bcc3e190e5dadc978d172b61e809cb3bd Bisecting: 212 revisions left to test after this (roughly 8 steps) warning: unable to access '/syzkaller/.config/git/ignore': Permission denied warning: unable to access '/syzkaller/.config/git/attributes': Permission denied [e99314a340d27efafab3b7ea226beb239162cd46] Merge tag 'kvmarm-5.15' of git://git.kernel.org/pub/scm/linux/kernel/git/kvmarm/kvmarm into HEAD testing commit e99314a340d27efafab3b7ea226beb239162cd46 compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 031d70ffc78ca6d0b839361459a341212fb2a0c2f9bc844bbaf73d8996a84cca run #0: crashed: INFO: rcu detected stall in sys_sendfile64 run #1: OK run #2: OK run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK # git bisect bad e99314a340d27efafab3b7ea226beb239162cd46 Bisecting: 110 revisions left to test after this (roughly 7 steps) warning: unable to access '/syzkaller/.config/git/ignore': Permission denied warning: unable to access '/syzkaller/.config/git/attributes': Permission denied [0176ec51290f8ef543a8c18a02e932d6ccedbbc5] KVM: stats: Update doc for histogram statistics testing commit 0176ec51290f8ef543a8c18a02e932d6ccedbbc5 compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 477ef004f7cc4f943e7da6f0cef2ea5d554282ae74bdad4b3b5c71bb779d1d42 all runs: OK # git bisect good 0176ec51290f8ef543a8c18a02e932d6ccedbbc5 Bisecting: 56 revisions left to test after this (roughly 6 steps) warning: unable to access '/syzkaller/.config/git/ignore': Permission denied warning: unable to access '/syzkaller/.config/git/attributes': Permission denied [cf0c7125d5783f93b78921845d4b101c65a7998b] Merge branch kvm-arm64/mmu/el2-tracking into kvmarm-master/next testing commit cf0c7125d5783f93b78921845d4b101c65a7998b compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 69fc97af7c34440bff3de31e48625eaa5b8f506384a29d5ceaed6209fb9d5108 run #0: crashed: INFO: rcu detected stall in corrupted run #1: OK run #2: OK run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK # git bisect bad cf0c7125d5783f93b78921845d4b101c65a7998b Bisecting: 27 revisions left to test after this (roughly 5 steps) warning: unable to access '/syzkaller/.config/git/ignore': Permission denied warning: unable to access '/syzkaller/.config/git/attributes': Permission denied [3ce5db8a597794c0d0be2a319a0923c6fe81c899] Merge branch kvm-arm64/misc-5.15 into kvmarm-master/next testing commit 3ce5db8a597794c0d0be2a319a0923c6fe81c899 compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 69fc97af7c34440bff3de31e48625eaa5b8f506384a29d5ceaed6209fb9d5108 run #0: crashed: INFO: rcu detected stall in ext4_file_write_iter run #1: OK run #2: OK run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK # git bisect bad 3ce5db8a597794c0d0be2a319a0923c6fe81c899 Bisecting: 12 revisions left to test after this (roughly 4 steps) warning: unable to access '/syzkaller/.config/git/ignore': Permission denied warning: unable to access '/syzkaller/.config/git/attributes': Permission denied [6e73bc90ec447b8fcec5fd22fa49e100f3b4f909] Merge branch arm64/for-next/sysreg into kvm-arm64/misc-5.15 testing commit 6e73bc90ec447b8fcec5fd22fa49e100f3b4f909 compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: ec10d7dcd3b0f77995a573835a9428fa840c4d8136c574ea71387da10232bf35 run #0: OK run #1: OK run #2: OK run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: crashed: INFO: rcu detected stall in corrupted # git bisect bad 6e73bc90ec447b8fcec5fd22fa49e100f3b4f909 Bisecting: 6 revisions left to test after this (roughly 3 steps) warning: unable to access '/syzkaller/.config/git/ignore': Permission denied warning: unable to access '/syzkaller/.config/git/attributes': Permission denied [504c6295b998effa682089747a96d7bb5933d4db] arm64/mm: Add remaining ID_AA64MMFR0_PARANGE_ macros testing commit 504c6295b998effa682089747a96d7bb5933d4db compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: ec10d7dcd3b0f77995a573835a9428fa840c4d8136c574ea71387da10232bf35 run #0: OK run #1: OK run #2: OK run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: crashed: INFO: rcu detected stall in corrupted # git bisect bad 504c6295b998effa682089747a96d7bb5933d4db Bisecting: 2 revisions left to test after this (roughly 2 steps) warning: unable to access '/syzkaller/.config/git/ignore': Permission denied warning: unable to access '/syzkaller/.config/git/attributes': Permission denied [6fadc1241c33fe0228c94bc6a1aa6c1da8872e8b] KVM: arm64: perf: Replace '0xf' instances with ID_AA64DFR0_PMUVER_IMP_DEF testing commit 6fadc1241c33fe0228c94bc6a1aa6c1da8872e8b compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: ec10d7dcd3b0f77995a573835a9428fa840c4d8136c574ea71387da10232bf35 run #0: basic kernel testing failed: BUG: sleeping function called from invalid context in lock_sock_nested run #1: basic kernel testing failed: BUG: sleeping function called from invalid context in lock_sock_nested run #2: crashed: INFO: rcu detected stall in ext4_file_write_iter run #3: crashed: WARNING in rcu_check_gp_start_stall run #4: crashed: INFO: rcu detected stall in ext4_file_write_iter run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK # git bisect bad 6fadc1241c33fe0228c94bc6a1aa6c1da8872e8b Bisecting: 0 revisions left to test after this (roughly 1 step) warning: unable to access '/syzkaller/.config/git/ignore': Permission denied warning: unable to access '/syzkaller/.config/git/attributes': Permission denied [013cc4c6788f1ce9885d3c0281904f93ee8f2271] KVM: arm64: Fix comments related to GICv2 PMR reporting testing commit 013cc4c6788f1ce9885d3c0281904f93ee8f2271 compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: ec10d7dcd3b0f77995a573835a9428fa840c4d8136c574ea71387da10232bf35 run #0: crashed: INFO: rcu detected stall in corrupted run #1: OK run #2: OK run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK # git bisect bad 013cc4c6788f1ce9885d3c0281904f93ee8f2271 Bisecting: 0 revisions left to test after this (roughly 0 steps) warning: unable to access '/syzkaller/.config/git/ignore': Permission denied warning: unable to access '/syzkaller/.config/git/attributes': Permission denied [38f703663d4c82ead5b51b8860deeef19d6dcb6d] KVM: arm64: Count VMID-wide TLB invalidations testing commit 38f703663d4c82ead5b51b8860deeef19d6dcb6d compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: ec10d7dcd3b0f77995a573835a9428fa840c4d8136c574ea71387da10232bf35 run #0: basic kernel testing failed: BUG: sleeping function called from invalid context in lock_sock_nested run #1: crashed: INFO: rcu detected stall in ext4_file_write_iter run #2: OK run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: crashed: INFO: rcu detected stall in corrupted run #19: OK # git bisect bad 38f703663d4c82ead5b51b8860deeef19d6dcb6d warning: unable to access '/syzkaller/.config/git/attributes': Permission denied 38f703663d4c82ead5b51b8860deeef19d6dcb6d is the first bad commit commit 38f703663d4c82ead5b51b8860deeef19d6dcb6d Author: Paolo Bonzini Date: Tue Jul 27 12:32:51 2021 +0200 KVM: arm64: Count VMID-wide TLB invalidations KVM/ARM has an architecture-specific implementation of kvm_flush_remote_tlbs; however, unlike the generic one, it does not count the flushes in kvm->stat.remote_tlb_flush, so that it inexorably remained stuck to zero. Signed-off-by: Paolo Bonzini Reviewed-by: Oliver Upton Signed-off-by: Marc Zyngier Link: https://lore.kernel.org/r/20210727103251.16561-1-pbonzini@redhat.com arch/arm64/kvm/mmu.c | 1 + 1 file changed, 1 insertion(+) parent commit c500bee1c5b2f1d59b1081ac879d73268ab0ff17 wasn't tested testing commit c500bee1c5b2f1d59b1081ac879d73268ab0ff17 compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: ec10d7dcd3b0f77995a573835a9428fa840c4d8136c574ea71387da10232bf35 culprit signature: ec10d7dcd3b0f77995a573835a9428fa840c4d8136c574ea71387da10232bf35 parent signature: ec10d7dcd3b0f77995a573835a9428fa840c4d8136c574ea71387da10232bf35 Reproducer flagged being flaky revisions tested: 17, total time: 3h30m40.169263114s (build: 1h54m19.772305061s, test: 1h34m37.078580451s) first bad commit: 38f703663d4c82ead5b51b8860deeef19d6dcb6d KVM: arm64: Count VMID-wide TLB invalidations recipients (to): ["maz@kernel.org" "oupton@google.com" "pbonzini@redhat.com"] recipients (cc): [] crash: INFO: rcu detected stall in corrupted rcu: INFO: rcu_preempt detected stalls on CPUs/tasks: rcu: Tasks blocked on level-0 rcu_node (CPUs 0-1): (detected by 1, t=10502 jiffies, g=6973, q=1537) rcu: All QSes seen, last rcu_preempt kthread activity 153 (4294957980-4294957827), jiffies_till_next_fqs=1, root ->qsmask 0x0