ci starts bisection 2022-11-17 11:53:28.70477914 +0000 UTC m=+127719.269271904 bisecting cause commit starting from 7eba4505394e21df44dcace6b5d741a8e2deea3a building syzkaller on 3a127a3157fd19caabb023978737471213127590 ensuring issue is reproducible on original commit 7eba4505394e21df44dcace6b5d741a8e2deea3a testing commit 7eba4505394e21df44dcace6b5d741a8e2deea3a gcc compiler: gcc (Debian 10.2.1-6) 10.2.1 20210110, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: bd1a789627f7bdd10d4f2ae6d64cc04b6fa17b290b240fb4200ae6d9542a0417 run #0: crashed: INFO: rcu detected stall in corrupted run #1: crashed: INFO: rcu detected stall in corrupted run #2: crashed: INFO: rcu detected stall in corrupted run #3: crashed: INFO: rcu detected stall in corrupted run #4: crashed: INFO: rcu detected stall in corrupted run #5: crashed: INFO: rcu detected stall in corrupted run #6: crashed: INFO: rcu detected stall in corrupted run #7: crashed: INFO: rcu detected stall in corrupted run #8: crashed: INFO: rcu detected stall in corrupted run #9: crashed: INFO: rcu detected stall in corrupted run #10: crashed: INFO: rcu detected stall in corrupted run #11: crashed: INFO: rcu detected stall in corrupted run #12: crashed: INFO: rcu detected stall in corrupted run #13: crashed: INFO: rcu detected stall in corrupted run #14: crashed: INFO: rcu detected stall in corrupted run #15: crashed: INFO: rcu detected stall in corrupted run #16: crashed: INFO: rcu detected stall in corrupted run #17: crashed: INFO: rcu detected stall in corrupted run #18: crashed: INFO: rcu detected stall in corrupted run #19: OK testing release v6.0 testing commit 4fe89d07dcc2804c8b562f6c7896a45643d34b2f gcc compiler: gcc (Debian 10.2.1-6) 10.2.1 20210110, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: d3ed2bf12f763198be8210333f69f4e69bf47fadc2be388822818292c126245e run #0: crashed: INFO: rcu detected stall in corrupted run #1: crashed: INFO: rcu detected stall in corrupted run #2: crashed: INFO: rcu detected stall in corrupted run #3: crashed: INFO: rcu detected stall in corrupted run #4: crashed: INFO: rcu detected stall in corrupted run #5: crashed: INFO: rcu detected stall in corrupted run #6: crashed: INFO: rcu detected stall in corrupted run #7: crashed: INFO: rcu detected stall in corrupted run #8: crashed: INFO: rcu detected stall in corrupted run #9: OK testing release v5.19 testing commit 3d7cb6b04c3f3115719235cc6866b10326de34cd gcc compiler: gcc (Debian 10.2.1-6) 10.2.1 20210110, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: d1d958a92c39a48c347d70a8d335c25a2db2fd46c326dc5f1abb54812be5727b run #0: OK run #1: OK run #2: crashed: WARNING: ODEBUG bug in netdev_run_todo run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK reproducer seems to be flaky testing release v5.18 testing commit 4b0986a3613c92f4ec1bdc7f60ec66fea135991f gcc compiler: gcc (Debian 10.2.1-6) 10.2.1 20210110, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 8d043b58b02c8586fc6ac41f332630989ae471ec72b9f2205ebfdc23ba72a265 run #0: crashed: WARNING in process_one_work run #1: OK run #2: OK run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK testing release v5.17 testing commit f443e374ae131c168a065ea1748feac6b2e76613 gcc compiler: gcc (Debian 10.2.1-6) 10.2.1 20210110, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: bd1e1562f686bff0f5eeebe5304d29a7d022ef89b964352a620d999f95bde7b7 all runs: OK # git bisect start 4b0986a3613c92f4ec1bdc7f60ec66fea135991f f443e374ae131c168a065ea1748feac6b2e76613 Bisecting: 8498 revisions left to test after this (roughly 13 steps) [25fd2d41b505d0640bdfe67aa77c549de2d3c18a] selftests: kselftest framework: provide "finished" helper testing commit 25fd2d41b505d0640bdfe67aa77c549de2d3c18a gcc compiler: gcc (Debian 10.2.1-6) 10.2.1 20210110, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: a6b3f908663d5aeb5f0a8f5892399556362c8787e19af66e90c4e377343229b1 run #0: crashed: WARNING: ODEBUG bug in netdev_run_todo run #1: OK run #2: OK run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK # git bisect bad 25fd2d41b505d0640bdfe67aa77c549de2d3c18a Bisecting: 3943 revisions left to test after this (roughly 12 steps) [b4bc93bd76d4da32600795cd323c971f00a2e788] Merge tag 'arm-drivers-5.18' of git://git.kernel.org/pub/scm/linux/kernel/git/soc/soc testing commit b4bc93bd76d4da32600795cd323c971f00a2e788 gcc compiler: gcc (Debian 10.2.1-6) 10.2.1 20210110, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 08c6bf8a9d9fedfe0ae22a96f5d1e71c3f59c71c6dc4644aa7387bc0afb487fc all runs: OK # git bisect good b4bc93bd76d4da32600795cd323c971f00a2e788 Bisecting: 1997 revisions left to test after this (roughly 11 steps) [9a225f81f540f65225e4b820e303d40d9e747e78] ice: Support GTP-U and GTP-C offload in switchdev testing commit 9a225f81f540f65225e4b820e303d40d9e747e78 gcc compiler: gcc (Debian 10.2.1-6) 10.2.1 20210110, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 5a3335b8ff9be374a0b631cf8e06660dcdff5ecf95974229d071134de52b2b7d run #0: crashed: WARNING: ODEBUG bug in netdev_run_todo run #1: OK run #2: OK run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK # git bisect bad 9a225f81f540f65225e4b820e303d40d9e747e78 Bisecting: 944 revisions left to test after this (roughly 10 steps) [b96a79253fff1cd2c928b379eadd8c7a6f8055e1] Merge tag 'wireless-next-2022-02-11' of git://git.kernel.org/pub/scm/linux/kernel/git/wireless/wireless-next testing commit b96a79253fff1cd2c928b379eadd8c7a6f8055e1 gcc compiler: gcc (Debian 10.2.1-6) 10.2.1 20210110, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: f1186ba684be7687304a679fa5edf579f543002ce5d8f1d9890a707884f96b4b all runs: basic kernel testing failed: WARNING: suspicious RCU usage in hsr_node_get_first # git bisect skip b96a79253fff1cd2c928b379eadd8c7a6f8055e1 Bisecting: 944 revisions left to test after this (roughly 10 steps) [a498c5953a9cdadcc1479c07d5b04c1afa3f53dc] vxlan_multicast: Move multicast helpers to a separate file testing commit a498c5953a9cdadcc1479c07d5b04c1afa3f53dc gcc compiler: gcc (Debian 10.2.1-6) 10.2.1 20210110, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 013d7ad895d63619b082f9c891df43f059a08b7544d0d2580b9780c69324d5c8 run #0: OK run #1: OK run #2: OK run #3: OK run #4: OK run #5: crashed: WARNING in process_one_work run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK # git bisect bad a498c5953a9cdadcc1479c07d5b04c1afa3f53dc Bisecting: 722 revisions left to test after this (roughly 10 steps) [45230829827b19ba09bdce17dfc0a4deff771281] Merge git://git.kernel.org/pub/scm/linux/kernel/git/netfilter/nf-next testing commit 45230829827b19ba09bdce17dfc0a4deff771281 gcc compiler: gcc (Debian 10.2.1-6) 10.2.1 20210110, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: f6a6fef0cfe5abd37f9ae686f95fdfccd358c151ea509e3e5a68def263953230 all runs: basic kernel testing failed: WARNING: suspicious RCU usage in hsr_node_get_first # git bisect skip 45230829827b19ba09bdce17dfc0a4deff771281 Bisecting: 722 revisions left to test after this (roughly 10 steps) [35c71aa04a13c20b7b1f01200cdd8a09842e58c8] Merge branch '1GbE' of git://git.kernel.org/pub/scm/linux/kernel/git/tnguy/next-queue testing commit 35c71aa04a13c20b7b1f01200cdd8a09842e58c8 gcc compiler: gcc (Debian 10.2.1-6) 10.2.1 20210110, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 3d5c1b38786b02858426804377bc2373babd7c2d9918aa6226210a9a4bcfd87c run #0: crashed: WARNING: ODEBUG bug in netdev_run_todo run #1: OK run #2: OK run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK run #10: OK run #11: OK run #12: OK run #13: OK run #14: OK run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK # git bisect bad 35c71aa04a13c20b7b1f01200cdd8a09842e58c8 Bisecting: 102 revisions left to test after this (roughly 7 steps) [b640b5522ad97289ceade2bff7584156f201542b] ionic: Allow flexibility for error reporting on dev commands testing commit b640b5522ad97289ceade2bff7584156f201542b gcc compiler: gcc (Debian 10.2.1-6) 10.2.1 20210110, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: b1e5c0114d10424625c62fbbb0f2af7afaf1312700b152ce1d736a1a9d47abb6 all runs: OK # git bisect good b640b5522ad97289ceade2bff7584156f201542b Bisecting: 50 revisions left to test after this (roughly 6 steps) [5fd16021578ecb290a51368bd9d19b2963f6bac5] net: enetc: use .mac_select_pcs() interface testing commit 5fd16021578ecb290a51368bd9d19b2963f6bac5 gcc compiler: gcc (Debian 10.2.1-6) 10.2.1 20210110, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 61defcde32a610701bdc45b21efdbc74ad9941042d9a3598572ff78bd71f5a0d all runs: OK # git bisect good 5fd16021578ecb290a51368bd9d19b2963f6bac5 Bisecting: 25 revisions left to test after this (roughly 5 steps) [08dfa5a19e1f4344ce5d3a5eed4c5529adafe0dc] net: remove linkmode_change_bit() testing commit 08dfa5a19e1f4344ce5d3a5eed4c5529adafe0dc gcc compiler: gcc (Debian 10.2.1-6) 10.2.1 20210110, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: dd19138f8cc8ed6c8a6c507afc0c8979c456d09585b47a39e31b5104f8685ce3 all runs: OK # git bisect good 08dfa5a19e1f4344ce5d3a5eed4c5529adafe0dc Bisecting: 12 revisions left to test after this (roughly 4 steps) [c217ab7a3961df568233faf485ac67aea1f8c5cb] r8169: enable ASPM L1.2 if system vendor flags it as safe testing commit c217ab7a3961df568233faf485ac67aea1f8c5cb gcc compiler: gcc (Debian 10.2.1-6) 10.2.1 20210110, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 8bac0f5867f7ec30f2c98c41554f9d5f77cb6f1de90913eff3a8e21a99b82cb0 all runs: OK # git bisect good c217ab7a3961df568233faf485ac67aea1f8c5cb Bisecting: 5 revisions left to test after this (roughly 3 steps) [9498d4affd61e9d97ec06cd67bc46da2485d8dba] iavf: Remove useless DMA-32 fallback configuration testing commit 9498d4affd61e9d97ec06cd67bc46da2485d8dba gcc compiler: gcc (Debian 10.2.1-6) 10.2.1 20210110, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: ce9afba732432b82e353b69d99518d65950f3e75138baa33d3b993a728c19538 all runs: OK # git bisect good 9498d4affd61e9d97ec06cd67bc46da2485d8dba Bisecting: 2 revisions left to test after this (roughly 2 steps) [f80f4dc3b2c06e69d146f41de3d59c552986bbc4] igb: Remove useless DMA-32 fallback configuration testing commit f80f4dc3b2c06e69d146f41de3d59c552986bbc4 gcc compiler: gcc (Debian 10.2.1-6) 10.2.1 20210110, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 520632c0d400c5faded510a29e27bc5588e54f9306d808dfd1ddd370c378168b all runs: OK # git bisect good f80f4dc3b2c06e69d146f41de3d59c552986bbc4 Bisecting: 1 revision left to test after this (roughly 1 step) [72d044e4bfa6bd9096536e2e1c62aecfe1a525e4] Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net testing commit 72d044e4bfa6bd9096536e2e1c62aecfe1a525e4 gcc compiler: gcc (Debian 10.2.1-6) 10.2.1 20210110, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: a6e4f9843f39becefcec206b23b2d33ddd2b5366e47bbe511f46aec1c73b9fb5 all runs: OK # git bisect good 72d044e4bfa6bd9096536e2e1c62aecfe1a525e4 Bisecting: 0 revisions left to test after this (roughly 0 steps) [ac9178926649eb676f261f912e5ab53bfe3500bf] igbvf: Remove useless DMA-32 fallback configuration testing commit ac9178926649eb676f261f912e5ab53bfe3500bf gcc compiler: gcc (Debian 10.2.1-6) 10.2.1 20210110, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 6469abbcf1675893856e8b33a08668348ee97a3652cac33f8d9304f784e2cd5c all runs: OK # git bisect good ac9178926649eb676f261f912e5ab53bfe3500bf 35c71aa04a13c20b7b1f01200cdd8a09842e58c8 is the first bad commit commit 35c71aa04a13c20b7b1f01200cdd8a09842e58c8 Merge: 72d044e4bfa6 ac9178926649 Author: Jakub Kicinski Date: Thu Jan 27 18:59:39 2022 -0800 Merge branch '1GbE' of git://git.kernel.org/pub/scm/linux/kernel/git/tnguy/next-queue Tony Nguyen says: ==================== 1GbE Intel Wired LAN Driver Updates 2022-01-27 Christophe Jaillet removes useless DMA-32 fallback calls from applicable Intel drivers and simplifies code as a result of the removal. * '1GbE' of git://git.kernel.org/pub/scm/linux/kernel/git/tnguy/next-queue: igbvf: Remove useless DMA-32 fallback configuration igb: Remove useless DMA-32 fallback configuration igc: Remove useless DMA-32 fallback configuration ice: Remove useless DMA-32 fallback configuration iavf: Remove useless DMA-32 fallback configuration e1000e: Remove useless DMA-32 fallback configuration i40e: Remove useless DMA-32 fallback configuration ixgbevf: Remove useless DMA-32 fallback configuration ixgbe: Remove useless DMA-32 fallback configuration ixgb: Remove useless DMA-32 fallback configuration ==================== Link: https://lore.kernel.org/r/20220127215224.422113-1-anthony.l.nguyen@intel.com Signed-off-by: Jakub Kicinski drivers/net/ethernet/intel/e1000e/netdev.c | 22 +++++++--------------- drivers/net/ethernet/intel/i40e/i40e_main.c | 9 +++------ drivers/net/ethernet/intel/iavf/iavf_main.c | 9 +++------ drivers/net/ethernet/intel/ice/ice_main.c | 2 -- drivers/net/ethernet/intel/igb/igb_main.c | 19 ++++++------------- drivers/net/ethernet/intel/igbvf/netdev.c | 22 ++++++---------------- drivers/net/ethernet/intel/igc/igc_main.c | 19 ++++++------------- drivers/net/ethernet/intel/ixgb/ixgb_main.c | 19 +++++-------------- drivers/net/ethernet/intel/ixgbe/ixgbe_main.c | 20 +++++++------------- drivers/net/ethernet/intel/ixgbevf/ixgbevf_main.c | 20 ++++++-------------- 10 files changed, 49 insertions(+), 112 deletions(-) Reproducer flagged being flaky revisions tested: 20, total time: 5h12m16.397721783s (build: 2h22m22.096009868s, test: 2h47m15.30348258s) first bad commit: 35c71aa04a13c20b7b1f01200cdd8a09842e58c8 Merge branch '1GbE' of git://git.kernel.org/pub/scm/linux/kernel/git/tnguy/next-queue recipients (to): ["kuba@kernel.org"] recipients (cc): [] crash: WARNING: ODEBUG bug in netdev_run_todo ------------[ cut here ]------------ ODEBUG: free active (active state 0) object type: timer_list hint: delayed_work_timer_fn+0x0/0x90 include/linux/find.h:144 WARNING: CPU: 1 PID: 8 at lib/debugobjects.c:505 debug_print_object+0x16e/0x250 lib/debugobjects.c:505 Modules linked in: CPU: 1 PID: 8 Comm: kworker/u4:0 Not tainted 5.17.0-rc1-syzkaller #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 10/26/2022 Workqueue: netns cleanup_net RIP: 0010:debug_print_object+0x16e/0x250 lib/debugobjects.c:505 Code: ff df 48 89 fa 48 c1 ea 03 80 3c 02 00 0f 85 af 00 00 00 48 8b 14 dd 80 c3 82 89 4c 89 ee 48 c7 c7 80 b7 82 89 e8 e3 36 ec 04 <0f> 0b 83 05 65 e7 79 09 01 48 83 c4 18 5b 5d 41 5c 41 5d 41 5e c3 RSP: 0018:ffffc90000cd78b0 EFLAGS: 00010286 RAX: 0000000000000000 RBX: 0000000000000003 RCX: 0000000000000000 RDX: 0000000000000001 RSI: ffffffff8982b320 RDI: fffff5200019af08 RBP: 0000000000000001 R08: 0000000000000001 R09: ffff8880b9d341c7 R10: ffffed10173a6838 R11: 0000000000000001 R12: ffffffff892d5da0 R13: ffffffff8982bdc0 R14: ffffffff815dc200 R15: dffffc0000000000 FS: 0000000000000000(0000) GS:ffff8880b9d00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f902d8a59b0 CR3: 00000000682b3000 CR4: 00000000003506e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Call Trace: __debug_check_no_obj_freed lib/debugobjects.c:992 [inline] debug_check_no_obj_freed+0x301/0x420 lib/debugobjects.c:1023 slab_free_hook mm/slub.c:1703 [inline] slab_free_freelist_hook+0xeb/0x1c0 mm/slub.c:1754 slab_free mm/slub.c:3509 [inline] kfree+0xcb/0x280 mm/slub.c:4562 device_release+0x93/0x200 drivers/base/core.c:2229 kobject_cleanup lib/kobject.c:705 [inline] kobject_release lib/kobject.c:736 [inline] kref_put include/linux/kref.h:65 [inline] kobject_put+0x139/0x410 lib/kobject.c:753 netdev_run_todo+0x659/0x930 net/core/dev.c:9973 default_device_exit_batch+0x2aa/0x360 net/core/dev.c:10946 cleanup_net+0x423/0x980 net/core/net_namespace.c:598 process_one_work+0x879/0x1410 kernel/workqueue.c:2307 worker_thread+0x5a0/0xf60 kernel/workqueue.c:2454 kthread+0x299/0x340 kernel/kthread.c:377 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:295