ci2 starts bisection 2022-09-22 07:49:16.950589679 +0000 UTC m=+35042.890719539 bisecting fixing commit since 0974b8411a58cd5b4c7c3cfe28f4874c0b7267e7 building syzkaller on 3037caa999f22cdb40f1fa5c6b1b13e5d6af9781 testing commit 0974b8411a58cd5b4c7c3cfe28f4874c0b7267e7 gcc compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 1b18266156c7d14be4b71d1514ff48fd7f0bbd08d28d7d31916b2a4f714a055c run #0: OK run #1: crashed: BUG: workqueue lockup run #2: crashed: BUG: workqueue lockup run #3: crashed: BUG: workqueue lockup run #4: crashed: BUG: workqueue lockup run #5: crashed: BUG: workqueue lockup run #6: crashed: BUG: workqueue lockup run #7: crashed: BUG: workqueue lockup run #8: crashed: BUG: workqueue lockup run #9: crashed: BUG: workqueue lockup run #10: crashed: BUG: workqueue lockup run #11: crashed: BUG: workqueue lockup run #12: crashed: BUG: workqueue lockup run #13: crashed: BUG: workqueue lockup run #14: crashed: BUG: workqueue lockup run #15: OK run #16: OK run #17: OK run #18: OK run #19: OK testing current HEAD 59390358870abe8c36369f14ccb8a945026dd327 testing commit 59390358870abe8c36369f14ccb8a945026dd327 gcc compiler: gcc (GCC) 10.2.1 20210217, GNU ld (GNU Binutils for Debian) 2.35.2 kernel signature: 309e28d2c1b1bf0545abbbe732bc6770f5f76d1893322ecd5d81a54f82d2f55a run #0: crashed: BUG: workqueue lockup run #1: crashed: BUG: workqueue lockup run #2: crashed: BUG: workqueue lockup run #3: crashed: BUG: workqueue lockup run #4: crashed: BUG: workqueue lockup run #5: crashed: BUG: workqueue lockup run #6: crashed: BUG: workqueue lockup run #7: crashed: BUG: workqueue lockup run #8: crashed: BUG: workqueue lockup run #9: OK revisions tested: 2, total time: 28m31.836193816s (build: 9m55.588341105s, test: 17m17.032439667s) the crash still happens on HEAD commit msg: Merge 5.10.140 into android12-5.10-lts crash: BUG: workqueue lockup BUG: workqueue lockup - pool cpus=1 node=0 flags=0x0 nice=0 stuck for 234s! Showing busy workqueues and worker pools: workqueue events: flags=0x0 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=7/256 refcnt=8 pending: destroy_list_workfn , usb_gadget_state_work , free_work , usb_gadget_state_work, usb_gadget_state_work , usb_gadget_state_work, usb_gadget_state_work pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=4/256 refcnt=5 pending: usb_gadget_state_work, vmstat_shepherd , psi_avgs_work, free_work workqueue events_unbound: flags=0x2 pwq 4: cpus=0-1 flags=0x4 nice=0 active=5/512 refcnt=7 in-flight: 10:fsnotify_mark_destroy_workfn fsnotify_mark_destroy_workfn, 465:fsnotify_connector_destroy_workfn fsnotify_connector_destroy_workfn , 473:toggle_allocation_gate workqueue events_power_efficient: flags=0x80 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=2/256 refcnt=3 pending: wg_ratelimiter_gc_entries , neigh_periodic_work pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: neigh_periodic_work workqueue rcu_gp: flags=0x8 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: process_srcu workqueue mm_percpu_wq: flags=0x8 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: vmstat_update pending: vmstat_update workqueue usb_hub_wq: flags=0x4 active=8/256 refcnt=9 in-flight: 445:hub_event , hub_event, hub_event, hub_event active=2/256 refcnt=3 in-flight: 439:hub_event hub_event pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: work_fn workqueue ipv6_addrconf: flags=0x40008 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/1 refcnt=15 pending: addrconf_dad_work delayed: addrconf_dad_work, addrconf_dad_work workqueue wg-kex-wg0: flags=0x24 pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker workqueue wg-crypt-wg0: flags=0x28 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=2/256 refcnt=3 pending: wg_packet_encrypt_worker, wg_packet_tx_worker pending: wg_packet_handshake_receive_worker workqueue wg-crypt-wg0: flags=0x28 pending: wg_packet_encrypt_worker, wg_packet_tx_worker node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=3/256 refcnt=4 workqueue wg-kex-wg2: flags=0x24 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker workqueue wg-crypt-wg2: flags=0x28 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=3/256 refcnt=4 pending: wg_packet_encrypt_worker, wg_packet_tx_worker , wg_packet_decrypt_worker pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_encrypt_worker workqueue wg-kex-wg0: flags=0x24 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker workqueue wg-crypt-wg0: flags=0x28 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=2/256 refcnt=3 pending: wg_packet_encrypt_worker, wg_packet_tx_worker workqueue wg-kex-wg1: flags=0x24 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker workqueue wg-crypt-wg1: flags=0x28 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=3/256 refcnt=4 pending: wg_packet_encrypt_worker, wg_packet_tx_worker, wg_packet_decrypt_worker workqueue wg-kex-wg2: flags=0x24 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker workqueue wg-crypt-wg2: flags=0x28 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=3/256 refcnt=4 pending: wg_packet_encrypt_worker, wg_packet_tx_worker, wg_packet_decrypt_worker workqueue wg-kex-wg0: flags=0x24 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker workqueue wg-crypt-wg0: flags=0x28 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=2/256 refcnt=3 pending: wg_packet_tx_worker, wg_packet_encrypt_worker workqueue wg-crypt-wg1: flags=0x28 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=3/256 refcnt=4 pending: wg_packet_encrypt_worker, wg_packet_tx_worker, wg_packet_decrypt_worker workqueue wg-kex-wg1: flags=0x24 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker workqueue wg-crypt-wg1: flags=0x28 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=3/256 refcnt=4 pending: wg_packet_encrypt_worker, wg_packet_tx_worker, wg_packet_decrypt_worker workqueue wg-kex-wg2: flags=0x24 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker workqueue wg-crypt-wg2: flags=0x28 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=3/256 refcnt=4 pending: wg_packet_encrypt_worker, wg_packet_tx_worker, wg_packet_decrypt_worker workqueue wg-kex-wg2: flags=0x24 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker workqueue wg-crypt-wg2: flags=0x28 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=3/256 refcnt=4 pending: wg_packet_encrypt_worker, wg_packet_tx_worker, wg_packet_decrypt_worker pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_encrypt_worker workqueue wg-kex-wg0: flags=0x24 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker workqueue wg-crypt-wg0: flags=0x28 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=2/256 refcnt=3 pending: wg_packet_tx_worker, wg_packet_encrypt_worker workqueue wg-kex-wg0: flags=0x24 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker workqueue wg-crypt-wg0: flags=0x28 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=2/256 refcnt=3 pending: wg_packet_encrypt_worker, wg_packet_tx_worker workqueue wg-kex-wg1: flags=0x24 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker workqueue wg-crypt-wg1: flags=0x28 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=3/256 refcnt=4 pending: wg_packet_encrypt_worker, wg_packet_decrypt_worker , wg_packet_tx_worker workqueue wg-kex-wg1: flags=0x24 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker workqueue wg-crypt-wg1: flags=0x28 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=3/256 refcnt=4 pending: wg_packet_encrypt_worker, wg_packet_tx_worker, wg_packet_decrypt_worker workqueue wg-kex-wg2: flags=0x24 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker workqueue wg-crypt-wg2: flags=0x28 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=3/256 refcnt=4 pending: wg_packet_encrypt_worker, wg_packet_tx_worker , wg_packet_decrypt_worker workqueue wg-kex-wg2: flags=0x24 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2 pending: wg_packet_handshake_receive_worker workqueue wg-crypt-wg2: flags=0x28 pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=3/256 refcnt=4 pending: wg_packet_encrypt_worker, wg_packet_tx_worker , wg_packet_decrypt_worker pool 0: cpus=0 node=0 flags=0x0 nice=0 hung=42s workers=6 idle: 377 109 727 58 5 pool 2: cpus=1 node=0 flags=0x0 nice=0 hung=234s workers=8 idle: 25 20 371 450 382 pool 4: cpus=0-1 flags=0x4 nice=0 hung=0s workers=5 idle: 104 7