syzbot

 sign-in | mailing list | source | docs
🐞 Open [48] 🐞 Fixed [19] 🐞 Invalid [23] 📈 Kernel Health 📈 Bug Lifetimes 📈 Fuzzing 📈 Crashes 💬 Send us feedback

BUG: workqueue lockup

Status: premoderation: reported on 2022/11/29 19:20
Reported-by: syzbot+0f3c4c2b0b0923739a2d@syzkaller.appspotmail.com
First crash: 187d, last: 16d
▶ ▼ Similar bugs (14)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream BUG: workqueue lockup (4) block C 47 1295d 1702d 16/24 fixed on 2019/12/13 00:31
linux-5.15 BUG: workqueue lockup origin:upstream C 35 5d15h 86d 0/3 upstream: reported C repro on 2023/03/11 08:51
upstream BUG: workqueue lockup (2) C 406 1851d 2009d 6/24 fixed on 2018/05/13 10:02
linux-4.14 BUG: workqueue lockup C 282 96d 1498d 0/1 upstream: reported C repro on 2019/04/29 11:26
upstream BUG: workqueue lockup C 172 2032d 2043d 3/24 fixed on 2017/11/11 01:37
upstream BUG: workqueue lockup (5) C done 1000 36m 1237d 0/24 upstream: reported C repro on 2020/01/14 22:04
android-5-10 BUG: workqueue lockup (2) C error 42 12d 91d 0/2 upstream: reported C repro on 2023/03/05 21:10
upstream BUG: workqueue lockup (3) C 1215 1795d 1848d 9/24 fixed on 2018/07/09 18:05
android-6-1 BUG: workqueue lockup 1 18d 18d 0/2 premoderation: reported on 2023/05/17 23:30
android-414 BUG: workqueue lockup C 114 1360d 1516d 0/1 public: reported C repro on 2019/04/11 00:00
linux-4.19 BUG: workqueue lockup C error 41 90d 1504d 0/1 upstream: reported C repro on 2019/04/22 20:37
android-5-10 BUG: workqueue lockup C error 25 490d 588d 0/2 closed as invalid on 2022/02/22 17:18
android-49 BUG: workqueue lockup C 69 1284d 1516d 0/3 public: reported C repro on 2019/04/11 08:44
linux-6.1 BUG: workqueue lockup origin:upstream C 19 1d23h 89d 0/3 upstream: reported C repro on 2023/03/07 17:51

Sample crash report:
BUG: workqueue lockup - pool cpus=0 node=0 flags=0x0 nice=0 stuck for 252s!
Showing busy workqueues and worker pools:
workqueue events: flags=0x0
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=3/256 refcnt=4
    in-flight: 483:linkwatch_event
    pending: vmstat_shepherd, free_work
workqueue events_long: flags=0x0
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=8/256 refcnt=9
    pending: br_fdb_cleanup, br_fdb_cleanup, br_fdb_cleanup, br_fdb_cleanup, br_fdb_cleanup, br_fdb_cleanup, br_fdb_cleanup, br_fdb_cleanup
workqueue events_power_efficient: flags=0x80
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=2/256 refcnt=3
    in-flight: 6:check_lifetime
    pending: wg_ratelimiter_gc_entries
workqueue mm_percpu_wq: flags=0x8
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=2/256 refcnt=4
    pending: vmstat_update, lru_add_drain_per_cpu BAR(35)
workqueue writeback: flags=0x4a
  pwq 4: cpus=0-1 flags=0x4 nice=0 active=1/256 refcnt=3
    in-flight: 8:wb_workfn
workqueue ipv6_addrconf: flags=0x40008
  pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/1 refcnt=13
    in-flight: 7069:addrconf_dad_work
    inactive: addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/1 refcnt=20
    in-flight: 689:addrconf_dad_work
    inactive: addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_verify_work
workqueue wg-crypt-wg0: flags=0x28
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: wg_packet_encrypt_worker
workqueue wg-kex-wg0: flags=0x24
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: wg_packet_handshake_receive_worker
workqueue wg-crypt-wg0: flags=0x28
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=3/256 refcnt=4
    pending: wg_packet_encrypt_worker, wg_packet_tx_worker, wg_packet_decrypt_worker
workqueue wg-kex-wg1: flags=0x24
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: wg_packet_handshake_receive_worker
workqueue wg-crypt-wg1: flags=0x28
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=3/256 refcnt=4
    pending: wg_packet_encrypt_worker, wg_packet_decrypt_worker, wg_packet_tx_worker
workqueue wg-crypt-wg2: flags=0x28
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=2/256 refcnt=3
    pending: wg_packet_encrypt_worker, wg_packet_tx_worker
workqueue wg-crypt-wg0: flags=0x28
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=3/256 refcnt=4
    pending: wg_packet_encrypt_worker, wg_packet_tx_worker, wg_packet_decrypt_worker
workqueue wg-crypt-wg1: flags=0x28
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=3/256 refcnt=4
    pending: wg_packet_tx_worker, wg_packet_decrypt_worker, wg_packet_encrypt_worker
workqueue wg-kex-wg2: flags=0x24
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: wg_packet_handshake_receive_worker
workqueue wg-crypt-wg0: flags=0x28
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=3/256 refcnt=4
    pending: wg_packet_encrypt_worker, wg_packet_tx_worker, wg_packet_decrypt_worker
workqueue wg-crypt-wg2: flags=0x28
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=2/256 refcnt=3
    pending: wg_packet_tx_worker, wg_packet_encrypt_worker
workqueue wg-kex-wg1: flags=0x24
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: wg_packet_handshake_receive_worker
workqueue wg-crypt-wg1: flags=0x28
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=3/256 refcnt=4
    pending: wg_packet_decrypt_worker, wg_packet_tx_worker, wg_packet_encrypt_worker
workqueue wg-kex-wg2: flags=0x24
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: wg_packet_handshake_receive_worker
workqueue wg-crypt-wg2: flags=0x28
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=2/256 refcnt=3
    pending: wg_packet_encrypt_worker, wg_packet_tx_worker
workqueue wg-kex-wg0: flags=0x24
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: wg_packet_handshake_receive_worker
workqueue wg-crypt-wg0: flags=0x28
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=3/256 refcnt=4
    pending: wg_packet_encrypt_worker, wg_packet_tx_worker, wg_packet_decrypt_worker
workqueue wg-kex-wg1: flags=0x24
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: wg_packet_handshake_receive_worker
workqueue wg-crypt-wg1: flags=0x28
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=3/256 refcnt=4
    pending: wg_packet_tx_worker, wg_packet_decrypt_worker, wg_packet_encrypt_worker
workqueue wg-kex-wg2: flags=0x24
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: wg_packet_handshake_receive_worker
workqueue wg-crypt-wg2: flags=0x28
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=2/256 refcnt=3
    pending: wg_packet_encrypt_worker, wg_packet_tx_worker
workqueue wg-kex-wg0: flags=0x24
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: wg_packet_handshake_receive_worker
workqueue wg-crypt-wg0: flags=0x28
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=3/256 refcnt=4
    pending: wg_packet_encrypt_worker, wg_packet_tx_worker, wg_packet_decrypt_worker
workqueue wg-kex-wg1: flags=0x24
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: wg_packet_handshake_receive_worker
workqueue wg-crypt-wg1: flags=0x28
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=3/256 refcnt=4
    pending: wg_packet_tx_worker, wg_packet_encrypt_worker, wg_packet_decrypt_worker
workqueue wg-kex-wg2: flags=0x24
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: wg_packet_handshake_receive_worker
workqueue wg-crypt-wg2: flags=0x28
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=2/256 refcnt=3
    pending: wg_packet_tx_worker, wg_packet_encrypt_worker
workqueue wg-kex-wg0: flags=0x24
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: wg_packet_handshake_receive_worker
workqueue wg-crypt-wg0: flags=0x28
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=3/256 refcnt=4
    pending: wg_packet_encrypt_worker, wg_packet_tx_worker, wg_packet_decrypt_worker
workqueue wg-kex-wg1: flags=0x24
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: wg_packet_handshake_receive_worker
workqueue wg-crypt-wg1: flags=0x28
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=3/256 refcnt=4
    pending: wg_packet_tx_worker, wg_packet_decrypt_worker, wg_packet_encrypt_worker
workqueue wg-kex-wg2: flags=0x24
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: wg_packet_handshake_receive_worker
workqueue wg-crypt-wg2: flags=0x28
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=2/256 refcnt=3
    pending: wg_packet_encrypt_worker, wg_packet_tx_worker
pool 0: cpus=0 node=0 flags=0x0 nice=0 hung=252s workers=5 idle: 20 24828
pool 2: cpus=1 node=0 flags=0x0 nice=0 hung=0s workers=4 idle: 31532 506 6074
pool 4: cpus=0-1 flags=0x4 nice=0 hung=0s workers=4 idle: 13843 4105 4536

Crashes (53):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets Manager Title
2023/05/20 09:13 android13-5.15-lts 19c0ed55a470 96689200 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15 BUG: workqueue lockup
2023/05/01 17:36 android13-5.15-lts 6d40cb68a657 62df2017 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/04/30 16:36 android13-5.15-lts 6d40cb68a657 62df2017 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/04/03 05:52 android13-5.15-lts 7364b7abbafb 41147e3e .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/04/02 14:42 android13-5.15-lts 7364b7abbafb f325deb0 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15 BUG: workqueue lockup
2023/03/31 17:05 android13-5.15-lts 7364b7abbafb f325deb0 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/03/31 10:33 android13-5.15-lts 7364b7abbafb f325deb0 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/03/30 17:16 android13-5.15-lts 7364b7abbafb f325deb0 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/03/28 08:55 android13-5.15-lts fa7bbebb182b 47f3aaf1 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15 BUG: workqueue lockup
2023/03/26 00:12 android13-5.15-lts 5448b2fda85f fbf0499a .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15 BUG: workqueue lockup
2023/03/15 11:23 android13-5.15-lts 5448b2fda85f 18b58603 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/03/11 09:07 android13-5.15-lts 5448b2fda85f 5205ef30 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15 BUG: workqueue lockup
2023/03/01 16:06 android13-5.15-lts 5448b2fda85f ef65e6cb .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/02/22 18:30 android13-5.15-lts 5448b2fda85f 9f1e2cb3 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/02/20 05:05 android13-5.15-lts 5448b2fda85f bcdf85f8 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/02/15 21:09 android13-5.15-lts 5020746bff95 6be0f1f5 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/02/15 04:59 android13-5.15-lts 5020746bff95 e62ba3c1 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/02/14 15:52 android13-5.15-lts 5020746bff95 93ae7e0a .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/02/14 02:06 android13-5.15-lts 5020746bff95 93ae7e0a .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/02/14 01:01 android13-5.15-lts 5020746bff95 93ae7e0a .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/02/14 00:56 android13-5.15-lts 5020746bff95 93ae7e0a .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/02/12 23:04 android13-5.15-lts 5020746bff95 93e26d60 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/02/12 08:06 android13-5.15-lts 5020746bff95 93e26d60 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/02/12 02:44 android13-5.15-lts 5020746bff95 93e26d60 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/02/07 17:08 android13-5.15-lts 5020746bff95 5bc3be51 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/02/07 08:10 android13-5.15-lts 7e0097918ff8 5bc3be51 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/02/05 14:35 android13-5.15-lts 7e0097918ff8 be607b78 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/02/04 15:32 android13-5.15-lts 7e0097918ff8 be607b78 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/02/03 13:40 android13-5.15-lts 7e0097918ff8 1b2f701a .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/02/02 16:55 android13-5.15-lts cab35cbd710c 16d19e30 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/02/02 01:59 android13-5.15-lts 52cea9ba914f 9a6f477c .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/02/02 00:49 android13-5.15-lts 52cea9ba914f 9a6f477c .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/01/30 20:25 android13-5.15-lts d753150bdc01 b68fb8d6 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/01/30 12:47 android13-5.15-lts d753150bdc01 b68fb8d6 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15 BUG: workqueue lockup
2023/01/30 07:18 android13-5.15-lts d753150bdc01 9dfcf09c .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/01/30 00:14 android13-5.15-lts d753150bdc01 9dfcf09c .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/01/29 15:22 android13-5.15-lts d753150bdc01 9dfcf09c .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/01/29 06:20 android13-5.15-lts d753150bdc01 9dfcf09c .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/01/27 16:55 android13-5.15-lts d753150bdc01 9dfcf09c .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/01/27 05:34 android13-5.15-lts e66b45d52787 9dfcf09c .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/01/22 23:34 android13-5.15-lts 72d681a01da5 cc0f9968 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/01/21 07:29 android13-5.15-lts 72d681a01da5 cc0f9968 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/01/20 19:03 android13-5.15-lts 49ca4a597809 dd15ff29 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/01/15 14:56 android13-5.15-lts c73b4619ad86 a63719e7 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/01/09 13:47 android13-5.15-lts c73b4619ad86 1dac8c7a .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15 BUG: workqueue lockup
2023/01/09 03:35 android13-5.15-lts c73b4619ad86 1dac8c7a .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2023/01/07 07:06 android13-5.15-lts c73b4619ad86 1dac8c7a .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2022/12/28 15:29 android13-5.15-lts c73b4619ad86 44712fbc .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2022/12/19 12:42 android13-5.15-lts c73b4619ad86 05494336 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2022/12/18 03:57 android13-5.15-lts c73b4619ad86 05494336 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15-perf BUG: workqueue lockup
2022/11/29 19:19 android13-5.15-lts d9d889009b78 579a3740 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-15 BUG: workqueue lockup
* Struck through repros no longer work on HEAD.