BUG: workqueue lockup (5)

BUG: workqueue lockup (5)
Status: upstream: reported C repro on 2020/01/14 22:04
Reported-by: syzbot+f0b66b520b54883d4b9d@syzkaller.appspotmail.com
First crash: 618d, last: 9d12h

Cause bisection: introduced by (bisect log) :
commit ebe02de2c60caa3ee5a1b39c7c8b2a40e1fda2d8
Author: Himanshu Jha <himanshujha199640@gmail.com>
Date: Tue Aug 29 13:12:27 2017 +0000

drm/amd/powerplay/hwmgr: Remove null check before kfree

Crash: WARNING in __x86_set_memory_region (log)
Repro: C syz .config

similar bugs (8):
Kernel	Title	Repro	Count	Last	Reported	Patched	Status
upstream	BUG: workqueue lockup (4)	C	47	672d	1078d	16/22	fixed on 2019/12/13 00:31
upstream	BUG: workqueue lockup (2)	C	406	1228d	1386d	6/22	fixed on 2018/05/13 10:02
linux-4.14	BUG: workqueue lockup	C	218	10d	874d	0/1	upstream: reported C repro on 2019/04/29 11:26
upstream	BUG: workqueue lockup	C	172	1409d	1419d	3/22	fixed on 2017/11/11 01:37
upstream	BUG: workqueue lockup (3)	C	1215	1172d	1225d	9/22	fixed on 2018/07/09 18:05
android-414	BUG: workqueue lockup	C	114	737d	893d	0/1	public: reported C repro on 2019/04/11 00:00
linux-4.19	BUG: workqueue lockup	C	24	1d12h	881d	0/1	upstream: reported C repro on 2019/04/22 20:37
android-49	BUG: workqueue lockup	C	69	661d	893d	0/3	public: reported C repro on 2019/04/11 08:44

Sample crash report:

BUG: workqueue lockup - pool cpus=0 node=0 flags=0x0 nice=0 stuck for 173s!
Showing busy workqueues and worker pools:
workqueue events: flags=0x0
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=12/256 refcnt=13
    in-flight: 8670:ipvlan_process_multicast
    pending: free_work, ovs_dp_masks_rebalance, delayed_fput, ipvlan_process_multicast, nsim_fib_event_work, free_obj_work, kfree_rcu_monitor, vmstat_shepherd, kfree_rcu_work, switchdev_deferred_process_work, rht_deferred_worker
workqueue events_long: flags=0x0
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=2/256 refcnt=3
    pending: defense_work_handler, br_multicast_gc_work
workqueue events_unbound: flags=0x2
  pwq 4: cpus=0-1 flags=0x4 nice=0 active=1/512 refcnt=4
    in-flight: 346:toggle_allocation_gate
workqueue events_power_efficient: flags=0x80
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=4/256 refcnt=5
    pending: fb_flashcursor, neigh_periodic_work, wg_ratelimiter_gc_entries, do_cache_clean
workqueue mm_percpu_wq: flags=0x8
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: vmstat_update
workqueue cgroup_destroy: flags=0x0
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/1 refcnt=4
    pending: css_release_work_fn
    delayed: css_release_work_fn, css_free_rwork_fn
workqueue dm_bufio_cache: flags=0x8
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: work_fn
workqueue mld: flags=0x40008
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/1 refcnt=25
    pending: mld_ifc_work
    delayed: mld_ifc_work, mld_ifc_work, mld_ifc_work, mld_dad_work, mld_ifc_work, mld_dad_work, mld_ifc_work, mld_ifc_work, mld_ifc_work, mld_ifc_work, mld_dad_work, mld_ifc_work, mld_dad_work, mld_ifc_work, mld_ifc_work, mld_ifc_work, mld_dad_work, mld_ifc_work, mld_dad_work, mld_dad_work, mld_dad_work, mld_dad_work, mld_dad_work
workqueue ipv6_addrconf: flags=0x40008
  pwq 2: cpus=1 node=0 flags=0x0 nice=0 active=1/1 refcnt=2
    in-flight: 8669:addrconf_dad_work
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/1 refcnt=44
    pending: addrconf_dad_work
    delayed: addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work, addrconf_dad_work
workqueue wg-kex-wg0: flags=0x24
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: wg_packet_handshake_receive_worker
workqueue wg-crypt-wg0: flags=0x28
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=3/256 refcnt=4
    pending: wg_packet_tx_worker, wg_packet_encrypt_worker, wg_packet_decrypt_worker
workqueue wg-kex-wg1: flags=0x24
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: wg_packet_handshake_receive_worker
workqueue wg-crypt-wg1: flags=0x28
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=3/256 refcnt=4
    pending: wg_packet_decrypt_worker, wg_packet_tx_worker, wg_packet_encrypt_worker
workqueue wg-kex-wg2: flags=0x24
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=1/256 refcnt=2
    pending: wg_packet_handshake_receive_worker
workqueue wg-crypt-wg2: flags=0x28
  pwq 0: cpus=0 node=0 flags=0x0 nice=0 active=2/256 refcnt=3
    pending: wg_packet_tx_worker, wg_packet_encrypt_worker
pool 0: cpus=0 node=0 flags=0x0 nice=0 hung=173s workers=3 idle: 8510 3170
pool 2: cpus=1 node=0 flags=0x0 nice=0 hung=0s workers=4 idle: 8659 8672 4576
pool 4: cpus=0-1 flags=0x4 nice=0 hung=0s workers=3 idle: 188 8613

Fix bisection attempts:
Manager	Time	Kernel	Commit	Syzkaller	Config	Log	Report	Syz repro	C repro
ci-upstream-kasan-gce-smack-root	2021/06/12 17:21	upstream	ad347abe4a98	917afeaa	.config	log	report	syz	C
ci-upstream-kasan-gce-smack-root	2021/04/01 05:34	upstream	d19cc4bfbff1	917afeaa	.config	log	report	syz	C
ci-upstream-kasan-gce-smack-root	2020/11/07 07:20	upstream	659caaf65dc9	917afeaa	.config	log	report	syz	C

Crashes (94):
Manager	Time	Kernel	Commit	Syzkaller	Config	Log	Report	Syz repro	C repro	VM info	Title
ci-upstream-kasan-gce-root	2021/08/01 16:22	upstream	f3438b4c4e69	6c236867	.config	log	report	syz	C		BUG: workqueue lockup
ci-upstream-kasan-gce-selinux-root	2021/07/15 08:52	upstream	8096acd7442e	b9a2f64e	.config	log	report	syz	C		BUG: workqueue lockup
ci-upstream-net-kasan-gce	2021/08/01 20:36	net-next	3e12361b6d23	6c236867	.config	log	report	syz	C		BUG: workqueue lockup
ci-upstream-linux-next-kasan-gce-root	2021/06/25 09:55	linux-next	a1f92694393a	0edbbe31	.config	log	report	syz	C		BUG: workqueue lockup
ci-upstream-kasan-gce-smack-root	2020/06/30 23:05	upstream	9ebcfadb0610	917afeaa	.config	log	report	syz	C
ci-upstream-kasan-gce-root	2020/05/28 09:58	upstream	b0c3ba31be3e	142a0957	.config	log	report	syz	C
ci-upstream-kasan-gce-root	2020/04/25 09:57	upstream	b4f633221f0a	03d97a1b	.config	log	report	syz	C
ci-upstream-kasan-gce-smack-root	2020/04/23 14:14	upstream	c578ddb39e56	2e44d63e	.config	log	report	syz	C
ci-upstream-kasan-gce-root	2020/04/20 11:02	upstream	0fe5f9ca2235	9f7c6d12	.config	log	report	syz	C
ci-upstream-kasan-gce-selinux-root	2020/04/11 07:30	upstream	ab6f762f0f53	a8c6a3f8	.config	log	report	syz	C
ci-upstream-kasan-gce-root	2020/03/30 06:09	upstream	e595dd94515e	05736b29	.config	log	report	syz	C
ci-upstream-kasan-gce-root	2020/03/21 03:54	upstream	6c90b86a745a	2c31c529	.config	log	report	syz	C
ci-upstream-kasan-gce-selinux-root	2020/03/18 10:52	upstream	ac309e7744be	97bc55ce	.config	log	report	syz	C
ci-upstream-kasan-gce-root	2020/03/15 15:46	upstream	d3dca69085e9	749688d2	.config	log	report	syz	C
ci-upstream-kasan-gce-smack-root	2020/03/15 02:29	upstream	69a4d0baeeb1	749688d2	.config	log	report	syz	C
ci-upstream-kasan-gce-selinux-root	2020/03/09 04:58	upstream	61a09258f2e5	2e9971bb	.config	log	report	syz	C
ci-upstream-kasan-gce-selinux-root	2020/03/08 11:08	upstream	c20037652700	2e9971bb	.config	log	report	syz	C
ci-upstream-kasan-gce-smack-root	2020/03/04 12:59	upstream	63623fd44972	c88c7b75	.config	log	report	syz	C
ci-upstream-kasan-gce-selinux-root	2020/02/16 00:48	upstream	829e69446995	5d7b90f1	.config	log	report	syz	C
ci-upstream-kasan-gce-smack-root	2020/02/13 10:03	upstream	f2850dd5ee01	84f4fc8a	.config	log	report	syz	C
ci-upstream-kasan-gce	2020/02/13 06:50	upstream	f2850dd5ee01	84f4fc8a	.config	log	report	syz	C
ci-upstream-kasan-gce	2020/02/09 19:08	upstream	fdfa3a6778b1	6ece2ea5	.config	log	report	syz	C
ci-upstream-kasan-gce-root	2020/01/11 06:19	upstream	e69ec487b2c7	4de4e9f0	.config	log	report	syz	C
ci-upstream-linux-next-kasan-gce-root	2020/05/11 04:15	linux-next	ac935d227366	8742a2b9	.config	log	report	syz	C
ci-upstream-linux-next-kasan-gce-root	2020/04/10 12:45	linux-next	0434e521ce3b	a8c6a3f8	.config	log	report	syz	C
ci-upstream-linux-next-kasan-gce-root	2020/03/31 08:39	linux-next	770fbb32d34e	c8d1cc20	.config	log	report	syz	C
ci2-upstream-usb	2020/03/23 03:12	https://github.com/google/kasan.git usb-fuzzer	e17994d1e7b1	78267cec	.config	log	report	syz	C
ci2-upstream-usb	2020/03/20 10:39	https://github.com/google/kasan.git usb-fuzzer	e17994d1e7b1	2c31c529	.config	log	report	syz	C
ci-qemu-upstream	2021/07/20 20:38	upstream	8cae8cd89f05	1b201b48	.config	log	report			info	BUG: workqueue lockup
ci-qemu-upstream	2021/07/16 21:12	upstream	d936eb238744	f115ae98	.config	log	report			info	BUG: workqueue lockup
ci-qemu-upstream	2021/06/14 01:18	upstream	009c9aa5be65	1ba81399	.config	log	report			info	BUG: workqueue lockup
ci-qemu-upstream	2021/05/13 16:53	upstream	c06a2ba62fc4	ecb594cb	.config	log	report			info	BUG: workqueue lockup
ci-qemu-upstream	2021/04/20 11:14	upstream	7af08140979a	c0ced557	.config	log	report			info	BUG: workqueue lockup
ci-qemu-upstream	2021/04/13 10:22	upstream	89698becf06d	bfeda1b1	.config	log	report			info	BUG: workqueue lockup
ci-qemu-upstream	2021/02/26 10:54	upstream	2c87f7a38f93	4c37c133	.config	log	report			info	BUG: workqueue lockup
ci-qemu-upstream	2021/02/02 23:07	upstream	3aaf0a27ffc2	624dad51	.config	log	report			info	BUG: workqueue lockup
ci-qemu-upstream	2021/02/02 16:13	upstream	88bb507a74ea	19e09687	.config	log	report			info	BUG: workqueue lockup
ci-qemu-upstream	2021/01/30 01:55	upstream	bec4c2968fce	fc9fd31e	.config	log	report			info	BUG: workqueue lockup
ci-qemu-upstream	2021/01/28 09:13	upstream	76c057c84d28	eefc07f2	.config	log	report			info	BUG: workqueue lockup
ci-qemu2-arm64-compat	2021/09/10 21:15	upstream	bf9f243f23e6	5ae8508a	.config	log	report			info	BUG: workqueue lockup
ci-qemu2-arm64-compat	2021/07/03 05:59	upstream	3dbdb38e2869	55aa55c2	.config	log	report			info	BUG: workqueue lockup
ci-qemu-upstream-386	2021/06/19 05:40	upstream	b1edae0d5f2e	aba2b2fb	.config	log	report			info	BUG: workqueue lockup
ci-qemu-upstream-386	2021/06/14 10:04	upstream	009c9aa5be65	1ba81399	.config	log	report			info	BUG: workqueue lockup
ci-qemu-upstream-386	2021/06/12 17:50	upstream	ad347abe4a98	1ba81399	.config	log	report			info	BUG: workqueue lockup
ci-qemu2-arm64-compat	2021/04/15 18:58	upstream	7f75285ca572	c59079a6	.config	log	report			info	BUG: workqueue lockup
ci-qemu-upstream-386	2021/02/02 18:45	upstream	88bb507a74ea	19e09687	.config	log	report			info	BUG: workqueue lockup
ci-qemu-upstream-386	2021/02/02 05:42	upstream	88bb507a74ea	e6b95f32	.config	log	report			info	BUG: workqueue lockup
ci-qemu-upstream-386	2021/02/01 00:33	upstream	6642d600b541	fc9fd31e	.config	log	report			info	BUG: workqueue lockup
ci-qemu-upstream-386	2021/01/30 18:07	upstream	0e9bcda5d286	fc9fd31e	.config	log	report			info	BUG: workqueue lockup
ci-upstream-net-this-kasan-gce	2021/08/21 00:46	net	a8f89fa27773	b599f2fc	.config	log	report			info	BUG: workqueue lockup
ci-upstream-bpf-kasan-gce	2021/07/07 20:39	bpf	af0efa050caa	4846d5c1	.config	log	report			info	BUG: workqueue lockup
ci-upstream-net-this-kasan-gce	2021/04/08 05:42	net	5219d6012d46	6a81331a	.config	log	report			info	BUG: workqueue lockup
ci-upstream-bpf-kasan-gce	2021/02/26 18:58	bpf	557c223b643a	4c37c133	.config	log	report			info	BUG: workqueue lockup
ci-upstream-linux-next-kasan-gce-root	2021/06/28 17:46	linux-next	a1f92694393a	9d2ab5df	.config	log	report			info	BUG: workqueue lockup
ci-upstream-kasan-gce	2021/01/17 02:30	upstream	0da0a8a0a0e1	65a7a854	.config	log	report			info
ci-upstream-kasan-gce	2021/01/16 01:20	upstream	5ee88057889b	65a7a854	.config	log	report			info
ci-upstream-kasan-gce	2020/12/27 03:51	upstream	f838f8d2b694	821e0b09	.config	log	report			info
ci-upstream-kasan-gce-root	2020/12/08 23:38	upstream	7d8761ba27fc	a7f7f4a4	.config	log	report			info
ci-qemu-upstream	2020/11/15 18:12	upstream	e28c0d7c92c8	1bf9a662	.config	log	report			info
ci-qemu-upstream	2020/09/07 18:30	upstream	fffe3ae0ee84	abf9ba4f	.config	log	report
ci-qemu-upstream	2020/08/24 17:00	upstream	fffe3ae0ee84	67b599d1	.config	log	report
ci-upstream-kasan-gce-smack-root	2020/07/24 03:38	upstream	d15be546031c	70c104a1	.config	log	report
ci-upstream-kasan-gce	2020/07/20 17:19	upstream	5714ee50bb43	4285ffa3	.config	log	report
ci-upstream-kasan-gce	2020/07/03 04:11	upstream	cd77006e01b3	bed10395	.config	log	report
ci-upstream-kasan-gce	2020/07/01 13:30	upstream	7c30b859a947	39acb39d	.config	log	report
ci-qemu-upstream-386	2020/08/01 10:22	upstream	7dc6fd0f3b84	d895b3be	.config	log	report
ci-upstream-kasan-gce-386	2020/07/28 12:28	upstream	92ed30191993	cb93dc6a	.config	log	report
ci-upstream-bpf-kasan-gce	2020/12/27 20:36	bpf	a61daaf351da	2242f77f	.config	log	report			info
ci-upstream-bpf-kasan-gce	2020/12/22 22:53	bpf	e7e518053c26	04201c06	.config	log	report			info
ci-upstream-bpf-kasan-gce	2020/09/30 03:56	bpf	9cf51446e686	5abc3f1a	.config	log	report			info
ci-upstream-bpf-next-kasan-gce	2021/01/12 02:23	bpf-next	e22d7f05e445	2c1f2513	.config	log	report			info
ci-upstream-bpf-next-kasan-gce	2020/12/15 14:55	bpf-next	0e12c0271887	97183ed7	.config	log	report			info
ci-upstream-bpf-next-kasan-gce	2020/12/03 11:12	bpf-next	97306be45fbe	e6b0d314	.config	log	report			info
ci-upstream-net-kasan-gce	2020/10/08 05:33	net-next	9faebeb2d800	1880b4a9	.config	log	report			info
ci-upstream-net-kasan-gce	2020/09/30 08:24	net-next	280095713ce2	5abc3f1a	.config	log	report			info
ci-upstream-net-kasan-gce	2020/09/29 02:05	net-next	bcbf1be0ad49	1b88c6d5	.config	log	report			info
ci-upstream-net-kasan-gce	2020/09/26 13:32	net-next	6fba737a9320	2d5ea0cb	.config	log	report			info
ci-upstream-net-kasan-gce	2020/09/24 10:14	net-next	1a26e88d534b	54289b08	.config	log	report			info
ci-upstream-net-kasan-gce	2020/09/23 15:11	net-next	748d1c8a425e	287cd75a	.config	log	report			info
ci-upstream-net-kasan-gce	2020/09/21 03:22	net-next	3cec0369905d	9564d2e9	.config	log	report			info
ci-upstream-net-kasan-gce	2020/09/16 04:19	net-next	0f9ad4e75944	18d7d030	.config	log	report			info
ci-upstream-net-kasan-gce	2020/09/15 09:43	net-next	ed6d9b022813	6989d6f6	.config	log	report			info
ci-upstream-linux-next-kasan-gce-root	2020/09/17 10:25	linux-next	5fa35f247b56	8247808b	.config	log	report			info