bisecting cause commit starting from 8903263671cb22bc33545eb7cbd68c875bb87e95 building syzkaller on bc238812ae6d1f5a7e99ff60b5b3089a73f1cfb3 testing commit 8903263671cb22bc33545eb7cbd68c875bb87e95 with gcc (GCC) 8.1.0 kernel signature: 3f15b4174e701118e1816270416d9a03c76df0c9de55bc54e1eafed5cf59bcf7 all runs: crashed: WARNING in kthread_queue_work testing release v5.7 testing commit 3d77e6a8804abcc0504c904bd6e5cdf3a5cf8162 with gcc (GCC) 8.1.0 kernel signature: 219970a8e7ba7dff21bb1bf5440aaaf610190b92171b766fa139566a0aacfcc3 all runs: OK # git bisect start 8903263671cb22bc33545eb7cbd68c875bb87e95 3d77e6a8804abcc0504c904bd6e5cdf3a5cf8162 Bisecting: 11518 revisions left to test after this (roughly 14 steps) [3b69e8b4571125bec1f77f886174fe6cab6b9d75] Merge tag 'sh-for-5.8' of git://git.libc.org/linux-sh testing commit 3b69e8b4571125bec1f77f886174fe6cab6b9d75 with gcc (GCC) 8.1.0 kernel signature: d8e1a9e6cc5519c198e2d1041e6c61af58be823380d4b3a9de8156af6c049c68 all runs: basic kernel testing failed: BUG: using smp_processor_id() in preemptible code in ext4_mb_new_blocks # git bisect skip 3b69e8b4571125bec1f77f886174fe6cab6b9d75 Bisecting: 11518 revisions left to test after this (roughly 14 steps) [342ed2400b78072cc01c0130ce41240dec60d56d] workqueue: Remove unnecessary kfree() call in rcu_free_wq() testing commit 342ed2400b78072cc01c0130ce41240dec60d56d with gcc (GCC) 8.1.0 kernel signature: ca3defb28a79e353e264e39a063ffb01cdc539ed84257cf49860390b1af7d4b9 all runs: OK # git bisect good 342ed2400b78072cc01c0130ce41240dec60d56d Bisecting: 11518 revisions left to test after this (roughly 14 steps) [234ef0d085b353798583d758f983bc49943c6fcf] btrfs: make insert_reserved_file_extent take btrfs_inode testing commit 234ef0d085b353798583d758f983bc49943c6fcf with gcc (GCC) 8.1.0 kernel signature: c64a3cab7e1afc7dbfe3fd8f1d76b3447205d26b996ace8c734674fca4aa3f84 all runs: OK # git bisect good 234ef0d085b353798583d758f983bc49943c6fcf Bisecting: 3572 revisions left to test after this (roughly 12 steps) [8344b918c68afb44575ac387600e29b22f426bbb] Merge remote-tracking branch 'crypto/master' testing commit 8344b918c68afb44575ac387600e29b22f426bbb with gcc (GCC) 8.1.0 kernel signature: 5aa8431ef3325b215d4c57a52c73ee71279dbc6df1363a7d153b43c6012f2ddb all runs: OK # git bisect good 8344b918c68afb44575ac387600e29b22f426bbb Bisecting: 1777 revisions left to test after this (roughly 11 steps) [3b4036f7fdca4f6139ee41e18dc8ca9b0d26a37c] Merge remote-tracking branch 'regulator/for-next' testing commit 3b4036f7fdca4f6139ee41e18dc8ca9b0d26a37c with gcc (GCC) 8.1.0 kernel signature: ee0b8d780ad7981821763c8e662ce6e1b688a7095d9d00c6618cde79d0c86d46 all runs: OK # git bisect good 3b4036f7fdca4f6139ee41e18dc8ca9b0d26a37c Bisecting: 881 revisions left to test after this (roughly 10 steps) [6564efb0a3f904acf5fced3bbebfc822db2ee3c8] Merge remote-tracking branch 'thunderbolt/next' testing commit 6564efb0a3f904acf5fced3bbebfc822db2ee3c8 with gcc (GCC) 8.1.0 kernel signature: 4163d25a43a0a21fb02184aa36d983ee1486590fe0c14a6e29afc5c405f45e8d all runs: OK # git bisect good 6564efb0a3f904acf5fced3bbebfc822db2ee3c8 Bisecting: 447 revisions left to test after this (roughly 9 steps) [ecc9fe7f91c5c2f97e5fdb71c54cde032cbe11c5] Merge remote-tracking branch 'nvdimm/libnvdimm-for-next' testing commit ecc9fe7f91c5c2f97e5fdb71c54cde032cbe11c5 with gcc (GCC) 8.1.0 kernel signature: b377b19b00757aa864277ca69a4283ba4c07d704456fc672617eb657197ce4ae all runs: OK # git bisect good ecc9fe7f91c5c2f97e5fdb71c54cde032cbe11c5 Bisecting: 236 revisions left to test after this (roughly 8 steps) [6de62f5629875029fbd8d79d7fa9c45e8dbea966] kcov: make some symbols static testing commit 6de62f5629875029fbd8d79d7fa9c45e8dbea966 with gcc (GCC) 8.1.0 kernel signature: 3271d901f4a486e9681b6d3d264b1c2ca52e014b130d7f025b1a4084de496d73 all runs: crashed: WARNING in kthread_queue_work # git bisect bad 6de62f5629875029fbd8d79d7fa9c45e8dbea966 Bisecting: 105 revisions left to test after this (roughly 7 steps) [04a9470bc6dd705d0969705287b40c699eabeb14] kasan: update documentation for generic kasan testing commit 04a9470bc6dd705d0969705287b40c699eabeb14 with gcc (GCC) 8.1.0 kernel signature: 2f796f73384f2f6a05621ab49991a71545de6c1cb4f88da57bf916e78b65a413 all runs: crashed: WARNING in kthread_queue_work # git bisect bad 04a9470bc6dd705d0969705287b40c699eabeb14 Bisecting: 51 revisions left to test after this (roughly 6 steps) [0210a0c941caeb33f4554f4eb606f5c374ce530c] mm: slub: implement SLUB version of obj_to_index() testing commit 0210a0c941caeb33f4554f4eb606f5c374ce530c with gcc (GCC) 8.1.0 kernel signature: e04aae06125e0a2b438408816d716b7b23e38367d21a27ead19f47ba2e337fc5 run #0: crashed: WARNING in kthread_queue_work run #1: crashed: WARNING in kthread_queue_work run #2: crashed: WARNING in kthread_queue_work run #3: crashed: WARNING in kthread_queue_work run #4: crashed: WARNING in kthread_queue_work run #5: crashed: WARNING in kthread_queue_work run #6: crashed: WARNING in kthread_queue_work run #7: crashed: WARNING in kthread_queue_work run #8: crashed: WARNING in kthread_queue_work run #9: boot failed: can't ssh into the instance # git bisect bad 0210a0c941caeb33f4554f4eb606f5c374ce530c Bisecting: 25 revisions left to test after this (roughly 5 steps) [e8b94086cf8e35e94219f79a14f135ecb66d18ab] mm, slab: check GFP_SLAB_BUG_MASK before alloc_pages in kmalloc_order testing commit e8b94086cf8e35e94219f79a14f135ecb66d18ab with gcc (GCC) 8.1.0 kernel signature: f54fbe9382bd8afff8612dbdcc3acf11b3b9668abfb5d5749b47fb7c51224bb1 all runs: crashed: WARNING in kthread_queue_work # git bisect bad e8b94086cf8e35e94219f79a14f135ecb66d18ab Bisecting: 13 revisions left to test after this (roughly 4 steps) [394bd7db0a8e962f2f7ef9b8968504be273c59f7] scripts/decode_stacktrace.sh: skip missing symbols testing commit 394bd7db0a8e962f2f7ef9b8968504be273c59f7 with gcc (GCC) 8.1.0 kernel signature: f36aeef185c76a1387a7d3f73fa154b6200f4410a6ebde8250982f34e34d2060 all runs: crashed: WARNING in kthread_queue_work # git bisect bad 394bd7db0a8e962f2f7ef9b8968504be273c59f7 Bisecting: 5 revisions left to test after this (roughly 3 steps) [9db1764ebf5ba5dc41feacf82d637878baa24611] lib/test_kasan.c testing commit 9db1764ebf5ba5dc41feacf82d637878baa24611 with gcc (GCC) 8.1.0 kernel signature: 0b9d1019988aaeb6e03e83d423988152d083191f33fb450ab25c2453aba2ed1c all runs: OK # git bisect good 9db1764ebf5ba5dc41feacf82d637878baa24611 Bisecting: 2 revisions left to test after this (roughly 2 steps) [86a0f0d734f022f7024735a5c546346236f0027a] scripts/tags.sh: collect compiled source precisely testing commit 86a0f0d734f022f7024735a5c546346236f0027a with gcc (GCC) 8.1.0 kernel signature: 2cbe67a85d1f7b45a009575fa3803fcacbb0860708bc63ca87f26845fe15416d all runs: crashed: WARNING in kthread_queue_work # git bisect bad 86a0f0d734f022f7024735a5c546346236f0027a Bisecting: 0 revisions left to test after this (roughly 1 step) [4977caef05aa154f5e45a232fc4f0e1c74a0c739] kthread: work could not be queued when worker being destroyed testing commit 4977caef05aa154f5e45a232fc4f0e1c74a0c739 with gcc (GCC) 8.1.0 kernel signature: 3d75e05eb2e226ca6151a0adf1c1682bc80addcc890dbf0a811f6f2299407aac run #0: crashed: WARNING in kthread_queue_work run #1: crashed: WARNING in kthread_queue_work run #2: crashed: WARNING in kthread_queue_work run #3: crashed: WARNING in kthread_queue_work run #4: crashed: WARNING in kthread_queue_work run #5: crashed: WARNING in kthread_queue_work run #6: crashed: WARNING in kthread_queue_work run #7: boot failed: can't ssh into the instance run #8: boot failed: can't ssh into the instance run #9: boot failed: can't ssh into the instance # git bisect bad 4977caef05aa154f5e45a232fc4f0e1c74a0c739 Bisecting: 0 revisions left to test after this (roughly 0 steps) [f78b6c215220fd67722d7c1eb853c8ac328d0c98] checkpatch: test $GIT_DIR changes testing commit f78b6c215220fd67722d7c1eb853c8ac328d0c98 with gcc (GCC) 8.1.0 kernel signature: 8d94b601f611da2c2d2d104a9e3383905b04b04e16f34de802ef718d250c69db run #0: OK run #1: OK run #2: boot failed: can't ssh into the instance run #3: OK run #4: OK run #5: OK run #6: OK run #7: OK run #8: OK run #9: OK # git bisect good f78b6c215220fd67722d7c1eb853c8ac328d0c98 4977caef05aa154f5e45a232fc4f0e1c74a0c739 is the first bad commit commit 4977caef05aa154f5e45a232fc4f0e1c74a0c739 Author: Zhang Qiang Date: Tue Jul 7 12:29:47 2020 +1000 kthread: work could not be queued when worker being destroyed The "queuing_blocked" func should print warning message and returns true when the worker being destroyed. Before the work is put into the queue of the worker thread, the state of the worker thread needs to be detected,because the worker thread may be in the destruction state at this time. Link: http://lkml.kernel.org/r/20200705013018.7375-1-qiang.zhang@windriver.com Link: http://lkml.kernel.org/r/20200702070156.5862-1-qiang.zhang@windriver.com Signed-off-by: Zhang Qiang Suggested-by: Petr Mladek Reviewed-by: Petr Mladek Cc: Tejun Heo Cc: Ben Dooks (Codethink) Cc: J. Bruce Fields Cc: Liang Chen Cc: Peter Zijlstra (Intel) Signed-off-by: Andrew Morton Signed-off-by: Stephen Rothwell kernel/kthread.c | 3 +++ 1 file changed, 3 insertions(+) culprit signature: 3d75e05eb2e226ca6151a0adf1c1682bc80addcc890dbf0a811f6f2299407aac parent signature: 8d94b601f611da2c2d2d104a9e3383905b04b04e16f34de802ef718d250c69db revisions tested: 18, total time: 3h50m50.321569531s (build: 1h28m37.540401672s, test: 2h19m16.117357369s) first bad commit: 4977caef05aa154f5e45a232fc4f0e1c74a0c739 kthread: work could not be queued when worker being destroyed cc: ["akpm@linux-foundation.org" "pmladek@suse.com" "qiang.zhang@windriver.com" "sfr@canb.auug.org.au"] crash: WARNING in kthread_queue_work ------------[ cut here ]------------ WARNING: CPU: 1 PID: 8202 at kernel/kthread.c:817 queuing_blocked kernel/kthread.c:817 [inline] WARNING: CPU: 1 PID: 8202 at kernel/kthread.c:817 kthread_queue_work+0x8a/0xa0 kernel/kthread.c:864 Kernel panic - not syncing: panic_on_warn set ... CPU: 1 PID: 8202 Comm: systemd-udevd Not tainted 5.8.0-rc4-syzkaller #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011 Call Trace: __dump_stack lib/dump_stack.c:77 [inline] dump_stack+0xb3/0xec lib/dump_stack.c:118 panic+0x115/0x2fa kernel/panic.c:231 __warn.cold.13+0x20/0x25 kernel/panic.c:600 report_bug+0xc0/0xf0 lib/bug.c:198 handle_bug+0x35/0x90 arch/x86/kernel/traps.c:235 exc_invalid_op+0x13/0x60 arch/x86/kernel/traps.c:255 asm_exc_invalid_op+0x12/0x20 arch/x86/include/asm/idtentry.h:542 RIP: 0010:queuing_blocked kernel/kthread.c:817 [inline] RIP: 0010:kthread_queue_work+0x8a/0xa0 kernel/kthread.c:864 Code: 89 df e8 c9 f7 ff ff 41 bd 01 00 00 00 eb cb 48 8d 7b 20 be ff ff ff ff e8 b3 87 e0 01 85 c0 75 a6 0f 0b 48 83 7b 68 00 75 a4 <0f> 0b 45 31 ed eb a9 0f 1f 44 00 00 66 2e 0f 1f 84 00 00 00 00 00 RSP: 0018:ffffc90002cd7998 EFLAGS: 00010046 RAX: 0000000000000001 RBX: ffff888219fff158 RCX: 0000000000000001 RDX: ffff8881105ba100 RSI: ffff888219fff178 RDI: 0000000000000082 RBP: ffff8881291ce128 R08: 000000000007b760 R09: 0000000000000001 R10: 00000000ffffffff R11: 456f7c38c93683af R12: ffff888219fff160 R13: 0000000000000000 R14: 0000000000000282 R15: ffff88812a1c4380 loop_queue_rq+0x15d/0x1a0 drivers/block/loop.c:2026 blk_mq_dispatch_rq_list+0xc6/0x6b0 block/blk-mq.c:1277 blk_mq_do_dispatch_sched+0x10c/0x150 block/blk-mq-sched.c:134 __blk_mq_sched_dispatch_requests+0xf7/0x150 block/blk-mq-sched.c:250 blk_mq_sched_dispatch_requests+0x2b/0x50 block/blk-mq-sched.c:276 __blk_mq_run_hw_queue+0x68/0x110 block/blk-mq.c:1418 __blk_mq_delay_run_hw_queue+0x1a7/0x1e0 block/blk-mq.c:1495 blk_mq_run_hw_queue+0x81/0xd0 block/blk-mq.c:1548 blk_mq_sched_insert_requests+0xea/0x2b0 block/blk-mq-sched.c:530 blk_mq_flush_plug_list+0x14c/0x2c0 block/blk-mq.c:1817 blk_flush_plug_list+0xcc/0xf0 block/blk-core.c:1859 blk_finish_plug+0x1c/0x29 block/blk-core.c:1876 read_pages+0x17b/0x3f0 mm/readahead.c:150 page_cache_readahead_unbounded+0x159/0x280 mm/readahead.c:244 generic_file_buffered_read+0x45d/0x6c0 mm/filemap.c:2033 call_read_iter include/linux/fs.h:1901 [inline] new_sync_read+0x10c/0x190 fs/read_write.c:415 vfs_read+0x9a/0x180 fs/read_write.c:462 ksys_read+0x5a/0xd0 fs/read_write.c:588 do_syscall_64+0x60/0xe0 arch/x86/entry/common.c:384 entry_SYSCALL_64_after_hwframe+0x44/0xa9 RIP: 0033:0x7f0cef070210 Code: Bad RIP value. RSP: 002b:00007ffc7d127728 EFLAGS: 00000246 ORIG_RAX: 0000000000000000 RAX: ffffffffffffffda RBX: 000055fd45bdf520 RCX: 00007f0cef070210 RDX: 0000000000000400 RSI: 000055fd45bdf548 RDI: 000000000000000f RBP: 000055fd45bf3c80 R08: 00007f0cef05af88 R09: 0000000000000430 R10: 000000000000006d R11: 0000000000000246 R12: 0000000000000000 R13: 0000000000000400 R14: 000055fd45bf3cd0 R15: 0000000000000400 Shutting down cpus with NMI Kernel Offset: disabled Rebooting in 86400 seconds..