syzbot


INFO: task hung in blk_queue_enter

Status: fixed on 2018/07/09 18:05
Subsystems: block
[Documentation on labels]
Reported-by: syzbot+c4f9cebf9d651f6e54de@syzkaller.appspotmail.com
Fix commit: cd4a4ae4683d block: don't use blocking queue entered for recursive bio submits
First crash: 2191d, last: 2117d
Discussions (2)
Title Replies (including bot) Last reply
[PATCH 4.17 000/101] 4.17.9-stable review 100 (101) 2018/07/22 11:42
INFO: task hung in blk_queue_enter 24 (25) 2018/06/07 13:19
Similar bugs (4)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
linux-4.19 INFO: task hung in blk_queue_enter 1 535d 535d 0/1 auto-obsoleted due to no activity on 2023/03/08 06:36
android-414 INFO: task hung in blk_queue_enter 1 1966d 1839d 0/1 auto-closed as invalid on 2019/06/06 06:07
android-49 INFO: task hung in blk_queue_enter 1 1954d 1839d 0/3 auto-closed as invalid on 2019/06/18 00:11
upstream INFO: task hung in blk_queue_enter (2) block 2 259d 260d 0/26 auto-obsoleted due to no activity on 2023/11/09 05:10

Sample crash report:
INFO: task syz-executor467:4507 blocked for more than 120 seconds.
      Not tainted 4.17.0-rc4+ #39
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
syz-executor467 D15848  4507   4502 0x00000000
Call Trace:
 context_switch kernel/sched/core.c:2848 [inline]
 __schedule+0x801/0x1e30 kernel/sched/core.c:3490
 schedule+0xef/0x430 kernel/sched/core.c:3549
 blk_queue_enter+0x8da/0xdf0 block/blk-core.c:953
 generic_make_request+0x144/0x1510 block/blk-core.c:2395
 blk_queue_split+0x374/0x2090 block/blk-merge.c:215
 blk_mq_make_request+0x2d0/0x25c0 block/blk-mq.c:1861
 generic_make_request+0x795/0x1510 block/blk-core.c:2460
 submit_bio+0xba/0x460 block/blk-core.c:2568
 mpage_bio_submit fs/mpage.c:66 [inline]
 mpage_readpages+0x6d7/0x970 fs/mpage.c:393
 blkdev_readpages+0x2c/0x40 fs/block_dev.c:577
 read_pages mm/readahead.c:121 [inline]
 __do_page_cache_readahead+0x79a/0xdc0 mm/readahead.c:199
 ra_submit mm/internal.h:66 [inline]
 ondemand_readahead+0x550/0xc40 mm/readahead.c:478
 page_cache_sync_readahead+0xd1/0x110 mm/readahead.c:510
 generic_file_buffered_read mm/filemap.c:2092 [inline]
 generic_file_read_iter+0x1a74/0x2f00 mm/filemap.c:2362
 blkdev_read_iter+0x120/0x190 fs/block_dev.c:1930
 call_read_iter include/linux/fs.h:1778 [inline]
 generic_file_splice_read+0x552/0x910 fs/splice.c:307
 do_splice_to+0x12e/0x190 fs/splice.c:880
 splice_direct_to_actor+0x268/0x8d0 fs/splice.c:952
 do_splice_direct+0x2cc/0x400 fs/splice.c:1061
 do_sendfile+0x60f/0xe00 fs/read_write.c:1440
 __do_sys_sendfile64 fs/read_write.c:1495 [inline]
 __se_sys_sendfile64 fs/read_write.c:1487 [inline]
 __x64_sys_sendfile64+0x155/0x240 fs/read_write.c:1487
 do_syscall_64+0x1b1/0x800 arch/x86/entry/common.c:287
 entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x4493e9
RSP: 002b:00007f797bbf3da8 EFLAGS: 00000293 ORIG_RAX: 0000000000000028
RAX: ffffffffffffffda RBX: 00000000006dac3c RCX: 00000000004493e9
RDX: 0000000020000240 RSI: 0000000000000003 RDI: 0000000000000003
RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000
R10: 0020000102000007 R11: 0000000000000293 R12: 00000000006dac38
R13: 6f6f6c2f7665642f R14: 0020000102000007 R15: 0000000000000008

Showing all locks held in the system:
2 locks held by khungtaskd/892:
 #0: 00000000a17c7b71 (rcu_read_lock){....}, at: check_hung_uninterruptible_tasks kernel/hung_task.c:175 [inline]
 #0: 00000000a17c7b71 (rcu_read_lock){....}, at: watchdog+0x1ff/0xf60 kernel/hung_task.c:249
 #1: 00000000e4d61928 (tasklist_lock){.+.+}, at: debug_show_all_locks+0xde/0x34a kernel/locking/lockdep.c:4470
2 locks held by getty/4477:
 #0: 000000005e94c04d (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x37/0x40 drivers/tty/tty_ldsem.c:365
 #1: 00000000e390507c (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x321/0x1cc0 drivers/tty/n_tty.c:2131
2 locks held by getty/4478:
 #0: 00000000cff31727 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x37/0x40 drivers/tty/tty_ldsem.c:365
 #1: 0000000056d3de1e (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x321/0x1cc0 drivers/tty/n_tty.c:2131
2 locks held by getty/4479:
 #0: 00000000639bec5d (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x37/0x40 drivers/tty/tty_ldsem.c:365
 #1: 00000000e2655391 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x321/0x1cc0 drivers/tty/n_tty.c:2131
2 locks held by getty/4480:
 #0: 0000000035846f68 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x37/0x40 drivers/tty/tty_ldsem.c:365
 #1: 00000000945d2479 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x321/0x1cc0 drivers/tty/n_tty.c:2131
2 locks held by getty/4481:
 #0: 00000000e2adb7df (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x37/0x40 drivers/tty/tty_ldsem.c:365
 #1: 000000003e8c10b1 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x321/0x1cc0 drivers/tty/n_tty.c:2131
2 locks held by getty/4482:
 #0: 0000000092744a17 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x37/0x40 drivers/tty/tty_ldsem.c:365
 #1: 0000000088f89dd8 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x321/0x1cc0 drivers/tty/n_tty.c:2131
2 locks held by getty/4483:
 #0: 000000008472d87f (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x37/0x40 drivers/tty/tty_ldsem.c:365
 #1: 00000000babf978d (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x321/0x1cc0 drivers/tty/n_tty.c:2131
1 lock held by syz-executor467/4505:
 #0: 000000001dd8ac7f (&lo->lo_ctl_mutex/1){+.+.}, at: lo_ioctl+0x8d/0x2130 drivers/block/loop.c:1391
1 lock held by syz-executor467/4511:
 #0: 000000001dd8ac7f (&lo->lo_ctl_mutex/1){+.+.}, at: lo_ioctl+0x8d/0x2130 drivers/block/loop.c:1391
1 lock held by syz-executor467/4514:
 #0: 000000001dd8ac7f (&lo->lo_ctl_mutex/1){+.+.}, at: lo_ioctl+0x8d/0x2130 drivers/block/loop.c:1391
1 lock held by syz-executor467/4515:
 #0: 000000001dd8ac7f (&lo->lo_ctl_mutex/1){+.+.}, at: lo_ioctl+0x8d/0x2130 drivers/block/loop.c:1391
1 lock held by syz-executor467/4517:
 #0: 000000001dd8ac7f (&lo->lo_ctl_mutex/1){+.+.}, at: lo_ioctl+0x8d/0x2130 drivers/block/loop.c:1391
1 lock held by syz-executor467/4518:
 #0: 000000001dd8ac7f (&lo->lo_ctl_mutex/1){+.+.}, at: lo_ioctl+0x8d/0x2130 drivers/block/loop.c:1391
1 lock held by syz-executor467/4520:
 #0: 000000001dd8ac7f (&lo->lo_ctl_mutex/1){+.+.}, at: lo_ioctl+0x8d/0x2130 drivers/block/loop.c:1391
1 lock held by syz-executor467/4521:
 #0: 000000001dd8ac7f (&lo->lo_ctl_mutex/1){+.+.}, at: lo_ioctl+0x8d/0x2130 drivers/block/loop.c:1391
1 lock held by syz-executor467/4523:
 #0: 000000001dd8ac7f (&lo->lo_ctl_mutex/1){+.+.}, at: lo_ioctl+0x8d/0x2130 drivers/block/loop.c:1391
1 lock held by syz-executor467/4524:
 #0: 000000001dd8ac7f (&lo->lo_ctl_mutex/1){+.+.}, at: lo_ioctl+0x8d/0x2130 drivers/block/loop.c:1391
1 lock held by syz-executor467/5371:
 #0: 000000001dd8ac7f (&lo->lo_ctl_mutex/1){+.+.}, at: lo_ioctl+0x8d/0x2130 drivers/block/loop.c:1391
1 lock held by blkid/5374:
 #0: 000000001dd8ac7f (&lo->lo_ctl_mutex/1){+.+.}, at: lo_ioctl+0x8d/0x2130 drivers/block/loop.c:1391

=============================================

NMI backtrace for cpu 0
CPU: 0 PID: 892 Comm: khungtaskd Not tainted 4.17.0-rc4+ #39
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Call Trace:
 __dump_stack lib/dump_stack.c:77 [inline]
 dump_stack+0x1b9/0x294 lib/dump_stack.c:113
 nmi_cpu_backtrace.cold.4+0x19/0xce lib/nmi_backtrace.c:103
 nmi_trigger_cpumask_backtrace+0x151/0x192 lib/nmi_backtrace.c:62
 arch_trigger_cpumask_backtrace+0x14/0x20 arch/x86/kernel/apic/hw_nmi.c:38
 trigger_all_cpu_backtrace include/linux/nmi.h:138 [inline]
 check_hung_task kernel/hung_task.c:132 [inline]
 check_hung_uninterruptible_tasks kernel/hung_task.c:190 [inline]
 watchdog+0xc10/0xf60 kernel/hung_task.c:249
 kthread+0x345/0x410 kernel/kthread.c:238
 ret_from_fork+0x3a/0x50 arch/x86/entry/entry_64.S:412
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 4504 Comm: syz-executor467 Not tainted 4.17.0-rc4+ #39
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
RIP: 0010:debug_lockdep_rcu_enabled+0x53/0x90 kernel/rcu/update.c:300
RSP: 0018:ffff8801ac9e7908 EFLAGS: 00000802
RAX: dffffc0000000000 RBX: 1ffff1003593cf28 RCX: 0000000000000000
RDX: 1ffffffff1213998 RSI: 0000000000000000 RDI: ffffffff8909ccc0
RBP: ffff8801ac9e7908 R08: 0000000000000000 R09: 0000000000000000
R10: ffffed0035cd2618 R11: ffff8801ae6930c3 R12: 0000000000000000
R13: 0000000000000002 R14: 0000000000000000 R15: 0000000000000000
FS:  00000000019e6880(0000) GS:ffff8801daf00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000001d97000 CR3: 00000001aca17000 CR4: 00000000001406e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 trace_lock_acquire include/trace/events/lock.h:13 [inline]
 lock_acquire+0x3f9/0x520 kernel/locking/lockdep.c:3919
 rcu_lock_acquire include/linux/rcupdate.h:246 [inline]
 rcu_read_lock include/linux/rcupdate.h:632 [inline]
 __fget+0xf5/0x650 fs/file.c:684
 __fget_light+0x342/0x430 fs/file.c:741
 __fdget fs/file.c:749 [inline]
 __fdget_pos+0x6e/0x1e0 fs/file.c:760
 fdget_pos include/linux/file.h:67 [inline]
 ksys_write+0x77/0x250 fs/read_write.c:593
 __do_sys_write fs/read_write.c:610 [inline]
 __se_sys_write fs/read_write.c:607 [inline]
 __x64_sys_write+0x73/0xb0 fs/read_write.c:607
 do_syscall_64+0x1b1/0x800 arch/x86/entry/common.c:287
 entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x4493e9
RSP: 002b:00007ffcc9c13198 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
RAX: ffffffffffffffda RBX: 00000000004002e0 RCX: 00000000004493e9
RDX: 0000000000000012 RSI: 00000000004adebd RDI: 0000000000000001
RBP: 00000000006d9018 R08: 00000000004002e0 R09: 00000000004002e0
R10: 00000000004002e0 R11: 0000000000000202 R12: 0000000000406ec0
R13: 0000000000406f50 R14: 0000000000000000 R15: 0000000000000000
Code: 03 38 d0 7c 04 84 d2 75 4c 8b 15 19 3d 18 08 85 d2 74 3e 48 c7 c7 c0 cc 09 89 48 b8 00 00 00 00 00 fc ff df 48 89 fa 48 c1 ea 03 <0f> b6 14 02 48 89 f8 83 e0 07 83 c0 03 38 d0 7c 04 84 d2 75 1c 

Crashes (1595):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2018/05/09 02:08 upstream 036db8bd9637 b88872ba .config console log report syz C ci-upstream-kasan-gce
2018/04/29 10:57 upstream cdface520934 d5a5d045 .config console log report syz C ci-upstream-kasan-gce-root
2018/04/27 22:54 upstream d8a332730e75 7785e404 .config console log report syz C ci-upstream-kasan-gce
2018/06/08 06:48 upstream 68abbe729567 f7b27b7a .config console log report ci-upstream-kasan-gce-root
2018/06/08 01:46 upstream 1c8c5a9d38f6 645e75f8 .config console log report ci-upstream-kasan-gce
2018/06/08 00:19 upstream 1c8c5a9d38f6 645e75f8 .config console log report ci-upstream-kasan-gce-root
2018/06/06 16:46 upstream af6c5d5e01ad 41f9540d .config console log report ci-upstream-kasan-gce
2018/06/06 15:12 upstream af6c5d5e01ad 41f9540d .config console log report ci-upstream-kasan-gce
2018/06/06 07:52 upstream 5037be168f0e 863a24bb .config console log report ci-upstream-kasan-gce
2018/06/06 05:09 upstream 5037be168f0e 863a24bb .config console log report ci-upstream-kasan-gce
2018/06/06 03:07 upstream 5037be168f0e 863a24bb .config console log report ci-upstream-kasan-gce-root
2018/06/05 15:32 upstream 716a685fdb89 a316ff92 .config console log report ci-upstream-kasan-gce-root
2018/06/05 09:46 upstream 716a685fdb89 a316ff92 .config console log report ci-upstream-kasan-gce
2018/06/04 21:26 upstream 910470e03f34 a50d873b .config console log report ci-upstream-kasan-gce-root
2018/06/04 19:38 upstream 29dcea88779c 6cbe7c26 .config console log report ci-upstream-kasan-gce-root
2018/06/04 08:39 upstream 29dcea88779c 6cbe7c26 .config console log report ci-upstream-kasan-gce
2018/06/03 23:36 upstream 325e14f97e0c 2f93b54f .config console log report ci-upstream-kasan-gce
2018/06/03 15:19 upstream 918fe1b31579 2f93b54f .config console log report ci-upstream-kasan-gce-root
2018/06/03 08:45 upstream 918fe1b31579 2f93b54f .config console log report ci-upstream-kasan-gce
2018/04/27 09:02 upstream 0644f186fc9d 73417389 .config console log report ci-upstream-kasan-gce
2018/06/08 00:21 upstream 1c8c5a9d38f6 645e75f8 .config console log report ci-upstream-kasan-gce-386
2018/06/04 11:54 upstream 29dcea88779c 6cbe7c26 .config console log report ci-upstream-kasan-gce-386
2018/06/04 10:47 upstream 29dcea88779c 6cbe7c26 .config console log report ci-upstream-kasan-gce-386
2018/06/04 01:17 upstream 325e14f97e0c 2f93b54f .config console log report ci-upstream-kasan-gce-386
2018/06/03 19:28 upstream 918fe1b31579 2f93b54f .config console log report ci-upstream-kasan-gce-386
2018/07/09 16:32 https://github.com/google/kmsan.git master a00de5aa4da3 f25e5770 .config console log report ci-upstream-kmsan-gce
2018/07/09 13:40 https://github.com/google/kmsan.git master a00de5aa4da3 f25e5770 .config console log report ci-upstream-kmsan-gce
2018/07/09 12:17 https://github.com/google/kmsan.git master a00de5aa4da3 f25e5770 .config console log report ci-upstream-kmsan-gce
2018/07/08 22:12 https://github.com/google/kmsan.git master a00de5aa4da3 f25e5770 .config console log report ci-upstream-kmsan-gce
2018/07/08 15:54 https://github.com/google/kmsan.git master a00de5aa4da3 c9a7a4dc .config console log report ci-upstream-kmsan-gce
2018/07/08 14:23 https://github.com/google/kmsan.git master a00de5aa4da3 c9a7a4dc .config console log report ci-upstream-kmsan-gce
2018/07/08 11:03 https://github.com/google/kmsan.git master a00de5aa4da3 c9a7a4dc .config console log report ci-upstream-kmsan-gce
2018/07/08 08:30 https://github.com/google/kmsan.git master a00de5aa4da3 c9a7a4dc .config console log report ci-upstream-kmsan-gce
2018/07/08 05:34 https://github.com/google/kmsan.git master a00de5aa4da3 c9a7a4dc .config console log report ci-upstream-kmsan-gce
2018/07/08 04:28 https://github.com/google/kmsan.git master a00de5aa4da3 c9a7a4dc .config console log report ci-upstream-kmsan-gce
2018/07/08 04:03 https://github.com/google/kmsan.git master a00de5aa4da3 c9a7a4dc .config console log report ci-upstream-kmsan-gce
2018/07/07 22:45 https://github.com/google/kmsan.git master a00de5aa4da3 ab89aea9 .config console log report ci-upstream-kmsan-gce
2018/07/07 17:51 https://github.com/google/kmsan.git master a00de5aa4da3 ab89aea9 .config console log report ci-upstream-kmsan-gce
2018/07/07 13:06 https://github.com/google/kmsan.git master a00de5aa4da3 6c0c0099 .config console log report ci-upstream-kmsan-gce
2018/07/07 10:28 https://github.com/google/kmsan.git master a00de5aa4da3 6c0c0099 .config console log report ci-upstream-kmsan-gce
2018/07/06 17:14 https://github.com/google/kmsan.git master a00de5aa4da3 9636bc93 .config console log report ci-upstream-kmsan-gce
2018/07/06 15:00 https://github.com/google/kmsan.git master a00de5aa4da3 9636bc93 .config console log report ci-upstream-kmsan-gce
2018/07/06 10:52 https://github.com/google/kmsan.git master 9c9df9f275f0 18403e65 .config console log report ci-upstream-kmsan-gce
2018/07/06 09:15 https://github.com/google/kmsan.git master 9c9df9f275f0 18403e65 .config console log report ci-upstream-kmsan-gce
2018/07/05 21:54 https://github.com/google/kmsan.git master 86eb85c04833 d3b2a0e2 .config console log report ci-upstream-kmsan-gce
2018/07/05 19:03 https://github.com/google/kmsan.git master 86eb85c04833 d3b2a0e2 .config console log report ci-upstream-kmsan-gce
2018/07/05 17:42 https://github.com/google/kmsan.git master 86eb85c04833 d3b2a0e2 .config console log report ci-upstream-kmsan-gce
* Struck through repros no longer work on HEAD.