syzbot


INFO: task hung in del_gendisk (4)

Status: auto-obsoleted due to no activity on 2024/05/18 00:16
Subsystems: block
[Documentation on labels]
First crash: 364d, last: 345d
Similar bugs (4)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: task hung in del_gendisk block C done 5 1263d 1296d 20/28 fixed on 2021/11/10 00:50
upstream INFO: task hung in del_gendisk (3) block 4 517d 566d 0/28 auto-obsoleted due to no activity on 2023/11/27 17:59
upstream INFO: task hung in del_gendisk (2) block 56 1162d 1163d 0/28 closed as dup on 2021/11/21 13:57
upstream INFO: task can't die in blk_mq_freeze_queue_wait block 221 1161d 1169d 20/28 fixed on 2022/03/08 16:11

Sample crash report:
INFO: task kworker/0:4:4880 blocked for more than 143 seconds.
      Not tainted 6.8.0-rc3-syzkaller-00061-ga9c83252bff6 #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
task:kworker/0:4     state:D stack:22288 pid:4880  tgid:4880  ppid:2      flags:0x00004000
Workqueue: usb_hub_wq hub_event
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5400 [inline]
 __schedule+0xca8/0x3100 kernel/sched/core.c:6727
 __schedule_loop kernel/sched/core.c:6802 [inline]
 schedule+0xe9/0x270 kernel/sched/core.c:6817
 schedule_preempt_disabled+0x13/0x20 kernel/sched/core.c:6874
 __mutex_lock_common kernel/locking/mutex.c:684 [inline]
 __mutex_lock+0x5b9/0x9d0 kernel/locking/mutex.c:752
 del_gendisk+0x2af/0xb10 block/genhd.c:673
 sd_remove+0x8f/0x150 drivers/scsi/sd.c:3782
 device_remove drivers/base/dd.c:569 [inline]
 device_remove+0x11f/0x170 drivers/base/dd.c:561
 __device_release_driver drivers/base/dd.c:1272 [inline]
 device_release_driver_internal+0x44a/0x610 drivers/base/dd.c:1295
 bus_remove_device+0x22c/0x420 drivers/base/bus.c:574
 device_del+0x39a/0xa50 drivers/base/core.c:3814
 __scsi_remove_device+0x30c/0x3f0 drivers/scsi/scsi_sysfs.c:1489
 scsi_forget_host+0x138/0x190 drivers/scsi/scsi_scan.c:2004
 scsi_remove_host+0x153/0x430 drivers/scsi/hosts.c:181
 quiesce_and_remove_host drivers/usb/storage/usb.c:855 [inline]
 usb_stor_disconnect+0x121/0x270 drivers/usb/storage/usb.c:1075
 usb_unbind_interface+0x1e5/0x960 drivers/usb/core/driver.c:461
 device_remove drivers/base/dd.c:569 [inline]
 device_remove+0x11f/0x170 drivers/base/dd.c:561
 __device_release_driver drivers/base/dd.c:1272 [inline]
 device_release_driver_internal+0x44a/0x610 drivers/base/dd.c:1295
 bus_remove_device+0x22c/0x420 drivers/base/bus.c:574
 device_del+0x39a/0xa50 drivers/base/core.c:3814
 usb_disable_device+0x36c/0x7f0 drivers/usb/core/message.c:1416
 usb_disconnect+0x2e1/0x910 drivers/usb/core/hub.c:2296
 hub_port_connect drivers/usb/core/hub.c:5352 [inline]
 hub_port_connect_change drivers/usb/core/hub.c:5652 [inline]
 port_event drivers/usb/core/hub.c:5812 [inline]
 hub_event+0x1be0/0x4f40 drivers/usb/core/hub.c:5894
 process_one_work+0x886/0x15d0 kernel/workqueue.c:2633
 process_scheduled_works kernel/workqueue.c:2706 [inline]
 worker_thread+0x8b9/0x1290 kernel/workqueue.c:2787
 kthread+0x2c6/0x3a0 kernel/kthread.c:388
 ret_from_fork+0x45/0x80 arch/x86/kernel/process.c:147
 ret_from_fork_asm+0x11/0x20 arch/x86/entry/entry_64.S:242
 </TASK>
INFO: task scsi_id:7304 blocked for more than 143 seconds.
      Not tainted 6.8.0-rc3-syzkaller-00061-ga9c83252bff6 #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
task:scsi_id         state:D stack:25984 pid:7304  tgid:7304  ppid:7223   flags:0x00004002
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5400 [inline]
 __schedule+0xca8/0x3100 kernel/sched/core.c:6727
 __schedule_loop kernel/sched/core.c:6802 [inline]
 schedule+0xe9/0x270 kernel/sched/core.c:6817
 blk_queue_enter+0x39e/0x610 block/blk-core.c:328
 blk_mq_alloc_request+0x43e/0x880 block/blk-mq.c:596
 scsi_alloc_request drivers/scsi/scsi_lib.c:1136 [inline]
 scsi_execute_cmd+0x12b/0x770 drivers/scsi/scsi_lib.c:217
 ioctl_internal_command.constprop.0+0xe6/0x3e0 drivers/scsi/scsi_ioctl.c:79
 scsi_set_medium_removal+0x12d/0x1e0 drivers/scsi/scsi_ioctl.c:139
 sd_release+0x10b/0x130 drivers/scsi/sd.c:1463
 blkdev_put_whole+0xa5/0xe0 block/bdev.c:671
 bdev_release+0x509/0xa80 block/bdev.c:985
 blkdev_release+0x37/0x50 block/fops.c:631
 __fput+0x270/0xb70 fs/file_table.c:376
 __fput_sync+0x47/0x50 fs/file_table.c:461
 __do_sys_close fs/open.c:1554 [inline]
 __se_sys_close fs/open.c:1539 [inline]
 __x64_sys_close+0x87/0xf0 fs/open.c:1539
 do_syscall_x64 arch/x86/entry/common.c:52 [inline]
 do_syscall_64+0xd3/0x250 arch/x86/entry/common.c:83
 entry_SYSCALL_64_after_hwframe+0x63/0x6b
RIP: 0033:0x7fc97a3850a8
RSP: 002b:00007ffc7a079aa8 EFLAGS: 00000246 ORIG_RAX: 0000000000000003
RAX: ffffffffffffffda RBX: 00007ffc7a079cb4 RCX: 00007fc97a3850a8
RDX: 0000000700000000 RSI: 0000000000000007 RDI: 0000000000000003
RBP: 0000000000000003 R08: 0000000000000000 R09: 00007ffc7a079478
R10: 000055c58dee991a R11: 0000000000000246 R12: 00000000ffffffff
R13: 0000000000000810 R14: 00007ffc7a07a498 R15: 00007fc97a7cda80
 </TASK>

Showing all locks held in the system:
6 locks held by kworker/0:1/9:
 #0: ffff888106aa6138 ((wq_completion)usb_hub_wq){+.+.}-{0:0}, at: process_one_work+0x789/0x15d0 kernel/workqueue.c:2608
 #1: ffffc9000009fd80 ((work_completion)(&hub->events)){+.+.}-{0:0}, at: process_one_work+0x7eb/0x15d0 kernel/workqueue.c:2609
 #2: ffff88810abaf190 (&dev->mutex){....}-{3:3}, at: device_lock include/linux/device.h:990 [inline]
 #2: ffff88810abaf190 (&dev->mutex){....}-{3:3}, at: hub_event+0x1be/0x4f40 drivers/usb/core/hub.c:5840
 #3: ffff8881032e7190 (&dev->mutex){....}-{3:3}, at: device_lock include/linux/device.h:990 [inline]
 #3: ffff8881032e7190 (&dev->mutex){....}-{3:3}, at: __device_attach+0x7f/0x4b0 drivers/base/dd.c:1005
 #4: ffff888113d2d160 (&dev->mutex){....}-{3:3}, at: device_lock include/linux/device.h:990 [inline]
 #4: ffff888113d2d160 (&dev->mutex){....}-{3:3}, at: __device_attach+0x7f/0x4b0 drivers/base/dd.c:1005
 #5: ffff888100f13e38 (hcd->bandwidth_mutex){+.+.}-{3:3}, at: usb_set_interface+0x29b/0xea0 drivers/usb/core/message.c:1561
6 locks held by kworker/1:1/28:
 #0: ffff888106aa6138 ((wq_completion)usb_hub_wq){+.+.}-{0:0}, at: process_one_work+0x789/0x15d0 kernel/workqueue.c:2608
 #1: ffffc900001e7d80 ((work_completion)(&hub->events)){+.+.}-{0:0}, at: process_one_work+0x7eb/0x15d0 kernel/workqueue.c:2609
 #2: ffff88810affc190 (&dev->mutex){....}-{3:3}, at: device_lock include/linux/device.h:990 [inline]
 #2: ffff88810affc190 (&dev->mutex){....}-{3:3}, at: hub_event+0x1be/0x4f40 drivers/usb/core/hub.c:5840
 #3: ffff8881093b5508 (&port_dev->status_lock){+.+.}-{3:3}, at: usb_lock_port drivers/usb/core/hub.c:3198 [inline]
 #3: ffff8881093b5508 (&port_dev->status_lock){+.+.}-{3:3}, at: hub_port_connect drivers/usb/core/hub.c:5409 [inline]
 #3: ffff8881093b5508 (&port_dev->status_lock){+.+.}-{3:3}, at: hub_port_connect_change drivers/usb/core/hub.c:5652 [inline]
 #3: ffff8881093b5508 (&port_dev->status_lock){+.+.}-{3:3}, at: port_event drivers/usb/core/hub.c:5812 [inline]
 #3: ffff8881093b5508 (&port_dev->status_lock){+.+.}-{3:3}, at: hub_event+0x28b4/0x4f40 drivers/usb/core/hub.c:5894
 #4: ffff888108b59e38 (hcd->address0_mutex){+.+.}-{3:3}, at: hub_port_connect drivers/usb/core/hub.c:5410 [inline]
 #4: ffff888108b59e38 (hcd->address0_mutex){+.+.}-{3:3}, at: hub_port_connect_change drivers/usb/core/hub.c:5652 [inline]
 #4: ffff888108b59e38 (hcd->address0_mutex){+.+.}-{3:3}, at: port_event drivers/usb/core/hub.c:5812 [inline]
 #4: ffff888108b59e38 (hcd->address0_mutex){+.+.}-{3:3}, at: hub_event+0x28da/0x4f40 drivers/usb/core/hub.c:5894
 #5: ffffffff888fa430 (ehci_cf_port_reset_rwsem){.+.+}-{3:3}, at: hub_port_reset+0x1a7/0x1e50 drivers/usb/core/hub.c:3013
1 lock held by khungtaskd/29:
 #0: ffffffff87eadb60 (rcu_read_lock){....}-{1:2}, at: rcu_lock_acquire include/linux/rcupdate.h:298 [inline]
 #0: ffffffff87eadb60 (rcu_read_lock){....}-{1:2}, at: rcu_read_lock include/linux/rcupdate.h:750 [inline]
 #0: ffffffff87eadb60 (rcu_read_lock){....}-{1:2}, at: debug_show_all_locks+0x75/0x340 kernel/locking/lockdep.c:6614
2 locks held by getty/2449:
 #0: ffff8881110e10a0 (&tty->ldisc_sem){++++}-{0:0}, at: tty_ldisc_ref_wait+0x24/0x80 drivers/tty/tty_ldisc.c:243
 #1: ffffc900000432f0 (&ldata->atomic_read_lock){+.+.}-{3:3}, at: n_tty_read+0xfc6/0x1490 drivers/tty/n_tty.c:2201
5 locks held by kworker/1:4/4830:
 #0: ffff888106aa6138 ((wq_completion)usb_hub_wq){+.+.}-{0:0}, at: process_one_work+0x789/0x15d0 kernel/workqueue.c:2608
 #1: ffffc9000a707d80 ((work_completion)(&hub->events)){+.+.}-{0:0}, at: process_one_work+0x7eb/0x15d0 kernel/workqueue.c:2609
 #2: ffff88810abfc190 (&dev->mutex){....}-{3:3}, at: device_lock include/linux/device.h:990 [inline]
 #2: ffff88810abfc190 (&dev->mutex){....}-{3:3}, at: hub_event+0x1be/0x4f40 drivers/usb/core/hub.c:5840
 #3: ffff88810abff508 (&port_dev->status_lock){+.+.}-{3:3}, at: usb_lock_port drivers/usb/core/hub.c:3198 [inline]
 #3: ffff88810abff508 (&port_dev->status_lock){+.+.}-{3:3}, at: hub_port_connect drivers/usb/core/hub.c:5409 [inline]
 #3: ffff88810abff508 (&port_dev->status_lock){+.+.}-{3:3}, at: hub_port_connect_change drivers/usb/core/hub.c:5652 [inline]
 #3: ffff88810abff508 (&port_dev->status_lock){+.+.}-{3:3}, at: port_event drivers/usb/core/hub.c:5812 [inline]
 #3: ffff88810abff508 (&port_dev->status_lock){+.+.}-{3:3}, at: hub_event+0x28b4/0x4f40 drivers/usb/core/hub.c:5894
 #4: ffff88810936b4a8 (hcd->address0_mutex){+.+.}-{3:3}, at: hub_port_connect drivers/usb/core/hub.c:5410 [inline]
 #4: ffff88810936b4a8 (hcd->address0_mutex){+.+.}-{3:3}, at: hub_port_connect_change drivers/usb/core/hub.c:5652 [inline]
 #4: ffff88810936b4a8 (hcd->address0_mutex){+.+.}-{3:3}, at: port_event drivers/usb/core/hub.c:5812 [inline]
 #4: ffff88810936b4a8 (hcd->address0_mutex){+.+.}-{3:3}, at: hub_event+0x28da/0x4f40 drivers/usb/core/hub.c:5894
8 locks held by kworker/0:4/4880:
 #0: ffff888106aa6138 ((wq_completion)usb_hub_wq){+.+.}-{0:0}, at: process_one_work+0x789/0x15d0 kernel/workqueue.c:2608
 #1: ffffc9000b15fd80 ((work_completion)(&hub->events)){+.+.}-{0:0}, at: process_one_work+0x7eb/0x15d0 kernel/workqueue.c:2609
 #2: ffff8881093b2190 (&dev->mutex){....}-{3:3}, at: device_lock include/linux/device.h:990 [inline]
 #2: ffff8881093b2190 (&dev->mutex){....}-{3:3}, at: hub_event+0x1be/0x4f40 drivers/usb/core/hub.c:5840
 #3: ffff8881066d2190 (&dev->mutex){....}-{3:3}, at: device_lock include/linux/device.h:990 [inline]
 #3: ffff8881066d2190 (&dev->mutex){....}-{3:3}, at: usb_disconnect+0x10a/0x910 drivers/usb/core/hub.c:2287
 #4: ffff888115a75160 (&dev->mutex){....}-{3:3}, at: device_lock include/linux/device.h:990 [inline]
 #4: ffff888115a75160 (&dev->mutex){....}-{3:3}, at: __device_driver_lock drivers/base/dd.c:1095 [inline]
 #4: ffff888115a75160 (&dev->mutex){....}-{3:3}, at: device_release_driver_internal+0xa4/0x610 drivers/base/dd.c:1292
 #5: ffff8881119680e0 (&shost->scan_mutex){+.+.}-{3:3}, at: scsi_remove_host+0x2c/0x430 drivers/scsi/hosts.c:169
 #6: ffff8881197fe370 (&dev->mutex){....}-{3:3}, at: device_lock include/linux/device.h:990 [inline]
 #6: ffff8881197fe370 (&dev->mutex){....}-{3:3}, at: __device_driver_lock drivers/base/dd.c:1095 [inline]
 #6: ffff8881197fe370 (&dev->mutex){....}-{3:3}, at: device_release_driver_internal+0xa4/0x610 drivers/base/dd.c:1292
 #7: ffff88811eacc358 (&disk->open_mutex){+.+.}-{3:3}, at: del_gendisk+0x2af/0xb10 block/genhd.c:673
3 locks held by kworker/0:5/4995:
 #0: ffff888100088d38 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0x789/0x15d0 kernel/workqueue.c:2608
 #1: ffffc9000b14fd80 ((work_completion)(&fw_work->work)){+.+.}-{0:0}, at: process_one_work+0x7eb/0x15d0 kernel/workqueue.c:2609
 #2: ffff88810affc190 (&dev->mutex){....}-{3:3}, at: device_lock include/linux/device.h:990 [inline]
 #2: ffff88810affc190 (&dev->mutex){....}-{3:3}, at: ath9k_hif_usb_firmware_fail drivers/net/wireless/ath/ath9k/hif_usb.c:1163 [inline]
 #2: ffff88810affc190 (&dev->mutex){....}-{3:3}, at: ath9k_hif_usb_firmware_cb+0x3b1/0x620 drivers/net/wireless/ath/ath9k/hif_usb.c:1296
1 lock held by scsi_id/7304:
 #0: ffff88811eacc358 (&disk->open_mutex){+.+.}-{3:3}, at: bdev_release+0xcd/0xa80 block/bdev.c:969
3 locks held by kworker/0:0/8451:

=============================================

NMI backtrace for cpu 0
CPU: 0 PID: 29 Comm: khungtaskd Not tainted 6.8.0-rc3-syzkaller-00061-ga9c83252bff6 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/25/2024
Call Trace:
 <TASK>
 __dump_stack lib/dump_stack.c:88 [inline]
 dump_stack_lvl+0xd9/0x1b0 lib/dump_stack.c:106
 nmi_cpu_backtrace+0x277/0x390 lib/nmi_backtrace.c:113
 nmi_trigger_cpumask_backtrace+0x299/0x300 lib/nmi_backtrace.c:62
 trigger_all_cpu_backtrace include/linux/nmi.h:160 [inline]
 check_hung_uninterruptible_tasks kernel/hung_task.c:222 [inline]
 watchdog+0xf87/0x1210 kernel/hung_task.c:379
 kthread+0x2c6/0x3a0 kernel/kthread.c:388
 ret_from_fork+0x45/0x80 arch/x86/kernel/process.c:147
 ret_from_fork_asm+0x11/0x20 arch/x86/entry/entry_64.S:242
 </TASK>
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 2354 Comm: jbd2/sda1-8 Not tainted 6.8.0-rc3-syzkaller-00061-ga9c83252bff6 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/25/2024
RIP: 0010:rdtsc_ordered arch/x86/include/asm/msr.h:215 [inline]
RIP: 0010:read_tsc+0xc/0x20 arch/x86/kernel/tsc.c:1130
Code: 1e fa e8 87 ca 42 00 8b 05 91 df 2a 08 c3 f3 0f 1e fa e9 77 ca 42 00 0f 1f 80 00 00 00 00 f3 0f 1e fa e8 67 ca 42 00 0f 01 f9 <66> 90 48 c1 e2 20 48 09 d0 c3 66 2e 0f 1f 84 00 00 00 00 00 f3 0f
RSP: 0018:ffffc900049bf508 EFLAGS: 00000293
RAX: 00000000d89075b2 RBX: 0000000000017f82 RCX: 0000000000000001
RDX: 0000000000000105 RSI: ffffffff810b12a9 RDI: ffffffff87cddbe0
RBP: 0000000000017f82 R08: 0000000000000005 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000000 R12: ffffffff87cddbe0
R13: dffffc0000000000 R14: 0000000000000000 R15: ffffc900049bf700
FS:  0000000000000000(0000) GS:ffff8881f6700000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fdea6b800c0 CR3: 00000001138f5000 CR4: 00000000003506f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <NMI>
 </NMI>
 <TASK>
 tk_clock_read kernel/time/timekeeping.c:195 [inline]
 timekeeping_get_delta kernel/time/timekeeping.c:255 [inline]
 timekeeping_get_ns kernel/time/timekeeping.c:388 [inline]
 ktime_get+0x1a8/0x490 kernel/time/timekeeping.c:848
 ktime_get_ns include/linux/timekeeping.h:155 [inline]
 blk_mq_rq_time_init block/blk-mq.c:335 [inline]
 __blk_mq_alloc_requests+0x1120/0x16a0 block/blk-mq.c:517
 blk_mq_get_new_requests block/blk-mq.c:2905 [inline]
 blk_mq_submit_bio+0x5a3/0x2010 block/blk-mq.c:3001
 __submit_bio+0x7d/0x230 block/blk-core.c:608
 __submit_bio_noacct_mq block/blk-core.c:687 [inline]
 submit_bio_noacct_nocheck+0x847/0xba0 block/blk-core.c:716
 submit_bio_noacct+0x306/0x1090 block/blk-core.c:826
 journal_submit_commit_record+0x73b/0xab0 fs/jbd2/commit.c:156
 jbd2_journal_commit_transaction+0x39f5/0x63c0 fs/jbd2/commit.c:882
 kjournald2+0x1fb/0x900 fs/jbd2/journal.c:201
 kthread+0x2c6/0x3a0 kernel/kthread.c:388
 ret_from_fork+0x45/0x80 arch/x86/kernel/process.c:147
 ret_from_fork_asm+0x11/0x20 arch/x86/entry/entry_64.S:242
 </TASK>

Crashes (3):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2024/02/18 00:09 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing a9c83252bff6 578f7538 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-usb INFO: task hung in del_gendisk
2024/02/10 19:03 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing 88bae831f381 77b23aa1 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-usb INFO: task hung in del_gendisk
2024/01/29 11:49 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing f1a27f081c1f 991a98f4 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-usb INFO: task hung in del_gendisk
* Struck through repros no longer work on HEAD.