syzbot


INFO: task hung in virtio_cleanup

Status: closed as invalid on 2023/04/06 23:24
Subsystems: usb crypto
[Documentation on labels]
Reported-by: syzbot+1db88381b64aaa929ef6@syzkaller.appspotmail.com
First crash: 1223d, last: 884d
Cause bisection: introduced by (bisect log) :
commit 77a36a3ab4ff17fad23831192e3694a3c5a1750d
Author: Samuel Čavoj <sammko@sammserver.com>
Date: Fri Mar 13 02:12:38 2020 +0000

  HID: Add driver fixing Glorious PC Gaming Race mouse report descriptor

Crash: WARNING: ODEBUG bug in netdev_run_todo (log)
Repro: C syz .config
  
Fix bisection the fix commit could be any of (bisect log):
  f40ddce88593 Linux 5.11
  79160a603bdb Merge tag 'usb-5.14-rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb
  
Discussions (1)
Title Replies (including bot) Last reply
INFO: task hung in virtio_cleanup 0 (2) 2021/02/26 17:40
Similar bugs (1)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
linux-5.15 INFO: task hung in virtio_cleanup origin:lts-only C error 28 243d 365d 0/3 upstream: reported C repro on 2023/03/19 17:36
Last patch testing requests (4)
Created Duration User Patch Repo Result
2023/01/18 22:32 20m retest repro https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing OK log
2022/10/16 04:30 17m retest repro linux-next error OK
2022/09/18 15:29 19m retest repro upstream OK log
2022/09/05 05:27 16m retest repro https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing error OK
Fix bisection attempts (3)
Created Duration User Patch Repo Result
2021/07/06 11:13 32m bisect fix upstream job log (2)
2021/06/06 09:05 27m bisect fix upstream job log (0) log
2021/04/04 10:03 26m bisect fix upstream job log (0) log
Cause bisection attempts (2)
Created Duration User Patch Repo Result
2021/02/26 14:20 3h18m bisect upstream job log (1) log
2021/02/17 04:57 0m bisect upstream error job log (0)

Sample crash report:
INFO: task kworker/0:1:7 blocked for more than 143 seconds.
      Not tainted 5.14.0-rc2-next-20210723-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
task:kworker/0:1     state:D stack:24672 pid:    7 ppid:     2 flags:0x00004000
Workqueue: usb_hub_wq hub_event
Call Trace:
 context_switch kernel/sched/core.c:4700 [inline]
 __schedule+0x93a/0x26f0 kernel/sched/core.c:5957
 schedule+0xd3/0x270 kernel/sched/core.c:6036
 schedule_timeout+0x1db/0x2a0 kernel/time/timer.c:1855
 do_wait_for_common kernel/sched/completion.c:85 [inline]
 __wait_for_common kernel/sched/completion.c:106 [inline]
 wait_for_common kernel/sched/completion.c:117 [inline]
 wait_for_completion+0x176/0x280 kernel/sched/completion.c:138
 virtio_cleanup+0x80/0xa0 drivers/char/hw_random/virtio-rng.c:85
 cleanup_rng drivers/char/hw_random/core.c:81 [inline]
 kref_put include/linux/kref.h:65 [inline]
 drop_current_rng+0xda/0x110 drivers/char/hw_random/core.c:109
 set_current_rng+0x2d3/0x490 drivers/char/hw_random/core.c:96
 hwrng_register+0x3bf/0x600 drivers/char/hw_random/core.c:499
 chaoskey_probe+0x886/0xc50 drivers/usb/misc/chaoskey.c:205
 usb_probe_interface+0x315/0x7f0 drivers/usb/core/driver.c:396
 call_driver_probe drivers/base/dd.c:517 [inline]
 really_probe+0x245/0xcc0 drivers/base/dd.c:596
 __driver_probe_device+0x338/0x4d0 drivers/base/dd.c:751
 driver_probe_device+0x4c/0x1a0 drivers/base/dd.c:781
 __device_attach_driver+0x20b/0x2f0 drivers/base/dd.c:898
 bus_for_each_drv+0x15f/0x1e0 drivers/base/bus.c:427
 __device_attach+0x228/0x4a0 drivers/base/dd.c:969
 bus_probe_device+0x1e4/0x290 drivers/base/bus.c:487
 device_add+0xc35/0x21b0 drivers/base/core.c:3356
 usb_set_configuration+0x113f/0x1910 drivers/usb/core/message.c:2170
 usb_generic_driver_probe+0xba/0x100 drivers/usb/core/generic.c:238
 usb_probe_device+0xd9/0x2c0 drivers/usb/core/driver.c:293
 call_driver_probe drivers/base/dd.c:517 [inline]
 really_probe+0x245/0xcc0 drivers/base/dd.c:596
 __driver_probe_device+0x338/0x4d0 drivers/base/dd.c:751
 driver_probe_device+0x4c/0x1a0 drivers/base/dd.c:781
 __device_attach_driver+0x20b/0x2f0 drivers/base/dd.c:898
 bus_for_each_drv+0x15f/0x1e0 drivers/base/bus.c:427
 __device_attach+0x228/0x4a0 drivers/base/dd.c:969
 bus_probe_device+0x1e4/0x290 drivers/base/bus.c:487
 device_add+0xc35/0x21b0 drivers/base/core.c:3356
 usb_new_device.cold+0x63f/0x108e drivers/usb/core/hub.c:2563
 hub_port_connect drivers/usb/core/hub.c:5348 [inline]
 hub_port_connect_change drivers/usb/core/hub.c:5488 [inline]
 port_event drivers/usb/core/hub.c:5634 [inline]
 hub_event+0x2357/0x4330 drivers/usb/core/hub.c:5716
 process_one_work+0x98d/0x1630 kernel/workqueue.c:2276
 worker_thread+0x658/0x11f0 kernel/workqueue.c:2422
 kthread+0x3e5/0x4d0 kernel/kthread.c:319
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:295

Showing all locks held in the system:
6 locks held by kworker/0:1/7:
 #0: ffff888019043d38 ((wq_completion)usb_hub_wq){+.+.}-{0:0}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline]
 #0: ffff888019043d38 ((wq_completion)usb_hub_wq){+.+.}-{0:0}, at: atomic64_set include/asm-generic/atomic-instrumented.h:620 [inline]
 #0: ffff888019043d38 ((wq_completion)usb_hub_wq){+.+.}-{0:0}, at: atomic_long_set include/asm-generic/atomic-long.h:41 [inline]
 #0: ffff888019043d38 ((wq_completion)usb_hub_wq){+.+.}-{0:0}, at: set_work_data kernel/workqueue.c:617 [inline]
 #0: ffff888019043d38 ((wq_completion)usb_hub_wq){+.+.}-{0:0}, at: set_work_pool_and_clear_pending kernel/workqueue.c:644 [inline]
 #0: ffff888019043d38 ((wq_completion)usb_hub_wq){+.+.}-{0:0}, at: process_one_work+0x871/0x1630 kernel/workqueue.c:2247
 #1: ffffc90000cc7db0 ((work_completion)(&hub->events)){+.+.}-{0:0}, at: process_one_work+0x8a5/0x1630 kernel/workqueue.c:2251
 #2: ffff888146d44220 (&dev->mutex){....}-{3:3}, at: device_lock include/linux/device.h:758 [inline]
 #2: ffff888146d44220 (&dev->mutex){....}-{3:3}, at: hub_event+0x1c1/0x4330 drivers/usb/core/hub.c:5662
 #3: ffff88823bdfca20 (&dev->mutex){....}-{3:3}, at: device_lock include/linux/device.h:758 [inline]
 #3: ffff88823bdfca20 (&dev->mutex){....}-{3:3}, at: __device_attach+0x7a/0x4a0 drivers/base/dd.c:944
 #4: ffff8880168061a8 (&dev->mutex){....}-{3:3}, at: device_lock include/linux/device.h:758 [inline]
 #4: ffff8880168061a8 (&dev->mutex){....}-{3:3}, at: __device_attach+0x7a/0x4a0 drivers/base/dd.c:944
 #5: ffffffff8c3c09e8 (rng_mutex){+.+.}-{3:3}, at: hwrng_register+0x7a/0x600 drivers/char/hw_random/core.c:472
5 locks held by kworker/u4:1/10:
1 lock held by khungtaskd/1660:
 #0: ffffffff8b97eb80 (rcu_read_lock){....}-{1:2}, at: debug_show_all_locks+0x53/0x260 kernel/locking/lockdep.c:6446

=============================================

NMI backtrace for cpu 0
CPU: 0 PID: 1660 Comm: khungtaskd Not tainted 5.14.0-rc2-next-20210723-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Call Trace:
 __dump_stack lib/dump_stack.c:88 [inline]
 dump_stack_lvl+0xcd/0x134 lib/dump_stack.c:105
 nmi_cpu_backtrace.cold+0x44/0xd7 lib/nmi_backtrace.c:105
 nmi_trigger_cpumask_backtrace+0x1b3/0x230 lib/nmi_backtrace.c:62
 trigger_all_cpu_backtrace include/linux/nmi.h:146 [inline]
 check_hung_uninterruptible_tasks kernel/hung_task.c:254 [inline]
 watchdog+0xd3e/0xf50 kernel/hung_task.c:339
 kthread+0x3e5/0x4d0 kernel/kthread.c:319
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:295
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 8453 Comm: syz-executor741 Not tainted 5.14.0-rc2-next-20210723-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
RIP: 0010:native_apic_mem_write+0x8/0x10 arch/x86/include/asm/apic.h:110
Code: c7 c0 96 ee 8e e8 98 a7 88 00 eb b0 66 0f 1f 44 00 00 be 01 00 00 00 e9 86 ff 2c 00 cc cc cc cc cc cc 89 ff 89 b7 00 c0 5f ff <c3> 0f 1f 80 00 00 00 00 48 b8 00 00 00 00 00 fc ff df 53 89 fb 48
RSP: 0018:ffffc9000178fb38 EFLAGS: 00000046
RAX: dffffc0000000000 RBX: ffffffff8b323a60 RCX: 0000000000000020
RDX: 1ffffffff166474e RSI: 000000000000ff61 RDI: 0000000000000380
RBP: ffff8880b9d1f2c0 R08: 000000000000003f R09: 0000000000000000
R10: ffffffff8168a747 R11: 0000000000000000 R12: 000000000000ff61
R13: 0000000000000020 R14: ffff8880b9d423c0 R15: 00000000000423c0
FS:  0000000000551300(0000) GS:ffff8880b9d00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fa8f0d15000 CR3: 00000000149e0000 CR4: 00000000001506e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 apic_write arch/x86/include/asm/apic.h:394 [inline]
 lapic_next_event+0x4d/0x80 arch/x86/kernel/apic/apic.c:472
 clockevents_program_event+0x254/0x370 kernel/time/clockevents.c:334
 tick_program_event+0xac/0x140 kernel/time/tick-oneshot.c:44
 hrtimer_reprogram+0x38f/0x440 kernel/time/hrtimer.c:871
 hrtimer_start_range_ns+0x60f/0x870 kernel/time/hrtimer.c:1151
 hrtimer_start_expires include/linux/hrtimer.h:436 [inline]
 hrtimer_sleeper_start_expires kernel/time/hrtimer.c:1817 [inline]
 do_nanosleep+0x1e8/0x690 kernel/time/hrtimer.c:1893
 hrtimer_nanosleep+0x1f9/0x4a0 kernel/time/hrtimer.c:1949
 common_nsleep+0xa2/0xc0 kernel/time/posix-timers.c:1227
 __do_sys_clock_nanosleep kernel/time/posix-timers.c:1267 [inline]
 __se_sys_clock_nanosleep kernel/time/posix-timers.c:1245 [inline]
 __x64_sys_clock_nanosleep+0x2f4/0x430 kernel/time/posix-timers.c:1245
 do_syscall_x64 arch/x86/entry/common.c:50 [inline]
 do_syscall_64+0x35/0xb0 arch/x86/entry/common.c:80
 entry_SYSCALL_64_after_hwframe+0x44/0xae
RIP: 0033:0x479c7a
Code: 83 ff 03 74 3b 48 83 ec 28 b8 fa ff ff ff 83 ff 02 49 89 ca 0f 44 f8 64 8b 04 25 18 00 00 00 85 c0 75 2d b8 e6 00 00 00 0f 05 <89> c2 f7 da 3d 00 f0 ff ff b8 00 00 00 00 0f 47 c2 48 83 c4 28 c3
RSP: 002b:00007fff6cc0c5a0 EFLAGS: 00000246 ORIG_RAX: 00000000000000e6
RAX: ffffffffffffffda RBX: 00000000000afb12 RCX: 0000000000479c7a
RDX: 00007fff6cc0c5e0 RSI: 0000000000000000 RDI: 0000000000000000
RBP: 00000000000021dd R08: 00000000000002d1 R09: 00007fff6cca8080
R10: 0000000000000000 R11: 0000000000000246 R12: 00007fff6cc0c61c
R13: 431bde82d7b634db R14: 00000000004b3018 R15: 00000000004004a0

Crashes (16):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2021/07/25 20:57 linux-next 90d856e71443 4d1b57d4 .config console log report syz C ci-upstream-linux-next-kasan-gce-root INFO: task hung in virtio_cleanup
2021/02/17 04:57 upstream f40ddce88593 98682e5e .config console log report syz C ci-upstream-kasan-gce INFO: task hung in virtio_cleanup
2020/12/29 23:13 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing cb4d9b52ec06 80910769 .config console log report syz C ci2-upstream-usb
2021/10/16 07:24 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing 660a92a59b9e 0c5d9412 .config console log report info ci2-upstream-usb INFO: task hung in virtio_cleanup
2021/10/03 05:51 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing ae9a6149884e db0f5787 .config console log report info ci2-upstream-usb INFO: task hung in virtio_cleanup
2021/09/01 08:18 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing 9c1587d99f93 7eb7e152 .config console log report info ci2-upstream-usb INFO: task hung in virtio_cleanup
2021/05/07 08:03 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing 83a9d2a05296 06585184 .config console log report info ci2-upstream-usb INFO: task hung in virtio_cleanup
2021/05/06 04:46 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing d665ea6ea86c 06c27ff5 .config console log report info ci2-upstream-usb INFO: task hung in virtio_cleanup
2021/04/30 16:44 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing 4a0225c3d208 77e2b668 .config console log report info ci2-upstream-usb INFO: task hung in virtio_cleanup
2021/03/05 07:45 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing 5e17812c22bc 9d751681 .config console log report info ci2-upstream-usb INFO: task hung in virtio_cleanup
2021/02/15 21:43 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing b5a12546e779 98682e5e .config console log report info ci2-upstream-usb INFO: task hung in virtio_cleanup
2021/01/26 08:26 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing 7cbcd008e104 52e37319 .config console log report info ci2-upstream-usb INFO: task hung in virtio_cleanup
2020/12/30 21:01 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing cb4d9b52ec06 ecb8c012 .config console log report info ci2-upstream-usb
2020/12/29 20:47 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing cb4d9b52ec06 80910769 .config console log report info ci2-upstream-usb
2020/11/18 02:00 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing 0fb2c41f992c 09323409 .config console log report info ci2-upstream-usb
2020/11/11 20:29 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing 57cde551225b cca87986 .config console log report info ci2-upstream-usb
* Struck through repros no longer work on HEAD.