syzbot


INFO: task hung in vhost_net_stop

Status: closed as invalid on 2022/10/12 18:48
Subsystems: kvm net virt
[Documentation on labels]
First crash: 973d, last: 782d
Cause bisection: failed (error log, bisect log)
  
Fix bisection: failed (error log, bisect log)
  
Last patch testing requests (7)
Created Duration User Patch Repo Result
2022/10/07 05:30 19m retest repro upstream OK log
2022/10/04 13:30 24m retest repro upstream error OK
2022/09/22 02:29 19m retest repro upstream OK log
2022/09/22 00:29 19m retest repro upstream OK log
2022/09/21 21:29 19m retest repro upstream OK log
2022/09/21 19:29 18m retest repro upstream OK log
2022/09/21 15:29 18m retest repro upstream OK log

Sample crash report:
INFO: task syz-executor397:6534 blocked for more than 143 seconds.
      Not tainted 5.16.0-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
task:syz-executor397 state:D stack:28112 pid: 6534 ppid:  3637 flags:0x00004002
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:4986 [inline]
 __schedule+0xab2/0x4f00 kernel/sched/core.c:6296
 schedule+0xd2/0x260 kernel/sched/core.c:6369
 schedule_preempt_disabled+0xf/0x20 kernel/sched/core.c:6428
 __mutex_lock_common kernel/locking/mutex.c:673 [inline]
 __mutex_lock+0xa32/0x12f0 kernel/locking/mutex.c:733
 vhost_net_stop_vq drivers/vhost/net.c:1359 [inline]
 vhost_net_stop+0x142/0x270 drivers/vhost/net.c:1373
 vhost_net_release+0x9c/0x2d0 drivers/vhost/net.c:1405
 __fput+0x286/0x9f0 fs/file_table.c:280
 task_work_run+0xdd/0x1a0 kernel/task_work.c:164
 exit_task_work include/linux/task_work.h:32 [inline]
 do_exit+0xb29/0x2a30 kernel/exit.c:806
 do_group_exit+0xd2/0x2f0 kernel/exit.c:935
 __do_sys_exit_group kernel/exit.c:946 [inline]
 __se_sys_exit_group kernel/exit.c:944 [inline]
 __x64_sys_exit_group+0x3a/0x50 kernel/exit.c:944
 do_syscall_x64 arch/x86/entry/common.c:50 [inline]
 do_syscall_64+0x35/0xb0 arch/x86/entry/common.c:80
 entry_SYSCALL_64_after_hwframe+0x44/0xae
RIP: 0033:0x7fcf820a5b39
RSP: 002b:00007ffe5f066dd8 EFLAGS: 00000246 ORIG_RAX: 00000000000000e7
RAX: ffffffffffffffda RBX: 00007fcf8211a330 RCX: 00007fcf820a5b39
RDX: 000000000000003c RSI: 00000000000000e7 RDI: 0000000000000000
RBP: 0000000000000000 R08: ffffffffffffffc0 R09: 00007ffe5f066fc8
R10: 00007ffe5f066fc8 R11: 0000000000000246 R12: 00007fcf8211a330
R13: 0000000000000001 R14: 0000000000000000 R15: 0000000000000001
 </TASK>

Showing all locks held in the system:
1 lock held by khungtaskd/27:
 #0: ffffffff8bb85320 (rcu_read_lock){....}-{1:2}, at: debug_show_all_locks+0x53/0x260 kernel/locking/lockdep.c:6460
2 locks held by getty/3287:
 #0: ffff888023d6d098 (&tty->ldisc_sem){++++}-{0:0}, at: tty_ldisc_ref_wait+0x22/0x80 drivers/tty/tty_ldisc.c:244
 #1: ffffc90002b632e8 (&ldata->atomic_read_lock){+.+.}-{3:3}, at: n_tty_read+0xcf0/0x1230 drivers/tty/n_tty.c:2077
1 lock held by syz-executor397/6534:
 #0: ffff8880772a0218 (&vq->mutex){+.+.}-{3:3}, at: vhost_net_stop_vq drivers/vhost/net.c:1359 [inline]
 #0: ffff8880772a0218 (&vq->mutex){+.+.}-{3:3}, at: vhost_net_stop+0x142/0x270 drivers/vhost/net.c:1373
1 lock held by vhost-6534/6535:

=============================================

NMI backtrace for cpu 0
CPU: 0 PID: 27 Comm: khungtaskd Not tainted 5.16.0-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Call Trace:
 <TASK>
 __dump_stack lib/dump_stack.c:88 [inline]
 dump_stack_lvl+0xcd/0x134 lib/dump_stack.c:106
 nmi_cpu_backtrace.cold+0x47/0x144 lib/nmi_backtrace.c:111
 nmi_trigger_cpumask_backtrace+0x1b3/0x230 lib/nmi_backtrace.c:62
 trigger_all_cpu_backtrace include/linux/nmi.h:146 [inline]
 check_hung_uninterruptible_tasks kernel/hung_task.c:210 [inline]
 watchdog+0xc1d/0xf50 kernel/hung_task.c:295
 kthread+0x2e9/0x3a0 kernel/kthread.c:359
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:295
 </TASK>
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 6535 Comm: vhost-6534 Not tainted 5.16.0-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
RIP: 0010:__sanitizer_cov_trace_pc+0x37/0x60 kernel/kcov.c:200
Code: 81 e1 00 01 00 00 65 48 8b 14 25 00 70 02 00 a9 00 01 ff 00 74 0e 85 c9 74 35 8b 82 a4 15 00 00 85 c0 74 2b 8b 82 80 15 00 00 <83> f8 02 75 20 48 8b 8a 88 15 00 00 8b 92 84 15 00 00 48 8b 01 48
RSP: 0018:ffffc9000349faf0 EFLAGS: 00000246
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000
RDX: ffff888075a09d00 RSI: ffffffff86d68eb7 RDI: 0000000000000003
RBP: dffffc0000000000 R08: 000000000000000f R09: ffffc9000349fb27
R10: ffffffff86d68ea9 R11: 0000000000000001 R12: ffff88801d905c00
R13: 000000000000000f R14: 0000000000000000 R15: 0000000000000000
FS:  0000000000000000(0000) GS:ffff8880b9d00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000055c7fbe99f10 CR3: 0000000074ff4000 CR4: 0000000000350ee0
Call Trace:
 <TASK>
 vhost_iotlb_itree_subtree_search drivers/vhost/iotlb.c:19 [inline]
 vhost_iotlb_itree_iter_first drivers/vhost/iotlb.c:19 [inline]
 vhost_iotlb_itree_first+0x177/0x280 drivers/vhost/iotlb.c:169
 iotlb_access_ok+0x1ce/0x3e0 drivers/vhost/vhost.c:1336
 vq_meta_prefetch+0xbc/0x280 drivers/vhost/vhost.c:1366
 handle_rx+0x145/0x1b40 drivers/vhost/net.c:1140
 vhost_worker+0x23d/0x3d0 drivers/vhost/vhost.c:372
 kthread+0x2e9/0x3a0 kernel/kthread.c:359
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:295
 </TASK>
----------------
Code disassembly (best guess):
   0:	81 e1 00 01 00 00    	and    $0x100,%ecx
   6:	65 48 8b 14 25 00 70 	mov    %gs:0x27000,%rdx
   d:	02 00
   f:	a9 00 01 ff 00       	test   $0xff0100,%eax
  14:	74 0e                	je     0x24
  16:	85 c9                	test   %ecx,%ecx
  18:	74 35                	je     0x4f
  1a:	8b 82 a4 15 00 00    	mov    0x15a4(%rdx),%eax
  20:	85 c0                	test   %eax,%eax
  22:	74 2b                	je     0x4f
  24:	8b 82 80 15 00 00    	mov    0x1580(%rdx),%eax
* 2a:	83 f8 02             	cmp    $0x2,%eax <-- trapping instruction
  2d:	75 20                	jne    0x4f
  2f:	48 8b 8a 88 15 00 00 	mov    0x1588(%rdx),%rcx
  36:	8b 92 84 15 00 00    	mov    0x1584(%rdx),%edx
  3c:	48 8b 01             	mov    (%rcx),%rax
  3f:	48                   	rex.W

Crashes (233):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2022/01/20 07:28 upstream 1d1df41c5a33 5da9499f .config console log report syz C ci-upstream-kasan-gce-root INFO: task hung in vhost_net_stop
2021/08/28 00:25 linux-next 5e63226c7228 d5a29e53 .config console log report syz C ci-upstream-linux-next-kasan-gce-root INFO: task hung in vhost_net_stop
2022/01/22 09:46 upstream 9b57f4589857 214351e1 .config console log report syz C ci-upstream-kasan-gce INFO: task hung in vhost_net_stop
2021/12/26 21:51 upstream 438645193e59 e4f103c4 .config console log report syz C ci-upstream-kasan-gce INFO: task hung in vhost_net_stop
2021/12/26 17:15 upstream 438645193e59 e4f103c4 .config console log report syz C ci-upstream-kasan-gce-smack-root INFO: task hung in vhost_net_stop
2021/10/25 22:09 upstream 87066fdd2e30 4f0000ee .config console log report syz C ci-upstream-kasan-gce INFO: task hung in vhost_net_stop
2021/09/23 11:00 upstream cf1d2c3e7e2f 8cac236e .config console log report syz C ci-upstream-kasan-gce INFO: task hung in vhost_net_stop
2021/08/28 02:08 upstream 1a6436f37512 d5a29e53 .config console log report syz C ci-upstream-kasan-gce INFO: task hung in vhost_net_stop
2022/03/05 23:13 upstream 0014404f9c18 7bdd8b2c .config console log report info ci-upstream-kasan-gce-selinux-root INFO: task hung in vhost_net_stop
2022/02/28 06:33 upstream 7e57714cd0ad 45a13a73 .config console log report info ci-upstream-kasan-gce-smack-root INFO: task hung in vhost_net_stop
2022/02/26 12:30 upstream 9137eda53752 45a13a73 .config console log report info ci-upstream-kasan-gce-selinux-root INFO: task hung in vhost_net_stop
2022/02/25 02:29 upstream 73878e5eb1bd 7c337266 .config console log report info ci-upstream-kasan-gce-smack-root INFO: task hung in vhost_net_stop
2022/02/22 19:47 upstream 917bbdb107f8 6e821dbf .config console log report info ci-upstream-kasan-gce-selinux-root INFO: task hung in vhost_net_stop
2022/02/21 20:56 upstream 038101e6b2cd 6e821dbf .config console log report info ci-upstream-kasan-gce-selinux-root INFO: task hung in vhost_net_stop
2022/02/21 00:00 upstream 7f25f0412c9e 3cd800e4 .config console log report info ci-upstream-kasan-gce-smack-root INFO: task hung in vhost_net_stop
2022/01/27 18:27 upstream 626b2dda7651 64a8e201 .config console log report info ci-upstream-kasan-gce-root INFO: task hung in vhost_net_stop
2022/01/19 09:14 upstream 99613159ad74 0620189b .config console log report info ci-upstream-kasan-gce-root INFO: task hung in vhost_net_stop
2022/01/18 01:42 upstream 0c947b893d69 731a2d23 .config console log report info ci-upstream-kasan-gce-root INFO: task hung in vhost_net_stop
2022/01/12 08:19 upstream 6f38be8f2ccd 44d1319a .config console log report info ci-upstream-kasan-gce-root INFO: task hung in vhost_net_stop
2022/01/10 01:21 upstream e900deb24820 2ca0d385 .config console log report info ci-upstream-kasan-gce-root INFO: task hung in vhost_net_stop
2022/01/09 01:15 upstream 21f35d2ca83e 2ca0d385 .config console log report info ci-upstream-kasan-gce-root INFO: task hung in vhost_net_stop
2022/01/08 20:52 upstream d1587f7bfe9a 2ca0d385 .config console log report info ci-upstream-kasan-gce-smack-root INFO: task hung in vhost_net_stop
2022/01/07 14:28 upstream ddec8ed2d490 6acc789a .config console log report info ci-upstream-kasan-gce-smack-root INFO: task hung in vhost_net_stop
2022/01/03 16:46 upstream c9e6606c7fe9 4a3f34f2 .config console log report info ci-upstream-kasan-gce-smack-root INFO: task hung in vhost_net_stop
2022/01/01 23:30 upstream 278218f6778b e1768e9c .config console log report info ci-upstream-kasan-gce-smack-root INFO: task hung in vhost_net_stop
2022/01/01 22:08 upstream 278218f6778b e1768e9c .config console log report info ci-upstream-kasan-gce-smack-root INFO: task hung in vhost_net_stop
2021/12/31 11:14 upstream 74c78b4291b4 36bd2e48 .config console log report info ci-upstream-kasan-gce-smack-root INFO: task hung in vhost_net_stop
2021/12/30 05:26 upstream eec4df26e24e 6cc879d4 .config console log report info ci-upstream-kasan-gce-smack-root INFO: task hung in vhost_net_stop
2021/12/29 12:54 upstream e7c124bd0463 6cc879d4 .config console log report info ci-upstream-kasan-gce INFO: task hung in vhost_net_stop
2021/12/29 08:19 upstream ecf71de775a0 76c8cf06 .config console log report info ci-upstream-kasan-gce-root INFO: task hung in vhost_net_stop
2021/12/14 13:59 upstream 5472f14a3742 d018dd31 .config console log report info ci-upstream-kasan-gce-smack-root INFO: task hung in vhost_net_stop
2021/12/10 04:20 upstream c741e49150db 4d4ce9bc .config console log report info ci-upstream-kasan-gce-smack-root INFO: task hung in vhost_net_stop
2021/12/05 11:25 upstream 79a72162048e a617004c .config console log report info ci-upstream-kasan-gce-smack-root INFO: task hung in vhost_net_stop
2021/12/03 13:31 upstream 5f58da2befa5 c7c20675 .config console log report info ci-upstream-kasan-gce-smack-root INFO: task hung in vhost_net_stop
2022/02/20 20:44 upstream 7f25f0412c9e 3cd800e4 .config console log report info ci-upstream-kasan-gce-386 INFO: task hung in vhost_net_stop
2022/02/19 10:38 upstream 4f12b742eb2b 3cd800e4 .config console log report info ci-upstream-kasan-gce-386 INFO: task hung in vhost_net_stop
2022/02/14 15:34 upstream 754e0b0e3560 8b9ca619 .config console log report info ci-upstream-kasan-gce-386 INFO: task hung in vhost_net_stop
2022/02/14 13:24 upstream 754e0b0e3560 8b9ca619 .config console log report info ci-upstream-kasan-gce-386 INFO: task hung in vhost_net_stop
2022/02/11 06:48 upstream f1baf68e1383 0b33604d .config console log report info ci-upstream-kasan-gce-386 INFO: task hung in vhost_net_stop
2022/02/10 17:21 upstream e3c85076d7a6 0b33604d .config console log report info ci-upstream-kasan-gce-386 INFO: task hung in vhost_net_stop
2022/02/06 20:26 upstream d8ad2ce873ab a7dab638 .config console log report info ci-upstream-kasan-gce-386 INFO: task hung in vhost_net_stop
2022/02/02 21:28 upstream 27bb0b18c208 4ebb2798 .config console log report info ci-upstream-kasan-gce-386 INFO: task hung in vhost_net_stop
2022/01/31 15:00 upstream 26291c54e111 6b7c57fe .config console log report info ci-upstream-kasan-gce-386 INFO: task hung in vhost_net_stop
2022/01/21 05:32 upstream 2c271fe77d52 ab3d9f17 .config console log report info ci-upstream-kasan-gce-386 INFO: task hung in vhost_net_stop
2022/01/20 16:42 upstream fa2e1ba3e9e3 b838eb76 .config console log report info ci-upstream-kasan-gce-386 INFO: task hung in vhost_net_stop
2022/01/19 22:49 upstream 1d1df41c5a33 5da9499f .config console log report info ci-upstream-kasan-gce-386 INFO: task hung in vhost_net_stop
2022/01/17 00:59 upstream 79e06c4c4950 723cfaf0 .config console log report info ci-upstream-kasan-gce-386 INFO: task hung in vhost_net_stop
2022/01/13 20:07 upstream 455e73a07f6e b8d780ab .config console log report info ci-upstream-kasan-gce-386 INFO: task hung in vhost_net_stop
2022/01/05 19:08 upstream c9e6606c7fe9 6acc789a .config console log report info ci-upstream-kasan-gce-386 INFO: task hung in vhost_net_stop
2022/01/01 08:17 upstream 800829388818 e1768e9c .config console log report info ci-upstream-kasan-gce-386 INFO: task hung in vhost_net_stop
2021/12/31 01:16 upstream 74c78b4291b4 36bd2e48 .config console log report info ci-upstream-kasan-gce-386 INFO: task hung in vhost_net_stop
2021/12/30 06:31 upstream eec4df26e24e 6cc879d4 .config console log report info ci-upstream-kasan-gce-386 INFO: task hung in vhost_net_stop
2021/08/27 16:30 upstream 77dd11439b86 b318694d .config console log report info ci-upstream-kasan-gce-386 INFO: task hung in vhost_net_stop
2022/01/17 10:05 linux-next 68e0667e38d9 731a2d23 .config console log report info ci-upstream-linux-next-kasan-gce-root INFO: task can't die in vhost_net_stop
2022/01/16 21:13 linux-next 70e6f1b39929 723cfaf0 .config console log report info ci-upstream-linux-next-kasan-gce-root INFO: task can't die in vhost_net_stop
2022/01/16 08:58 linux-next 70e6f1b39929 723cfaf0 .config console log report info ci-upstream-linux-next-kasan-gce-root INFO: task can't die in vhost_net_stop
2022/01/13 21:54 linux-next 27c9d5b3c24a b8d780ab .config console log report info ci-upstream-linux-next-kasan-gce-root INFO: task can't die in vhost_net_stop
2022/01/10 10:38 linux-next 57c149e506d5 2ca0d385 .config console log report info ci-upstream-linux-next-kasan-gce-root INFO: task can't die in vhost_net_stop
* Struck through repros no longer work on HEAD.