syzbot

 sign-in | mailing list | source | docs
🐞 Open [968] ≡ Subsystems 🐞 Fixed [4557] 🐞 Invalid [10491] 📈 Kernel Health 📈 Bug Lifetimes 📈 Fuzzing 📈 Crashes 💬 Send us feedback

INFO: task hung in netdev_run_todo (2)

Status: upstream: reported C repro on 2020/12/13 16:23
Labels: staging usb (incorrect?)
Reported-by: syzbot+9d77543f47951a63d5c1@syzkaller.appspotmail.com
First crash: 1179d, last: 7d12h

Cause bisection: failed (error log, bisect log)
▶ ▼ Discussions (2)
Title Replies (including bot) Last reply
[syzbot] Monthly staging report 0 (1) 2023/04/05 08:59
INFO: task hung in netdev_run_todo (2) 0 (2) 2022/03/24 20:20
▶ ▼ Similar bugs (8)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
linux-4.19 INFO: task hung in netdev_run_todo (3) 15 204d 520d 0/1 auto-obsoleted due to no activity on 2023/03/07 08:19
upstream INFO: task hung in netdev_run_todo 12 1378d 1933d 0/24 closed as invalid on 2019/10/23 07:29
linux-4.19 INFO: task hung in netdev_run_todo (2) 3 1011d 1059d 0/1 auto-closed as invalid on 2020/12/20 04:57
android-44 INFO: task hung in netdev_run_todo 1 1872d 1872d 0/2 auto-closed as invalid on 2019/02/22 12:49
linux-4.19 INFO: task hung in netdev_run_todo 1 1337d 1337d 0/1 auto-closed as invalid on 2020/01/29 06:48
android-49 INFO: task hung in netdev_run_todo 1 1865d 1865d 0/3 auto-closed as invalid on 2019/02/22 14:57
linux-4.14 INFO: task hung in netdev_run_todo 1 198d 198d 0/1 auto-obsoleted due to no activity on 2023/03/13 17:45
upstream INFO: task can't die in netdev_run_todo net syz error 2 620d 1013d 0/24 auto-obsoleted due to no activity on 2023/04/16 04:59
▶ ▼ Fix bisection attempts (10)
Created Duration User Patch Repo Result
2023/05/04 10:43 33m bisect fix upstream job log (0) log
2023/04/03 07:32 36m bisect fix upstream job log (0) log
2023/03/04 06:08 34m bisect fix upstream job log (0) log
2023/02/01 20:35 37m bisect fix upstream job log (0) log
2022/10/12 17:53 38m (2) bisect fix upstream job log (0) log
2022/08/25 15:11 34m bisect fix upstream job log (0) log
2022/07/26 05:11 29m bisect fix upstream job log (0) log
2022/06/25 21:23 27m bisect fix upstream job log (0) log
2022/05/23 23:37 26m bisect fix upstream job log (0) log
2022/04/23 20:19 30m bisect fix upstream job log (0) log

Sample crash report:
INFO: task kworker/1:2:3649 blocked for more than 143 seconds.
      Tainted: G        W         5.17.0-syzkaller-04443-ged4643521e6a #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
task:kworker/1:2     state:D stack:24952 pid: 3649 ppid:     2 flags:0x00004000
Workqueue: usb_hub_wq hub_event
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5073 [inline]
 __schedule+0xa9a/0x4940 kernel/sched/core.c:6382
 schedule+0xd2/0x1f0 kernel/sched/core.c:6454
 schedule_preempt_disabled+0xf/0x20 kernel/sched/core.c:6513
 __mutex_lock_common kernel/locking/mutex.c:673 [inline]
 __mutex_lock+0xa32/0x12f0 kernel/locking/mutex.c:733
 netdev_run_todo+0x70f/0xaa0 net/core/dev.c:9967
 r871xu_dev_remove+0x24f/0x2c0 drivers/staging/rtl8712/usb_intf.c:599
 usb_unbind_interface+0x1d8/0x8e0 drivers/usb/core/driver.c:458
 __device_release_driver+0x627/0x760 drivers/base/dd.c:1209
 device_release_driver_internal drivers/base/dd.c:1242 [inline]
 device_release_driver+0x26/0x40 drivers/base/dd.c:1265
 bus_remove_device+0x2eb/0x5a0 drivers/base/bus.c:529
 device_del+0x4f3/0xc80 drivers/base/core.c:3592
 usb_disable_device+0x35b/0x7b0 drivers/usb/core/message.c:1419
 usb_disconnect.cold+0x278/0x6ec drivers/usb/core/hub.c:2228
 hub_port_connect drivers/usb/core/hub.c:5202 [inline]
 hub_port_connect_change drivers/usb/core/hub.c:5502 [inline]
 port_event drivers/usb/core/hub.c:5660 [inline]
 hub_event+0x1e74/0x4680 drivers/usb/core/hub.c:5742
 process_one_work+0x996/0x1610 kernel/workqueue.c:2289
 process_scheduled_works kernel/workqueue.c:2352 [inline]
 worker_thread+0x854/0x1080 kernel/workqueue.c:2438
 kthread+0x2e9/0x3a0 kernel/kthread.c:376
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:295
 </TASK>
INFO: lockdep is turned off.
NMI backtrace for cpu 1
CPU: 1 PID: 27 Comm: khungtaskd Tainted: G        W         5.17.0-syzkaller-04443-ged4643521e6a #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Call Trace:
 <TASK>
 __dump_stack lib/dump_stack.c:88 [inline]
 dump_stack_lvl+0xcd/0x134 lib/dump_stack.c:106
 nmi_cpu_backtrace.cold+0x47/0x144 lib/nmi_backtrace.c:111
 nmi_trigger_cpumask_backtrace+0x1e6/0x230 lib/nmi_backtrace.c:62
 trigger_all_cpu_backtrace include/linux/nmi.h:146 [inline]
 check_hung_uninterruptible_tasks kernel/hung_task.c:212 [inline]
 watchdog+0xc1d/0xf50 kernel/hung_task.c:369
 kthread+0x2e9/0x3a0 kernel/kthread.c:376
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:295
 </TASK>
Sending NMI from CPU 1 to CPUs 0:
NMI backtrace for cpu 0
CPU: 0 PID: 3639 Comm: syz-executor169 Tainted: G        W         5.17.0-syzkaller-04443-ged4643521e6a #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
RIP: 0010:____rb_erase_color lib/rbtree.c:259 [inline]
RIP: 0010:rb_erase+0x516/0x1210 lib/rbtree.c:445
Code: 48 89 f9 48 c1 e9 03 80 3c 19 00 0f 85 bb 0b 00 00 49 8d 7d 10 4c 89 60 08 48 89 f8 48 c1 e8 03 80 3c 18 00 0f 85 90 0b 00 00 <4d> 89 ec 4d 8b 6d 10 e9 cb fd ff ff 48 b8 00 00 00 00 00 fc ff df
RSP: 0018:ffffc90002befa38 EFLAGS: 00000046
RAX: 1ffff1100fd8aaf4 RBX: dffffc0000000000 RCX: 1ffff110173873d1
RDX: ffffed10173873d0 RSI: ffff8880b9c39e80 RDI: ffff88807ec557a0
RBP: ffff88801da05790 R08: ffff8880b9c39e40 R09: 0000000000000000
R10: 0000000000000006 R11: ffff8880b9c3a958 R12: ffff88801d7d5790
R13: ffff88807ec55790 R14: ffff88801da05791 R15: ffff8880b9c39e80
FS:  00005555558cf300(0000) GS:ffff8880b9c00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f945ed6a01d CR3: 00000000222c0000 CR4: 00000000003506f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <TASK>
 rb_erase_cached include/linux/rbtree.h:126 [inline]
 __dequeue_entity kernel/sched/fair.c:624 [inline]
 set_next_entity+0x334/0x5e0 kernel/sched/fair.c:4522
 pick_next_task_fair+0x6ad/0xe20 kernel/sched/fair.c:7348
 __pick_next_task kernel/sched/core.c:5695 [inline]
 pick_next_task kernel/sched/core.c:5768 [inline]
 __schedule+0x3e8/0x4940 kernel/sched/core.c:6346
 schedule+0xd2/0x1f0 kernel/sched/core.c:6454
 freezable_schedule include/linux/freezer.h:172 [inline]
 do_nanosleep+0x24e/0x690 kernel/time/hrtimer.c:2044
 hrtimer_nanosleep+0x1f9/0x4a0 kernel/time/hrtimer.c:2097
 common_nsleep+0xa2/0xc0 kernel/time/posix-timers.c:1227
 __do_sys_clock_nanosleep kernel/time/posix-timers.c:1267 [inline]
 __se_sys_clock_nanosleep kernel/time/posix-timers.c:1245 [inline]
 __x64_sys_clock_nanosleep+0x2f4/0x430 kernel/time/posix-timers.c:1245
 do_syscall_x64 arch/x86/entry/common.c:50 [inline]
 do_syscall_64+0x35/0xb0 arch/x86/entry/common.c:80
 entry_SYSCALL_64_after_hwframe+0x44/0xae
RIP: 0033:0x7f945ed4a2aa
Code: 83 ff 03 74 3b 48 83 ec 28 b8 fa ff ff ff 83 ff 02 49 89 ca 0f 44 f8 64 8b 04 25 18 00 00 00 85 c0 75 2d b8 e6 00 00 00 0f 05 <89> c2 f7 da 3d 00 f0 ff ff b8 00 00 00 00 0f 47 c2 48 83 c4 28 c3
RSP: 002b:00007ffcdea2c300 EFLAGS: 00000246 ORIG_RAX: 00000000000000e6
RAX: ffffffffffffffda RBX: 00000000000f4240 RCX: 00007f945ed4a2aa
RDX: 00007ffcdea2c340 RSI: 0000000000000000 RDI: 0000000000000000
RBP: 000000000000126b R08: 00000000000002cc R09: 00007ffcdea53080
R10: 0000000000000000 R11: 0000000000000246 R12: 00000000000adfd3
R13: 00007ffcdea2c37c R14: 00007ffcdea2c390 R15: 00007ffcdea2c380
 </TASK>
INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.178 msecs
----------------
Code disassembly (best guess):
   0:	48 89 f9             	mov    %rdi,%rcx
   3:	48 c1 e9 03          	shr    $0x3,%rcx
   7:	80 3c 19 00          	cmpb   $0x0,(%rcx,%rbx,1)
   b:	0f 85 bb 0b 00 00    	jne    0xbcc
  11:	49 8d 7d 10          	lea    0x10(%r13),%rdi
  15:	4c 89 60 08          	mov    %r12,0x8(%rax)
  19:	48 89 f8             	mov    %rdi,%rax
  1c:	48 c1 e8 03          	shr    $0x3,%rax
  20:	80 3c 18 00          	cmpb   $0x0,(%rax,%rbx,1)
  24:	0f 85 90 0b 00 00    	jne    0xbba
* 2a:	4d 89 ec             	mov    %r13,%r12 <-- trapping instruction
  2d:	4d 8b 6d 10          	mov    0x10(%r13),%r13
  31:	e9 cb fd ff ff       	jmpq   0xfffffe01
  36:	48 b8 00 00 00 00 00 	movabs $0xdffffc0000000000,%rax
  3d:	fc ff df

Crashes (237):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets Manager Title
2022/03/24 20:19 upstream ed4643521e6a 89bc8608 .config console log report syz C ci-upstream-kasan-gce INFO: task hung in netdev_run_todo
2022/03/24 18:36 upstream ed4643521e6a 89bc8608 .config console log report info ci-upstream-kasan-gce INFO: task hung in netdev_run_todo
2022/02/27 22:12 upstream 2293be58d6a1 45a13a73 .config console log report info ci-upstream-kasan-gce-smack-root INFO: task hung in netdev_run_todo
2021/09/29 16:16 upstream 02d5e016800d be530f6c .config console log report info ci-upstream-kasan-gce-smack-root INFO: task hung in netdev_run_todo
2021/09/29 06:09 upstream a4e6f95a891a d82cb927 .config console log report info ci-upstream-kasan-gce-smack-root INFO: task hung in netdev_run_todo
2021/09/26 12:13 upstream a3b397b4fffb 8cac236e .config console log report info ci-upstream-kasan-gce-selinux-root INFO: task hung in netdev_run_todo
2021/09/23 21:13 upstream 58e2cf5d7946 8cac236e .config console log report info ci-upstream-kasan-gce-selinux-root INFO: task hung in netdev_run_todo
2021/09/19 14:14 upstream d4d016caa4b8 70b76c1d .config console log report info ci-upstream-kasan-gce INFO: task hung in netdev_run_todo
2021/09/16 00:30 upstream b7213ffa0e58 07e953c1 .config console log report info ci-upstream-kasan-gce-root INFO: task hung in netdev_run_todo
2021/09/30 22:52 upstream 02d5e016800d 1d849ab4 .config console log report info ci-upstream-kasan-gce-386 INFO: task hung in netdev_run_todo
2021/09/30 21:08 upstream 02d5e016800d 1d849ab4 .config console log report info ci-upstream-kasan-gce-386 INFO: task hung in netdev_run_todo
2021/09/29 18:32 upstream 02d5e016800d be530f6c .config console log report info ci-upstream-kasan-gce-386 INFO: task hung in netdev_run_todo
2021/09/28 19:20 upstream d33bec7b3dfa d82cb927 .config console log report info ci-upstream-kasan-gce-386 INFO: task hung in netdev_run_todo
2021/09/28 15:32 upstream d33bec7b3dfa d82cb927 .config console log report info ci-upstream-kasan-gce-386 INFO: task hung in netdev_run_todo
2021/09/28 13:56 upstream 0513e464f900 d82cb927 .config console log report info ci-upstream-kasan-gce-386 INFO: task hung in netdev_run_todo
2021/09/24 05:31 upstream f9e36107ec70 8cac236e .config console log report info ci-upstream-kasan-gce-386 INFO: task hung in netdev_run_todo
2021/09/24 03:08 upstream f9e36107ec70 8cac236e .config console log report info ci-upstream-kasan-gce-386 INFO: task hung in netdev_run_todo
2021/09/22 06:18 upstream 92477dd1faa6 169724fe .config console log report info ci-upstream-kasan-gce-386 INFO: task hung in netdev_run_todo
2021/11/05 07:23 net-old 436014e860d3 4c1be0be .config console log report info ci-upstream-net-this-kasan-gce INFO: task hung in netdev_run_todo
2021/10/01 16:57 net-old ca6e11c337da cc80db95 .config console log report info ci-upstream-net-this-kasan-gce INFO: task hung in netdev_run_todo
2023/05/23 09:57 net-next d49b9b07725f 4bce1a3e .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-net-kasan-gce INFO: task hung in netdev_run_todo
2022/01/17 15:15 net-next-old fe8152b38d3a 731a2d23 .config console log report info ci-upstream-net-kasan-gce INFO: task hung in netdev_run_todo
2021/10/20 07:01 net-next-old cb3dc8901ba4 466b7db1 .config console log report info ci-upstream-net-kasan-gce INFO: task hung in netdev_run_todo
2021/10/20 05:57 net-next-old cb3dc8901ba4 466b7db1 .config console log report info ci-upstream-net-kasan-gce INFO: task hung in netdev_run_todo
2021/10/20 04:27 net-next-old cb3dc8901ba4 466b7db1 .config console log report info ci-upstream-net-kasan-gce INFO: task hung in netdev_run_todo
2021/10/20 03:47 net-next-old cb3dc8901ba4 466b7db1 .config console log report info ci-upstream-net-kasan-gce INFO: task hung in netdev_run_todo
2021/10/20 02:32 net-next-old cb3dc8901ba4 466b7db1 .config console log report info ci-upstream-net-kasan-gce INFO: task hung in netdev_run_todo
2021/10/20 01:31 net-next-old cb3dc8901ba4 466b7db1 .config console log report info ci-upstream-net-kasan-gce INFO: task hung in netdev_run_todo
2021/10/19 23:58 net-next-old cb3dc8901ba4 466b7db1 .config console log report info ci-upstream-net-kasan-gce INFO: task hung in netdev_run_todo
2021/10/19 22:28 net-next-old cb3dc8901ba4 466b7db1 .config console log report info ci-upstream-net-kasan-gce INFO: task hung in netdev_run_todo
2021/10/19 22:11 net-next-old cb3dc8901ba4 466b7db1 .config console log report info ci-upstream-net-kasan-gce INFO: task hung in netdev_run_todo
2021/10/19 21:00 net-next-old cb3dc8901ba4 466b7db1 .config console log report info ci-upstream-net-kasan-gce INFO: task hung in netdev_run_todo
2021/10/19 19:35 net-next-old cb3dc8901ba4 466b7db1 .config console log report info ci-upstream-net-kasan-gce INFO: task hung in netdev_run_todo
2021/10/19 18:33 net-next-old cb3dc8901ba4 466b7db1 .config console log report info ci-upstream-net-kasan-gce INFO: task hung in netdev_run_todo
2021/10/19 13:55 net-next-old cb3dc8901ba4 24dc29db .config console log report info ci-upstream-net-kasan-gce INFO: task hung in netdev_run_todo
2021/10/19 12:51 net-next-old cb3dc8901ba4 24dc29db .config console log report info ci-upstream-net-kasan-gce INFO: task hung in netdev_run_todo
2021/10/19 10:03 net-next-old f616447034a1 24dc29db .config console log report info ci-upstream-net-kasan-gce INFO: task hung in netdev_run_todo
2021/10/19 08:41 net-next-old f616447034a1 24dc29db .config console log report info ci-upstream-net-kasan-gce INFO: task hung in netdev_run_todo
2021/10/19 00:39 net-next-old f616447034a1 24dc29db .config console log report info ci-upstream-net-kasan-gce INFO: task hung in netdev_run_todo
2021/10/18 23:26 net-next-old f616447034a1 24dc29db .config console log report info ci-upstream-net-kasan-gce INFO: task hung in netdev_run_todo
2021/10/18 15:28 net-next-old d40dfa0cebd8 0c5d9412 .config console log report info ci-upstream-net-kasan-gce INFO: task hung in netdev_run_todo
2021/10/18 15:14 net-next-old d40dfa0cebd8 0c5d9412 .config console log report info ci-upstream-net-kasan-gce INFO: task hung in netdev_run_todo
2021/10/18 14:12 net-next-old d40dfa0cebd8 0c5d9412 .config console log report info ci-upstream-net-kasan-gce INFO: task hung in netdev_run_todo
2021/10/18 14:06 net-next-old d40dfa0cebd8 0c5d9412 .config console log report info ci-upstream-net-kasan-gce INFO: task hung in netdev_run_todo
2021/10/18 13:05 net-next-old d40dfa0cebd8 0c5d9412 .config console log report info ci-upstream-net-kasan-gce INFO: task hung in netdev_run_todo
2021/10/18 12:30 net-next-old d40dfa0cebd8 0c5d9412 .config console log report info ci-upstream-net-kasan-gce INFO: task hung in netdev_run_todo
2021/10/21 02:05 linux-next 51dba6e335ff f111d03b .config console log report info ci-upstream-linux-next-kasan-gce-root INFO: task hung in netdev_run_todo
2021/10/21 00:17 linux-next 51dba6e335ff f111d03b .config console log report info ci-upstream-linux-next-kasan-gce-root INFO: task hung in netdev_run_todo
2021/10/20 22:11 linux-next 51dba6e335ff f111d03b .config console log report info ci-upstream-linux-next-kasan-gce-root INFO: task hung in netdev_run_todo
2021/10/20 13:42 linux-next 51dba6e335ff 418a00eb .config console log report info ci-upstream-linux-next-kasan-gce-root INFO: task hung in netdev_run_todo
2021/10/20 12:42 linux-next 51dba6e335ff 418a00eb .config console log report info ci-upstream-linux-next-kasan-gce-root INFO: task hung in netdev_run_todo
2021/10/20 11:25 linux-next 51dba6e335ff 418a00eb .config console log report info ci-upstream-linux-next-kasan-gce-root INFO: task hung in netdev_run_todo
2021/10/20 10:21 linux-next 51dba6e335ff 418a00eb .config console log report info ci-upstream-linux-next-kasan-gce-root INFO: task hung in netdev_run_todo
2021/10/20 10:15 linux-next 51dba6e335ff 418a00eb .config console log report info ci-upstream-linux-next-kasan-gce-root INFO: task hung in netdev_run_todo
2021/10/20 08:13 linux-next 51dba6e335ff 466b7db1 .config console log report info ci-upstream-linux-next-kasan-gce-root INFO: task hung in netdev_run_todo
2020/10/06 11:11 upstream 7575fdda569b 1880b4a9 .config console log report info ci-upstream-kasan-gce-selinux-root
2020/03/07 11:29 upstream fb279f4e2386 fd2a5f28 .config console log report ci-upstream-kasan-gce-root
2021/01/13 04:47 net-next-old c73a45965dd5 0cdd6185 .config console log report info ci-upstream-net-kasan-gce
* Struck through repros no longer work on HEAD.