syzbot


INFO: task hung in netdev_run_todo

Status: auto-closed as invalid on 2019/02/22 14:57
First crash: 2418d, last: 2418d
Similar bugs (11)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
linux-4.19 INFO: task hung in netdev_run_todo (3) 15 757d 1073d 0/1 auto-obsoleted due to no activity on 2023/03/07 08:19
upstream INFO: task hung in netdev_run_todo net 12 1931d 2486d 0/28 closed as invalid on 2019/10/23 07:29
linux-4.19 INFO: task hung in netdev_run_todo (2) 3 1564d 1612d 0/1 auto-closed as invalid on 2020/12/20 04:57
android-44 INFO: task hung in netdev_run_todo 1 2426d 2426d 0/2 auto-closed as invalid on 2019/02/22 12:49
upstream INFO: task hung in netdev_run_todo (4) wireguard 94 8d16h 55d 0/28 upstream: reported on 2024/10/09 19:06
linux-4.19 INFO: task hung in netdev_run_todo 1 1890d 1890d 0/1 auto-closed as invalid on 2020/01/29 06:48
upstream INFO: task hung in netdev_run_todo (3) net 24 168d 206d 0/28 auto-obsoleted due to no activity on 2024/08/07 04:24
linux-5.15 INFO: task hung in netdev_run_todo 1 403d 403d 0/3 auto-obsoleted due to no activity on 2024/02/04 09:09
upstream INFO: task hung in netdev_run_todo (2) staging wireguard usb C error 241 294d 1451d 0/28 auto-obsoleted due to no activity on 2024/05/05 22:51
linux-4.14 INFO: task hung in netdev_run_todo 1 751d 751d 0/1 auto-obsoleted due to no activity on 2023/03/13 17:45
linux-5.15 INFO: task hung in netdev_run_todo (2) 54 16d 197d 0/3 upstream: reported on 2024/05/20 16:49

Sample crash report:
IPVS: set_ctl: invalid protocol: 191 0.0.0.0:20002 lblc
device lo left promiscuous mode
INFO: task kworker/u4:3:41 blocked for more than 120 seconds.
      Not tainted 4.9.95-gee0bcd6 #6
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
kworker/u4:3    D24552    41      2 0x00000000
Workqueue: netns cleanup_net
 ffff8801d95cc800 ffff8801b0542f40 ffff8801c5a4b9c0 ffff8801a4646000
 ffff8801db221b98 ffff8801d9677778 ffffffff839e140d ffff8801d95cd0c8
 ffffed003b2b9a18 ffff8801d95cc800 00fffc0000000000 ffff8801db222468
Call Trace:
 [<ffffffff839e2a0f>] schedule+0x7f/0x1b0 kernel/sched/core.c:3557
 [<ffffffff839e3393>] schedule_preempt_disabled+0x13/0x20 kernel/sched/core.c:3590
 [<ffffffff839e7816>] __mutex_lock_common kernel/locking/mutex.c:582 [inline]
 [<ffffffff839e7816>] mutex_lock_nested+0x326/0x870 kernel/locking/mutex.c:621
 [<ffffffff830af6a7>] rtnl_lock+0x17/0x20 net/core/rtnetlink.c:70
 [<ffffffff8308a369>] netdev_run_todo+0x169/0x650 net/core/dev.c:7525
 [<ffffffff830af6be>] rtnl_unlock+0xe/0x10 net/core/rtnetlink.c:104
 [<ffffffff8346b9f4>] ip_tunnel_delete_net+0x2b4/0x390 net/ipv4/ip_tunnel.c:1061
 [<ffffffff8348dcb9>] ipip_exit_net+0x129/0x1f0 net/ipv4/ipip.c:652
 [<ffffffff83053c80>] ops_exit_list.isra.6+0xb0/0x160 net/core/net_namespace.c:136
 [<ffffffff83056b51>] cleanup_net+0x321/0x630 net/core/net_namespace.c:473
 [<ffffffff8118ae01>] process_one_work+0x7e1/0x1500 kernel/workqueue.c:2092
 [<ffffffff8118bbf6>] worker_thread+0xd6/0x10a0 kernel/workqueue.c:2226
 [<ffffffff8119ad2d>] kthread+0x26d/0x300 kernel/kthread.c:211
 [<ffffffff839f24dc>] ret_from_fork+0x5c/0x70 arch/x86/entry/entry_64.S:373

Showing all locks held in the system:
4 locks held by kworker/u4:3/41:
 #0:  ("%s""netns"){.+.+.+}, at: [<ffffffff8118ad0e>] work_static include/linux/workqueue.h:186 [inline]
 #0:  ("%s""netns"){.+.+.+}, at: [<ffffffff8118ad0e>] set_work_data kernel/workqueue.c:617 [inline]
 #0:  ("%s""netns"){.+.+.+}, at: [<ffffffff8118ad0e>] set_work_pool_and_clear_pending kernel/workqueue.c:644 [inline]
 #0:  ("%s""netns"){.+.+.+}, at: [<ffffffff8118ad0e>] process_one_work+0x6ee/0x1500 kernel/workqueue.c:2085
 #1:  (net_cleanup_work){+.+.+.}, at: [<ffffffff8118ad48>] process_one_work+0x728/0x1500 kernel/workqueue.c:2089
 #2:  (net_mutex){+.+.+.}, at: [<ffffffff8305696f>] cleanup_net+0x13f/0x630 net/core/net_namespace.c:439
 #3:  (rtnl_mutex){+.+.+.}, at: [<ffffffff830af6a7>] rtnl_lock+0x17/0x20 net/core/rtnetlink.c:70
2 locks held by khungtaskd/519:
 #0:  (rcu_read_lock){......}, at: [<ffffffff813646bc>] check_hung_uninterruptible_tasks kernel/hung_task.c:168 [inline]
 #0:  (rcu_read_lock){......}, at: [<ffffffff813646bc>] watchdog+0x11c/0xa20 kernel/hung_task.c:239
 #1:  (tasklist_lock){.+.+..}, at: [<ffffffff81423cb0>] debug_show_all_locks+0x79/0x218 kernel/locking/lockdep.c:4336
2 locks held by getty/3776:
 #0:  (&tty->ldisc_sem){++++++}, at: [<ffffffff839f04b2>] ldsem_down_read+0x32/0x40 drivers/tty/tty_ldsem.c:367
 #1:  (&ldata->atomic_read_lock){+.+.+.}, at: [<ffffffff8211cb02>] n_tty_read+0x202/0x16b0 drivers/tty/n_tty.c:2133
1 lock held by syz-executor1/3863:
 #0:  (rtnl_mutex){+.+.+.}, at: [<ffffffff830af6a7>] rtnl_lock+0x17/0x20 net/core/rtnetlink.c:70
3 locks held by kworker/0:3/979:
 #0:  ("%s"("ipv6_addrconf")){.+.+..}, at: [<ffffffff8118ad0e>] work_static include/linux/workqueue.h:186 [inline]
 #0:  ("%s"("ipv6_addrconf")){.+.+..}, at: [<ffffffff8118ad0e>] set_work_data kernel/workqueue.c:617 [inline]
 #0:  ("%s"("ipv6_addrconf")){.+.+..}, at: [<ffffffff8118ad0e>] set_work_pool_and_clear_pending kernel/workqueue.c:644 [inline]
 #0:  ("%s"("ipv6_addrconf")){.+.+..}, at: [<ffffffff8118ad0e>] process_one_work+0x6ee/0x1500 kernel/workqueue.c:2085
 #1:  ((addr_chk_work).work){+.+...}, at: [<ffffffff8118ad48>] process_one_work+0x728/0x1500 kernel/workqueue.c:2089
 #2:  (rtnl_mutex){+.+.+.}, at: [<ffffffff830af6a7>] rtnl_lock+0x17/0x20 net/core/rtnetlink.c:70
1 lock held by syz-executor3/2502:
 #0:  (net_mutex){+.+.+.}, at: [<ffffffff83056fb5>] copy_net_ns+0x155/0x290 net/core/net_namespace.c:406
1 lock held by syz-executor1/2550:
 #0:  (rtnl_mutex){+.+.+.}, at: [<ffffffff830af6a7>] rtnl_lock+0x17/0x20 net/core/rtnetlink.c:70
1 lock held by syz-executor7/2518:
 #0:  (ipvs->sync_mutex){+.+.+.}, at: [<ffffffff832dd2c5>] do_ip_vs_set_ctl+0x645/0xbd0 net/netfilter/ipvs/ip_vs_ctl.c:2402
2 locks held by syz-executor7/2557:
 #0:  (rtnl_mutex){+.+.+.}, at: [<ffffffff830af6a7>] rtnl_lock+0x17/0x20 net/core/rtnetlink.c:70
 #1:  (ipvs->sync_mutex){+.+.+.}, at: [<ffffffff832dd58d>] do_ip_vs_set_ctl+0x90d/0xbd0 net/netfilter/ipvs/ip_vs_ctl.c:2397
1 lock held by syz-executor6/2524:
 #0:  (net_mutex){+.+.+.}, at: [<ffffffff83056fb5>] copy_net_ns+0x155/0x290 net/core/net_namespace.c:406
1 lock held by syz-executor6/2562:
 #0:  (net_mutex){+.+.+.}, at: [<ffffffff83056fb5>] copy_net_ns+0x155/0x290 net/core/net_namespace.c:406
1 lock held by syz-executor4/2526:
 #0:  (rtnl_mutex){+.+.+.}, at: [<ffffffff830af6a7>] rtnl_lock+0x17/0x20 net/core/rtnetlink.c:70
1 lock held by ipvs-b:45:0/2553:
 #0:  (rtnl_mutex){+.+.+.}, at: [<ffffffff830af6a7>] rtnl_lock+0x17/0x20 net/core/rtnetlink.c:70

=============================================

NMI backtrace for cpu 1
CPU: 1 PID: 519 Comm: khungtaskd Not tainted 4.9.95-gee0bcd6 #6
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
 ffff8801d874fd08 ffffffff81eb0f89 0000000000000000 0000000000000001
 0000000000000001 0000000000000001 ffffffff810b7d60 ffff8801d874fd40
 ffffffff81ebc2b7 0000000000000001 0000000000000000 0000000000000002
Call Trace:
 [<ffffffff81eb0f89>] __dump_stack lib/dump_stack.c:15 [inline]
 [<ffffffff81eb0f89>] dump_stack+0xc1/0x128 lib/dump_stack.c:51
 [<ffffffff81ebc2b7>] nmi_cpu_backtrace.cold.2+0x48/0x87 lib/nmi_backtrace.c:99
 [<ffffffff81ebc24a>] nmi_trigger_cpumask_backtrace+0x12a/0x14f lib/nmi_backtrace.c:60
 [<ffffffff810b7e64>] arch_trigger_cpumask_backtrace+0x14/0x20 arch/x86/kernel/apic/hw_nmi.c:37
 [<ffffffff81364c54>] trigger_all_cpu_backtrace include/linux/nmi.h:58 [inline]
 [<ffffffff81364c54>] check_hung_task kernel/hung_task.c:125 [inline]
 [<ffffffff81364c54>] check_hung_uninterruptible_tasks kernel/hung_task.c:182 [inline]
 [<ffffffff81364c54>] watchdog+0x6b4/0xa20 kernel/hung_task.c:239
 [<ffffffff8119ad2d>] kthread+0x26d/0x300 kernel/kthread.c:211
 [<ffffffff839f24dc>] ret_from_fork+0x5c/0x70 arch/x86/entry/entry_64.S:373
Sending NMI from CPU 1 to CPUs 0:
NMI backtrace for cpu 0 skipped: idling at pc 0xffffffff839f0f16

Crashes (1):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2018/04/21 15:28 https://android.googlesource.com/kernel/common android-4.9 ee0bcd679075 d23fcf6c .config console log report ci-android-49-kasan-gce-386
* Struck through repros no longer work on HEAD.