syzbot


INFO: task hung in ovs_dp_cmd_get

Status: auto-closed as invalid on 2020/01/08 04:23
Subsystems: openvswitch
[Documentation on labels]
First crash: 1994d, last: 1994d

Sample crash report:
INFO: task syz-executor.5:13620 blocked for more than 143 seconds.
      Not tainted 5.3.0+ #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
syz-executor.5  D27512 13620  13600 0x00004004
Call Trace:
 context_switch kernel/sched/core.c:3384 [inline]
 __schedule+0x94f/0x1e70 kernel/sched/core.c:4069
 schedule+0xd9/0x260 kernel/sched/core.c:4136
 schedule_preempt_disabled+0x13/0x20 kernel/sched/core.c:4195
 __mutex_lock_common kernel/locking/mutex.c:1033 [inline]
 __mutex_lock+0x7b0/0x13c0 kernel/locking/mutex.c:1103
 mutex_lock_nested+0x16/0x20 kernel/locking/mutex.c:1118
 ovs_lock net/openvswitch/datapath.c:105 [inline]
 ovs_dp_cmd_get+0x4f/0x310 net/openvswitch/datapath.c:1794
 genl_family_rcv_msg+0x74b/0xf90 net/netlink/genetlink.c:629
 genl_rcv_msg+0xca/0x170 net/netlink/genetlink.c:654
 netlink_rcv_skb+0x177/0x450 net/netlink/af_netlink.c:2477
 genl_rcv+0x29/0x40 net/netlink/genetlink.c:665
 netlink_unicast_kernel net/netlink/af_netlink.c:1302 [inline]
 netlink_unicast+0x531/0x710 net/netlink/af_netlink.c:1328
 netlink_sendmsg+0x8a5/0xd60 net/netlink/af_netlink.c:1917
 sock_sendmsg_nosec net/socket.c:637 [inline]
 sock_sendmsg+0xd7/0x130 net/socket.c:657
 ___sys_sendmsg+0x803/0x920 net/socket.c:2311
 __sys_sendmsg+0x105/0x1d0 net/socket.c:2356
 __do_sys_sendmsg net/socket.c:2365 [inline]
 __se_sys_sendmsg net/socket.c:2363 [inline]
 __x64_sys_sendmsg+0x78/0xb0 net/socket.c:2363
 do_syscall_64+0xfa/0x760 arch/x86/entry/common.c:290
 entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x459a59
Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 <90> 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90
RSP: 002b:00007fa1548c3c78 EFLAGS: 00000246 ORIG_RAX: 000000000000002e
RAX: ffffffffffffffda RBX: 0000000000000003 RCX: 0000000000459a59
RDX: 0000000000000000 RSI: 0000000020000180 RDI: 0000000000000003
RBP: 000000000075bf20 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 00007fa1548c46d4
R13: 00000000004c7b64 R14: 00000000004dd8c0 R15: 00000000ffffffff
INFO: task syz-executor.5:13622 blocked for more than 143 seconds.
      Not tainted 5.3.0+ #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
syz-executor.5  D27808 13622  13600 0x00004004
Call Trace:
 context_switch kernel/sched/core.c:3384 [inline]
 __schedule+0x94f/0x1e70 kernel/sched/core.c:4069
 schedule+0xd9/0x260 kernel/sched/core.c:4136
 schedule_preempt_disabled+0x13/0x20 kernel/sched/core.c:4195
 __mutex_lock_common kernel/locking/mutex.c:1033 [inline]
 __mutex_lock+0x7b0/0x13c0 kernel/locking/mutex.c:1103
 mutex_lock_nested+0x16/0x20 kernel/locking/mutex.c:1118
 ovs_lock net/openvswitch/datapath.c:105 [inline]
 ovs_dp_cmd_get+0x4f/0x310 net/openvswitch/datapath.c:1794
 genl_family_rcv_msg+0x74b/0xf90 net/netlink/genetlink.c:629
 genl_rcv_msg+0xca/0x170 net/netlink/genetlink.c:654
 netlink_rcv_skb+0x177/0x450 net/netlink/af_netlink.c:2477
 genl_rcv+0x29/0x40 net/netlink/genetlink.c:665
 netlink_unicast_kernel net/netlink/af_netlink.c:1302 [inline]
 netlink_unicast+0x531/0x710 net/netlink/af_netlink.c:1328
 netlink_sendmsg+0x8a5/0xd60 net/netlink/af_netlink.c:1917
 sock_sendmsg_nosec net/socket.c:637 [inline]
 sock_sendmsg+0xd7/0x130 net/socket.c:657
 ___sys_sendmsg+0x803/0x920 net/socket.c:2311
 __sys_sendmsg+0x105/0x1d0 net/socket.c:2356
 __do_sys_sendmsg net/socket.c:2365 [inline]
 __se_sys_sendmsg net/socket.c:2363 [inline]
 __x64_sys_sendmsg+0x78/0xb0 net/socket.c:2363
 do_syscall_64+0xfa/0x760 arch/x86/entry/common.c:290
 entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x459a59
Code: Bad RIP value.
RSP: 002b:00007fa1548a2c78 EFLAGS: 00000246 ORIG_RAX: 000000000000002e
RAX: ffffffffffffffda RBX: 0000000000000003 RCX: 0000000000459a59
RDX: 0000000000000000 RSI: 0000000020000180 RDI: 0000000000000003
RBP: 000000000075bfc8 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 00007fa1548a36d4
R13: 00000000004c7b64 R14: 00000000004dd8c0 R15: 00000000ffffffff
INFO: task syz-executor.0:13632 blocked for more than 144 seconds.
      Not tainted 5.3.0+ #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
syz-executor.0  D27592 13632  13609 0x00000004
Call Trace:
 context_switch kernel/sched/core.c:3384 [inline]
 __schedule+0x94f/0x1e70 kernel/sched/core.c:4069
 schedule+0xd9/0x260 kernel/sched/core.c:4136
 schedule_preempt_disabled+0x13/0x20 kernel/sched/core.c:4195
 __mutex_lock_common kernel/locking/mutex.c:1033 [inline]
 __mutex_lock+0x7b0/0x13c0 kernel/locking/mutex.c:1103
 mutex_lock_nested+0x16/0x20 kernel/locking/mutex.c:1118
 ovs_lock net/openvswitch/datapath.c:105 [inline]
 ovs_dp_cmd_new+0x5d9/0xe30 net/openvswitch/datapath.c:1642
 genl_family_rcv_msg+0x74b/0xf90 net/netlink/genetlink.c:629
 genl_rcv_msg+0xca/0x170 net/netlink/genetlink.c:654
 netlink_rcv_skb+0x177/0x450 net/netlink/af_netlink.c:2477
 genl_rcv+0x29/0x40 net/netlink/genetlink.c:665
 netlink_unicast_kernel net/netlink/af_netlink.c:1302 [inline]
 netlink_unicast+0x531/0x710 net/netlink/af_netlink.c:1328
 netlink_sendmsg+0x8a5/0xd60 net/netlink/af_netlink.c:1917
 sock_sendmsg_nosec net/socket.c:637 [inline]
 sock_sendmsg+0xd7/0x130 net/socket.c:657
 ___sys_sendmsg+0x803/0x920 net/socket.c:2311
 __sys_sendmsg+0x105/0x1d0 net/socket.c:2356
 __do_sys_sendmsg net/socket.c:2365 [inline]
 __se_sys_sendmsg net/socket.c:2363 [inline]
 __x64_sys_sendmsg+0x78/0xb0 net/socket.c:2363
 do_syscall_64+0xfa/0x760 arch/x86/entry/common.c:290
 entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x459a59
Code: Bad RIP value.
RSP: 002b:00007f1c2cb42c78 EFLAGS: 00000246 ORIG_RAX: 000000000000002e
RAX: ffffffffffffffda RBX: 0000000000000003 RCX: 0000000000459a59
RDX: 0000000005000000 RSI: 0000000020000040 RDI: 0000000000000004
RBP: 000000000075bf20 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 00007f1c2cb436d4
R13: 00000000004c7b64 R14: 00000000004dd8c0 R15: 00000000ffffffff
INFO: task syz-executor.3:13649 blocked for more than 144 seconds.
      Not tainted 5.3.0+ #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
syz-executor.3  D28184 13649  13606 0x00004004
Call Trace:
 context_switch kernel/sched/core.c:3384 [inline]
 __schedule+0x94f/0x1e70 kernel/sched/core.c:4069
 schedule+0xd9/0x260 kernel/sched/core.c:4136
 schedule_preempt_disabled+0x13/0x20 kernel/sched/core.c:4195
 __mutex_lock_common kernel/locking/mutex.c:1033 [inline]
 __mutex_lock+0x7b0/0x13c0 kernel/locking/mutex.c:1103
 mutex_lock_nested+0x16/0x20 kernel/locking/mutex.c:1118
 ovs_lock net/openvswitch/datapath.c:105 [inline]
 ovs_dp_cmd_set+0x55/0x2d0 net/openvswitch/datapath.c:1759
 genl_family_rcv_msg+0x74b/0xf90 net/netlink/genetlink.c:629
 genl_rcv_msg+0xca/0x170 net/netlink/genetlink.c:654
 netlink_rcv_skb+0x177/0x450 net/netlink/af_netlink.c:2477
 genl_rcv+0x29/0x40 net/netlink/genetlink.c:665
 netlink_unicast_kernel net/netlink/af_netlink.c:1302 [inline]
 netlink_unicast+0x531/0x710 net/netlink/af_netlink.c:1328
 netlink_sendmsg+0x8a5/0xd60 net/netlink/af_netlink.c:1917
 sock_sendmsg_nosec net/socket.c:637 [inline]
 sock_sendmsg+0xd7/0x130 net/socket.c:657
 ___sys_sendmsg+0x803/0x920 net/socket.c:2311
 __sys_sendmsg+0x105/0x1d0 net/socket.c:2356
 __do_sys_sendmsg net/socket.c:2365 [inline]
 __se_sys_sendmsg net/socket.c:2363 [inline]
 __x64_sys_sendmsg+0x78/0xb0 net/socket.c:2363
 do_syscall_64+0xfa/0x760 arch/x86/entry/common.c:290
 entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x459a59
Code: Bad RIP value.
RSP: 002b:00007fbbdcf9ec78 EFLAGS: 00000246 ORIG_RAX: 000000000000002e
RAX: ffffffffffffffda RBX: 0000000000000003 RCX: 0000000000459a59
RDX: 0000000000000000 RSI: 0000000020000180 RDI: 0000000000000003
RBP: 000000000075bf20 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 00007fbbdcf9f6d4
R13: 00000000004c7b64 R14: 00000000004dd8c0 R15: 00000000ffffffff

Showing all locks held in the system:
1 lock held by khungtaskd/1064:
 #0: ffffffff88faad00 (rcu_read_lock){....}, at: debug_show_all_locks+0x5f/0x27e kernel/locking/lockdep.c:5337
1 lock held by rsyslogd/8615:
 #0: ffff88808d20eba0 (&f->f_pos_lock){+.+.}, at: __fdget_pos+0xee/0x110 fs/file.c:801
2 locks held by getty/8705:
 #0: ffff88809af78c50 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:340
 #1: ffffc90005f3d2e0 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1c10 drivers/tty/n_tty.c:2156
2 locks held by getty/8706:
 #0: ffff888097ca1210 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:340
 #1: ffffc90005f312e0 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1c10 drivers/tty/n_tty.c:2156
2 locks held by getty/8707:
 #0: ffff8880a7819290 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:340
 #1: ffffc90005f412e0 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1c10 drivers/tty/n_tty.c:2156
2 locks held by getty/8708:
 #0: ffff8880a7818190 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:340
 #1: ffffc90005f4b2e0 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1c10 drivers/tty/n_tty.c:2156
2 locks held by getty/8709:
 #0: ffff8880a7818a10 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:340
 #1: ffffc90005f472e0 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1c10 drivers/tty/n_tty.c:2156
2 locks held by getty/8710:
 #0: ffff88809b684c10 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:340
 #1: ffffc90005f252e0 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1c10 drivers/tty/n_tty.c:2156
2 locks held by getty/8711:
 #0: ffff8880a8d54ed0 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:340
 #1: ffffc90005f192e0 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1c10 drivers/tty/n_tty.c:2156
5 locks held by kworker/u4:0/25393:
 #0: ffff8880a9826428 ((wq_completion)netns){+.+.}, at: __write_once_size include/linux/compiler.h:226 [inline]
 #0: ffff8880a9826428 ((wq_completion)netns){+.+.}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline]
 #0: ffff8880a9826428 ((wq_completion)netns){+.+.}, at: atomic64_set include/asm-generic/atomic-instrumented.h:855 [inline]
 #0: ffff8880a9826428 ((wq_completion)netns){+.+.}, at: atomic_long_set include/asm-generic/atomic-long.h:40 [inline]
 #0: ffff8880a9826428 ((wq_completion)netns){+.+.}, at: set_work_data kernel/workqueue.c:620 [inline]
 #0: ffff8880a9826428 ((wq_completion)netns){+.+.}, at: set_work_pool_and_clear_pending kernel/workqueue.c:647 [inline]
 #0: ffff8880a9826428 ((wq_completion)netns){+.+.}, at: process_one_work+0x88b/0x1740 kernel/workqueue.c:2240
 #1: ffff888201ecfdc0 (net_cleanup_work){+.+.}, at: process_one_work+0x8c1/0x1740 kernel/workqueue.c:2244
 #2: ffffffff8998aa08 (pernet_ops_rwsem){++++}, at: cleanup_net+0xae/0xa60 net/core/net_namespace.c:556
 #3: ffffffff89be56e0 (ovs_mutex){+.+.}, at: ovs_lock net/openvswitch/datapath.c:105 [inline]
 #3: ffffffff89be56e0 (ovs_mutex){+.+.}, at: ovs_exit_net+0x206/0xc30 net/openvswitch/datapath.c:2421
 #4: ffffffff88fae9d8 (rcu_state.barrier_mutex){+.+.}, at: rcu_barrier+0x47/0x350 kernel/rcu/tree.c:2894
2 locks held by syz-executor.5/13620:
 #0: ffffffff899e8a28 (cb_lock){++++}, at: genl_rcv+0x1a/0x40 net/netlink/genetlink.c:664
 #1: ffffffff89be56e0 (ovs_mutex){+.+.}, at: ovs_lock net/openvswitch/datapath.c:105 [inline]
 #1: ffffffff89be56e0 (ovs_mutex){+.+.}, at: ovs_dp_cmd_get+0x4f/0x310 net/openvswitch/datapath.c:1794
2 locks held by syz-executor.5/13622:
 #0: ffffffff899e8a28 (cb_lock){++++}, at: genl_rcv+0x1a/0x40 net/netlink/genetlink.c:664
 #1: ffffffff89be56e0 (ovs_mutex){+.+.}, at: ovs_lock net/openvswitch/datapath.c:105 [inline]
 #1: ffffffff89be56e0 (ovs_mutex){+.+.}, at: ovs_dp_cmd_get+0x4f/0x310 net/openvswitch/datapath.c:1794
2 locks held by kworker/u4:4/13625:
 #0: ffff8880ae834d18 (&rq->lock){-.-.}, at: rq_lock kernel/sched/sched.h:1215 [inline]
 #0: ffff8880ae834d18 (&rq->lock){-.-.}, at: __schedule+0x266/0x1e70 kernel/sched/core.c:4017
 #1: ffff888013287dc0 ((work_completion)(&(&bat_priv->nc.work)->work)){+.+.}, at: process_one_work+0x8c1/0x1740 kernel/workqueue.c:2244
2 locks held by syz-executor.0/13632:
 #0: ffffffff899e8a28 (cb_lock){++++}, at: genl_rcv+0x1a/0x40 net/netlink/genetlink.c:664
 #1: ffffffff89be56e0 (ovs_mutex){+.+.}, at: ovs_lock net/openvswitch/datapath.c:105 [inline]
 #1: ffffffff89be56e0 (ovs_mutex){+.+.}, at: ovs_dp_cmd_new+0x5d9/0xe30 net/openvswitch/datapath.c:1642
2 locks held by syz-executor.3/13649:
 #0: ffffffff899e8a28 (cb_lock){++++}, at: genl_rcv+0x1a/0x40 net/netlink/genetlink.c:664
 #1: ffffffff89be56e0 (ovs_mutex){+.+.}, at: ovs_lock net/openvswitch/datapath.c:105 [inline]
 #1: ffffffff89be56e0 (ovs_mutex){+.+.}, at: ovs_dp_cmd_set+0x55/0x2d0 net/openvswitch/datapath.c:1759

=============================================

NMI backtrace for cpu 1
CPU: 1 PID: 1064 Comm: khungtaskd Not tainted 5.3.0+ #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Call Trace:
 __dump_stack lib/dump_stack.c:77 [inline]
 dump_stack+0x172/0x1f0 lib/dump_stack.c:113
 nmi_cpu_backtrace.cold+0x70/0xb2 lib/nmi_backtrace.c:101
 nmi_trigger_cpumask_backtrace+0x23b/0x28b lib/nmi_backtrace.c:62
 arch_trigger_cpumask_backtrace+0x14/0x20 arch/x86/kernel/apic/hw_nmi.c:38
 trigger_all_cpu_backtrace include/linux/nmi.h:146 [inline]
 check_hung_uninterruptible_tasks kernel/hung_task.c:205 [inline]
 watchdog+0x9d0/0xef0 kernel/hung_task.c:289
 kthread+0x361/0x430 kernel/kthread.c:255
 ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:352
Sending NMI from CPU 1 to CPUs 0:
NMI backtrace for cpu 0
CPU: 0 PID: 25393 Comm: kworker/u4:0 Not tainted 5.3.0+ #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Workqueue: netns cleanup_net
RIP: 0010:io_serial_in+0x6b/0x90 drivers/tty/serial/8250/8250_port.c:451
Code: e9 00 00 00 49 8d 7c 24 38 48 b8 00 00 00 00 00 fc ff df 48 89 fa 48 c1 ea 03 d3 e3 80 3c 02 00 75 17 41 03 5c 24 38 89 da ec <5b> 0f b6 c0 41 5c 5d c3 e8 08 99 20 fe eb c2 e8 61 99 20 fe eb e2
RSP: 0018:ffff888201ecf5c0 EFLAGS: 00000002
RAX: dffffc0000000000 RBX: 00000000000003fd RCX: 0000000000000000
RDX: 00000000000003fd RSI: ffffffff838dc3d1 RDI: ffffffff8b56f158
RBP: ffff888201ecf5d0 R08: ffff88803f2ee3c0 R09: ffffed10403d9ebf
R10: ffffed10403d9ebe R11: 0000000000000003 R12: ffffffff8b56f120
R13: 0000000000000020 R14: 0000000000000000 R15: fffffbfff16ade2d
FS:  0000000000000000(0000) GS:ffff8880ae800000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: ffffffffff600400 CR3: 00000000903a2000 CR4: 00000000001406f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 serial_in drivers/tty/serial/8250/8250.h:113 [inline]
 wait_for_xmitr+0xa1/0x230 drivers/tty/serial/8250/8250_port.c:1969
 serial8250_console_putchar+0x1f/0x60 drivers/tty/serial/8250/8250_port.c:3110
 uart_console_write+0x54/0x110 drivers/tty/serial/serial_core.c:1928
 serial8250_console_write+0x612/0x9a0 drivers/tty/serial/8250/8250_port.c:3174
 univ8250_console_write+0x5f/0x70 drivers/tty/serial/8250/8250_core.c:587
 call_console_drivers kernel/printk/printk.c:1791 [inline]
 console_unlock+0xb89/0xf10 kernel/printk/printk.c:2473
 vprintk_emit+0x2a0/0x700 kernel/printk/printk.c:1996
 vprintk_default+0x28/0x30 kernel/printk/printk.c:2023
 vprintk_func+0x7e/0x189 kernel/printk/printk_safe.c:386
 printk+0xba/0xed kernel/printk/printk.c:2056
 __dev_set_promiscuity.cold+0x48/0x343 net/core/dev.c:7406
 dev_set_promiscuity+0x57/0xe0 net/core/dev.c:7445
 internal_dev_destroy+0xa1/0x150 net/openvswitch/vport-internal_dev.c:220
 ovs_vport_del+0x15e/0x1d0 net/openvswitch/vport.c:253
 ovs_dp_detach_port+0x126/0x1b0 net/openvswitch/datapath.c:212
 __dp_destroy+0x351/0x450 net/openvswitch/datapath.c:1710
 ovs_exit_net+0x287/0xc30 net/openvswitch/datapath.c:2423
 ops_exit_list.isra.0+0xaa/0x150 net/core/net_namespace.c:172
 cleanup_net+0x4e2/0xa60 net/core/net_namespace.c:594
 process_one_work+0x9af/0x1740 kernel/workqueue.c:2269
 worker_thread+0x98/0xe40 kernel/workqueue.c:2415
 kthread+0x361/0x430 kernel/kthread.c:255
 ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:352

Crashes (1):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2019/10/10 04:15 bpf 106c35dda32f c4b9981b .config console log report ci-upstream-bpf-kasan-gce
* Struck through repros no longer work on HEAD.