syzbot


INFO: task hung in ovs_ct_limit_cmd_del

Status: auto-closed as invalid on 2020/08/21 02:37
Subsystems: openvswitch
[Documentation on labels]
First crash: 1768d, last: 1768d

Sample crash report:
INFO: task syz-executor.0:10678 blocked for more than 143 seconds.
      Not tainted 5.7.0-rc5-syzkaller #0
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
syz-executor.0  D26088 10678   7044 0x00004004
Call Trace:
 context_switch kernel/sched/core.c:3367 [inline]
 __schedule+0x937/0x1ff0 kernel/sched/core.c:4083
 __sched_text_start+0x8/0x8
 schedule+0xd0/0x2a0 kernel/sched/core.c:4158
 schedule_preempt_disabled+0xf/0x20 kernel/sched/core.c:4217
 __mutex_lock_common kernel/locking/mutex.c:1033 [inline]
 __mutex_lock+0x7ab/0x13c0 kernel/locking/mutex.c:1103
 ovs_ct_limit_del_zone_limit net/openvswitch/conntrack.c:2003 [inline]
 ovs_ct_limit_cmd_del+0x40c/0x9b0 net/openvswitch/conntrack.c:2175
 mutex_trylock+0x2c0/0x2c0 kernel/locking/mutex.c:126
 vprintk_func+0x81/0x17e kernel/printk/printk_safe.c:385
 printk+0xc9/0xed kernel/printk/printk.c:2076
 ovs_ct_limit_del_zone_limit net/openvswitch/conntrack.c:2001 [inline]
 ovs_ct_limit_cmd_del+0x36e/0x9b0 net/openvswitch/conntrack.c:2175
 ovs_ct_limit_del_zone_limit net/openvswitch/conntrack.c:2003 [inline]
 ovs_ct_limit_cmd_del+0x40c/0x9b0 net/openvswitch/conntrack.c:2175
 ovs_lock+0x5/0x20 net/openvswitch/datapath.c:105
 ovs_ct_limit_del_zone_limit net/openvswitch/conntrack.c:2003 [inline]
 ovs_ct_limit_cmd_del+0x40c/0x9b0 net/openvswitch/conntrack.c:2175
 __nla_parse+0x2e/0x60 lib/nlattr.c:478
 __ovs_ct_lookup+0x2960/0x2960 include/linux/sctp.h:54
 genl_family_rcv_msg_attrs_parse+0x1bd/0x320 net/netlink/genetlink.c:500
 genl_family_rcv_msg_attrs_parse+0x1c7/0x320 net/netlink/genetlink.c:500
 genl_family_rcv_msg_doit net/netlink/genetlink.c:673 [inline]
 genl_family_rcv_msg net/netlink/genetlink.c:718 [inline]
 genl_rcv_msg+0x627/0xdf0 net/netlink/genetlink.c:735
 genl_family_rcv_msg_attrs_parse+0x320/0x320 include/net/netlink.h:662
 rcu_preempt_deferred_qs_irqrestore+0x672/0xb60 kernel/rcu/tree_plugin.h:528
 lock_release+0x800/0x800 kernel/locking/lockdep.c:4689
 netlink_rcv_skb+0x15a/0x410 net/netlink/af_netlink.c:2469
 genl_family_rcv_msg_attrs_parse+0x320/0x320 include/net/netlink.h:662
 netlink_ack+0xa10/0xa10 net/netlink/af_netlink.c:2426
 genl_rcv+0x24/0x40 net/netlink/genetlink.c:746
 netlink_unicast_kernel net/netlink/af_netlink.c:1303 [inline]
 netlink_unicast+0x537/0x740 net/netlink/af_netlink.c:1329
 netlink_attachskb+0x810/0x810 net/netlink/af_netlink.c:1235
 _copy_from_iter_full+0x25c/0x870 lib/iov_iter.c:800
 __phys_addr_symbol+0x2c/0x70 arch/x86/mm/physaddr.c:42
 overlaps mm/usercopy.c:110 [inline]
 check_kernel_text_object mm/usercopy.c:142 [inline]
 __check_object_size mm/usercopy.c:289 [inline]
 __check_object_size+0x171/0x437 mm/usercopy.c:256
 netlink_sendmsg+0x882/0xe10 net/netlink/af_netlink.c:1918
 aa_af_perm+0x260/0x260 security/apparmor/net.c:141
 netlink_unicast+0x740/0x740 net/netlink/af_netlink.c:82
 netlink_unicast+0x740/0x740 net/netlink/af_netlink.c:82
 sock_sendmsg_nosec net/socket.c:652 [inline]
 sock_sendmsg+0xcf/0x120 net/socket.c:672
 ____sys_sendmsg+0x6bf/0x7e0 net/socket.c:2362
 kernel_sendmsg+0x50/0x50 net/socket.c:692
 ___sys_sendmsg+0x100/0x170 net/socket.c:2416
 sendmsg_copy_msghdr+0x70/0x70 net/socket.c:2391
 __trace_hardirqs_on_caller kernel/locking/lockdep.c:3657 [inline]
 lockdep_hardirqs_on+0x463/0x620 kernel/locking/lockdep.c:3702
 rcu_lock_release include/linux/rcupdate.h:213 [inline]
 rcu_read_unlock include/linux/rcupdate.h:655 [inline]
 __fget_files+0x32f/0x500 fs/file.c:734
 ksys_dup3+0x3c0/0x3c0 include/linux/compiler.h:199
 get_current arch/x86/include/asm/current.h:15 [inline]
 __fget_light+0x11/0x270 fs/file.c:792
 __fget_light fs/file.c:804 [inline]
 __fget_light+0x20e/0x270 fs/file.c:790
 __sys_sendmsg+0xec/0x1b0 net/socket.c:2449
 __sys_sendmsg_sock+0xb0/0xb0 net/socket.c:2429
 clockid_to_kclock kernel/time/posix-timers.c:1407 [inline]
 __do_sys_clock_gettime kernel/time/posix-timers.c:1085 [inline]
 __se_sys_clock_gettime kernel/time/posix-timers.c:1082 [inline]
 __x64_sys_clock_gettime+0xb4/0x240 kernel/time/posix-timers.c:1082
 trace_hardirqs_off_caller+0x55/0x230 kernel/trace/trace_preemptirq.c:73
 do_syscall_64+0x21/0x7d0 arch/x86/entry/common.c:288
 do_syscall_64+0xf6/0x7d0 arch/x86/entry/common.c:295
 entry_SYSCALL_64_after_hwframe+0x49/0xb3

Showing all locks held in the system:
5 locks held by kworker/u4:5/296:
1 lock held by khungtaskd/1134:
 #0: ffffffff899bea80 (rcu_read_lock){....}-{1:2}, at: debug_show_all_locks+0x53/0x260 kernel/locking/lockdep.c:5754
1 lock held by in:imklog/6669:
 #0: ffff8880a33e5430 (&f->f_pos_lock){+.+.}-{3:3}, at: __fdget_pos+0xe9/0x100 fs/file.c:826
4 locks held by kworker/u4:4/7667:
 #0: ffff8880a9771938 ((wq_completion)netns){+.+.}-{0:0}, at: __write_once_size include/linux/compiler.h:226 [inline]
 #0: ffff8880a9771938 ((wq_completion)netns){+.+.}-{0:0}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline]
 #0: ffff8880a9771938 ((wq_completion)netns){+.+.}-{0:0}, at: atomic64_set include/asm-generic/atomic-instrumented.h:855 [inline]
 #0: ffff8880a9771938 ((wq_completion)netns){+.+.}-{0:0}, at: atomic_long_set include/asm-generic/atomic-long.h:40 [inline]
 #0: ffff8880a9771938 ((wq_completion)netns){+.+.}-{0:0}, at: set_work_data kernel/workqueue.c:615 [inline]
 #0: ffff8880a9771938 ((wq_completion)netns){+.+.}-{0:0}, at: set_work_pool_and_clear_pending kernel/workqueue.c:642 [inline]
 #0: ffff8880a9771938 ((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0x844/0x16a0 kernel/workqueue.c:2239
 #1: ffffc90001887dc0 (net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0x878/0x16a0 kernel/workqueue.c:2243
 #2: ffffffff8a57a930 (pernet_ops_rwsem){++++}-{3:3}, at: cleanup_net+0x9b/0xa50 net/core/net_namespace.c:565
 #3: ffffffff8a8115e8 (ovs_mutex){+.+.}-{3:3}, at: ovs_lock net/openvswitch/datapath.c:105 [inline]
 #3: ffffffff8a8115e8 (ovs_mutex){+.+.}-{3:3}, at: ovs_exit_net+0x1e3/0xba0 net/openvswitch/datapath.c:2469
2 locks held by syz-executor.0/10678:
 #0: ffffffff8a5ddc90 (cb_lock){++++}-{3:3}, at: genl_rcv+0x15/0x40 net/netlink/genetlink.c:745
 #1: ffffffff8a8115e8 (ovs_mutex){+.+.}-{3:3}, at: ovs_ct_limit_del_zone_limit net/openvswitch/conntrack.c:2003 [inline]
 #1: ffffffff8a8115e8 (ovs_mutex){+.+.}-{3:3}, at: ovs_ct_limit_cmd_del+0x40c/0x9b0 net/openvswitch/conntrack.c:2175

=============================================

NMI backtrace for cpu 1
CPU: 1 PID: 1134 Comm: khungtaskd Not tainted 5.7.0-rc5-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Call Trace:
 __dump_stack lib/dump_stack.c:77 [inline]
 dump_stack+0x188/0x20d lib/dump_stack.c:118
 nmi_cpu_backtrace.cold+0x70/0xb1 lib/nmi_backtrace.c:101
 lapic_can_unplug_cpu.cold+0x3b/0x3b
 nmi_trigger_cpumask_backtrace+0x231/0x27e lib/nmi_backtrace.c:62
 trigger_all_cpu_backtrace include/linux/nmi.h:146 [inline]
 check_hung_uninterruptible_tasks kernel/hung_task.c:205 [inline]
 watchdog+0xa8c/0x1010 kernel/hung_task.c:289
 reset_hung_task_detector+0x30/0x30 kernel/hung_task.c:243
 kthread+0x388/0x470 kernel/kthread.c:268
 kthread_mod_delayed_work+0x1a0/0x1a0 kernel/kthread.c:1090
 ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:351
Sending NMI from CPU 1 to CPUs 0:
NMI backtrace for cpu 0
CPU: 0 PID: 296 Comm: kworker/u4:5 Not tainted 5.7.0-rc5-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Workqueue: krdsd rds_connect_worker
RIP: 0010:debug_spin_lock_before kernel/locking/spinlock_debug.c:83 [inline]
RIP: 0010:do_raw_spin_lock+0x85/0x2e0 kernel/locking/spinlock_debug.c:112
Code: 00 00 00 48 89 4c 24 60 31 c9 48 c1 ea 03 0f b6 14 02 48 89 f8 83 e0 07 83 c0 03 38 d0 7c 08 84 d2 0f 85 02 02 00 00 8b 45 04 <3d> ad 4e ad de 0f 85 84 01 00 00 4c 8d 6d 10 48 b8 00 00 00 00 00
RSP: 0018:ffffc90000ea7968 EFLAGS: 00000246
RAX: 00000000dead4ead RBX: 1ffff920001d4f2e RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffffc90005c2152c
RBP: ffffc90005c21528 R08: 0000000000000001 R09: fffffbfff185dd3c
R10: ffffffff8c2ee9df R11: fffffbfff185dd3b R12: ffff888069404100
R13: dffffc0000000000 R14: 000000000000ffff R15: ffffc90005c21528
FS:  0000000000000000(0000) GS:ffff8880ae600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f56ffd3b000 CR3: 00000000987bd000 CR4: 00000000001406f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600
Call Trace:
 rwlock_bug.part.0+0x90/0x90 include/linux/sched.h:1329
 mark_held_locks+0x9f/0xe0 kernel/locking/lockdep.c:3628
 spin_lock_bh include/linux/spinlock.h:358 [inline]
 inet_csk_find_open_port net/ipv4/inet_connection_sock.c:229 [inline]
 inet_csk_get_port+0xbfb/0x2520 net/ipv4/inet_connection_sock.c:317
 inet_csk_listen_stop+0xb20/0xb20 net/ipv4/inet_connection_sock.c:1046
 mark_held_locks+0x9f/0xe0 kernel/locking/lockdep.c:3628
 __local_bh_enable_ip+0x159/0x270 kernel/softirq.c:194
 __inet_bind+0x5b2/0xbd0 net/ipv4/af_inet.c:524
 inet_bind+0xf3/0x160 net/ipv4/af_inet.c:453
 rds_tcp_conn_path_connect+0x536/0x880 net/rds/tcp_connect.c:144
 rds_tcp_state_change+0x270/0x270 net/rds/tcp_connect.c:70
 lock_is_held include/linux/lockdep.h:406 [inline]
 rcu_read_lock_sched_held+0x9c/0xd0 kernel/rcu/update.c:121
 rds_connect_worker+0x1a5/0x2c0 net/rds/threads.c:176
 process_one_work+0x965/0x16a0 kernel/workqueue.c:2268
 lock_release+0x800/0x800 kernel/locking/lockdep.c:4689
 pwq_dec_nr_in_flight+0x310/0x310 kernel/workqueue.c:1198
 rwlock_bug.part.0+0x90/0x90 include/linux/sched.h:1329
 worker_thread+0x96/0xe20 kernel/workqueue.c:2414
 process_one_work+0x16a0/0x16a0 kernel/workqueue.c:2273
 kthread+0x388/0x470 kernel/kthread.c:268
 kthread_mod_delayed_work+0x1a0/0x1a0 kernel/kthread.c:1090
 ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:351

Crashes (1):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2020/05/23 02:34 bpf 5cf65922bb15 9682898d .config console log report ci-upstream-bpf-kasan-gce
* Struck through repros no longer work on HEAD.