syzbot


INFO: task hung in nf_conntrack_cleanup_net_list

Status: auto-closed as invalid on 2019/05/17 18:27
Subsystems: netfilter
[Documentation on labels]
First crash: 1978d, last: 1978d

Sample crash report:
IPVS: sync thread started: state = BACKUP, mcast_ifn = veth1, syncid = 4, id = 0
tmpfs: Bad mount option “Q•/Ù‹«ös­º”rjµV¦[˜”aD
tmpfs: Bad mount option “Q•/Ù‹«ös­º”rjµV¦[˜”aD
INFO: task kworker/u4:4:2499 blocked for more than 140 seconds.
      Not tainted 4.20.0-rc1-next-20181109+ #110
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
kworker/u4:4    D13544  2499      2 0x80000000
Workqueue: netns cleanup_net
Call Trace:
 context_switch kernel/sched/core.c:2831 [inline]
 __schedule+0x8cf/0x21d0 kernel/sched/core.c:3472
 schedule+0xef/0x370 kernel/sched/core.c:3516
 exp_funnel_lock kernel/rcu/tree_exp.h:319 [inline]
 _synchronize_rcu_expedited.constprop.60+0x8df/0x9d0 kernel/rcu/tree_exp.h:622
 synchronize_rcu_expedited+0x27/0xa0 kernel/rcu/tree_exp.h:762
 synchronize_rcu.part.54+0x84/0x120 kernel/rcu/tree_plugin.h:870
 synchronize_rcu+0x27/0xa0 kernel/rcu/tree_plugin.h:873
 synchronize_net+0x4d/0x60 net/core/dev.c:9064
 nf_conntrack_cleanup_net_list+0x83/0x330 net/netfilter/nf_conntrack_core.c:2098
 nf_conntrack_pernet_exit+0x11d/0x170 net/netfilter/nf_conntrack_standalone.c:663
 ops_exit_list.isra.5+0x105/0x160 net/core/net_namespace.c:156
 cleanup_net+0x555/0xb10 net/core/net_namespace.c:551
 process_one_work+0xc8b/0x1c40 kernel/workqueue.c:2153
 worker_thread+0x17f/0x1390 kernel/workqueue.c:2296
 kthread+0x35a/0x440 kernel/kthread.c:246
 ret_from_fork+0x3a/0x50 arch/x86/entry/entry_64.S:352
INFO: task syz-executor4:24823 blocked for more than 140 seconds.
      Not tainted 4.20.0-rc1-next-20181109+ #110
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
syz-executor4   D25152 24823  21037 0x00000004
Call Trace:
 context_switch kernel/sched/core.c:2831 [inline]
 __schedule+0x8cf/0x21d0 kernel/sched/core.c:3472
 schedule+0xef/0x370 kernel/sched/core.c:3516
 __rwsem_down_write_failed_common+0xc9a/0x15e0 kernel/locking/rwsem-xadd.c:577
 rwsem_down_write_failed+0xe/0x10 kernel/locking/rwsem-xadd.c:606
 call_rwsem_down_write_failed+0x17/0x30 arch/x86/lib/rwsem.S:117
 __down_write arch/x86/include/asm/rwsem.h:142 [inline]
 down_write+0xa5/0x130 kernel/locking/rwsem.c:72
 register_netdevice_notifier+0xbc/0x910 net/core/dev.c:1628
 raw_init+0x2a3/0x330 net/can/raw.c:343
 can_create+0x28a/0x4b0 net/can/af_can.c:183
 __sock_create+0x536/0x930 net/socket.c:1278
 sock_create net/socket.c:1318 [inline]
 __sys_socket+0x106/0x260 net/socket.c:1348
 __do_sys_socket net/socket.c:1357 [inline]
 __se_sys_socket net/socket.c:1355 [inline]
 __x64_sys_socket+0x73/0xb0 net/socket.c:1355
 do_syscall_64+0x1b9/0x820 arch/x86/entry/common.c:290
 entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x457569
Code: 83 c4 18 c3 e8 d8 64 00 00 48 8b 04 24 48 8b 4c 24 08 48 89 01 e8 d7 2d fc ff e8 22 7a fc ff b8 02 00 00 00 48 8d 0d ea 55 0b <01> 87 01 8b 05 e2 55 0b 01 83 f8 01 0f 85 8a 00 00 00 b8 01 00 00
RSP: 002b:00007f953d2ddc78 EFLAGS: 00000246 ORIG_RAX: 0000000000000029
RAX: ffffffffffffffda RBX: 0000000000000003 RCX: 0000000000457569
RDX: 0000000000000001 RSI: 0000000000000003 RDI: 000000000000001d
RBP: 000000000072bf00 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 00007f953d2de6d4
R13: 00000000004c4728 R14: 00000000004d7b60 R15: 00000000ffffffff
INFO: task syz-executor4:24828 blocked for more than 140 seconds.
      Not tainted 4.20.0-rc1-next-20181109+ #110
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
syz-executor4   D18992 24828  21037 0x00000004
Call Trace:
 context_switch kernel/sched/core.c:2831 [inline]
 __schedule+0x8cf/0x21d0 kernel/sched/core.c:3472
 schedule+0xef/0x370 kernel/sched/core.c:3516
 __rwsem_down_write_failed_common+0xc9a/0x15e0 kernel/locking/rwsem-xadd.c:577
 rwsem_down_write_failed+0xe/0x10 kernel/locking/rwsem-xadd.c:606
 call_rwsem_down_write_failed+0x17/0x30 arch/x86/lib/rwsem.S:117
 __down_write arch/x86/include/asm/rwsem.h:142 [inline]
 down_write+0xa5/0x130 kernel/locking/rwsem.c:72
 register_netdevice_notifier+0xbc/0x910 net/core/dev.c:1628
 raw_init+0x2a3/0x330 net/can/raw.c:343
 can_create+0x28a/0x4b0 net/can/af_can.c:183
 __sock_create+0x536/0x930 net/socket.c:1278
 sock_create net/socket.c:1318 [inline]
 __sys_socket+0x106/0x260 net/socket.c:1348
 __do_sys_socket net/socket.c:1357 [inline]
 __se_sys_socket net/socket.c:1355 [inline]
 __x64_sys_socket+0x73/0xb0 net/socket.c:1355
 do_syscall_64+0x1b9/0x820 arch/x86/entry/common.c:290
 entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x457569
Code: 83 c4 18 c3 e8 d8 64 00 00 48 8b 04 24 48 8b 4c 24 08 48 89 01 e8 d7 2d fc ff e8 22 7a fc ff b8 02 00 00 00 48 8d 0d ea 55 0b <01> 87 01 8b 05 e2 55 0b 01 83 f8 01 0f 85 8a 00 00 00 b8 01 00 00
RSP: 002b:00007f953d2bcc78 EFLAGS: 00000246 ORIG_RAX: 0000000000000029
RAX: ffffffffffffffda RBX: 0000000000000003 RCX: 0000000000457569
RDX: 0000000000000001 RSI: 0000000000000003 RDI: 000000000000001d
RBP: 000000000072bfa0 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 00007f953d2bd6d4
R13: 00000000004c4728 R14: 00000000004d7b60 R15: 00000000ffffffff

Showing all locks held in the system:
2 locks held by kworker/1:0/17:
 #0: 0000000055a11129 ((wq_completion)"events"){+.+.}, at: __write_once_size include/linux/compiler.h:209 [inline]
 #0: 0000000055a11129 ((wq_completion)"events"){+.+.}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline]
 #0: 0000000055a11129 ((wq_completion)"events"){+.+.}, at: atomic64_set include/asm-generic/atomic-instrumented.h:855 [inline]
 #0: 0000000055a11129 ((wq_completion)"events"){+.+.}, at: atomic_long_set include/asm-generic/atomic-long.h:40 [inline]
 #0: 0000000055a11129 ((wq_completion)"events"){+.+.}, at: set_work_data kernel/workqueue.c:617 [inline]
 #0: 0000000055a11129 ((wq_completion)"events"){+.+.}, at: set_work_pool_and_clear_pending kernel/workqueue.c:644 [inline]
 #0: 0000000055a11129 ((wq_completion)"events"){+.+.}, at: process_one_work+0xb43/0x1c40 kernel/workqueue.c:2124
 #1: 00000000ef1fbe2c ((work_completion)(&smc->tcp_listen_work)){+.+.}, at: process_one_work+0xb9a/0x1c40 kernel/workqueue.c:2128
1 lock held by khungtaskd/1009:
 #0: 000000005a043cff (rcu_read_lock){....}, at: debug_show_all_locks+0xd0/0x424 kernel/locking/lockdep.c:4379
3 locks held by kworker/u4:4/2499:
 #0: 000000008383a263 ((wq_completion)"%s""netns"){+.+.}, at: __write_once_size include/linux/compiler.h:209 [inline]
 #0: 000000008383a263 ((wq_completion)"%s""netns"){+.+.}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline]
 #0: 000000008383a263 ((wq_completion)"%s""netns"){+.+.}, at: atomic64_set include/asm-generic/atomic-instrumented.h:855 [inline]
 #0: 000000008383a263 ((wq_completion)"%s""netns"){+.+.}, at: atomic_long_set include/asm-generic/atomic-long.h:40 [inline]
 #0: 000000008383a263 ((wq_completion)"%s""netns"){+.+.}, at: set_work_data kernel/workqueue.c:617 [inline]
 #0: 000000008383a263 ((wq_completion)"%s""netns"){+.+.}, at: set_work_pool_and_clear_pending kernel/workqueue.c:644 [inline]
 #0: 000000008383a263 ((wq_completion)"%s""netns"){+.+.}, at: process_one_work+0xb43/0x1c40 kernel/workqueue.c:2124
 #1: 00000000fc4ce6a0 (net_cleanup_work){+.+.}, at: process_one_work+0xb9a/0x1c40 kernel/workqueue.c:2128
 #2: 00000000086bd072 (pernet_ops_rwsem){++++}, at: cleanup_net+0x13f/0xb10 net/core/net_namespace.c:518
1 lock held by rsyslogd/5896:
 #0: 00000000441d06b7 (&f->f_pos_lock){+.+.}, at: __fdget_pos+0x1bb/0x200 fs/file.c:766
2 locks held by getty/5987:
 #0: 000000003915f38f (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x32/0x40 drivers/tty/tty_ldsem.c:353
 #1: 00000000e11416b3 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x335/0x1e80 drivers/tty/n_tty.c:2154
2 locks held by getty/5988:
 #0: 00000000d4072ef0 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x32/0x40 drivers/tty/tty_ldsem.c:353
 #1: 0000000028b9e0e3 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x335/0x1e80 drivers/tty/n_tty.c:2154
2 locks held by getty/5989:
 #0: 000000009b0a412e (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x32/0x40 drivers/tty/tty_ldsem.c:353
 #1: 00000000ec636dd1 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x335/0x1e80 drivers/tty/n_tty.c:2154
2 locks held by getty/5990:
 #0: 00000000fe1e8bc1 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x32/0x40 drivers/tty/tty_ldsem.c:353
 #1: 000000009864df5f (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x335/0x1e80 drivers/tty/n_tty.c:2154
2 locks held by getty/5991:
 #0: 0000000065a51251 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x32/0x40 drivers/tty/tty_ldsem.c:353
 #1: 000000008db5f041 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x335/0x1e80 drivers/tty/n_tty.c:2154
2 locks held by getty/5992:
 #0: 000000002ebead5d (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x32/0x40 drivers/tty/tty_ldsem.c:353
 #1: 000000008988a671 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x335/0x1e80 drivers/tty/n_tty.c:2154
2 locks held by getty/5993:
 #0: 00000000f2bbcc67 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x32/0x40 drivers/tty/tty_ldsem.c:353
 #1: 00000000c8cfccee (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x335/0x1e80 drivers/tty/n_tty.c:2154
1 lock held by syz-executor4/24823:
 #0: 00000000086bd072 (pernet_ops_rwsem){++++}, at: register_netdevice_notifier+0xbc/0x910 net/core/dev.c:1628
1 lock held by syz-executor4/24828:
 #0: 00000000086bd072 (pernet_ops_rwsem){++++}, at: register_netdevice_notifier+0xbc/0x910 net/core/dev.c:1628

=============================================

NMI backtrace for cpu 0
CPU: 0 PID: 1009 Comm: khungtaskd Not tainted 4.20.0-rc1-next-20181109+ #110
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Call Trace:
 __dump_stack lib/dump_stack.c:77 [inline]
 dump_stack+0x244/0x39d lib/dump_stack.c:113
 nmi_cpu_backtrace.cold.2+0x5c/0xa1 lib/nmi_backtrace.c:101
 nmi_trigger_cpumask_backtrace+0x1e8/0x22a lib/nmi_backtrace.c:62
 arch_trigger_cpumask_backtrace+0x14/0x20 arch/x86/kernel/apic/hw_nmi.c:38
 trigger_all_cpu_backtrace include/linux/nmi.h:144 [inline]
 check_hung_uninterruptible_tasks kernel/hung_task.c:205 [inline]
 watchdog+0xb4c/0x1060 kernel/hung_task.c:289
 kthread+0x35a/0x440 kernel/kthread.c:246
 ret_from_fork+0x3a/0x50 arch/x86/entry/entry_64.S:352
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 0 Comm: swapper/1 Not tainted 4.20.0-rc1-next-20181109+ #110
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
RIP: 0010:arch_atomic_add_return arch/x86/include/asm/atomic.h:167 [inline]
RIP: 0010:atomic_add_return include/asm-generic/atomic-instrumented.h:72 [inline]
RIP: 0010:rcu_dynticks_eqs_exit+0x61/0xa0 kernel/rcu/tree.c:266
Code: 54 48 03 1c c5 20 10 25 89 be 04 00 00 00 4c 8d a3 b8 00 00 00 4c 89 e7 e8 4c a7 59 00 b8 02 00 00 00 f0 0f c1 83 b8 00 00 00 <a8> 01 75 09 48 83 c4 08 5b 41 5c 5d c3 be 04 00 00 00 4c 89 e7 e8
RSP: 0018:ffff8801daf07c10 EFLAGS: 00000002
RAX: 00000000000f7814 RBX: ffff8801daf2da80 RCX: ffffffff816948a4
RDX: 0000000000000001 RSI: 0000000000000004 RDI: ffff8801daf2db38
RBP: ffff8801daf07c28 R08: ffffed003b5e5b68 R09: ffffed003b5e5b67
R10: ffffed003b5e5b67 R11: ffff8801daf2db3b R12: ffff8801daf2db38
R13: 1ffff1003b5e0f88 R14: ffff8801daf2db30 R15: ffff8801daf07ca0
FS:  0000000000000000(0000) GS:ffff8801daf00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: ffffffffff600400 CR3: 00000001cdca3000 CR4: 00000000001406e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <IRQ>
 rcu_nmi_enter_common kernel/rcu/tree.c:853 [inline]
 rcu_irq_enter+0x243/0x310 kernel/rcu/tree.c:901
 irq_enter+0xa/0xe0 kernel/softirq.c:347
 scheduler_ipi+0x3d0/0xad0 kernel/sched/core.c:1775
 smp_reschedule_interrupt+0x109/0x650 arch/x86/kernel/smp.c:278
 reschedule_interrupt+0xf/0x20 arch/x86/entry/entry_64.S:828
 </IRQ>
RIP: 0010:native_safe_halt+0x6/0x10 arch/x86/include/asm/irqflags.h:57
Code: 45 d8 e8 8d 1f f4 f9 48 8b 45 d8 e9 ca fe ff ff 48 89 df e8 7c 1f f4 f9 eb 82 90 90 90 90 90 90 90 90 90 90 55 48 89 e5 fb f4 <5d> c3 0f 1f 84 00 00 00 00 00 55 48 89 e5 f4 5d c3 90 90 90 90 90
RSP: 0018:ffff8801d9b2fcb8 EFLAGS: 00000282 ORIG_RAX: ffffffffffffff02
RAX: dffffc0000000000 RBX: 1ffff1003b365f9b RCX: 0000000000000000
RDX: 1ffffffff12a3f79 RSI: 0000000000000001 RDI: ffffffff8951fbc8
RBP: ffff8801d9b2fcb8 R08: ffff8801d9b20340 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000000 R12: ffff8801d9b2fd78
R13: ffffffff8a1509a0 R14: 0000000000000000 R15: 0000000000000001
 arch_safe_halt arch/x86/include/asm/paravirt.h:151 [inline]
 default_idle+0xbf/0x490 arch/x86/kernel/process.c:498
 arch_cpu_idle+0x10/0x20 arch/x86/kernel/process.c:489
 default_idle_call+0x6d/0x90 kernel/sched/idle.c:93
 cpuidle_idle_call kernel/sched/idle.c:153 [inline]
 do_idle+0x49b/0x5c0 kernel/sched/idle.c:262
 cpu_startup_entry+0x18/0x20 kernel/sched/idle.c:353
 start_secondary+0x487/0x5f0 arch/x86/kernel/smpboot.c:271
 secondary_startup_64+0xa4/0xb0 arch/x86/kernel/head_64.S:243

Crashes (1):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2018/11/18 18:17 linux-next 442b8cea2477 adf636a8 .config console log report ci-upstream-linux-next-kasan-gce-root
* Struck through repros no longer work on HEAD.