syzbot


INFO: task hung in rxrpc_destroy_all_connections

Status: auto-closed as invalid on 2019/11/30 22:24
Subsystems: afs net
[Documentation on labels]
First crash: 1696d, last: 1696d
Similar bugs (4)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
linux-4.19 INFO: task hung in rxrpc_destroy_all_connections 1 1711d 1711d 0/1 auto-closed as invalid on 2019/12/16 04:54
upstream INFO: task hung in rxrpc_destroy_all_connections (2) afs net 5 1297d 1333d 0/26 auto-closed as invalid on 2021/01/03 19:58
upstream INFO: task hung in rxrpc_destroy_all_connections (4) afs net 1 82d 75d 0/26 auto-obsoleted due to no activity on 2024/04/02 13:13
upstream INFO: task hung in rxrpc_destroy_all_connections (3) net afs 1 899d 899d 0/26 auto-closed as invalid on 2022/02/05 03:08

Sample crash report:
INFO: task kworker/u4:4:2553 blocked for more than 143 seconds.
      Not tainted 5.3.0-rc6+ #153
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
kworker/u4:4    D24472  2553      2 0x80004000
Workqueue: netns cleanup_net
Call Trace:
 context_switch kernel/sched/core.c:3254 [inline]
 __schedule+0x755/0x1580 kernel/sched/core.c:3880
 schedule+0xd9/0x260 kernel/sched/core.c:3947
 schedule_timeout+0x717/0xc50 kernel/time/timer.c:1783
 do_wait_for_common kernel/sched/completion.c:83 [inline]
 __wait_for_common kernel/sched/completion.c:104 [inline]
 wait_for_common kernel/sched/completion.c:115 [inline]
 wait_for_completion+0x29c/0x440 kernel/sched/completion.c:136
 flush_workqueue+0x40f/0x14b0 kernel/workqueue.c:2826
 rxrpc_destroy_all_connections+0x103/0x487 net/rxrpc/conn_object.c:468
 rxrpc_exit_net+0x1c2/0x310 net/rxrpc/net_ns.c:122
 ops_exit_list.isra.0+0xaa/0x150 net/core/net_namespace.c:172
 cleanup_net+0x4e2/0xa60 net/core/net_namespace.c:594
 process_one_work+0x9af/0x1740 kernel/workqueue.c:2269
 worker_thread+0x98/0xe40 kernel/workqueue.c:2415
 kthread+0x361/0x430 kernel/kthread.c:255
 ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:352
INFO: task syz-executor.2:20028 blocked for more than 143 seconds.
      Not tainted 5.3.0-rc6+ #153
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
syz-executor.2  D27432 20028  18749 0x00004004
Call Trace:
 context_switch kernel/sched/core.c:3254 [inline]
 __schedule+0x755/0x1580 kernel/sched/core.c:3880
 schedule+0xd9/0x260 kernel/sched/core.c:3947
 schedule_timeout+0x717/0xc50 kernel/time/timer.c:1783
 do_wait_for_common kernel/sched/completion.c:83 [inline]
 __wait_for_common kernel/sched/completion.c:104 [inline]
 wait_for_common kernel/sched/completion.c:115 [inline]
 wait_for_completion+0x29c/0x440 kernel/sched/completion.c:136
 flush_workqueue+0x40f/0x14b0 kernel/workqueue.c:2826
 rxrpc_release_sock net/rxrpc/af_rxrpc.c:899 [inline]
 rxrpc_release+0x418/0x840 net/rxrpc/af_rxrpc.c:930
 __sock_release+0xce/0x280 net/socket.c:590
 sock_close+0x1e/0x30 net/socket.c:1268
 __fput+0x2ff/0x890 fs/file_table.c:280
 ____fput+0x16/0x20 fs/file_table.c:313
 task_work_run+0x145/0x1c0 kernel/task_work.c:113
 tracehook_notify_resume include/linux/tracehook.h:188 [inline]
 exit_to_usermode_loop+0x316/0x380 arch/x86/entry/common.c:163
 prepare_exit_to_usermode arch/x86/entry/common.c:194 [inline]
 syscall_return_slowpath arch/x86/entry/common.c:274 [inline]
 do_syscall_64+0x5a9/0x6a0 arch/x86/entry/common.c:299
 entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x413561
Code: 94 d6 65 00 ba 02 00 00 00 bf 3a 38 44 00 ff 15 2d a1 24 00 85 c0 0f 85 e7 fd ff ff 31 c9 31 f6 41 b9 b0 20 41 00 41 b8 98 d6 <65> 00 ba 03 00 00 00 bf 44 38 44 00 ff 15 05 a1 24 00 85 c0 0f 85
RSP: 002b:00007ffebfc7c840 EFLAGS: 00000293 ORIG_RAX: 0000000000000003
RAX: 0000000000000000 RBX: 0000000000000004 RCX: 0000000000413561
RDX: 0000000000000000 RSI: 0000000000000081 RDI: 0000000000000003
RBP: 0000000000000000 R08: 0000000000760e20 R09: ffffffffffffffff
R10: 00007ffebfc7c910 R11: 0000000000000293 R12: 000000000075bfc8
R13: 0000000000000005 R14: 0000000000760e28 R15: ffffffffffffffff
INFO: task syz-executor.2:20030 blocked for more than 144 seconds.
      Not tainted 5.3.0-rc6+ #153
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
syz-executor.2  D26872 20030  18749 0x00004006
Call Trace:
 context_switch kernel/sched/core.c:3254 [inline]
 __schedule+0x755/0x1580 kernel/sched/core.c:3880
 schedule+0xd9/0x260 kernel/sched/core.c:3947
 schedule_timeout+0x717/0xc50 kernel/time/timer.c:1783
 do_wait_for_common kernel/sched/completion.c:83 [inline]
 __wait_for_common kernel/sched/completion.c:104 [inline]
 wait_for_common kernel/sched/completion.c:115 [inline]
 wait_for_completion+0x29c/0x440 kernel/sched/completion.c:136
 flush_workqueue+0x40f/0x14b0 kernel/workqueue.c:2826
 rxrpc_release_sock net/rxrpc/af_rxrpc.c:899 [inline]
 rxrpc_release+0x418/0x840 net/rxrpc/af_rxrpc.c:930
 __sock_release+0xce/0x280 net/socket.c:590
 sock_close+0x1e/0x30 net/socket.c:1268
 __fput+0x2ff/0x890 fs/file_table.c:280
 ____fput+0x16/0x20 fs/file_table.c:313
 task_work_run+0x145/0x1c0 kernel/task_work.c:113
 get_signal+0x2078/0x2500 kernel/signal.c:2528
 do_signal+0x87/0x1700 arch/x86/kernel/signal.c:815
 exit_to_usermode_loop+0x286/0x380 arch/x86/entry/common.c:159
 prepare_exit_to_usermode arch/x86/entry/common.c:194 [inline]
 syscall_return_slowpath arch/x86/entry/common.c:274 [inline]
 do_syscall_64+0x5a9/0x6a0 arch/x86/entry/common.c:299
 entry_SYSCALL_64_after_hwframe+0x49/0xbe
RIP: 0033:0x459879
Code: Bad RIP value.
RSP: 002b:00007f0d188b0c78 EFLAGS: 00000246 ORIG_RAX: 000000000000012b
RAX: fffffffffffffe00 RBX: 0000000000000005 RCX: 0000000000459879
RDX: 0000000000000216 RSI: 00000000200071c0 RDI: 0000000000000003
RBP: 000000000075bf20 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000002 R11: 0000000000000246 R12: 00007f0d188b16d4
R13: 00000000004c6dd5 R14: 00000000004dc220 R15: 00000000ffffffff

Showing all locks held in the system:
1 lock held by khungtaskd/1052:
 #0: 00000000fb3d4b62 (rcu_read_lock){....}, at: debug_show_all_locks+0x5f/0x27e kernel/locking/lockdep.c:5256
3 locks held by kworker/u4:4/2553:
 #0: 00000000e94f59c4 ((wq_completion)netns){+.+.}, at: __write_once_size include/linux/compiler.h:226 [inline]
 #0: 00000000e94f59c4 ((wq_completion)netns){+.+.}, at: arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline]
 #0: 00000000e94f59c4 ((wq_completion)netns){+.+.}, at: atomic64_set include/asm-generic/atomic-instrumented.h:855 [inline]
 #0: 00000000e94f59c4 ((wq_completion)netns){+.+.}, at: atomic_long_set include/asm-generic/atomic-long.h:40 [inline]
 #0: 00000000e94f59c4 ((wq_completion)netns){+.+.}, at: set_work_data kernel/workqueue.c:620 [inline]
 #0: 00000000e94f59c4 ((wq_completion)netns){+.+.}, at: set_work_pool_and_clear_pending kernel/workqueue.c:647 [inline]
 #0: 00000000e94f59c4 ((wq_completion)netns){+.+.}, at: process_one_work+0x88b/0x1740 kernel/workqueue.c:2240
 #1: 0000000036625532 (net_cleanup_work){+.+.}, at: process_one_work+0x8c1/0x1740 kernel/workqueue.c:2244
 #2: 00000000ba168b6f (pernet_ops_rwsem){++++}, at: cleanup_net+0xae/0xa60 net/core/net_namespace.c:556
1 lock held by rsyslogd/8807:
 #0: 000000002160d75e (&f->f_pos_lock){+.+.}, at: __fdget_pos+0xee/0x110 fs/file.c:801
2 locks held by getty/8897:
 #0: 00000000bbcc7390 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:340
 #1: 00000000a7a4528b (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1c10 drivers/tty/n_tty.c:2156
2 locks held by getty/8898:
 #0: 000000008c4257cd (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:340
 #1: 00000000b413a185 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1c10 drivers/tty/n_tty.c:2156
2 locks held by getty/8899:
 #0: 00000000a65d257f (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:340
 #1: 000000005cbd946a (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1c10 drivers/tty/n_tty.c:2156
2 locks held by getty/8900:
 #0: 00000000033910f5 (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:340
 #1: 00000000504f4354 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1c10 drivers/tty/n_tty.c:2156
2 locks held by getty/8901:
 #0: 0000000094b253dd (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:340
 #1: 00000000f7cbebed (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1c10 drivers/tty/n_tty.c:2156
2 locks held by getty/8902:
 #0: 0000000071341edb (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:340
 #1: 0000000065433d25 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1c10 drivers/tty/n_tty.c:2156
2 locks held by getty/8903:
 #0: 000000005067ddbc (&tty->ldisc_sem){++++}, at: ldsem_down_read+0x33/0x40 drivers/tty/tty_ldsem.c:340
 #1: 000000000656c3b6 (&ldata->atomic_read_lock){+.+.}, at: n_tty_read+0x232/0x1c10 drivers/tty/n_tty.c:2156
2 locks held by kworker/1:4/10306:
1 lock held by syz-executor.2/20028:
 #0: 0000000080326b75 (&sb->s_type->i_mutex_key#12){+.+.}, at: inode_lock include/linux/fs.h:778 [inline]
 #0: 0000000080326b75 (&sb->s_type->i_mutex_key#12){+.+.}, at: __sock_release+0x89/0x280 net/socket.c:589
1 lock held by syz-executor.2/20030:
 #0: 000000003841f93b (&sb->s_type->i_mutex_key#12){+.+.}, at: inode_lock include/linux/fs.h:778 [inline]
 #0: 000000003841f93b (&sb->s_type->i_mutex_key#12){+.+.}, at: __sock_release+0x89/0x280 net/socket.c:589

=============================================

NMI backtrace for cpu 0
CPU: 0 PID: 1052 Comm: khungtaskd Not tainted 5.3.0-rc6+ #153
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Call Trace:
 __dump_stack lib/dump_stack.c:77 [inline]
 dump_stack+0x172/0x1f0 lib/dump_stack.c:113
 nmi_cpu_backtrace.cold+0x70/0xb2 lib/nmi_backtrace.c:101
 nmi_trigger_cpumask_backtrace+0x23b/0x28b lib/nmi_backtrace.c:62
 arch_trigger_cpumask_backtrace+0x14/0x20 arch/x86/kernel/apic/hw_nmi.c:38
 trigger_all_cpu_backtrace include/linux/nmi.h:146 [inline]
 check_hung_uninterruptible_tasks kernel/hung_task.c:205 [inline]
 watchdog+0x9d0/0xef0 kernel/hung_task.c:289
 kthread+0x361/0x430 kernel/kthread.c:255
 ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:352
Sending NMI from CPU 0 to CPUs 1:
INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.087 msecs
NMI backtrace for cpu 1
CPU: 1 PID: 10306 Comm: kworker/1:4 Not tainted 5.3.0-rc6+ #153
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Workqueue: krxrpcd rxrpc_local_processor
RIP: 0010:__sanitizer_cov_trace_pc+0x4c/0x50 kernel/kcov.c:112
Code: f0 12 00 00 83 fa 02 75 20 48 8b 88 f8 12 00 00 8b 80 f4 12 00 00 48 8b 11 48 83 c2 01 48 39 d0 76 07 48 89 34 d1 48 89 11 5d <c3> 0f 1f 00 65 4c 8b 04 25 40 fe 01 00 65 8b 05 c8 89 8f 7e a9 00
RSP: 0000:ffff8880ae909968 EFLAGS: 00000206
RAX: ffff88809c9a0280 RBX: 0000000000000000 RCX: ffffffff85d5ff0e
RDX: 0000000000000100 RSI: ffffffff85d601f2 RDI: 0000000000000001
RBP: ffff8880ae909a18 R08: ffff88809c9a0280 R09: ffffed1013968f98
R10: ffffed1013968f97 R11: ffff88809cb47cbf R12: ffff888099f9e270
R13: 1ffff11015d21332 R14: ffffffff899efc40 R15: 0000000000000000
FS:  0000000000000000(0000) GS:ffff8880ae900000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000009c42b0 CR3: 000000009bd19000 CR4: 00000000001406e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <IRQ>
 nf_conntrack_confirm include/net/netfilter/nf_conntrack_core.h:65 [inline]
 nf_confirm+0x3d4/0x4d0 net/netfilter/nf_conntrack_proto.c:154
 ipv4_confirm+0x14c/0x240 net/netfilter/nf_conntrack_proto.c:169
 nf_hook_entry_hookfn include/linux/netfilter.h:135 [inline]
 nf_hook_slow+0xbc/0x1e0 net/netfilter/core.c:512
 nf_hook include/linux/netfilter.h:260 [inline]
 NF_HOOK include/linux/netfilter.h:303 [inline]
 ip_local_deliver+0x352/0x520 net/ipv4/ip_input.c:252
 dst_input include/net/dst.h:442 [inline]
 ip_rcv_finish+0x1d9/0x2e0 net/ipv4/ip_input.c:413
 NF_HOOK include/linux/netfilter.h:305 [inline]
 NF_HOOK include/linux/netfilter.h:299 [inline]
 ip_rcv+0xe8/0x3f0 net/ipv4/ip_input.c:523
 __netif_receive_skb_one_core+0x113/0x1a0 net/core/dev.c:5006
 __netif_receive_skb+0x2c/0x1d0 net/core/dev.c:5120
 process_backlog+0x206/0x750 net/core/dev.c:5951
 napi_poll net/core/dev.c:6388 [inline]
 net_rx_action+0x4d6/0x1080 net/core/dev.c:6456
 __do_softirq+0x262/0x98c kernel/softirq.c:292
 do_softirq_own_stack+0x2a/0x40 arch/x86/entry/entry_64.S:1082
 </IRQ>
 do_softirq.part.0+0x11a/0x170 kernel/softirq.c:337
 do_softirq kernel/softirq.c:329 [inline]
 __local_bh_enable_ip+0x211/0x270 kernel/softirq.c:189
 local_bh_enable include/linux/bottom_half.h:32 [inline]
 rcu_read_unlock_bh include/linux/rcupdate.h:681 [inline]
 ip_finish_output2+0x8f8/0x2570 net/ipv4/ip_output.c:229
 __ip_finish_output net/ipv4/ip_output.c:308 [inline]
 __ip_finish_output+0x5fc/0xb90 net/ipv4/ip_output.c:290
 ip_finish_output+0x38/0x1f0 net/ipv4/ip_output.c:318
 NF_HOOK_COND include/linux/netfilter.h:294 [inline]
 ip_output+0x21f/0x640 net/ipv4/ip_output.c:432
 dst_output include/net/dst.h:436 [inline]
 ip_local_out+0xbb/0x190 net/ipv4/ip_output.c:125
 ip_send_skb+0x42/0xf0 net/ipv4/ip_output.c:1554
 udp_send_skb.isra.0+0x6b2/0x1160 net/ipv4/udp.c:887
 udp_sendmsg+0x1e88/0x2830 net/ipv4/udp.c:1174
 inet_sendmsg+0x9e/0xe0 net/ipv4/af_inet.c:807
 sock_sendmsg_nosec net/socket.c:637 [inline]
 sock_sendmsg+0xd7/0x130 net/socket.c:657
 kernel_sendmsg+0x44/0x50 net/socket.c:677
 rxrpc_reject_packets+0x3b6/0xac0 net/rxrpc/output.c:599
 rxrpc_local_processor+0x17a/0x870 net/rxrpc/local_object.c:471
 process_one_work+0x9af/0x1740 kernel/workqueue.c:2269
 worker_thread+0x98/0xe40 kernel/workqueue.c:2415
 kthread+0x361/0x430 kernel/kthread.c:255
 ret_from_fork+0x24/0x30 arch/x86/entry/entry_64.S:352

Crashes (1):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2019/09/01 22:18 net-next-old 38320f69403d bad3cce2 .config console log report ci-upstream-net-kasan-gce
* Struck through repros no longer work on HEAD.