Starting background file system checks in 60 seconds. Sun Jul 18 19:35:20 UTC 2021 FreeBSD/amd64 (ci-freebsd-main-0.c.syzkaller.internal) (ttyu0) Warning: Permanently added '10.128.0.115' (ECDSA) to the list of known hosts. executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program executing program login: panic: Bad list head 0xfffffe00582b9270 first->prev != head cpuid = 1 time = 1626637093 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0xc7/frame 0xfffffe009bcab350 kdb_backtrace() at kdb_backtrace+0xd3/frame 0xfffffe009bcab4b0 vpanic() at vpanic+0x2c5/frame 0xfffffe009bcab590 panic() at panic+0xb5/frame 0xfffffe009bcab650 sctp_inpcb_bind() at sctp_inpcb_bind+0x19c3/frame 0xfffffe009bcab790 sctp6_bind() at sctp6_bind+0x171/frame 0xfffffe009bcab880 sobind() at sobind+0xd5/frame 0xfffffe009bcab8d0 kern_bindat() at kern_bindat+0x25e/frame 0xfffffe009bcab9b0 sys_bind() at sys_bind+0xfb/frame 0xfffffe009bcab9f0 amd64_syscall() at amd64_syscall+0x425/frame 0xfffffe009bcabbf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe009bcabbf0 --- syscall (0, FreeBSD ELF64, nosys), rip = 0x2ba36a, rsp = 0x7fffdffdcf78, rbp = 0x7fffdffdcfb0 --- KDB: enter: panic [ thread pid 1365 tid 101275 ] Stopped at kdb_enter+0x6b: movq $0,0x28ef1aa(%rip) db> db> set $lines = 0 db> set $maxwidth = 0 db> show registers cs 0x20 ds 0x3b es 0x3b fs 0x13 gs 0x1b ss 0x28 rax 0x12 rcx 0xdb709e34a62df198 rdx 0xdffff7c000000000 rbx 0 rsp 0xfffffe009bcab490 rbp 0xfffffe009bcab4b0 rsi 0x1 rdi 0xffffffff84087140 cov_trace_pc r8 0x3 r9 0xfffffe009bcaafe8 r10 0 r11 0xfffffe009e9b7350 r12 0xfffffe009e9b6e40 r13 0xfffffe009bcab501 r14 0xffffffff82c565e0 .str.18 r15 0xffffffff82c565e0 .str.18 rip 0xffffffff8179a90b kdb_enter+0x6b rflags 0x46 kdb_enter+0x6b: movq $0,0x28ef1aa(%rip) db> show proc Process 1365 (syz-executor0298883) at 0xfffffe009ea92a70: state: NORMAL uid: 0 gids: 0, 0, 5 parent: pid 790 at 0xfffffe009e453a70 ABI: FreeBSD ELF64 flag: 0x10000080 flag2: 0 arguments: ./syz-executor029888378 reaper: 0xfffffe0053d4b538 reapsubtree: 1 sigparent: 20 vmspace: 0xfffffe009e415000 (map 0xfffffe009e415000) (map.pmap 0xfffffe009e4150c0) (pmap 0xfffffe009e415120) threads: 3 100538 RunQ syz-executor0298883 101274 D biowr 0xfffffe000797b488 syz-executor0298883 101275 Run CPU 1 syz-executor0298883 db> ps pid ppid pgrp uid state wmesg wchan cmd 1365 790 785 0 R (threaded) syz-executor0298883 100538 RunQ syz-executor0298883 101274 D biowr 0xfffffe000797b488 syz-executor0298883 101275 Run CPU 1 syz-executor0298883 1363 788 785 0 T (threaded) syz-executor0298883 100146 s syz-executor0298883 101268 RunQ syz-executor0298883 101269 RunQ syz-executor0298883 1362 793 785 0 RE syz-executor0298883 1361 789 785 0 RE syz-executor0298883 793 787 785 0 S wait 0xfffffe009e51c538 syz-executor0298883 790 787 785 0 S nanslp 0xffffffff84056981 syz-executor0298883 789 787 785 0 S wait 0xfffffe00588d6a70 syz-executor0298883 788 787 785 0 S wait 0xfffffe005885f000 syz-executor0298883 787 785 785 0 S nanslp 0xffffffff84056980 syz-executor0298883 785 783 785 0 Ss pause 0xfffffe009e426b20 csh 783 694 783 0 Ss select 0xfffffe0053d46740 sshd 760 1 760 0 Ss+ ttyin 0xfffffe0057004cb0 getty 759 1 759 0 Ss+ ttyin 0xfffffe00583840b0 getty 758 1 758 0 Ss+ ttyin 0xfffffe00583844b0 getty 757 1 757 0 Ss+ ttyin 0xfffffe00583848b0 getty 756 1 756 0 Ss+ ttyin 0xfffffe0058384cb0 getty 755 1 755 0 Ss+ ttyin 0xfffffe00582dc0b0 getty 754 1 754 0 Ss+ ttyin 0xfffffe00582dc4b0 getty 753 1 753 0 Ss+ ttyin 0xfffffe00582dc8b0 getty 752 1 752 0 Ss+ ttyin 0xfffffe00582dccb0 getty 698 1 698 0 Ss nanslp 0xffffffff84056981 cron 694 1 694 0 Ss select 0xfffffe0053d46340 sshd 507 1 507 0 Ss select 0xfffffe0056b8f5c0 syslogd 436 1 436 0 Ss select 0xfffffe0056b8f4c0 devd 435 1 435 65 Ss select 0xfffffe0056b8f540 dhclient 350 1 350 0 Ss select 0xfffffe0056b8f6c0 dhclient 347 1 347 0 Ss select 0xfffffe0053d46840 dhclient 23 0 0 0 DL syncer 0xffffffff8417cac0 [syncer] 22 0 0 0 DL vlruwt 0xfffffe005849d538 [vnlru] 21 0 0 0 DL (threaded) [bufdaemon] 100083 D qsleep 0xffffffff8417a9c0 [bufdaemon] 100088 D - 0xffffffff83411f80 [bufspacedaemon-0] 100097 D sdflush 0xfffffe00079198e8 [/ worker] 20 0 0 0 DL psleep 0xffffffff841b2d40 [vmdaemon] 19 0 0 0 DL (threaded) [pagedaemon] 100081 D psleep 0xffffffff841a6878 [dom0] 100086 D launds 0xffffffff841a6884 [laundry: dom0] 100087 D umarcl 0xffffffff81e90e90 [uma] 18 0 0 0 DL - 0xffffffff83e0dae0 [rand_harvestq] 17 0 0 0 DL waiting 0xffffffff84af9460 [sctp_iterator] 16 0 0 0 DL pftm 0xffffffff847f4d30 [pf purge] 15 0 0 0 DL - 0xffffffff84175e40 [soaiod4] 9 0 0 0 DL - 0xffffffff84175e40 [soaiod3] 8 0 0 0 DL - 0xffffffff84175e40 [soaiod2] 7 0 0 0 DL - 0xffffffff84175e40 [soaiod1] 6 0 0 0 DL (threaded) [cam] 100046 D - 0xffffffff83c93240 [doneq0] 100047 D - 0xffffffff83c931c0 [async] 100080 D - 0xffffffff83c93040 [scanner] 14 0 0 0 DL seqstat 0xfffffe0056aafc88 [sequencer 00] 5 0 0 0 DL crypto_ 0xfffffe0053e16c80 [crypto returns 1] 4 0 0 0 DL crypto_ 0xfffffe0053e16c30 [crypto returns 0] 3 0 0 0 DL crypto_ 0xffffffff841a0920 [crypto] 13 0 0 0 DL (threaded) [geom] 100037 D - 0xffffffff84029f40 [g_event] 100038 D - 0xffffffff84029f80 [g_up] 100039 D - 0xffffffff84029fc0 [g_down] 2 0 0 0 DL (threaded) [KTLS] 100028 D - 0xfffffe0053e16e00 [thr_0] 100029 D - 0xfffffe0053e16e80 [thr_1] 12 0 0 0 WL (threaded) [intr] 100010 I [swi6: task queue] 100011 I [swi6: Giant taskq] 100014 I [swi5: fast taskq] 100030 I [swi1: netisr 0] 100031 I [swi3: vm] 100032 I [swi4: clock (0)] 100033 I [swi4: clock (1)] 100034 I [swi1: hpts] 100035 I [swi1: hpts] 100048 I [irq24: virtio_pci0] 100049 I [irq25: virtio_pci0] 100050 I [irq26: virtio_pci0] 100051 I [irq27: virtio_pci0] 100052 I [irq28: virtio_pci1] 100053 I [irq29: virtio_pci1] 100054 I [irq30: virtio_pci1] 100055 I [irq31: virtio_pci1] 100056 I [irq32: virtio_pci1] 100061 I [irq10: virtio_pci2] 100063 I [irq1: atkbd0] 100064 I [irq12: psm0] 100065 I [swi0: uart uart++] 100073 I [swi1: pf send] 11 0 0 0 RL (threaded) [idle] 100003 CanRun [idle: cpu0] 100004 CanRun [idle: cpu1] 1 0 1 0 SLs wait 0xfffffe0053d4b538 [init] 10 0 0 0 DL audit_w 0xffffffff841a18c0 [audit] 0 0 0 0 RLs (threaded) [kernel] 100000 D swapin 0xffffffff8402ae40 [swapper] 100005 D - 0xfffffe000791d500 [softirq_0] 100006 D - 0xfffffe000791d400 [softirq_1] 100007 D - 0xfffffe000791d300 [if_io_tqg_0] 100008 D - 0xfffffe000791d200 [if_io_tqg_1] 100009 D - 0xfffffe000791d100 [if_config_tqg_0] 100012 Run CPU 0 [thread taskq] 100013 D - 0xfffffe0053dde000 [inm_free taskq] 100015 D - 0xfffffe0053df1c00 [kqueue_ctx taskq] 100016 D - 0xfffffe0053df1b00 [linuxkpi_irq_wq] 100017 D - 0xfffffe0053df1a00 [aiod_kick taskq] 100018 D - 0xfffffe0053df1900 [in6m_free taskq] 100019 D - 0xfffffe0053df1800 [pci_hp taskq] 100020 D - 0xfffffe0053df1700 [linuxkpi_short_wq_0] 100021 D - 0xfffffe0053df1700 [linuxkpi_short_wq_1] 100022 D - 0xfffffe0053df1700 [linuxkpi_short_wq_2] 100023 D - 0xfffffe0053df1700 [linuxkpi_short_wq_3] 100024 D - 0xfffffe0053df1600 [linuxkpi_long_wq_0] 100025 D - 0xfffffe0053df1600 [linuxkpi_long_wq_1] 100026 D - 0xfffffe0053df1600 [linuxkpi_long_wq_2] 100027 D - 0xfffffe0053df1600 [linuxkpi_long_wq_3] 100036 D - 0xfffffe0053e27700 [firmware taskq] 100040 D - 0xfffffe0053e27600 [crypto_0] 100041 D - 0xfffffe0053e27600 [crypto_1] 100057 D - 0xfffffe0053e27000 [vtnet0 rxq 0] 100058 D - 0xfffffe0056ec9e00 [vtnet0 txq 0] 100059 D - 0xfffffe0056ec9d00 [vtnet0 rxq 1] 100060 D - 0xfffffe0056ec9c00 [vtnet0 txq 1] 100062 D vtbslp 0xfffffe0056b8f780 [virtio_balloon] 100066 D - 0xfffffe0056ec9500 [mca taskq] 100067 D - 0xffffffff82c5d561 [deadlkres] 100075 D - 0xfffffe0056ec9300 [acpi_task_0] 100076 D - 0xfffffe0056ec9300 [acpi_task_1] 100077 D - 0xfffffe0056ec9300 [acpi_task_2] 100079 D - 0xfffffe0053e27500 [CAM taskq] db> show all locks Process 1365 (syz-executor0298883) thread 0xfffffe009ea89020 (101274) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe000797b508) locked @ /syzkaller/managers/main/kernel/sys/ufs/ffs/ffs_softdep.c:14730 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0007943948) locked @ /syzkaller/managers/main/kernel/sys/kern/vfs_bio.c:3928 exclusive lockmgr ufs (ufs) r = 0 (0xfffffe009e437070) locked @ /syzkaller/managers/main/kernel/sys/kern/vfs_vnops.c:1157 Process 1365 (syz-executor0298883) thread 0xfffffe009e9b6e40 (101275) exclusive sleep mutex sctp-inp (inp) r = 0 (0xfffffe009ea1a968) locked @ /syzkaller/managers/main/kernel/sys/netinet/sctp_pcb.c:2997 exclusive rw sctp-info (sctp-info) r = 0 (0xfffffe00081b1358) locked @ /syzkaller/managers/main/kernel/sys/netinet/sctp_pcb.c:2918 Process 1362 (syz-executor0298883) thread 0xfffffe009e9b8ac0 (100960) exclusive sleep mutex sctp-create (inp_create) r = 0 (0xfffffe009e9fce88) locked @ /syzkaller/managers/main/kernel/sys/netinet/sctp_pcb.c:3330 Process 1361 (syz-executor0298883) thread 0xfffffe009ea86c80 (100532) exclusive sleep mutex sctp-create (inp_create) r = 0 (0xfffffe009ea4be88) locked @ /syzkaller/managers/main/kernel/sys/netinet/sctp_pcb.c:3330 Process 0 (kernel) thread 0xfffffe0053dee1e0 (100012) exclusive sleep mutex kernel arena (kernel arena) r = 0 (0xffffffff840ab600) locked @ /syzkaller/managers/main/kernel/sys/kern/subr_vmem.c:789 exclusive sleep mutex vmem list lock (vmem list lock) r = 0 (0xffffffff83409bc0) locked @ /syzkaller/managers/main/kernel/sys/kern/subr_vmem.c:784 db> show malloc Type InUse MemUse Requests pf_hash 5 11524K 5 devbuf 4216 4338K 4244 tcp_hpts 6 3201K 6 sysctloid 34320 2027K 34387 vtbuf 24 1968K 46 kobj 326 1304K 485 newblk 28 1031K 11200 vfscache 3 1025K 3 pcb 47 564K 3499 inodedep 15 518K 1538 ufs_quota 1 512K 1 vfs_hash 1 512K 1 callout 2 512K 2 intr 4 472K 4 subproc 118 230K 1433 acpica 1674 184K 54712 vnet_data 1 168K 1 vmem 3 146K 4 tidhash 3 141K 3 linker 356 140K 384 pagedep 10 131K 596 tfo_ccache 1 128K 1 sem 4 106K 4 DEVFS1 103 103K 112 bus 984 80K 3475 mtx_pool 2 72K 2 syncache 1 68K 1 acpitask 1 64K 1 ddb_capture 1 64K 1 module 509 64K 509 umtx 308 39K 308 kdtrace 187 38K 2642 temp 18 33K 1626 hostcache 1 32K 1 shm 1 32K 1 DEVFS3 122 31K 132 msg 4 30K 4 gtaskqueue 18 26K 18 kbdmux 6 22K 6 DEVFS_RULE 56 20K 56 BPF 10 18K 10 ufs_mount 5 17K 6 proc 3 17K 3 tty 16 16K 16 ithread 99 16K 99 bus-sc 33 14K 1692 sctp_timw 51 13K 51 KTRACE 100 13K 100 kenv 95 12K 95 eventhandler 133 12K 133 ifaddr 30 12K 32 routetbl 50 11K 176 CAM queue 5 11K 1528 rman 84 10K 425 GEOM 60 10K 489 bmsafemap 2 9K 1541 UART 12 9K 12 devstat 4 9K 4 ksem 1 8K 1 rpc 2 8K 2 shmfd 1 8K 571 pfs_vncache 1 8K 1 pfs_nodes 20 8K 20 audit_evclass 236 8K 294 taskqueue 60 7K 60 sglist 5 7K 5 CAM DEV 3 6K 510 cred 22 6K 236 plimit 20 5K 347 ufs_dirhash 24 5K 24 sctp_atcl 12 5K 2844 UMA 270 5K 270 vt 11 5K 11 ifnet 3 5K 3 memdesc 1 4K 1 MCA 32 4K 32 evdev 4 4K 4 filedesc 1 4K 1 freework 15 4K 8271 acpisem 28 4K 28 hhook 15 4K 17 kqueue 51 4K 1368 ether_multi 40 4K 50 lltable 11 4K 11 pwddesc 49 4K 1366 pf_ifnet 5 3K 6 fpukern_ctx 3 3K 3 in6_multi 25 3K 25 terminal 11 3K 11 session 19 3K 32 uidinfo 3 3K 8 local_apic 1 2K 1 io_apic 1 2K 1 ipsec-saq 2 2K 2 CAM CCB 1 2K 18252 selfd 27 2K 18170 Unitno 27 2K 39 CAM XPT 22 2K 543 lockf 15 2K 22 proc-args 36 2K 495 diradd 12 2K 1184 ipsecpolicy 2 2K 2 acpidev 20 2K 20 msi 9 2K 9 clone 9 2K 9 softdep 1 1K 1 sahead 1 1K 1 secasvar 1 1K 1 vnodemarker 2 1K 22 NFSD session 1 1K 1 CAM periph 4 1K 271 select 7 1K 30 ipsec 3 1K 3 indirdep 3 1K 2753 nhops 6 1K 6 toponodes 6 1K 6 isadev 6 1K 6 mount 16 1K 89 pci_link 10 1K 10 sctp_ifa 5 1K 6 mkdir 5 1K 1172 crypto 4 1K 4 ip6ndp 4 1K 5 encap_export_host 12 1K 12 newdirblk 4 1K 586 freeblks 2 1K 1694 inpcbpolicy 16 1K 710 in_multi 2 1K 4 pfil 4 1K 4 cdev 2 1K 2 sctp_atky 12 1K 3978 chacha20random 1 1K 1 osd 7 1K 19 sctp_ifn 2 1K 6 NFSD lckfile 1 1K 1 NFSD V4client 1 1K 1 DEVFSP 4 1K 10 DEVFS 9 1K 10 dirrem 1 1K 1164 freefile 2 1K 1162 mld 2 1K 2 igmp 2 1K 2 vnodes 1 1K 1 CAM SIM 2 1K 2 ktls 1 1K 1 iov 2 1K 14817 feeder 7 1K 7 sctp_athm 12 1K 3410 tcpfunc 3 1K 3 loginclass 3 1K 7 prison 6 1K 6 lkpikmalloc 5 1K 6 aesni_data 2 1K 2 soname 5 1K 4602 apmdev 1 1K 1 atkbddev 2 1K 2 CAM dev queue 2 1K 2 xform 2 1K 56 CAM I/O Scheduler 1 1K 1 CAM path 4 1K 1034 procdesc 1 1K 6 pmchooks 1 1K 1 nexusdev 7 1K 7 tun 3 1K 3 sctp_vrf 1 1K 1 vnet 1 1K 1 entropy 2 1K 40 acpiintr 1 1K 1 pmc 1 1K 1 sctp_socko 2 1K 1136 cpus 2 1K 2 vnet_data_free 1 1K 1 Per-cpu 1 1K 1 p1003.1b 1 1K 1 filecaps 1 1K 66 cdg data 0 0K 0 tcp_do 0 0K 0 tcp_fsb 0 0K 0 chd data 0 0K 0 sctp_mcore 0 0K 0 sctp_iter 0 0K 4 sctp_mvrf 0 0K 0 sctp_cpal 0 0K 0 sctp_cmsg 0 0K 0 sctp_stre 0 0K 0 sctp_athi 0 0K 0 sctp_a_it 0 0K 4 sctp_aadr 0 0K 0 sctp_stro 0 0K 568 sctp_stri 0 0K 1132 sctp_map 0 0K 1136 cubic data 0 0K 0 htcp data 0 0K 0 vegas data 0 0K 0 pf_table 0 0K 0 pf_rule 0 0K 0 pf_altq 0 0K 0 pf_osfp 0 0K 0 pf_temp 0 0K 0 mqdata 0 0K 0 dctcp data 0 0K 0 NEWdirectio 0 0K 0 NEWNFSnode 0 0K 0 madt_table 0 0K 2 smartpqi 0 0K 0 NFSCL lck 0 0K 0 NFSCL lckown 0 0K 0 NFSCL client 0 0K 0 NFSCL deleg 0 0K 0 NFSCL open 0 0K 0 NFSCL owner 0 0K 0 NFS fh 0 0K 0 NFS req 0 0K 0 iavf 0 0K 0 ixl 0 0K 0 NFSD usrgroup 0 0K 0 NFSD string 0 0K 0 NFSD V4lock 0 0K 0 NFSD V4state 0 0K 0 NFSD srvcache 0 0K 0 ice-resmgr 0 0K 0 ice-osdep 0 0K 0 ice 0 0K 0 axgbe 0 0K 0 msdosfs_fat 0 0K 0 msdosfs_mount 0 0K 0 msdosfs_node 0 0K 0 DEVFS4 0 0K 0 DEVFS2 0 0K 0 xen_intr 0 0K 0 gntdev 0 0K 0 privcmd_dev 0 0K 0 xen_hvm 0 0K 0 legacydrv 0 0K 0 qpidrv 0 0K 0 evtchn_dev 0 0K 0 xenstore 0 0K 0 dmar_idpgtbl 0 0K 0 dmar_dom 0 0K 0 dmar_ctx 0 0K 0 ciss_data 0 0K 0 BACKLIGHT 0 0K 0 xnb 0 0K 0 isci 0 0K 0 iommu_dmamap 0 0K 0 xbbd 0 0K 0 hyperv_socket 0 0K 0 bxe_ilt 0 0K 0 xenbus 0 0K 0 xbd 0 0K 0 Balloon 0 0K 0 sysmouse 0 0K 0 vm_fictitious 0 0K 0 vtfont 0 0K 0 ath_hal 0 0K 0 athdev 0 0K 0 ata_pci 0 0K 0 ata_dma 0 0K 0 ata_generic 0 0K 0 amr 0 0K 0 pvscsi 0 0K 0 scsi_da 0 0K 69 UMAHash 0 0K 0 ata_da 0 0K 0 vm_pgdata 0 0K 0 jblocks 0 0K 0 savedino 0 0K 3285 sentinel 0 0K 0 jfsync 0 0K 0 jtrunc 0 0K 0 sbdep 0 0K 9 jsegdep 0 0K 0 jseg 0 0K 0 jfreefrag 0 0K 0 jfreeblk 0 0K 0 jnewblk 0 0K 0 jmvref 0 0K 0 jremref 0 0K 0 jaddref 0 0K 0 freedep 0 0K 0 freefrag 0 0K 1 allocindir 0 0K 0 allocdirect 0 0K 0 ufs_trim 0 0K 0 mactemp 0 0K 0 audit_trigger 0 0K 0 audit_pipe_presel 0 0K 0 audit_pipeent 0 0K 0 audit_pipe 0 0K 0 audit_evname 0 0K 0 audit_bsm 0 0K 0 audit_gidset 0 0K 0 audit_text 0 0K 0 audit_path 0 0K 0 audit_data 0 0K 0 audit_cred 0 0K 0 scsi_ch 0 0K 0 scsi_cd 0 0K 0 AHCI driver 0 0K 0 USBdev 0 0K 0 USB 0 0K 0 agp 0 0K 0 nvme_da 0 0K 0 ktls_ocf 0 0K 0 MLX5EEPROM 0 0K 0 MLX5EEPROM 0 0K 0 MLX5EEPROM 0 0K 0 MLX5EEPROM 0 0K 0 MLX5E_TLS 0 0K 0 MLX5EEPROM 0 0K 0 MLX5EEPROM 0 0K 0 MLX5EEPROM 0 0K 0 MLX5EN 0 0K 0 MLX5EEPROM 0 0K 0 MLX5EEPROM 0 0K 0 MLX5EEPROM 0 0K 0 MLX5DUMP 0 0K 0 MLX5EEPROM 0 0K 0 MLX5EEPROM 0 0K 0 seq_file 0 0K 0 radix 0 0K 0 idr 0 0K 0 lkpifw 0 0K 0 NLM 0 0K 0 ipsec-spdcache 0 0K 0 ipsec-reg 0 0K 0 ipsec-misc 0 0K 0 ipsecrequest 0 0K 0 ip6opt 0 0K 3 ip6_msource 0 0K 0 ip6_moptions 0 0K 0 in6_mfilter 0 0K 0 frag6 0 0K 0 tcplog 0 0K 0 tcp_hwpace 0 0K 0 acpipwr 0 0K 0 acpi_perf 0 0K 0 LRO 0 0K 0 newreno data 0 0K 0 ip_msource 0 0K 0 ip_moptions 0 0K 0 in_mfilter 0 0K 0 ipid 0 0K 0 80211scan 0 0K 0 80211ratectl 0 0K 0 80211power 0 0K 0 80211nodeie 0 0K 0 80211node 0 0K 0 80211mesh_gt 0 0K 0 80211mesh_rt 0 0K 0 80211perr 0 0K 0 80211prep 0 0K 0 80211preq 0 0K 0 80211dfs 0 0K 0 80211crypto 0 0K 0 80211vap 0 0K 0 iflib 0 0K 0 vlan 0 0K 0 gif 0 0K 0 ifdescr 0 0K 0 zlib 0 0K 0 fadvise 0 0K 0 VN POLL 0 0K 0 twsbuf 0 0K 0 statfs 0 0K 769 namei_tracker 0 0K 0 export_host 0 0K 0 cl_savebuf 0 0K 3 twe_commands 0 0K 0 twa_commands 0 0K 0 tcp_log_dev 0 0K 0 midi buffers 0 0K 0 mixer 0 0K 0 ac97 0 0K 0 hdacc 0 0K 0 hdac 0 0K 0 hdaa 0 0K 0 acpicmbat 0 0K 0 SIIS driver 0 0K 0 PUC 0 0K 0 ppbusdev 0 0K 0 agtiapi_MemAlloc malloc 0 0K 0 biobuf 0 0K 0 aios 0 0K 0 lio 0 0K 0 acl 0 0K 0 osti_cacheable 0 0K 0 mbuf_tag 0 0K 27 tempbuff 0 0K 0 tempbuff 0 0K 0 ag_tgt_map_t malloc 0 0K 0 ag_slr_map_t malloc 0 0K 0 lDevFlags * malloc 0 0K 0 tiDeviceHandle_t * malloc 0 0K 0 ag_portal_data_t malloc 0 0K 0 ag_device_t malloc 0 0K 0 STLock malloc 0 0K 0 CCB List 0 0K 0 sr_iov 0 0K 0 OCS 0 0K 0 OCS 0 0K 0 nvme 0 0K 0 nvd 0 0K 0 netmap 0 0K 0 mwldev 0 0K 0 MVS driver 0 0K 0 CAM ccb queue 0 0K 0 mrsasbuf 0 0K 0 mpt_user 0 0K 0 mps_user 0 0K 0 accf 0 0K 0 pts 0 0K 0 ioctlops 0 0K 85 eventfd 0 0K 0 Witness 0 0K 0 stack 0 0K 0 MPSSAS 0 0K 0 mps 0 0K 0 mpr_user 0 0K 0 MPRSAS 0 0K 0 mpr 0 0K 0 mfibuf 0 0K 0 sbuf 0 0K 288 md_sectors 0 0K 0 firmware 0 0K 0 compressor 0 0K 0 md_disk 0 0K 0 SWAP 0 0K 0 malodev 0 0K 0 LED 0 0K 0 sysctltmp 0 0K 656 sysctl 0 0K 3 ekcd 0 0K 0 dumper 0 0K 0 sendfile 0 0K 0 rctl 0 0K 0 ix_sriov 0 0K 0 aacraidcam 0 0K 0 aacraid_buf 0 0K 0 ix 0 0K 0 ipsbuf 0 0K 0 cache 0 0K 0 iirbuf 0 0K 0 kcovinfo 0 0K 0 prison_racct 0 0K 0 Fail Points 0 0K 0 sigio 0 0K 1 filedesc_to_leader 0 0K 0 pwd 0 0K 0 tty console 0 0K 0 aaccam 0 0K 0 aacbuf 0 0K 0 zstd 0 0K 0 XZ_DEC 0 0K 0 nvlist 0 0K 0 SCSI ENC 0 0K 0 SCSI sa 0 0K 0 scsi_pass 0 0K 0 isofs_node 0 0K 0 isofs_mount 0 0K 0 tr_raid5_data 0 0K 0 tr_raid1e_data 0 0K 0 tr_raid1_data 0 0K 0 tr_raid0_data 0 0K 0 tr_concat_data 0 0K 0 md_sii_data 0 0K 0 md_promise_data 0 0K 0 md_nvidia_data 0 0K 0 md_jmicron_data 0 0K 0 md_intel_data 0 0K 0 md_ddf_data 0 0K 0 raid_data 0 0K 72 geom_flashmap 0 0K 0 tmpfs dir 0 0K 0 tmpfs name 0 0K 0 tmpfs mount 0 0K 0 NFS FHA 0 0K 0 newnfsmnt 0 0K 0 newnfsclient_req 0 0K 0 NFSCL layrecall 0 0K 0 NFSCL session 0 0K 0 NFSCL sockreq 0 0K 0 NFSCL devinfo 0 0K 0 NFSCL flayout 0 0K 0 NFSCL layout 0 0K 0 NFSD rollback 0 0K 0 NFSCL diroff 0 0K 0 db> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree mbuf_jumbo_page 4096 8320 983 14887 0 254 38105088 0 pbuf 2624 0 973 0 0 2 2553152 0 mbuf 256 8578 992 31635 0 254 2449920 0 BUF TRIE 144 183 11577 9391 0 62 1693440 0 malloc-384 384 4154 16 4165 0 30 1601280 0 malloc-128 128 12105 78 13292 0 126 1559424 0 malloc-4096 4096 326 1 485 0 2 1339392 0 UMA Slabs 0 112 10127 22 10127 0 126 1136688 0 vmem btag 56 15619 52 15619 0 254 877576 0 FFS inode 1160 495 23 1658 0 8 600880 0 RADIX NODE 144 3200 211 43267 0 62 491184 0 malloc-65536 65536 4 2 48 0 1 393216 0 lkpicurr 160 2 2348 2 0 62 376000 0 lkpimm 160 1 2324 1 0 62 372000 0 sctp_asoc 2288 0 140 568 0 254 320320 0 THREAD 1808 135 19 1275 0 8 278432 0 VNODE 448 525 78 1690 0 30 270144 0 VM OBJECT 264 939 51 20838 0 30 261360 0 256 Bucket 2048 123 3 10885 0 8 258048 0 malloc-64 64 3862 107 3897 0 254 254016 0 malloc-16 16 13985 515 15182 0 254 232000 0 DEVCTL 1024 0 220 125 0 0 225280 0 malloc-4096 4096 51 4 1368 0 2 225280 0 malloc-256 256 48 807 12433 0 62 218880 0 malloc-65536 65536 3 0 3 0 1 196608 0 malloc-65536 65536 2 1 10 0 1 196608 0 malloc-32768 32768 0 6 2200 0 1 196608 0 UMA Zones 768 242 2 242 0 16 187392 0 malloc-128 128 1284 173 26856 0 126 186496 0 malloc-32 32 5521 149 5669 0 254 181440 0 FFS2 dinode 256 495 30 1657 0 62 134400 0 S VFS Cache 104 978 309 2156 0 126 133848 0 malloc-65536 65536 0 2 136 0 1 131072 0 malloc-1024 1024 115 5 288 0 16 122880 0 ksiginfo 112 54 990 74 0 126 116928 0 sctp_raddr 736 0 154 568 0 254 113344 0 MAP ENTRY 96 889 287 48865 0 126 112896 0 malloc-8192 8192 12 1 14 0 1 106496 0 malloc-2048 2048 21 29 20201 0 8 102400 0 malloc-32768 32768 1 2 131 0 1 98304 0 malloc-16384 16384 6 0 21 0 1 98304 0 malloc-256 256 281 79 3304 0 62 92160 0 VMSPACE 2544 28 8 1344 0 4 91584 0 UMA Kegs 384 227 6 227 0 30 89472 0 PROC 1336 50 16 1365 0 8 88176 0 clpbuf 2624 0 32 25 0 16 83968 0 malloc-128 128 402 218 5611 0 126 79360 0 filedesc0 1072 51 19 1366 0 8 75040 0 socket 944 34 42 3611 0 254 71744 0 64 Bucket 512 81 55 2933 0 30 69632 0 malloc-256 256 136 134 12142 0 62 69120 0 malloc-64 64 894 177 20842 0 254 68544 0 mbuf_cluster 2048 30 2 30 0 254 65536 0 malloc-16384 16384 2 2 162 0 1 65536 0 sctp_ep 1280 12 36 1710 0 254 61440 0 malloc-4096 4096 14 1 25 0 2 61440 0 malloc-384 384 94 66 4450 0 30 61440 0 g_bio 408 4 146 70416 0 30 61200 0 malloc-8192 8192 5 2 106 0 1 57344 0 malloc-2048 2048 16 12 557 0 8 57344 0 128 Bucket 1024 40 11 647 0 16 52224 0 malloc-4096 4096 10 2 543 0 2 49152 0 malloc-64 64 624 132 4361 0 254 48384 0 32 Bucket 256 49 131 5201 0 62 46080 0 malloc-8192 8192 2 3 30 0 1 40960 0 malloc-1024 1024 3 37 614 0 16 40960 0 malloc-1024 1024 3 37 511 0 16 40960 0 DIRHASH 1024 34 2 34 0 16 36864 0 NAMEI 1024 0 36 16351 0 16 36864 0 pcpu-8 8 4229 379 4257 0 254 36864 0 malloc-256 256 1 134 4825 0 62 34560 0 malloc-32768 32768 1 0 1 0 1 32768 0 malloc-32768 32768 1 0 1 0 1 32768 0 malloc-512 512 1 63 1251 0 30 32768 0 pcpu-64 64 487 25 487 0 254 32768 0 PWD 32 16 992 679 0 254 32256 0 malloc-256 256 79 41 549 0 62 30720 0 malloc-4096 4096 6 1 9 0 2 28672 0 sctp_chunk 152 0 182 566 0 254 27664 0 malloc-384 384 52 18 52 0 30 26880 0 malloc-256 256 85 20 412 0 62 26880 0 malloc-8192 8192 3 0 3 0 1 24576 0 malloc-1024 1024 16 8 32 0 16 24576 0 malloc-64 64 21 357 15127 0 254 24192 0 ttyinq 160 135 15 300 0 62 24000 0 8 Bucket 80 38 262 1563 0 126 24000 0 malloc-128 128 124 62 1046 0 126 23808 0 ttyoutq 256 72 18 160 0 62 23040 0 TURNSTILE 136 155 13 155 0 62 22848 0 malloc-1024 1024 13 7 895 0 16 20480 0 udp_inpcb 496 12 28 698 0 254 19840 0 malloc-128 128 44 111 1255 0 126 19840 0 Mountpoints 2752 2 5 2 0 4 19264 0 SLEEPQUEUE 88 155 37 155 0 126 16896 0 malloc-8192 8192 2 0 2 0 1 16384 0 malloc-4096 4096 2 2 93 0 2 16384 0 ertt_txseginfo 40 1 403 828 0 254 16160 0 2 Bucket 32 49 455 889 0 254 16128 0 malloc-384 384 31 9 31 0 30 15360 0 tcpcb 1080 3 11 8 0 254 15120 0 pipe 744 6 14 285 0 16 14880 0 malloc-4096 4096 0 3 769 0 2 12288 0 16 Bucket 144 45 39 437 0 62 12096 0 vtnet_tx_hdr 24 0 501 2840 0 254 12024 0 Files 80 87 63 10658 0 126 12000 0 malloc-16 16 35 715 4666 0 254 12000 0 malloc-16 16 504 246 1982 0 254 12000 0 malloc-128 128 14 79 268 0 126 11904 0 kenv 258 15 30 1026 0 30 11610 0 malloc-256 256 21 24 276 0 62 11520 0 malloc-8192 8192 1 0 1 0 1 8192 0 malloc-4096 4096 2 0 3 0 2 8192 0 malloc-2048 2048 3 1 3 0 8 8192 0 malloc-2048 2048 0 4 2 0 8 8192 0 malloc-1024 1024 8 0 8 0 16 8192 0 malloc-1024 1024 4 4 574 0 16 8192 0 malloc-512 512 10 6 30 0 30 8192 0 malloc-512 512 6 10 16 0 30 8192 0 malloc-512 512 3 13 62 0 30 8192 0 rtentry 176 13 33 17 0 62 8096 0 PGRP 88 19 73 32 0 126 8096 0 rl_entry 40 60 142 60 0 254 8080 0 udpcb 32 10 242 698 0 254 8064 0 ertt 72 3 109 8 0 126 8064 0 malloc-64 64 39 87 45 0 254 8064 0 malloc-64 64 4 122 8 0 254 8064 0 malloc-64 64 0 126 644 0 254 8064 0 malloc-64 64 9 117 31 0 254 8064 0 malloc-32 32 21 231 2322 0 254 8064 0 malloc-32 32 96 156 834 0 254 8064 0 malloc-32 32 167 85 3214 0 254 8064 0 malloc-32 32 34 218 2748 0 254 8064 0 malloc-32 32 57 195 426 0 254 8064 0 malloc-32 32 23 229 40 0 254 8064 0 4 Bucket 48 6 162 60 0 254 8064 0 KNOTE 160 0 50 7 0 62 8000 0 malloc-16 16 17 483 33 0 254 8000 0 malloc-16 16 32 468 24986 0 254 8000 0 malloc-16 16 21 479 26 0 254 8000 0 malloc-16 16 11 489 13 0 254 8000 0 ripcb 496 1 15 4 0 254 7936 0 tcp_inpcb 496 3 13 8 0 254 7936 0 malloc-128 128 15 47 20 0 126 7936 0 malloc-128 128 1 61 15 0 126 7936 0 routing nhops 256 10 20 17 0 62 7680 0 unpcb 256 7 23 1174 0 254 7680 0 mbuf_packet 256 0 30 2927 0 254 7680 0 malloc-384 384 10 10 12 0 30 7680 0 malloc-384 384 1 19 366 0 30 7680 0 malloc-256 256 14 16 269 0 62 7680 0 FPU_save_area 832 1 8 1 0 16 7488 0 cpuset 104 7 55 7 0 126 6448 0 epoch_record pcpu 256 4 12 4 0 62 4096 0 malloc-2048 2048 1 1 13 0 8 4096 0 malloc-2048 2048 1 1 1 0 8 4096 0 malloc-2048 2048 2 0 2 0 8 4096 0 malloc-1024 1024 4 0 4 0 16 4096 0 malloc-512 512 2 6 3 0 30 4096 0 pcpu-16 16 7 249 7 0 254 4096 0 sctp_laddr 48 0 84 4 0 254 4032 0 hostcache 64 1 62 1 0 254 4032 0 syncache 168 0 24 6 0 254 4032 0 malloc-32 32 0 126 2 0 254 4032 0 malloc-16 16 4 246 5 0 254 4000 0 UMA Slabs 1 176 8 14 8 0 62 3872 0 malloc-384 384 2 8 2 0 30 3840 0 mqnode 416 3 6 3 0 30 3744 0 KMAP ENTRY 96 12 27 14 0 0 3744 0 vmem 1856 1 1 1 0 8 3712 0 SMR CPU 32 3 60 3 0 254 2016 0 SMR SHARED 24 3 60 3 0 254 1512 0 FFS1 dinode 128 0 0 0 0 126 0 0 da_ccb 544 0 0 0 0 16 0 0 ada_ccb 272 0 0 0 0 30 0 0 swblk 136 0 0 0 0 62 0 0 swpctrie 144 0 0 0 0 62 0 0 cdg_qdiffsample 16 0 0 0 0 254 0 0 sctp_asconf_ack 48 0 0 0 0 254 0 0 sctp_asconf 40 0 0 0 0 254 0 0 sctp_stream_msg_out 112 0 0 0 0 254 0 0 sctp_readq 152 0 0 0 0 254 0 0 pf state scrubs 40 0 0 0 0 254 0 0 pf frag entries 40 0 0 0 0 254 0 0 pf frags 248 0 0 0 0 62 0 0 pf table entries 160 0 0 0 0 62 0 0 pf table entry counters 64 0 0 0 0 254 0 0 pf source nodes 136 0 0 0 0 254 0 0 pf state keys 88 0 0 0 0 126 0 0 pf states 312 0 0 0 0 254 0 0 pf tags 104 0 0 0 0 126 0 0 pf mtags 48 0 0 0 0 254 0 0 tcp_bbr_pcb 832 0 0 0 0 16 0 0 tcp_bbr_map 128 0 0 0 0 126 0 0 tcp_rack_pcb 832 0 0 0 0 16 0 0 tcp_rack_map 112 0 0 0 0 126 0 0 udplite_inpcb 496 0 0 0 0 254 0 0 tcp_log_node 120 0 0 0 0 126 0 0 tcp_log_bucket 176 0 0 0 0 62 0 0 tcp_log 416 0 0 0 0 254 0 0 tcpreass 48 0 0 0 0 254 0 0 tfo_ccache_entries 80 0 0 0 0 126 0 0 tfo 4 0 0 0 0 254 0 0 sackhole 32 0 0 0 0 254 0 0 tcptw 88 0 0 0 0 254 0 0 ipq 56 0 0 0 0 254 0 0 IPsec SA lft_c 16 0 0 0 0 254 0 0 itimer 352 0 0 0 0 30 0 0 AIOLIO 272 0 0 0 0 30 0 0 AIOCB 552 0 0 0 0 16 0 0 AIOP 32 0 0 0 0 254 0 0 AIO 208 0 0 0 0 62 0 0 mqnotifier 216 0 0 0 0 62 0 0 mvdata 64 0 0 0 0 254 0 0 mqueue 248 0 0 0 0 62 0 0 TMPFS node 224 0 0 0 0 62 0 0 NCLNODE 584 0 0 0 0 16 0 0 LTS VFS Cache 360 0 0 0 0 30 0 0 L VFS Cache 320 0 0 0 0 30 0 0 STS VFS Cache 144 0 0 0 0 62 0 0 cryptop 280 0 0 0 0 30 0 0 linux_dma_object 24 0 0 0 0 254 0 0 linux_dma_pctrie 144 0 0 0 0 62 0 0 IOMMU_MAP_ENTRY 120 0 0 0 0 126 0 0 ktls_session 192 0 0 0 0 62 0 0 mbuf_jumbo_16k 16384 0 0 0 0 254 0 0 mbuf_jumbo_9k 9216 0 0 0 0 254 0 0 audit_record 1280 0 0 0 0 8 0 0 domainset 40 0 0 0 0 254 0 0 MAC labels 40 0 0 0 0 254 0 0 vnpbuf 2624 0 0 0 0 64 0 0 mdpbuf 2624 0 0 0 0 3 0 0 nfspbuf 2624 0 0 0 0 16 0 0 swwbuf 2624 0 0 0 0 8 0 0 swrbuf 2624 0 0 0 0 16 0 0 umtx_shm 88 0 0 0 0 126 0 0 umtx pi 96 0 0 0 0 126 0 0 rangeset pctrie nodes 144 0 0 0 0 62 0 0 malloc-65536 65536 0 0 0 0 1 0 0 malloc-65536 65536 0 0 0 0 1 0 0 malloc-65536 65536 0 0 0 0 1 0 0 malloc-65536 65536 0 0 0 0 1 0 0 malloc-32768 32768 0 0 0 0 1 0 0 malloc-32768 32768 0 0 0 0 1 0 0 malloc-32768 32768 0 0 0 0 1 0 0 malloc-32768 32768 0 0 0 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-8192 8192 0 0 0 0 1 0 0 malloc-8192 8192 0 0 0 0 1 0 0 malloc-2048 2048 0 0 0 0 8 0 0 malloc-512 512 0 0 0 0 30 0 0 malloc-512 512 0 0 0 0 30 0 0 malloc-512 512 0 0 0 0 30 0 0 malloc-384 384 0 0 0 0 30 0 0 pcpu-32 32 0 0 0 0 254 0 0 pcpu-4 4 0 0 0 0 254 0 0 fakepg 104 0 0 0 0 126 0 0 UMA Hash 256 0 0 0 0 62 0 0