Fatal trap 9: general protection fault while in kernel mode cpuid = 0; apic id = 00 instruction pointer = 0x20:0xffffffff803f7500 stack pointer = 0x28:0xffffffff82ceaa40 frame pointer = 0x28:0xffffffff82ceaa90 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 0 (softirq_0) trap number = 9 panic: general protection fault cpuid = 0 time = 1605086057 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x47/frame 0xffffffff82cea710 vpanic() at vpanic+0x1c7/frame 0xffffffff82cea770 panic() at panic+0x43/frame 0xffffffff82cea7d0 trap_fatal() at trap_fatal+0x4cd/frame 0xffffffff82cea850 trap() at trap+0xf7/frame 0xffffffff82cea970 calltrap() at calltrap+0x8/frame 0xffffffff82cea970 --- trap 0x9, rip = 0xffffffff803f7500, rsp = 0xffffffff82ceaa40, rbp = 0xffffffff82ceaa90 --- ck_epoch_poll_deferred() at ck_epoch_poll_deferred+0x270/frame 0xffffffff82ceaa90 epoch_call_task() at epoch_call_task+0xa2/frame 0xffffffff82ceaae0 gtaskqueue_run_locked() at gtaskqueue_run_locked+0x1f0/frame 0xffffffff82ceab70 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xd4/frame 0xffffffff82ceabb0 fork_exit() at fork_exit+0xb3/frame 0xffffffff82ceabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffffff82ceabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- KDB: enter: panic [ thread pid 0 tid 100007 ] Stopped at kdb_enter+0x67: movq $0,0x147b766(%rip) db> set $lines = 0 db> set $maxwidth = 0 db> show registers cs 0x20 ds 0x3b es 0x3b fs 0x13 gs 0x1b ss 0x28 rax 0x12 rcx 0x80 rdx 0xffffffff81922df2 rbx 0 rsp 0xffffffff82cea6f0 rbp 0xffffffff82cea710 rsi 0x1 rdi 0 r8 0 r9 0xffffffff r10 0 r11 0xfffffe0023b5f610 r12 0xffffffff820671a0 ddb_dbbe r13 0 r14 0xffffffff8196f0c3 r15 0xffffffff8196f0c3 rip 0xffffffff810dfe97 kdb_enter+0x67 rflags 0x86 kdb_enter+0x67: movq $0,0x147b766(%rip) db> show proc Process 0 (kernel) at 0xffffffff8250ee30: state: NORMAL uid: 0 gids: 0 ABI: null reaper: 0xffffffff8250ee30 reapsubtree: 0 sigparent: 0 vmspace: 0xffffffff8250fa80 (map 0xffffffff8250fa80) (map.pmap 0xffffffff8250fb40) (pmap 0xffffffff8250fba0) threads: 25 100000 D swapin 0xffffffff8250ee30 [swapper] 100004 D - 0xfffff800042b5600 [if_io_tqg_0] 100005 D - 0xfffff800042b5500 [if_io_tqg_1] 100006 D - 0xfffff800042b5400 [if_config_tqg_0] 100007 Run CPU 0 [softirq_0] 100008 D - 0xfffff800042b5200 [softirq_1] 100009 RunQ [inm_free taskq] 100012 D - 0xfffff800042b6b00 [aiod_kick taskq] 100013 D - 0xfffff800042b6a00 [thread taskq] 100014 D - 0xfffff800042b6900 [in6m_free taskq] 100016 D - 0xfffff800042b6600 [kqueue_ctx taskq] 100023 D - 0xfffff800042b6000 [firmware taskq] 100028 D - 0xfffff8000433be00 [crypto_0] 100029 D - 0xfffff8000433be00 [crypto_1] 100043 D - 0xfffff8000433b800 [vtnet0 rxq 0] 100044 D - 0xfffff8000433b700 [vtnet0 txq 0] 100045 D - 0xfffff8000433b600 [vtnet0 rxq 1] 100046 D - 0xfffff8000433b500 [vtnet0 txq 1] 100048 D vtbslp 0xfffff800044cd080 [virtio_balloon] 100052 D - 0xfffff800046a1d00 [mca taskq] 100057 D - 0xffffffff81d16f50 [deadlkres] 100061 D - 0xfffff800046a1800 [acpi_task_0] 100062 D - 0xfffff800046a1800 [acpi_task_1] 100063 D - 0xfffff800046a1800 [acpi_task_2] 100065 D - 0xfffff8000433bd00 [CAM taskq] db> ps pid ppid pgrp uid state wmesg wchan cmd 4458 1 4458 0 Ss select 0xfffff800044db640 dhclient 4455 4446 424 0 S nanslp 0xffffffff8252ed30 dhclient 4446 424 424 0 S wait 0xfffff8003f6a9000 sh 3060 1 3060 65 Ss select 0xfffff800044db740 dhclient 2443 1 2443 0 Ss select 0xfffff8003f9b8e40 dhclient 2439 1 2439 0 Ss select 0xfffff8003f966b40 dhclient 1820 1 1820 65 Ss select 0xfffff80004a298c0 dhclient 1379 1 1379 0 Ss select 0xfffff8003f966cc0 dhclient 1376 1 1376 0 Ss select 0xfffff800044db6c0 dhclient 1357 1 1357 65 Rs dhclient 814 1 814 0 Ss select 0xfffff80004a29340 dhclient 806 1 806 0 Rs dhclient 784 762 784 0 Rs syz-executor.3 766 762 766 0 REs CPU 1 syz-executor.1 765 762 765 0 REs syz-executor.0 762 760 760 0 RE syz-fuzzer 760 758 760 0 Ss pause 0xfffff80026feaae8 csh 758 682 758 0 Ss select 0xfffff800044db5c0 sshd 742 1 742 0 Rs+ getty 741 1 741 0 Ss+ ttyin 0xfffff800049930b0 getty 740 1 740 0 Ss+ ttyin 0xfffff800049938b0 getty 739 1 739 0 Ss+ ttyin 0xfffff8000498f0b0 getty 738 1 738 0 Ss+ ttyin 0xfffff8000498f8b0 getty 737 1 737 0 Ss+ ttyin 0xfffff8000498b0b0 getty 736 1 736 0 Ss+ ttyin 0xfffff8000498b8b0 getty 735 1 735 0 Ss+ ttyin 0xfffff800049870b0 getty 734 1 734 0 Ss+ ttyin 0xfffff800049878b0 getty 686 1 686 0 Ss nanslp 0xffffffff8252ed31 cron 682 1 682 0 Ss select 0xfffff800044db840 sshd 495 1 495 0 Ss select 0xfffff800044db9c0 syslogd 424 1 424 0 Ss wait 0xfffff80004b62520 devd 423 1 423 65 Ss select 0xfffff80004a29e40 dhclient 338 1 338 0 Ss select 0xfffff80004a29ec0 dhclient 335 1 335 0 Ss select 0xfffff80004a29d40 dhclient 23 0 0 0 DL syncer 0xffffffff8261c138 [syncer] 22 0 0 0 DL vlruwt 0xfffff800049ad520 [vnlru] 21 0 0 0 DL (threaded) [bufdaemon] 100069 D qsleep 0xffffffff8261b200 [bufdaemon] 100070 D - 0xffffffff8200ac00 [bufspacedaemon-0] 100085 D sdflush 0xfffff80004a480e8 [/ worker] 20 0 0 0 DL psleep 0xffffffff826426c8 [vmdaemon] 19 0 0 0 DL (threaded) [pagedaemon] 100067 D psleep 0xffffffff82636b38 [dom0] 100075 D launds 0xffffffff82636b44 [laundry: dom0] 100076 D umarcl 0xffffffff814e7450 [uma] 18 0 0 0 DL - 0xffffffff823634f8 [rand_harvestq] 17 0 0 0 DL waiting 0xffffffff82e16818 [sctp_iterator] 16 0 0 0 DL pftm 0xffffffff82b5b390 [pf purge] 15 0 0 0 DL - 0xffffffff8261a7dc [soaiod4] 9 0 0 0 DL - 0xffffffff8261a7dc [soaiod3] 8 0 0 0 DL - 0xffffffff8261a7dc [soaiod2] 7 0 0 0 DL - 0xffffffff8261a7dc [soaiod1] 6 0 0 0 DL (threaded) [cam] 100033 D - 0xffffffff8223b240 [doneq0] 100066 D - 0xffffffff8223b110 [scanner] 5 0 0 0 DL crypto_ 0xfffff80004183a90 [crypto returns 1] 4 0 0 0 DL crypto_ 0xfffff80004183a30 [crypto returns 0] 3 0 0 0 DL crypto_ 0xffffffff82634020 [crypto] 14 0 0 0 DL seqstat 0xfffff80004300488 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100024 D - 0xffffffff8250e8a0 [g_event] 100025 D - 0xffffffff8250e8a8 [g_up] 100026 D - 0xffffffff8250e8b0 [g_down] 2 0 0 0 DL (threaded) [KTLS] 100017 D - 0xfffff80004183c00 [thr_0] 100018 D - 0xfffff80004183c80 [thr_1] 12 0 0 0 WL (threaded) [intr] 100010 I [swi6: task queue] 100011 I [swi6: Giant taskq] 100015 I [swi5: fast taskq] 100019 I [swi1: netisr 0] 100020 I [swi4: clock (0)] 100021 I [swi4: clock (1)] 100022 I [swi3: vm] 100034 I [irq24: virtio_pci0] 100035 I [irq25: virtio_pci0] 100036 I [irq26: virtio_pci0] 100037 I [irq27: virtio_pci0] 100038 I [irq28: virtio_pci1] 100039 I [irq29: virtio_pci1] 100040 I [irq30: virtio_pci1] 100041 I [irq31: virtio_pci1] 100042 I [irq32: virtio_pci1] 100047 I [irq10: virtio_pci2] 100049 I [irq1: atkbd0] 100050 I [irq12: psm0] 100051 I [swi0: uart uart++] 100059 I [swi1: pf send] 100073 I [swi1: hpts] 100074 I [swi1: hpts] 11 0 0 0 RL (threaded) [idle] 100002 CanRun [idle: cpu0] 100003 CanRun [idle: cpu1] 1 0 1 0 SLs wait 0xfffff80004294520 [init] 10 0 0 0 DL audit_w 0xffffffff82634540 [audit] 0 0 0 0 RLs (threaded) [kernel] 100000 D swapin 0xffffffff8250ee30 [swapper] 100004 D - 0xfffff800042b5600 [if_io_tqg_0] 100005 D - 0xfffff800042b5500 [if_io_tqg_1] 100006 D - 0xfffff800042b5400 [if_config_tqg_0] 100007 Run CPU 0 [softirq_0] 100008 D - 0xfffff800042b5200 [softirq_1] 100009 RunQ [inm_free taskq] 100012 D - 0xfffff800042b6b00 [aiod_kick taskq] 100013 D - 0xfffff800042b6a00 [thread taskq] 100014 D - 0xfffff800042b6900 [in6m_free taskq] 100016 D - 0xfffff800042b6600 [kqueue_ctx taskq] 100023 D - 0xfffff800042b6000 [firmware taskq] 100028 D - 0xfffff8000433be00 [crypto_0] 100029 D - 0xfffff8000433be00 [crypto_1] 100043 D - 0xfffff8000433b800 [vtnet0 rxq 0] 100044 D - 0xfffff8000433b700 [vtnet0 txq 0] 100045 D - 0xfffff8000433b600 [vtnet0 rxq 1] 100046 D - 0xfffff8000433b500 [vtnet0 txq 1] 100048 D vtbslp 0xfffff800044cd080 [virtio_balloon] 100052 D - 0xfffff800046a1d00 [mca taskq] 100057 D - 0xffffffff81d16f50 [deadlkres] 100061 D - 0xfffff800046a1800 [acpi_task_0] 100062 D - 0xfffff800046a1800 [acpi_task_1] 100063 D - 0xfffff800046a1800 [acpi_task_2] 100065 D - 0xfffff8000433bd00 [CAM taskq] db> show all locks Process 806 (dhclient) thread 0xfffffe0025783c00 (100120) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffff80004b0f8c8) locked @ /syzkaller/managers/i386/kernel/sys/kern/uipc_sockbuf.c:467 Process 766 (syz-executor.1) thread 0xfffffe0023b5f800 (100086) exclusive rw vm object (vm object) r = 0 (0xfffff8003f47b948) locked @ /syzkaller/managers/i386/kernel/sys/kern/kern_kcov.c:411 Process 765 (syz-executor.0) thread 0xfffffe0023b5e300 (100080) exclusive sleep mutex tun_mtx (tun_mtx) r = 0 (0xfffff80026ef0288) locked @ /syzkaller/managers/i386/kernel/sys/net/if_tuntap.c:1177 Process 762 (syz-fuzzer) thread 0xfffffe0023bb4300 (100098) exclusive sleep mutex vm reserv (vm reserv) r = 0 (0xfffff8007c7f2c20) locked @ /syzkaller/managers/i386/kernel/sys/vm/vm_reserv.c:1045 exclusive rw vm object (vm object) r = 0 (0xfffff8003fa40420) locked @ /syzkaller/managers/i386/kernel/sys/vm/vm_object.c:647 Process 0 (kernel) thread 0xfffffe00049e8100 (100009) exclusive sleep mutex if_addr_lock (if_addr_lock) r = 0 (0xfffff8000468a1a8) locked @ /syzkaller/managers/i386/kernel/sys/net/if.c:3629 exclusive sx in_multi_sx (in_multi_sx) r = 0 (0xffffffff8261e468) locked @ /syzkaller/managers/i386/kernel/sys/netinet/in_mcast.c:322 db> show malloc Type InUse MemUse Requests pf_hash 5 11524K 5 devbuf 4214 4339K 4242 tcp_hpts 5 3201K 5 vtbuf 24 1968K 46 sysctloid 29217 1704K 29281 kobj 336 1344K 496 newblk 16 1028K 4042 vfscache 3 1025K 3 pcb 28 541K 3549 inodedep 50 531K 3578 ufs_quota 1 512K 1 vfs_hash 1 512K 1 callout 2 512K 2 intr 4 472K 4 subproc 137 262K 4562 acpica 1674 184K 52510 vnet_data 1 168K 1 tidhash 2 140K 2 pagedep 9 130K 3495 tfo_ccache 1 128K 1 sem 4 106K 4 DEVFS1 105 105K 122 linker 254 97K 330 bus 979 79K 3034 mtx_pool 2 72K 2 BPF 38 71K 62 syncache 1 68K 1 acpitask 1 64K 1 ddb_capture 1 64K 1 module 507 64K 507 filedesc 9 61K 7099 umtx 342 43K 342 kdtrace 179 34K 14808 temp 35 33K 2943 hostcache 1 32K 1 shm 1 32K 1 DEVFS3 124 31K 134 msg 4 30K 4 gtaskqueue 18 26K 18 ifaddr 85 26K 113 vmem 3 22K 5 kbdmux 6 22K 6 DEVFS_RULE 56 20K 56 ufs_mount 5 17K 6 proc 3 17K 3 tty 16 16K 16 ithread 99 16K 99 bus-sc 30 14K 1415 KTRACE 100 13K 100 ifnet 7 13K 7 kenv 92 12K 92 lltable 38 12K 101 eventhandler 132 12K 132 ether_multi 134 11K 543 dirrem 40 10K 3485 GEOM 60 10K 489 rman 82 10K 423 bmsafemap 2 9K 3543 UART 12 9K 12 devstat 4 9K 4 sctp_timw 32 8K 32 rpc 2 8K 2 shmfd 1 8K 16 pfs_vncache 1 8K 1 in6_multi 61 8K 268 pfs_nodes 20 8K 20 audit_evclass 233 8K 291 CAM DEV 3 6K 510 plimit 23 6K 569 cred 23 6K 474 select 43 6K 43 selfd 85 6K 56798 sglist 5 6K 5 CAM queue 5 6K 1528 taskqueue 48 6K 48 ufs_dirhash 24 5K 24 pf_ifnet 10 5K 19 vt 11 5K 11 UMA 254 5K 254 memdesc 1 4K 1 MCA 32 4K 32 session 32 4K 66 pgrp 32 4K 68 evdev 4 4K 4 kqueue 58 4K 4491 routetbl 20 4K 36 lockf 33 4K 75 freework 14 4K 3487 freeblks 13 4K 3486 hhook 13 4K 13 DEVFSP 50 4K 302 terminal 11 3K 11 acpisem 22 3K 22 proc-args 51 3K 845 kcovinfo 39 3K 272 uidinfo 3 3K 11 sctp_stro 2 2K 987 local_apic 1 2K 1 io_apic 1 2K 1 ipsec-saq 2 2K 2 freefile 15 2K 3458 ip6ndp 12 2K 44 CAM XPT 22 2K 543 sctp_ifa 12 2K 54 sctp_atcl 4 2K 2626 Unitno 25 2K 45 ipsecpolicy 2 2K 2 acpidev 20 2K 20 msi 9 2K 9 clone 9 2K 9 tun 7 2K 7 softdep 1 1K 1 sahead 1 1K 1 secasvar 1 1K 1 in_multi 4 1K 21 nhops 6 1K 8 vnodemarker 2 1K 44 NFSD session 1 1K 1 CAM periph 4 1K 271 ipsec 3 1K 3 mld 6 1K 6 igmp 6 1K 6 toponodes 6 1K 6 isadev 6 1K 6 mount 16 1K 89 pci_link 10 1K 10 encap_export_host 12 1K 12 procdesc 5 1K 22 crypto 3 1K 3 sctp_ifn 4 1K 54 diradd 4 1K 3525 pfil 4 1K 4 CAM SIM 2 1K 2 cdev 2 1K 2 newdirblk 3 1K 3472 mkdir 3 1K 6944 chacha20random 1 1K 1 osd 3 1K 9 inpcbpolicy 9 1K 1150 sctp_atky 6 1K 3625 vnodes 1 1K 1 ktls 1 1K 1 NFSD lckfile 1 1K 1 NFSD V4client 1 1K 1 DEVFS 9 1K 10 feeder 7 1K 7 loginclass 3 1K 6 prison 6 1K 6 CAM dev queue 2 1K 2 CAM I/O Scheduler 1 1K 1 apmdev 1 1K 1 atkbddev 2 1K 2 CAM path 4 1K 1034 tcpfunc 2 1K 2 pmchooks 1 1K 1 soname 4 1K 5320 nexusdev 5 1K 5 sctp_vrf 1 1K 1 sctp_athm 4 1K 2636 sctp_map 4 1K 1974 entropy 2 1K 57 vnet 1 1K 1 pmc 1 1K 1 acpiintr 1 1K 1 filecaps 4 1K 116 cpus 2 1K 2 vnet_data_free 1 1K 1 Per-cpu 1 1K 1 p1003.1b 1 1K 1 sctp_mcore 0 0K 0 sctp_socko 0 0K 316 sctp_iter 0 0K 47 sctp_mvrf 0 0K 0 sctp_cpal 0 0K 0 sctp_cmsg 0 0K 0 sctp_stre 0 0K 0 sctp_athi 0 0K 0 sctp_a_it 0 0K 47 sctp_aadr 0 0K 1 sctp_stri 0 0K 16 pf_table 0 0K 0 pf_rule 0 0K 0 pf_altq 0 0K 0 pf_osfp 0 0K 0 pf_temp 0 0K 0 nvlist 0 0K 0 SCSI ENC 0 0K 0 SCSI sa 0 0K 0 madt_table 0 0K 2 scsi_pass 0 0K 0 ciss_data 0 0K 0 smartpqi 0 0K 0 pvscsi 0 0K 0 ath_hal 0 0K 0 athdev 0 0K 0 ata_pci 0 0K 0 ata_dma 0 0K 0 ata_generic 0 0K 0 amr 0 0K 0 scsi_da 0 0K 69 iavf 0 0K 0 ixl 0 0K 0 ata_da 0 0K 0 scsi_ch 0 0K 0 scsi_cd 0 0K 0 USBdev 0 0K 0 USB 0 0K 0 AHCI driver 0 0K 0 ice-resmgr 0 0K 0 ice-osdep 0 0K 0 ice 0 0K 0 axgbe 0 0K 0 fpukern_ctx 0 0K 0 agp 0 0K 0 xen_intr 0 0K 0 xen_hvm 0 0K 0 legacydrv 0 0K 0 qpidrv 0 0K 0 nvme_da 0 0K 0 dmar_idpgtbl 0 0K 0 dmar_dom 0 0K 0 dmar_ctx 0 0K 0 acpipwr 0 0K 0 twsbuf 0 0K 0 twe_commands 0 0K 0 isci 0 0K 0 iommu_dmamap 0 0K 0 twa_commands 0 0K 0 hyperv_socket 0 0K 0 bxe_ilt 0 0K 0 xenbus 0 0K 0 tcp_log_dev 0 0K 0 midi buffers 0 0K 0 mixer 0 0K 0 vm_fictitious 0 0K 0 ac97 0 0K 0 hdacc 0 0K 0 hdac 0 0K 0 hdaa 0 0K 0 acpi_perf 0 0K 0 acpicmbat 0 0K 0 SIIS driver 0 0K 0 CAM CCB 0 0K 2318 UMAHash 0 0K 0 vm_pgdata 0 0K 0 jblocks 0 0K 0 savedino 0 0K 3213 sentinel 0 0K 0 jfsync 0 0K 0 jtrunc 0 0K 0 sbdep 0 0K 19 jsegdep 0 0K 0 jseg 0 0K 0 jfreefrag 0 0K 0 jfreeblk 0 0K 0 jnewblk 0 0K 0 jmvref 0 0K 0 jremref 0 0K 0 jaddref 0 0K 0 freedep 0 0K 0 freefrag 0 0K 7 allocindir 0 0K 0 indirdep 0 0K 10 allocdirect 0 0K 0 ufs_trim 0 0K 0 mactemp 0 0K 0 audit_trigger 0 0K 0 audit_pipe_presel 0 0K 0 audit_pipeent 0 0K 0 audit_pipe 0 0K 0 audit_evname 0 0K 0 audit_bsm 0 0K 0 audit_gidset 0 0K 0 audit_text 0 0K 0 audit_path 0 0K 0 audit_data 0 0K 0 audit_cred 0 0K 0 xform 0 0K 0 NLM 0 0K 0 ipsec-spdcache 0 0K 0 ipsec-reg 0 0K 0 ipsec-misc 0 0K 0 ipsecrequest 0 0K 0 ip6opt 0 0K 340 ip6_msource 0 0K 0 ip6_moptions 0 0K 0 in6_mfilter 0 0K 0 frag6 0 0K 0 tcplog 0 0K 0 PUC 0 0K 0 LRO 0 0K 0 newreno data 0 0K 0 ip_msource 0 0K 0 ip_moptions 0 0K 0 in_mfilter 0 0K 0 ipid 0 0K 0 80211scan 0 0K 0 80211ratectl 0 0K 0 80211power 0 0K 0 80211nodeie 0 0K 0 80211node 0 0K 0 80211mesh_gt 0 0K 0 80211mesh_rt 0 0K 0 80211perr 0 0K 0 80211prep 0 0K 0 80211preq 0 0K 0 80211dfs 0 0K 0 80211crypto 0 0K 0 80211vap 0 0K 0 iflib 0 0K 0 vlan 0 0K 0 gif 0 0K 0 ifdescr 0 0K 0 zlib 0 0K 0 fadvise 0 0K 0 VN POLL 0 0K 0 ppbusdev 0 0K 0 statfs 0 0K 3617 namei_tracker 0 0K 4 export_host 0 0K 0 cl_savebuf 0 0K 2 agtiapi_MemAlloc malloc 0 0K 0 osti_cacheable 0 0K 0 tempbuff 0 0K 0 tempbuff 0 0K 0 ag_tgt_map_t malloc 0 0K 0 ag_slr_map_t malloc 0 0K 0 lDevFlags * malloc 0 0K 0 tiDeviceHandle_t * malloc 0 0K 0 ag_portal_data_t malloc 0 0K 0 ag_device_t malloc 0 0K 0 STLock malloc 0 0K 0 CCB List 0 0K 0 sr_iov 0 0K 0 OCS 0 0K 0 OCS 0 0K 0 nvme 0 0K 0 nvd 0 0K 0 netmap 0 0K 0 mwldev 0 0K 0 MVS driver 0 0K 0 biobuf 0 0K 0 aios 0 0K 0 lio 0 0K 0 acl 0 0K 0 mbuf_tag 0 0K 538 accf 0 0K 0 pts 0 0K 0 iov 0 0K 17785 ioctlops 0 0K 165 Witness 0 0K 0 stack 0 0K 0 CAM ccb queue 0 0K 0 mrsasbuf 0 0K 0 mpt_user 0 0K 0 mps_user 0 0K 0 MPSSAS 0 0K 0 sbuf 0 0K 288 mps 0 0K 0 firmware 0 0K 0 compressor 0 0K 0 mpr_user 0 0K 0 SWAP 0 0K 0 MPRSAS 0 0K 0 mpr 0 0K 0 sysctltmp 0 0K 808 sysctl 0 0K 1 mfibuf 0 0K 0 ekcd 0 0K 0 dumper 0 0K 0 sendfile 0 0K 0 rctl 0 0K 0 md_sectors 0 0K 0 md_disk 0 0K 0 malodev 0 0K 0 LED 0 0K 0 cache 0 0K 0 ix_sriov 0 0K 0 prison_racct 0 0K 0 Fail Points 0 0K 0 sigio 0 0K 7 filedesc_to_leader 0 0K 0 pwd 0 0K 0 tty console 0 0K 0 aacraidcam 0 0K 0 ix 0 0K 0 ipsbuf 0 0K 0 iirbuf 0 0K 0 aacraid_buf 0 0K 0 aaccam 0 0K 0 isofs_node 0 0K 0 isofs_mount 0 0K 0 tr_raid5_data 0 0K 0 tr_raid1e_data 0 0K 0 tr_raid1_data 0 0K 0 tr_raid0_data 0 0K 0 tr_concat_data 0 0K 0 md_sii_data 0 0K 0 md_promise_data 0 0K 0 md_nvidia_data 0 0K 0 md_jmicron_data 0 0K 0 md_intel_data 0 0K 0 md_ddf_data 0 0K 0 raid_data 0 0K 72 geom_flashmap 0 0K 0 tmpfs dir 0 0K 0 tmpfs name 0 0K 0 tmpfs mount 0 0K 0 NFS FHA 0 0K 0 newnfsmnt 0 0K 0 newnfsclient_req 0 0K 0 NFSCL layrecall 0 0K 0 NFSCL session 0 0K 0 NFSCL sockreq 0 0K 0 NFSCL devinfo 0 0K 0 NFSCL flayout 0 0K 0 NFSCL layout 0 0K 0 NFSD rollback 0 0K 0 NFSCL diroffdiroff 0 0K 0 NEWdirectio 0 0K 0 NEWNFSnode 0 0K 0 NFSCL lck 0 0K 0 NFSCL lckown 0 0K 0 NFSCL client 0 0K 0 NFSCL deleg 0 0K 0 NFSCL open 0 0K 0 NFSCL owner 0 0K 0 NFS fh 0 0K 0 NFS req 0 0K 0 NFSD usrgroup 0 0K 0 NFSD string 0 0K 0 NFSD V4lock 0 0K 0 NFSD V4state 0 0K 0 NFSD srvcache 0 0K 0 msdosfs_fat 0 0K 0 msdosfs_mount 0 0K 0 msdosfs_node 0 0K 0 DEVFS4 0 0K 0 DEVFS2 0 0K 0 gntdev 0 0K 0 privcmd_dev 0 0K 0 evtchn_dev 0 0K 0 xenstore 0 0K 0 aacbuf 0 0K 0 xnb 0 0K 0 xbbd 0 0K 0 xbd 0 0K 0 Balloon 0 0K 0 sysmouse 0 0K 0 vtfont 0 0K 0 zstd 0 0K 0 db> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree mbuf_cluster 2048 9728 2 9728 0 254 19927040 0 mbuf_packet 256 8281 1319 1193469 0 254 2457600 0 BUF TRIE 144 175 13293 860 0 62 1939392 0 RADIX NODE 144 11187 1354 240739 0 62 1805904 0 malloc-384 384 4203 67 6844 0 30 1639680 0 malloc-4096 4096 338 2 4117 0 2 1392640 0 malloc-128 128 9621 82 9836 0 126 1241984 0 pbuf 832 0 969 0 0 2 806208 0 UMA Slabs 0 112 5801 28 5801 0 126 652848 0 malloc-65536 65536 4 2 263 0 1 393216 0 malloc-4096 4096 76 14 4962 0 2 368640 0 VM OBJECT 264 1243 137 68627 0 30 364320 0 VNODE 488 578 70 4038 0 30 316224 0 THREAD 1792 141 30 5920 0 8 306432 0 mbuf 256 538 617 609027 0 254 295680 0 256 Bucket 2048 119 17 8167 0 8 278528 0 mbuf_jumbo_page 4096 0 67 1291 0 254 274432 0 malloc-65536 65536 4 0 4 0 1 262144 0 DEVCTL 1024 18 190 151 0 0 212992 0 malloc-16384 16384 4 9 3542 0 1 212992 0 socket 944 33 179 7165 0 254 200128 0 malloc-16 16 12223 277 12370 0 254 200000 0 malloc-64 64 2796 165 3013 0 254 189504 0 MAP ENTRY 96 1408 566 246073 0 126 189504 0 malloc-1024 1024 136 36 2758 0 16 176128 0 UMA Zones 768 226 3 226 0 16 175872 0 malloc-128 128 1183 88 31488 0 126 162688 0 malloc-32 32 4753 161 4897 0 254 157248 0 malloc-384 384 88 302 3698 0 30 149760 0 malloc-256 256 228 342 8151 0 62 145920 0 FFS2 dinode 256 541 14 3999 0 62 142080 0 malloc-256 256 46 494 11023 0 62 138240 0 S VFS Cache 104 1012 314 4652 0 126 137904 0 malloc-128 128 975 48 994 0 126 130944 0 VMSPACE 2536 35 16 4478 0 4 129336 0 ksiginfo 112 63 981 1953 0 126 116928 0 malloc-256 256 30 420 3708 0 62 115200 0 FFS inode 160 541 159 3999 0 62 112000 0 malloc-2048 2048 5 49 2325 0 8 110592 0 vmem btag 56 1774 86 1774 0 254 104160 0 sctp_asoc 2288 2 43 987 0 254 102960 0 PROC 1312 57 21 4482 0 8 102336 0 filedesc0 1080 57 27 4483 0 8 90720 0 UMA Kegs 384 212 1 212 0 30 81792 0 g_bio 408 0 200 6926 0 30 81600 0 sctp_ep 1280 2 61 1631 0 254 80640 0 malloc-256 256 176 124 11516 0 62 76800 0 128 Bucket 1024 45 22 1562 0 16 68608 0 malloc-65536 65536 1 0 1 0 1 65536 0 malloc-65536 65536 0 1 110 0 1 65536 0 malloc-65536 65536 0 1 8 0 1 65536 0 malloc-32768 32768 2 0 2 0 1 65536 0 malloc-32768 32768 0 2 112 0 1 65536 0 malloc-16384 16384 4 0 7 0 1 65536 0 malloc-8192 8192 8 0 8 0 1 65536 0 malloc-4096 4096 15 1 27 0 2 65536 0 64 Bucket 512 95 17 28596 0 30 57344 0 malloc-128 128 28 406 3487 0 126 55552 0 malloc-128 128 383 51 4421 0 126 55552 0 malloc-2048 2048 5 21 1890 0 8 53248 0 malloc-384 384 94 36 429 0 30 49920 0 32 Bucket 256 60 120 1516 0 62 46080 0 malloc-2048 2048 9 13 519 0 8 45056 0 malloc-64 64 593 100 22486 0 254 44352 0 malloc-4096 4096 4 6 18 0 2 40960 0 sctp_raddr 736 2 53 987 0 254 40480 0 malloc-64 64 472 158 1079 0 254 40320 0 Files 80 169 331 19564 0 126 40000 0 clpbuf 832 0 48 127 0 16 39936 0 unpcb 256 20 130 4315 0 254 38400 0 DIRHASH 1024 34 2 34 0 16 36864 0 NAMEI 1024 0 36 31354 0 16 36864 0 malloc-4096 4096 9 0 10 0 2 36864 0 pcpu-8 8 4295 313 4493 0 254 36864 0 tcpcb 1048 3 30 616 0 254 34584 0 malloc-32768 32768 1 0 1 0 1 32768 0 malloc-8192 8192 4 0 4 0 1 32768 0 pcpu-64 64 451 61 451 0 254 32768 0 malloc-64 64 297 207 1602 0 254 32256 0 malloc-128 128 209 39 3364 0 126 31744 0 pipe 744 17 23 461 0 16 29760 0 TURNSTILE 136 172 38 172 0 62 28560 0 KNOTE 160 0 175 109215 0 62 28000 0 ttyinq 160 135 40 300 0 62 28000 0 8 Bucket 80 80 270 30306 0 126 28000 0 malloc-256 256 70 35 3611 0 62 26880 0 malloc-256 256 42 63 2482 0 62 26880 0 malloc-8192 8192 0 3 28 0 1 24576 0 malloc-8192 8192 3 0 3 0 1 24576 0 malloc-8192 8192 1 2 90 0 1 24576 0 PWD 32 15 741 3567 0 254 24192 0 4 Bucket 48 8 496 7710 0 254 24192 0 ttyoutq 256 72 18 160 0 62 23040 0 malloc-256 256 35 55 187 0 62 23040 0 malloc-256 256 82 8 199 0 62 23040 0 malloc-64 64 126 189 4818 0 254 20160 0 Mountpoints 2752 2 5 2 0 4 19264 0 SLEEPQUEUE 88 172 20 172 0 126 16896 0 malloc-16384 16384 1 0 1 0 1 16384 0 malloc-16384 16384 1 0 1 0 1 16384 0 malloc-16384 16384 0 1 136 0 1 16384 0 malloc-16384 16384 1 0 1 0 1 16384 0 malloc-8192 8192 2 0 2 0 1 16384 0 malloc-8192 8192 1 1 3 0 1 16384 0 malloc-2048 2048 7 1 7 0 8 16384 0 malloc-2048 2048 5 3 213 0 8 16384 0 rtentry 176 25 67 87 0 62 16192 0 malloc-64 64 91 161 56876 0 254 16128 0 malloc-32 32 317 187 2019 0 254 16128 0 16 Bucket 144 58 54 22243 0 62 16128 0 vtnet_tx_hdr 24 0 668 589442 0 254 16032 0 tcp_inpcb 488 3 29 616 0 254 15616 0 routing nhops 256 25 35 87 0 62 15360 0 malloc-4096 4096 0 3 6 0 2 12288 0 malloc-1024 1024 2 10 42 0 16 12288 0 malloc-1024 1024 12 0 12 0 16 12288 0 malloc-512 512 5 19 555 0 30 12288 0 malloc-64 64 115 74 117 0 254 12096 0 malloc-128 128 21 72 4384 0 126 11904 0 malloc-128 128 58 35 372 0 126 11904 0 ripcb 488 4 20 50 0 254 11712 0 udp_inpcb 488 2 22 308 0 254 11712 0 malloc-8192 8192 1 0 1 0 1 8192 0 malloc-4096 4096 1 1 5 0 2 8192 0 malloc-2048 2048 2 2 3 0 8 8192 0 malloc-1024 1024 1 7 20 0 16 8192 0 malloc-1024 1024 6 2 6 0 16 8192 0 malloc-1024 1024 4 4 137 0 16 8192 0 malloc-1024 1024 0 8 8 0 16 8192 0 malloc-1024 1024 7 1 7 0 16 8192 0 malloc-512 512 0 16 118 0 30 8192 0 malloc-512 512 2 14 18 0 30 8192 0 malloc-512 512 0 16 135 0 30 8192 0 malloc-512 512 10 6 57 0 30 8192 0 malloc-512 512 8 8 8 0 30 8192 0 rl_entry 40 53 149 53 0 254 8080 0 sctp_stream_msg_out 112 0 72 2 0 254 8064 0 sctp_laddr 48 0 168 112 0 254 8064 0 udpcb 32 2 250 484 0 254 8064 0 malloc-64 64 3 123 192 0 254 8064 0 malloc-32 32 10 242 3594 0 254 8064 0 malloc-32 32 57 195 1376 0 254 8064 0 malloc-32 32 69 183 2866 0 254 8064 0 malloc-32 32 75 177 878 0 254 8064 0 malloc-32 32 33 219 2660 0 254 8064 0 malloc-32 32 33 219 1255 0 254 8064 0 2 Bucket 32 66 186 5691 0 254 8064 0 malloc-16 16 27 473 86 0 254 8000 0 malloc-16 16 270 230 528 0 254 8000 0 malloc-16 16 48 452 2795 0 254 8000 0 malloc-16 16 18 482 4096 0 254 8000 0 malloc-16 16 183 317 1238 0 254 8000 0 malloc-16 16 25 475 24455 0 254 8000 0 malloc-16 16 11 489 12 0 254 8000 0 sctp_chunk 152 2 50 14 0 254 7904 0 udplite_inpcb 488 0 16 176 0 254 7808 0 kenv 258 3 27 1017 0 30 7740 0 malloc-384 384 11 9 11 0 30 7680 0 FPU_save_area 832 1 8 1 0 16 7488 0 cpuset 104 7 55 7 0 126 6448 0 epoch_record pcpu 256 4 12 4 0 62 4096 0 malloc-2048 2048 0 2 12 0 8 4096 0 malloc-2048 2048 0 2 32 0 8 4096 0 malloc-512 512 1 7 1 0 30 4096 0 malloc-512 512 1 7 2 0 30 4096 0 pcpu-16 16 7 249 7 0 254 4096 0 hostcache 96 1 41 1 0 254 4032 0 syncache 168 0 24 4 0 254 4032 0 UMA Slabs 1 176 8 14 8 0 62 3872 0 malloc-384 384 1 9 1 0 30 3840 0 malloc-384 384 1 9 1 0 30 3840 0 KMAP ENTRY 96 12 27 12 0 126 3744 0 vmem 1856 1 1 1 0 8 3712 0 SMR CPU 32 2 29 2 0 254 992 0 SMR SHARED 24 2 29 2 0 254 744 0 FFS1 dinode 128 0 0 0 0 126 0 0 swblk 136 0 0 0 0 62 0 0 swpctrie 144 0 0 0 0 62 0 0 sctp_asconf_ack 48 0 0 0 0 254 0 0 sctp_asconf 40 0 0 0 0 254 0 0 sctp_readq 152 0 0 0 0 254 0 0 pf state scrubs 40 0 0 0 0 254 0 0 pf frag entries 40 0 0 0 0 254 0 0 pf frags 248 0 0 0 0 62 0 0 pf table entries 160 0 0 0 0 62 0 0 pf table entry counters 64 0 0 0 0 254 0 0 pf source nodes 136 0 0 0 0 254 0 0 pf state keys 88 0 0 0 0 126 0 0 pf states 296 0 0 0 0 254 0 0 pf tags 104 0 0 0 0 126 0 0 pf mtags 48 0 0 0 0 254 0 0 tcp_bbr_pcb 832 0 0 0 0 16 0 0 tcp_bbr_map 128 0 0 0 0 126 0 0 tcp_log_node 120 0 0 0 0 126 0 0 tcp_log_bucket 176 0 0 0 0 62 0 0 tcp_log 416 0 0 0 0 254 0 0 tcpreass 48 0 0 0 0 254 0 0 tfo_ccache_entries 80 0 0 0 0 126 0 0 tfo 4 0 0 0 0 254 0 0 sackhole 32 0 0 0 0 254 0 0 tcptw 88 0 0 0 0 254 0 0 ipq 56 0 0 0 0 254 0 0 IPsec SA lft_c 16 0 0 0 0 254 0 0 itimer 352 0 0 0 0 30 0 0 AIOLIO 272 0 0 0 0 30 0 0 AIOCB 744 0 0 0 0 16 0 0 AIOP 32 0 0 0 0 254 0 0 AIO 208 0 0 0 0 62 0 0 TMPFS node 224 0 0 0 0 62 0 0 NCLNODE 592 0 0 0 0 16 0 0 LTS VFS Cache 360 0 0 0 0 30 0 0 L VFS Cache 320 0 0 0 0 30 0 0 STS VFS Cache 144 0 0 0 0 62 0 0 crypto_session 72 0 0 0 0 126 0 0 cryptop 280 0 0 0 0 30 0 0 IOMMU_MAP_ENTRY 120 0 0 0 0 126 0 0 ktls_session 192 0 0 0 0 62 0 0 mbuf_jumbo_16k 16384 0 0 0 0 254 0 0 mbuf_jumbo_9k 9216 0 0 0 0 254 0 0 audit_record 1280 0 0 0 0 8 0 0 domainset 40 0 0 0 0 254 0 0 MAC labels 40 0 0 0 0 254 0 0 vnpbuf 832 0 0 0 0 62 0 0 mdpbuf 832 0 0 0 0 4 0 0 nfspbuf 832 0 0 0 0 16 0 0 swwbuf 832 0 0 0 0 8 0 0 swrbuf 832 0 0 0 0 16 0 0 umtx_shm 88 0 0 0 0 126 0 0 umtx pi 96 0 0 0 0 126 0 0 rangeset pctrie nodes 144 0 0 0 0 62 0 0 malloc-65536 65536 0 0 0 0 1 0 0 malloc-65536 65536 0 0 0 0 1 0 0 malloc-65536 65536 0 0 0 0 1 0 0 malloc-32768 32768 0 0 0 0 1 0 0 malloc-32768 32768 0 0 0 0 1 0 0 malloc-32768 32768 0 0 0 0 1 0 0 malloc-32768 32768 0 0 0 0 1 0 0 malloc-32768 32768 0 0 0 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-16384 16384 0 0 0 0 1 0 0 malloc-4096 4096 0 0 0 0 2 0 0 malloc-384 384 0 0 0 0 30 0 0 malloc-384 384 0 0 0 0 30 0 0 pcpu-32 32 0 0 0 0 254 0 0 pcpu-4 4 0 0 0 0 254 0 0 fakepg 104 0 0 0 0 126 0 0 UMA Hash 256 0 0 0 0 62 0 0