Fatal trap 9: general protection fault while in kernel mode cpuid = 0; apic id = 00 instruction pointer = 0x20:0xffffffff803f81f0 stack pointer = 0x0:0xffffffff82c1da30 frame pointer = 0x0:0xffffffff82c1da80 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 0 (softirq_0) trap number = 9 panic: general protection fault cpuid = 0 time = 1593132292 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x47/frame 0xffffffff82c1d700 vpanic() at vpanic+0x1c7/frame 0xffffffff82c1d760 panic() at panic+0x43/frame 0xffffffff82c1d7c0 trap_fatal() at trap_fatal+0x4ca/frame 0xffffffff82c1d840 trap() at trap+0xda/frame 0xffffffff82c1d960 calltrap() at calltrap+0x8/frame 0xffffffff82c1d960 --- trap 0x9, rip = 0xffffffff803f81f0, rsp = 0xffffffff82c1da30, rbp = 0xffffffff82c1da80 --- ck_epoch_poll_deferred() at ck_epoch_poll_deferred+0x270/frame 0xffffffff82c1da80 epoch_call_task() at epoch_call_task+0x12c/frame 0xffffffff82c1dae0 gtaskqueue_run_locked() at gtaskqueue_run_locked+0x1f0/frame 0xffffffff82c1db70 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xd4/frame 0xffffffff82c1dbb0 fork_exit() at fork_exit+0xb3/frame 0xffffffff82c1dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffffff82c1dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- KDB: enter: panic [ thread pid 0 tid 100006 ] Stopped at kdb_enter+0x67: movq $0,0x14a5176(%rip) db> db> set $lines = 0 db> set $maxwidth = 0 db> show registers cs 0x20 ds 0x3b ll+0x1a es 0x3b ll+0x1a fs 0x13 gs 0x1b ss 0 rax 0x12 rcx 0x80 ll+0x5f rdx 0xffffffff8195f9a3 rbx 0 rsp 0xffffffff82c1d6e0 rbp 0xffffffff82c1d700 rsi 0x1 rdi 0 r8 0 r9 0xffffffff r10 0 r11 0xfffffe0025781a10 r12 0xffffffff82068f70 ddb_dbbe r13 0 r14 0xffffffff819aa204 r15 0xffffffff819aa204 rip 0xffffffff810b4ab7 kdb_enter+0x67 rflags 0x82 ll+0x61 kdb_enter+0x67: movq $0,0x14a5176(%rip) db> show proc Process 0 (kernel) at 0xffffffff8250e750: state: NORMAL uid: 0 gids: 0 ABI: null reaper: 0xffffffff8250e750 reapsubtree: 0 sigparent: 0 vmspace: 0xffffffff8250f3a0 (map 0xffffffff8250f3a0) (map.pmap 0xffffffff8250f460) (pmap 0xffffffff8250f4c0) threads: 24 100000 D swapin 0xffffffff8250e750 [swapper] 100005 D - 0xfffff8000333f100 [if_config_tqg_0] 100006 Run CPU 0 [softirq_0] 100007 D - 0xfffff80003340e00 [softirq_1] 100008 D - 0xfffff80003340d00 [if_io_tqg_0] 100009 D - 0xfffff80003340c00 [if_io_tqg_1] 100011 D - 0xfffff800030d8e00 [kqueue_ctx taskq] 100012 D - 0xfffff800030d8d00 [aiod_kick taskq] 100015 D - 0xfffff800030d8a00 [in6m_free taskq] 100016 D - 0xfffff800030d8900 [thread taskq] 100023 D - 0xfffff800030d8800 [firmware taskq] 100028 D - 0xfffff800030d8700 [crypto_0] 100029 D - 0xfffff800030d8700 [crypto_1] 100043 D - 0xfffff800030d8500 [vtnet0 rxq 0] 100044 D - 0xfffff800030d8400 [vtnet0 txq 0] 100045 D - 0xfffff800030d8300 [vtnet0 rxq 1] 100046 D - 0xfffff800030d8200 [vtnet0 txq 1] 100048 D vtbslp 0xfffff80003514580 [virtio_balloon] 100052 D - 0xfffff800030d8100 [mca taskq] 100056 D - 0xffffffff81d4f9b1 [deadlkres] 100061 D - 0xfffff80003b67600 [acpi_task_0] 100062 D - 0xfffff80003b67600 [acpi_task_1] 100063 D - 0xfffff80003b67600 [acpi_task_2] 100065 D - 0xfffff800030d8600 [CAM taskq] db> ps pid ppid pgrp uid state wmesg wchan cmd 2153 2147 2153 0 Ss select 0xfffff80003a93240 dhclient 2150 1 2150 0 Ss select 0xfffff80010e22640 dhclient 2147 2140 424 65 S select 0xfffff800035128c0 dhclient 2140 424 424 0 S wait 0xfffff80010b5da40 sh 2131 1 2131 65 Ss select 0xfffff80003a93b40 dhclient 1906 1 1906 0 Rs syz-executor.2 1264 1 1264 0 Ss select 0xfffff80003a94ac0 dhclient 1261 1 1261 0 Rs dhclient 776 1 776 0 REs syz-executor.1 771 1 771 0 Rs syz-executor.0 764 682 764 0 Rs CPU 1 sshd 748 1 748 0 Ss+ ttyin 0xfffff800038234b0 getty 747 1 747 0 Ss+ ttyin 0xfffff80003b278b0 getty 746 1 746 0 Ss+ ttyin 0xfffff80003b27cb0 getty 745 1 745 0 Ss+ ttyin 0xfffff80003b2a0b0 getty 744 1 744 0 Ss+ ttyin 0xfffff80003b2a4b0 getty 743 1 743 0 Ss+ ttyin 0xfffff80003b2a8b0 getty 742 1 742 0 Ss+ ttyin 0xfffff80003b2acb0 getty 741 1 741 0 Ss+ ttyin 0xfffff80003b290b0 getty 740 1 740 0 Ss+ ttyin 0xfffff80003b294b0 getty 686 1 686 0 Ss nanslp 0xffffffff8252f240 cron 682 1 682 0 Ss select 0xfffff80003a93bc0 sshd 495 1 495 0 Ss select 0xfffff80003a93dc0 syslogd 424 1 424 0 Ss wait 0xfffff80003cb7520 devd 423 1 423 65 Ss select 0xfffff80003512ac0 dhclient 338 1 338 0 Ss select 0xfffff80003a93ac0 dhclient 335 1 335 0 Ss select 0xfffff80003512bc0 dhclient 23 0 0 0 DL vlruwt 0xfffff800033e3520 [vnlru] 22 0 0 0 DL syncer 0xffffffff8261a498 [syncer] 21 0 0 0 DL (threaded) [bufdaemon] 100069 D qsleep 0xffffffff826197e0 [bufdaemon] 100076 D - 0xffffffff8200aa00 [bufspacedaemon-0] 100085 D sdflush 0xfffff80003822ce8 [/ worker] 20 0 0 0 DL psleep 0xffffffff826407c8 [vmdaemon] 19 0 0 0 DL (threaded) [pagedaemon] 100067 D psleep 0xffffffff82634c58 [dom0] 100074 D launds 0xffffffff82634c64 [laundry: dom0] 100075 D umarcl 0xffffffff8154fd60 [uma] 18 0 0 0 DL - 0xffffffff82362e78 [rand_harvestq] 17 0 0 0 DL pftm 0xffffffff82c593a0 [pf purge] 16 0 0 0 DL waiting 0xffffffff8261cc10 [sctp_iterator] 15 0 0 0 DL - 0xffffffff82618dec [soaiod4] 9 0 0 0 DL - 0xffffffff82618dec [soaiod3] 8 0 0 0 DL - 0xffffffff82618dec [soaiod2] 7 0 0 0 DL - 0xffffffff82618dec [soaiod1] 6 0 0 0 DL (threaded) [cam] 100033 D - 0xffffffff8223abc0 [doneq0] 100066 D - 0xffffffff8223aa90 [scanner] 5 0 0 0 DL crypto_ 0xfffff800033e2390 [crypto returns 1] 4 0 0 0 DL crypto_ 0xfffff800033e2330 [crypto returns 0] 3 0 0 0 DL crypto_ 0xffffffff82632440 [crypto] 14 0 0 0 DL seqstat 0xfffff80003364888 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100024 D - 0xffffffff8250e1c0 [g_event] 100025 D - 0xffffffff8250e1c8 [g_up] 100026 D - 0xffffffff8250e1d0 [g_down] 2 0 0 0 DL (threaded) [KTLS] 100017 D - 0xfffff800031e3d80 [thr_0] 100018 D - 0xfffff800031e3dc0 [thr_1] 12 0 0 0 WL (threaded) [intr] 100010 I [swi5: fast taskq] 100013 I [swi6: task queue] 100014 I [swi6: Giant taskq] 100019 I [swi4: clock (0)] 100020 I [swi4: clock (1)] 100021 I [swi3: vm] 100022 I [swi1: netisr 0] 100034 I [irq24: virtio_pci0] 100035 I [irq25: virtio_pci0] 100036 I [irq26: virtio_pci0] 100037 I [irq27: virtio_pci0] 100038 I [irq28: virtio_pci1] 100039 I [irq29: virtio_pci1] 100040 I [irq30: virtio_pci1] 100041 I [irq31: virtio_pci1] 100042 I [irq32: virtio_pci1] 100047 I [irq10: virtio_pci2] 100049 I [irq1: atkbd0] 100050 I [irq12: psm0] 100051 I [swi0: uart uart++] 100060 I [swi1: pf send] 100072 I [swi1: hpts] 100073 I [swi1: hpts] 11 0 0 0 RL (threaded) [idle] 100003 CanRun [idle: cpu0] 100004 CanRun [idle: cpu1] 1 0 1 0 RLs [init] 10 0 0 0 DL audit_w 0xffffffff82632918 [audit] 0 0 0 0 RLs (threaded) [kernel] 100000 D swapin 0xffffffff8250e750 [swapper] 100005 D - 0xfffff8000333f100 [if_config_tqg_0] 100006 Run CPU 0 [softirq_0] 100007 D - 0xfffff80003340e00 [softirq_1] 100008 D - 0xfffff80003340d00 [if_io_tqg_0] 100009 D - 0xfffff80003340c00 [if_io_tqg_1] 100011 D - 0xfffff800030d8e00 [kqueue_ctx taskq] 100012 D - 0xfffff800030d8d00 [aiod_kick taskq] 100015 D - 0xfffff800030d8a00 [in6m_free taskq] 100016 D - 0xfffff800030d8900 [thread taskq] 100023 D - 0xfffff800030d8800 [firmware taskq] 100028 D - 0xfffff800030d8700 [crypto_0] 100029 D - 0xfffff800030d8700 [crypto_1] 100043 D - 0xfffff800030d8500 [vtnet0 rxq 0] 100044 D - 0xfffff800030d8400 [vtnet0 txq 0] 100045 D - 0xfffff800030d8300 [vtnet0 rxq 1] 100046 D - 0xfffff800030d8200 [vtnet0 txq 1] 100048 D vtbslp 0xfffff80003514580 [virtio_balloon] 100052 D - 0xfffff800030d8100 [mca taskq] 100056 D - 0xffffffff81d4f9b1 [deadlkres] 100061 D - 0xfffff80003b67600 [acpi_task_0] 100062 D - 0xfffff80003b67600 [acpi_task_1] 100063 D - 0xfffff80003b67600 [acpi_task_2] 100065 D - 0xfffff800030d8600 [CAM taskq] 770 1 770 0 Z syz-executor.3 db> show all locks Process 764 (sshd) thread 0xfffffe0025781c00 (100094) exclusive rw vm object (vm object) r = 0 (0xfffff8001051c108) locked @ /syzkaller/managers/i386/kernel/sys/vm/vm_map.c:3678 exclusive sx vm map (user) (vm map (user)) r = 0 (0xfffff800031bb648) locked @ /syzkaller/managers/i386/kernel/sys/vm/vm_map.c:3810 db> show malloc Type InUse MemUse Requests pf_hash 5 11524K 5 devbuf 4212 4850K 4240 tcp_hpts 5 3201K 5 vtbuf 24 1968K 46 sysctloid 27951 1631K 28015 kobj 334 1336K 493 newblk 16 1028K 4947 vfscache 4 1025K 4 inodedep 152 588K 1766 pcb 23 537K 6491 ufs_quota 1 512K 1 vfs_hash 1 512K 1 callout 2 512K 2 intr 4 472K 4 subproc 134 249K 2402 acpica 1674 185K 55859 vnet_data 1 168K 1 pagedep 15 132K 1416 tfo_ccache 1 128K 1 sem 4 106K 4 DEVFS1 105 105K 122 linker 239 96K 283 bus 996 80K 3400 mtx_pool 2 72K 2 syncache 1 68K 1 acpitask 1 64K 1 ddb_capture 1 64K 1 module 501 63K 501 BPF 30 53K 30 filedesc 7 45K 2835 umtx 342 43K 342 dirrem 136 34K 1683 temp 35 33K 2114 hostcache 1 32K 1 shm 1 32K 3 DEVFS3 124 31K 134 msg 4 30K 4 kdtrace 158 30K 6760 DEVFS_RULE 56 27K 56 vmem 3 26K 5 gtaskqueue 18 26K 18 ifaddr 74 25K 77 kbdmux 6 22K 6 freefile 136 17K 1681 ufs_mount 5 17K 6 proc 3 17K 3 tty 16 16K 16 tidhash 1 16K 1 ithread 98 16K 98 lltable 39 14K 108 bus-sc 30 14K 1439 KTRACE 100 13K 100 ifnet 7 13K 7 ether_multi 149 12K 210 kenv 92 12K 92 eventhandler 132 12K 132 pfs_nodes 20 10K 20 GEOM 60 10K 488 rman 82 10K 423 in6_multi 65 9K 105 bmsafemap 2 9K 1874 UART 12 9K 12 devstat 4 9K 4 rpc 2 8K 2 shmfd 1 8K 9 pfs_vncache 1 8K 1 audit_evclass 233 8K 291 CAM DEV 3 6K 510 cred 24 6K 774 vt 11 6K 11 plimit 21 6K 386 sglist 5 6K 5 CAM queue 5 6K 1528 sctp_timw 19 5K 19 taskqueue 45 5K 45 ufs_dirhash 24 5K 24 pf_ifnet 10 5K 19 UMA 249 5K 249 memdesc 1 4K 1 MCA 32 4K 32 evdev 4 4K 4 select 31 4K 31 routetbl 18 4K 24 session 27 4K 43 pgrp 27 4K 43 hhook 13 4K 13 kqueue 52 4K 2326 acpisem 22 3K 22 terminal 11 3K 11 DEVFSP 40 3K 96 lockf 23 3K 36 uidinfo 3 3K 8 proc-args 45 3K 616 local_apic 1 2K 1 io_apic 1 2K 1 ipsec-saq 2 2K 2 kcovinfo 32 2K 85 ip6ndp 12 2K 22 Unitno 34 2K 2131 CAM XPT 22 2K 543 mkdir 11 2K 2802 sctp_ifa 11 2K 20 diradd 10 2K 1723 acpidev 20 2K 20 msi 9 2K 9 tun 7 2K 7 freework 5 2K 3682 softdep 1 1K 1 freeblks 4 1K 1735 ipsecpolicy 1 1K 1 sahead 1 1K 1 secasvar 1 1K 1 in_multi 4 1K 8 clone 8 1K 8 vnodemarker 2 1K 16 NFSD session 1 1K 1 CAM periph 4 1K 271 newdirblk 7 1K 1401 mld 6 1K 6 igmp 6 1K 6 nhops 6 1K 6 toponodes 6 1K 6 isadev 6 1K 6 mount 16 1K 86 pci_link 10 1K 10 crypto 3 1K 3 sctp_ifn 4 1K 7 pfil 4 1K 4 chacha20random 1 1K 1 CAM SIM 2 1K 2 epoch 4 1K 4 cdev 2 1K 2 encap_export_host 8 1K 8 osd 3 1K 9 inpcbpolicy 8 1K 1522 vnodes 1 1K 41 NFSD lckfile 1 1K 1 NFSD V4client 1 1K 1 DEVFS 9 1K 10 feeder 7 1K 7 loginclass 3 1K 6 CAM dev queue 2 1K 2 CAM I/O Scheduler 1 1K 1 apmdev 1 1K 1 atkbddev 2 1K 2 CAM path 4 1K 1034 tcpfunc 2 1K 2 ktls 1 1K 1 pmchooks 1 1K 1 prison 4 1K 4 soname 4 1K 7902 nexusdev 5 1K 5 entropy 2 1K 41 sctp_vrf 1 1K 1 vnet 1 1K 1 acpiintr 1 1K 1 pmc 1 1K 1 filecaps 3 1K 101 cpus 2 1K 2 vnet_data_free 1 1K 1 Per-cpu 1 1K 1 p1003.1b 1 1K 1 pf_table 0 0K 0 pf_rule 0 0K 0 pf_altq 0 0K 0 pf_osfp 0 0K 0 pf_temp 0 0K 0 ath_hal 0 0K 0 madt_table 0 0K 2 athdev 0 0K 0 ata_pci 0 0K 0 ata_dma 0 0K 0 ata_generic 0 0K 0 amr 0 0K 0 scsi_da 0 0K 69 ata_da 0 0K 0 pvscsi 0 0K 0 smartpqi 0 0K 0 scsi_ch 0 0K 0 scsi_cd 0 0K 0 USBdev 0 0K 0 USB 0 0K 0 AHCI driver 0 0K 0 agp 0 0K 0 iavf 0 0K 0 ixl 0 0K 0 nvme_da 0 0K 0 acpipwr 0 0K 0 twsbuf 0 0K 0 twe_commands 0 0K 0 twa_commands 0 0K 0 tcp_log_dev 0 0K 0 ice-resmgr 0 0K 0 ice-osdep 0 0K 0 ice 0 0K 0 fpukern_ctx 0 0K 0 midi buffers 0 0K 0 xen_intr 0 0K 0 mixer 0 0K 0 xen_hvm 0 0K 0 legacydrv 0 0K 0 qpidrv 0 0K 0 ac97 0 0K 0 hdacc 0 0K 0 dmar_idpgtbl 0 0K 0 dmar_dom 0 0K 0 dmar_ctx 0 0K 0 dmar_dmamap 0 0K 0 hdac 0 0K 0 hdaa 0 0K 0 acpi_perf 0 0K 0 isci 0 0K 0 hyperv_socket 0 0K 0 bxe_ilt 0 0K 0 xenbus 0 0K 0 acpicmbat 0 0K 0 SIIS driver 0 0K 0 vm_fictitious 0 0K 0 CAM CCB 0 0K 8299 PUC 0 0K 0 ppbusdev 0 0K 0 agtiapi_MemAlloc malloc 0 0K 0 osti_cacheable 0 0K 0 tempbuff 0 0K 0 tempbuff 0 0K 0 UMAHash 0 0K 0 ag_tgt_map_t malloc 0 0K 0 ag_slr_map_t malloc 0 0K 0 vm_pgdata 0 0K 0 jblocks 0 0K 0 savedino 0 0K 2045 sentinel 0 0K 0 jfsync 0 0K 0 jtrunc 0 0K 0 sbdep 0 0K 7 jsegdep 0 0K 0 jseg 0 0K 0 jfreefrag 0 0K 0 jfreeblk 0 0K 0 jnewblk 0 0K 0 jmvref 0 0K 0 jremref 0 0K 0 jaddref 0 0K 0 freedep 0 0K 0 freefrag 0 0K 5 allocindir 0 0K 0 indirdep 0 0K 870 allocdirect 0 0K 0 ufs_trim 0 0K 0 mactemp 0 0K 0 audit_trigger 0 0K 0 audit_pipe_presel 0 0K 0 audit_pipeent 0 0K 0 audit_pipe 0 0K 0 audit_evname 0 0K 0 audit_bsm 0 0K 0 audit_gidset 0 0K 0 audit_text 0 0K 0 audit_path 0 0K 0 audit_data 0 0K 0 audit_cred 0 0K 0 xform 0 0K 0 NLM 0 0K 0 ipsec-spdcache 0 0K 0 ipsec-reg 0 0K 0 ipsec-misc 0 0K 0 ipsecrequest 0 0K 0 ip6opt 0 0K 18 ip6_msource 0 0K 0 ip6_moptions 0 0K 0 in6_mfilter 0 0K 0 frag6 0 0K 0 tcplog 0 0K 0 lDevFlags * malloc 0 0K 0 LRO 0 0K 0 sctp_mcore 0 0K 0 sctp_socko 0 0K 1771 sctp_iter 0 0K 13 sctp_mvrf 0 0K 0 sctp_cpal 0 0K 0 sctp_cmsg 0 0K 0 sctp_stre 0 0K 0 sctp_athi 0 0K 0 sctp_athm 0 0K 2651 sctp_atky 0 0K 2681 sctp_atcl 0 0K 2651 sctp_a_it 0 0K 13 sctp_aadr 0 0K 0 sctp_stro 0 0K 30 sctp_stri 0 0K 0 sctp_map 0 0K 60 newreno data 0 0K 0 ip_msource 0 0K 0 ip_moptions 0 0K 0 in_mfilter 0 0K 0 ipid 0 0K 0 80211scan 0 0K 0 80211ratectl 0 0K 0 80211power 0 0K 0 80211nodeie 0 0K 0 80211node 0 0K 0 80211mesh_gt 0 0K 0 80211mesh_rt 0 0K 0 80211perr 0 0K 0 80211prep 0 0K 0 80211preq 0 0K 0 80211dfs 0 0K 0 80211crypto 0 0K 0 80211vap 0 0K 0 iflib 0 0K 0 vlan 0 0K 0 gif 0 0K 0 ifdescr 0 0K 0 zlib 0 0K 0 fadvise 0 0K 0 tiDeviceHandle_t * malloc 0 0K 0 statfs 0 0K 1577 export_host 0 0K 0 cl_savebuf 0 0K 2 ag_portal_data_t malloc 0 0K 0 ag_device_t malloc 0 0K 0 STLock malloc 0 0K 0 CCB List 0 0K 0 sr_iov 0 0K 0 OCS 0 0K 0 OCS 0 0K 0 nvme 0 0K 0 nvd 0 0K 0 netmap 0 0K 0 mwldev 0 0K 0 MVS driver 0 0K 0 CAM ccb queue 0 0K 0 mrsasbuf 0 0K 0 mpt_user 0 0K 0 mps_user 0 0K 0 biobuf 0 0K 0 aios 0 0K 0 lio 0 0K 0 acl 0 0K 0 MPSSAS 0 0K 0 mbuf_tag 0 0K 235 accf 0 0K 0 pts 0 0K 0 iov 0 0K 15496 ioctlops 0 0K 131 Witness 0 0K 0 stack 0 0K 0 mps 0 0K 0 mpr_user 0 0K 0 MPRSAS 0 0K 0 mpr 0 0K 0 mfibuf 0 0K 0 md_sectors 0 0K 0 sbuf 0 0K 288 md_disk 0 0K 0 firmware 0 0K 0 compressor 0 0K 0 malodev 0 0K 0 SWAP 0 0K 0 LED 0 0K 0 sysctltmp 0 0K 624 sysctl 0 0K 1 ekcd 0 0K 0 dumper 0 0K 0 sendfile 0 0K 0 rctl 0 0K 0 ix_sriov 0 0K 0 aacraidcam 0 0K 0 ix 0 0K 0 ipsbuf 0 0K 0 iirbuf 0 0K 0 cache 0 0K 0 aacraid_buf 0 0K 0 prison_racct 0 0K 0 Fail Points 0 0K 0 sigio 0 0K 1 filedesc_to_leader 0 0K 0 pwd 0 0K 0 tty console 0 0K 0 aaccam 0 0K 0 aacbuf 0 0K 0 zstd 0 0K 0 nvlist 0 0K 0 SCSI ENC 0 0K 0 SCSI sa 0 0K 0 isofs_node 0 0K 0 isofs_mount 0 0K 0 tr_raid5_data 0 0K 0 tr_raid1e_data 0 0K 0 tr_raid1_data 0 0K 0 tr_raid0_data 0 0K 0 tr_concat_data 0 0K 0 md_sii_data 0 0K 0 md_promise_data 0 0K 0 md_nvidia_data 0 0K 0 md_jmicron_data 0 0K 0 md_intel_data 0 0K 0 md_ddf_data 0 0K 0 raid_data 0 0K 72 geom_flashmap 0 0K 0 NFS FHA 0 0K 0 newnfsmnt 0 0K 0 newnfsclient_req 0 0K 0 NFSCL layrecall 0 0K 0 NFSCL session 0 0K 0 NFSCL sockreq 0 0K 0 NFSCL devinfo 0 0K 0 NFSCL flayout 0 0K 0 NFSCL layout 0 0K 0 NFSD rollback 0 0K 0 NFSCL diroffdiroff 0 0K 0 NEWdirectio 0 0K 0 NEWNFSnode 0 0K 0 NFSCL lck 0 0K 0 NFSCL lckown 0 0K 0 NFSCL client 0 0K 0 NFSCL deleg 0 0K 0 NFSCL open 0 0K 0 NFSCL owner 0 0K 0 NFS fh 0 0K 0 NFS req 0 0K 0 NFSD usrgroup 0 0K 0 NFSD string 0 0K 0 NFSD V4lock 0 0K 0 NFSD V4state 0 0K 0 NFSD srvcache 0 0K 0 msdosfs_fat 0 0K 0 msdosfs_mount 0 0K 0 msdosfs_node 0 0K 0 DEVFS4 0 0K 0 DEVFS2 0 0K 0 gntdev 0 0K 0 privcmd_dev 0 0K 0 evtchn_dev 0 0K 0 xenstore 0 0K 0 scsi_pass 0 0K 0 ciss_data 0 0K 0 xnb 0 0K 0 xbbd 0 0K 0 xbd 0 0K 0 Balloon 0 0K 0 sysmouse 0 0K 0 vtfont 0 0K 0 db> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree mbuf_cluster 2048 9780 126 9784 0 254 20287488 0 mbuf_packet 256 8197 1455 533331 0 254 2470912 0 512 512 4174 34 4627 0 30 2154496 0 mbuf_jumbo_page 4096 0 508 3567 0 254 2080768 0 BUF TRIE 144 185 13311 4604 0 62 1943424 0 4096 4096 334 2 497 0 2 1376256 0 128 128 9311 144 9342 0 126 1210240 0 RADIX NODE 144 3808 4505 82560 0 62 1197072 0 sctp_asoc 2288 0 510 30 0 254 1166880 0 pbuf 832 0 969 0 0 2 806208 0 UMA Slabs 0 112 6965 13 6965 0 126 781536 0 sctp_ep 1280 0 510 2621 0 254 652800 0 tcpcb 1040 3 514 1315 0 254 537680 0 socket 904 25 488 5245 0 254 463752 0 sctp_raddr 736 0 517 30 0 254 380512 0 256 Bucket 2048 155 13 861 0 8 344064 0 65536 65536 4 1 116 0 1 327680 0 VM OBJECT 264 1052 178 35479 0 30 324720 0 4096 4096 66 10 2334 0 2 311296 0 THREAD 1792 131 40 2197 0 8 306432 0 VNODE 488 549 51 2272 0 30 292800 0 mbuf 256 484 544 271965 0 254 263168 0 16384 16384 6 10 1554 0 1 262144 0 256 256 290 715 14329 0 62 257280 0 ripcb 488 3 509 11 0 254 249856 0 udplite_inpcb 488 0 512 2 0 254 249856 0 tcp_inpcb 488 3 509 1315 0 254 249856 0 udp_inpcb 488 2 510 194 0 254 249856 0 32768 32768 1 6 699 0 1 229376 0 64 64 2743 344 2797 0 254 197568 0 65536 65536 3 0 3 0 1 196608 0 16 16 11754 246 11846 0 254 192000 0 1024 1024 116 64 435 0 16 184320 0 128 128 1209 186 25170 0 126 178560 0 UMA Zones 768 223 3 223 0 16 173568 0 MAP ENTRY 96 1108 656 122364 0 126 169344 0 FFS2 dinode 256 513 117 2234 0 62 161280 0 32 32 4439 475 4469 0 254 157248 0 vmem btag 56 2165 198 2165 0 254 132328 0 65536 65536 1 1 4 0 1 131072 0 65536 65536 0 2 115 0 1 131072 0 unpcb 256 14 496 1070 0 254 130560 0 VMSPACE 2536 28 20 2304 0 4 121728 0 ksiginfo 112 62 982 98 0 126 116928 0 2048 2048 5 51 9070 0 8 114688 0 512 512 163 53 1817 0 30 110592 0 PROC 1312 51 30 2319 0 8 106272 0 FFS inode 160 513 112 2234 0 62 100000 0 128 128 506 269 6183 0 126 99200 0 128 128 478 297 2248 0 126 99200 0 32768 32768 1 2 3 0 1 98304 0 g_bio 408 0 240 30850 0 30 97920 0 filedesc0 1088 50 34 2320 0 8 91392 0 128 Bucket 1024 49 34 488 0 16 84992 0 128 128 413 238 1327 0 126 83328 0 UMA Kegs 384 209 6 209 0 30 82560 0 S VFS Cache 108 613 143 3026 0 126 81648 0 256 256 151 164 4485 0 62 80640 0 256 256 194 121 1959 0 62 80640 0 64 Bucket 512 136 0 2149 0 30 69632 0 64 64 568 503 1224 0 254 68544 0 64 64 519 552 2781 0 254 68544 0 65536 65536 1 0 1 0 1 65536 0 8192 8192 7 1 116 0 1 65536 0 4096 4096 13 3 26 0 2 65536 0 2048 2048 4 28 2816 0 8 65536 0 512 512 88 32 96 0 30 61440 0 64 64 258 561 2535 0 254 52416 0 128 128 155 248 644 0 126 51584 0 128 128 43 360 2835 0 126 51584 0 256 256 16 179 1890 0 62 49920 0 256 256 18 177 3539 0 62 49920 0 32 Bucket 256 46 149 873 0 62 49920 0 DIRHASH 1024 34 14 34 0 16 49152 0 NAMEI 1024 0 48 20320 0 16 49152 0 8192 8192 6 0 6 0 1 49152 0 4096 4096 6 6 464 0 2 49152 0 512 512 0 96 2658 0 30 49152 0 512 512 47 49 50 0 30 49152 0 512 512 25 71 603 0 30 49152 0 syncache 168 0 264 4 0 254 44352 0 4 Bucket 48 9 915 15570 0 254 44352 0 Files 80 133 417 13671 0 126 44000 0 clpbuf 832 0 48 126 0 16 39936 0 pipe 760 12 38 438 0 16 38000 0 2048 2048 4 14 48 0 8 36864 0 selfd 64 54 513 14883 0 254 36288 0 PWD 32 13 1121 1487 0 254 36288 0 64 64 0 567 14474 0 254 36288 0 64 64 170 397 246 0 254 36288 0 64 64 55 512 2347 0 254 36288 0 64 64 16 551 41 0 254 36288 0 8 Bucket 80 79 371 18478 0 126 36000 0 128 128 45 234 3158 0 126 35712 0 routing nhops 256 12 123 44 0 62 34560 0 ttyoutq 256 72 63 160 0 62 34560 0 256 256 21 114 1058 0 62 34560 0 256 256 47 88 1835 0 62 34560 0 256 256 17 118 405 0 62 34560 0 TURNSTILE 136 172 80 172 0 62 34272 0 SLEEPQUEUE 88 172 212 172 0 126 33792 0 32768 32768 0 1 112 0 1 32768 0 32768 32768 1 0 1 0 1 32768 0 16384 16384 2 0 3 0 1 32768 0 4096 4096 7 1 7 0 2 32768 0 2048 2048 2 14 4 0 8 32768 0 2048 2048 6 10 20 0 8 32768 0 2048 2048 7 9 10 0 8 32768 0 1024 1024 1 31 39 0 16 32768 0 1024 1024 27 5 57 0 16 32768 0 1024 1024 10 22 10 0 16 32768 0 1024 1024 7 25 7 0 16 32768 0 1024 1024 0 32 1147 0 16 32768 0 512 512 12 52 12 0 30 32768 0 mt_stats_zone 64 443 69 443 0 254 32768 0 64 pcpu 8 3765 331 3786 0 254 32768 0 KNOTE 160 0 200 24930 0 62 32000 0 ttyinq 160 135 65 300 0 62 32000 0 cpuset 104 7 272 7 0 126 29016 0 sctp_laddr 48 0 588 29 0 254 28224 0 hostcache 96 1 293 1 0 254 28224 0 32 32 274 608 4596 0 254 28224 0 KMAP ENTRY 96 12 279 12 0 126 27936 0 rtentry 208 24 109 44 0 62 27664 0 8192 8192 1 2 5 0 1 24576 0 8192 8192 2 1 4 0 1 24576 0 8192 8192 3 0 3 0 1 24576 0 rl_entry 40 77 529 77 0 254 24240 0 vtnet_tx_hdr 24 0 1002 256953 0 254 24048 0 Mountpoints 2816 2 6 2 0 4 22528 0 udpcb 32 2 628 196 0 254 20160 0 32 32 5 625 4735 0 254 20160 0 32 32 95 535 2480 0 254 20160 0 32 32 145 485 2594 0 254 20160 0 32 32 29 601 39 0 254 20160 0 32 32 27 603 829 0 254 20160 0 32 32 21 609 1073 0 254 20160 0 16 Bucket 144 66 74 4741 0 62 20160 0 2 Bucket 32 69 561 10632 0 254 20160 0 procdesc 136 3 142 14 0 62 19720 0 epoch_record pcpu 256 4 60 4 0 62 16384 0 16384 16384 1 0 1 0 1 16384 0 16384 16384 1 0 1 0 1 16384 0 4096 4096 1 3 1578 0 2 16384 0 4096 4096 3 1 3 0 2 16384 0 2048 2048 1 7 1 0 8 16384 0 2048 2048 2 6 2 0 8 16384 0 1024 1024 4 12 4 0 16 16384 0 1024 1024 1 15 1 0 16 16384 0 512 512 1 31 1 0 30 16384 0 mt_zone 24 443 225 443 0 254 16032 0 16 16 451 549 1557 0 254 16000 0 kenv 258 3 57 1119 0 30 15480 0 MAP 216 2 69 2 0 62 15336 0 FPU_save_area 832 1 17 1 0 16 14976 0 vmem 1856 1 7 1 0 8 14848 0 16 16 7 743 4661 0 254 12000 0 16 16 15 735 128 0 254 12000 0 16 16 34 716 25407 0 254 12000 0 16 16 22 728 304 0 254 12000 0 16 16 28 722 138 0 254 12000 0 8192 8192 1 0 1 0 1 8192 0 8192 8192 1 0 1 0 1 8192 0 SMR CPU 32 1 254 1 0 254 8160 0 rentr 24 0 334 4 0 254 8016 0 16 16 1 499 1 0 254 8000 0 SMR SHARED 24 1 254 1 0 254 6120 0 UMA Slabs 1 176 8 14 8 0 62 3872 0 int pcpu 4 34 478 34 0 254 2048 0 FFS1 dinode 128 0 0 0 0 126 0 0 swblk 136 0 0 0 0 62 0 0 swpctrie 144 0 0 0 0 62 0 0 pf state scrubs 40 0 0 0 0 254 0 0 pf frag entries 40 0 0 0 0 254 0 0 pf frags 256 0 0 0 0 62 0 0 pf table entries 160 0 0 0 0 62 0 0 pf table entry counters 64 0 0 0 0 254 0 0 pf source nodes 136 0 0 0 0 254 0 0 pf state keys 88 0 0 0 0 126 0 0 pf states 296 0 0 0 0 254 0 0 pf tags 104 0 0 0 0 126 0 0 pf mtags 48 0 0 0 0 254 0 0 tcp_bbr_pcb 832 0 0 0 0 16 0 0 tcp_bbr_map 128 0 0 0 0 126 0 0 IPsec SA lft_c 16 0 0 0 0 254 0 0 sctp_asconf_ack 48 0 0 0 0 254 0 0 sctp_asconf 40 0 0 0 0 254 0 0 sctp_stream_msg_out 112 0 0 0 0 254 0 0 sctp_readq 152 0 0 0 0 254 0 0 sctp_chunk 152 0 0 0 0 254 0 0 tcp_log_node 120 0 0 0 0 126 0 0 tcp_log_bucket 184 0 0 0 0 62 0 0 tcp_log 416 0 0 0 0 254 0 0 tcpreass 48 0 0 0 0 254 0 0 tfo_ccache_entries 80 0 0 0 0 126 0 0 tfo 4 0 0 0 0 254 0 0 sackhole 32 0 0 0 0 254 0 0 tcptw 88 0 0 0 0 254 0 0 ipq 56 0 0 0 0 254 0 0 itimer 352 0 0 0 0 30 0 0 AIOLIO 280 0 0 0 0 30 0 0 AIOCB 752 0 0 0 0 16 0 0 AIOP 32 0 0 0 0 254 0 0 AIO 208 0 0 0 0 62 0 0 NCLNODE 592 0 0 0 0 16 0 0 LTS VFS Cache 368 0 0 0 0 30 0 0 L VFS Cache 328 0 0 0 0 30 0 0 STS VFS Cache 148 0 0 0 0 62 0 0 VNODEPOLL 120 0 0 0 0 126 0 0 crypto_session 72 0 0 0 0 126 0 0 cryptop 280 0 0 0 0 30 0 0 nvme_request 128 0 0 0 0 126 0 0 DMAR_MAP_ENTRY 128 0 0 0 0 126 0 0 ktls_session 192 0 0 0 0 62 0 0 mbuf_jumbo_16k 16384 0 0 0 0 254 0 0 mbuf_jumbo_9k 9216 0 0 0 0 254 0 0 audit_record 1280 0 0 0 0 8 0 0 domainset 40 0 0 0 0 254 0 0 MAC labels 40 0 0 0 0 254 0 0 vnpbuf 832 0 0 0 0 62 0 0 mdpbuf 832 0 0 0 0 4 0 0 nfspbuf 832 0 0 0 0 16 0 0 swwbuf 832 0 0 0 0 8 0 0 swrbuf 832 0 0 0 0 16 0 0 umtx_shm 88 0 0 0 0 126 0 0 umtx pi 96 0 0 0 0 126 0 0 rangeset pctrie nodes 144 0 0 0 0 62 0 0 65536 65536 0 0 0 0 1 0 0 65536 65536 0 0 0 0 1 0 0 65536 65536 0 0 0 0 1 0 0 32768 32768 0 0 0 0 1 0 0 32768 32768 0 0 0 0 1 0 0 32768 32768 0 0 0 0 1 0 0 32768 32768 0 0 0 0 1 0 0 16384 16384 0 0 0 0 1 0 0 16384 16384 0 0 0 0 1 0 0 16384 16384 0 0 0 0 1 0 0 16384 16384 0 0 0 0 1 0 0 8192 8192 0 0 0 0 1 0 0 4096 4096 0 0 0 0 2 0 0 fakepg 104 0 0 0 0 126 0 0 UMA Hash 256 0 0 0 0 62 0 0