syzbot


Fatal trap NUM: page fault in in6_selecthlim (2)

Status: auto-obsoleted due to no activity on 2023/08/04 21:42
Reported-by: syzbot+0942f36780d154791940@syzkaller.appspotmail.com
First crash: 301d, last: 301d
Similar bugs (2)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
freebsd Fatal trap NUM: page fault in in6_selecthlim 15 518d 882d 0/2 auto-obsoleted due to no activity on 2022/12/30 19:04
freebsd Fatal trap NUM: page fault in in6_selecthlim (3) 3 10d 101d 0/2 upstream: reported on 2023/11/23 17:01

Sample crash report:
Fatal trap 12: page fault while in kernel mode
cpuid = 1; apic id = 01
fault virtual address	= 0x10
fault code		= supervisor read data, page not present
instruction pointer	= 0x20:0xffffffff819ff874
stack pointer	        = 0x28:0xfffffe0053fcd620
frame pointer	        = 0x28:0xfffffe0053fcd6d0
code segment		= base 0x0, limit 0xfffff, type 0x1b
			= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags	= interrupt enabled, resume, IOPL = 0
current process		= 2 (clock (0))
rdi:               10 rsi:               1c rdx:             ffff
rcx: fffffe00033eee30  r8:                0  r9:      20000000000
rax: fffffe00033eee30 rbx:                0 rbp: fffffe0053fcd6d0
r10:                0 r11: fffffe0058db11a0 r12: 1fffffc00a7f9ac4
r13: dffff7c000000000 r14: fffffe0057ac1800 r15: fffffe009a7b8498
trap number		= 12
panic: page fault
cpuid = 1
time = 1683409346
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0xc7/frame 0xfffffe0053fcce10
kdb_backtrace() at kdb_backtrace+0xd1/frame 0xfffffe0053fccf70
vpanic() at vpanic+0x254/frame 0xfffffe0053fcd050
panic() at panic+0xb5/frame 0xfffffe0053fcd110
trap_fatal() at trap_fatal+0x7ed/frame 0xfffffe0053fcd230
trap_pfault() at trap_pfault+0x182/frame 0xfffffe0053fcd370
trap() at trap+0x5e1/frame 0xfffffe0053fcd550
calltrap() at calltrap+0x8/frame 0xfffffe0053fcd550
--- trap 0xc, rip = 0xffffffff819ff874, rsp = 0xfffffe0053fcd620, rbp = 0xfffffe0053fcd6d0 ---
in6_selecthlim() at in6_selecthlim+0xd4/frame 0xfffffe0053fcd6d0
sctp_lowlevel_chunk_output() at sctp_lowlevel_chunk_output+0x1e69/frame 0xfffffe0053fcd980
sctp_send_abort_tcb() at sctp_send_abort_tcb+0x56a/frame 0xfffffe0053fcda80
sctp_abort_an_association() at sctp_abort_an_association+0xb8/frame 0xfffffe0053fcdad0
sctp_threshold_management() at sctp_threshold_management+0x43e/frame 0xfffffe0053fcdb20
sctp_t1init_timer() at sctp_t1init_timer+0xa9/frame 0xfffffe0053fcdb70
sctp_timeout_handler() at sctp_timeout_handler+0x689/frame 0xfffffe0053fcdcb0
softclock_call_cc() at softclock_call_cc+0x3e3/frame 0xfffffe0053fcde80
softclock_thread() at softclock_thread+0x1ef/frame 0xfffffe0053fcdef0
fork_exit() at fork_exit+0xd0/frame 0xfffffe0053fcdf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0053fcdf30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
KDB: enter: panic
[ thread pid 2 tid 100029 ]
Stopped at      kdb_enter+0x6b: movq    $0,0x213d26a(%rip)
db> set $lines = 0
db> set $maxwidth = 0
db> show registers
cs                        0x20
ds                        0x3b
es                        0x3b
fs                        0x13
gs                        0x1b
ss                        0x28
rax                       0x12
rcx         0xffffffff815c7056  printf+0xf6
rdx                        0x1
rbx                          0
rsp         0xfffffe0053fccf50
rbp         0xfffffe0053fccf70
rsi                          0
rdi         0xffffffff815c70b8  printf+0x158
r8                           0
r9                  0xffffffff
r10                          0
r11         0xfffffe0058db11a0
r12                          0
r13         0xfffffe005429d3a0
r14         0xffffffff826a5920  .str.26
r15         0xffffffff826a5920  .str.26
rip         0xffffffff815b6e2b  kdb_enter+0x6b
rflags                    0x46
kdb_enter+0x6b: movq    $0,0x213d26a(%rip)
db> show proc
Process 2 (clock) at 0xfffffe00541e2020:
 state: NORMAL
 uid: 0  gids: 0
 parent: pid 0 at 0xffffffff836ac0a0
 ABI: null
 flag: 0x10000284  flag2: 0
 reaper: 0xffffffff836ac0a0 reapsubtree: 2
 sigparent: 20
 vmspace: 0xffffffff836ad040
   (map 0xffffffff836ad040)
   (map.pmap 0xffffffff836ad100)
   (pmap 0xffffffff836ad170)
 threads: 2
100029                   Run     CPU 1                       [clock (0)]
100030                   I                                   [clock (1)]
db> ps
  pid  ppid  pgrp   uid  state   wmesg   wchan               cmd
19520 18121 18121     0  R       (threaded)                  syz-executor.0
122171                   RunQ                                syz-executor.0
127119                   S       connec  0xfffffe009aa6149a  syz-executor.0
127120                   S       uwait   0xfffffe0099649e00  syz-executor.0
19514   778   778     0  T       (threaded)                  syz-executor.1
127102                   s                                   syz-executor.1
127111                   RunQ                                syz-executor.1
19308     0     0     0  DL      -       0xffffffff837e1440  [soaiod4]
19307     0     0     0  DL      -       0xffffffff837e1440  [soaiod3]
19306     0     0     0  DL      -       0xffffffff837e1440  [soaiod2]
19305     0     0     0  DL      -       0xffffffff837e1440  [soaiod1]
18225 18210 18225     0  Ss      select  0xfffffe009ae110c0  dhclient
18216     1 18216     0  Ss      select  0xfffffe009ae11a40  dhclient
18210 18187   430    65  S       select  0xfffffe009b66a840  dhclient
18187   430   430     0  S       wait    0xfffffe009b552000  sh
18121   774 18121     0  Rs                                  syz-executor.0
 7237     1   785     0  SV      uwait   0xfffffe009964b780  syz-executor.3
 7226     1   785     0  SV      uwait   0xfffffe0057667400  syz-executor.3
 7217     1   785     0  SV      uwait   0xfffffe009964c600  syz-executor.3
 7208     1   785     0  SV      uwait   0xfffffe0057a7fa80  syz-executor.3
 7199     1   785     0  SV      uwait   0xfffffe009964b680  syz-executor.3
 7190     1   785     0  SV      uwait   0xfffffe009964c180  syz-executor.3
 7181     1   785     0  SV      uwait   0xfffffe0057666a80  syz-executor.3
 7172     1   785     0  SV      uwait   0xfffffe0057666200  syz-executor.3
 7163     1   785     0  SV      uwait   0xfffffe00542c0600  syz-executor.3
 7154     1   785     0  SV      uwait   0xfffffe0057666700  syz-executor.3
 7145     1   785     0  SV      uwait   0xfffffe00542c0a00  syz-executor.3
 7137     1   785     0  SV      uwait   0xfffffe0057a80100  syz-executor.3
 7127     1   785     0  SV      uwait   0xfffffe0057668080  syz-executor.3
 7118     1   785     0  SV      uwait   0xfffffe009964c700  syz-executor.3
 7111     1   785     0  SV      uwait   0xfffffe00542c0b00  syz-executor.3
 7102     1   785     0  SV      uwait   0xfffffe0057a80c80  syz-executor.3
 7093     1   785     0  SV      uwait   0xfffffe009964c380  syz-executor.3
 7084     1   785     0  SV      uwait   0xfffffe0057a80700  syz-executor.3
 7075     1   785     0  SV      uwait   0xfffffe00542c0c00  syz-executor.3
 7067     1   785     0  SV      uwait   0xfffffe0057a7f780  syz-executor.3
 7061     1   785     0  SV      uwait   0xfffffe0057a80200  syz-executor.3
 7046     1   785     0  SV      uwait   0xfffffe0057666600  syz-executor.3
 7040     1   785     0  SV      uwait   0xfffffe009964c480  syz-executor.3
 7032     1   785     0  SV      uwait   0xfffffe0057a80d80  syz-executor.3
 7019     1   785     0  SV      uwait   0xfffffe0057666500  syz-executor.3
 7010     1   785     0  SV      uwait   0xfffffe0057a81200  syz-executor.3
 7000     1   785     0  SV      uwait   0xfffffe009964c080  syz-executor.3
 6992     1   785     0  SV      uwait   0xfffffe0057666980  syz-executor.3
 6985     1   785     0  SV      uwait   0xfffffe0057a7f880  syz-executor.3
 6974     1   785     0  SV      uwait   0xfffffe0057a7fc80  syz-executor.3
 5487     1  5487    65  Ss      select  0xfffffe009274c440  dhclient
 5330     1   782     0  SV      uwait   0xfffffe00542c0d00  syz-executor.2
 5314     1   782     0  SV      uwait   0xfffffe009964bf00  syz-executor.2
 3953     1  3953     0  Ss      select  0xfffffe009274ccc0  dhclient
 3943     1  3943     0  Ss      select  0xfffffe009274b240  dhclient
 3900     1  3900    65  Ss      select  0xfffffe00925845c0  dhclient
 3188     1  3188     0  Ss      select  0xfffffe0092583640  dhclient
 3185     1  3185     0  Ss      select  0xfffffe0092583cc0  dhclient
 3166     1  3166    65  Ss      select  0xfffffe00925832c0  dhclient
 2577     1  2577     0  Ss      select  0xfffffe0092584540  dhclient
 2574     1  2574     0  Ss      select  0xfffffe0092584240  dhclient
 2445     0     0     0  DL      aiordy  0xfffffe0092db8ae0  [aiod4]
 2444     0     0     0  DL      aiordy  0xfffffe0092db8020  [aiod3]
 2443     0     0     0  DL      aiordy  0xfffffe0092db95a0  [aiod2]
 2442     0     0     0  DL      aiordy  0xfffffe0092db7ac0  [aiod1]
  785   774   785     0  Ss      piperd  0xfffffe0058da46c0  syz-executor.3
  782   774   782     0  Ss      piperd  0xfffffe0092d373e8  syz-executor.2
  778   774   778     0  Rs                                  syz-executor.1
  774   772   772     0  R       (threaded)                  syz-fuzzer
100088                   S       kqread  0xfffffe00929adc00  syz-fuzzer
100110                   RunQ                                syz-fuzzer
100111                   S       uwait   0xfffffe0057666e80  syz-fuzzer
100112                   S       wait    0xfffffe0057b7bb00  syz-fuzzer
100113                   S       uwait   0xfffffe0057667700  syz-fuzzer
100114                   S       uwait   0xfffffe0057667800  syz-fuzzer
100115                   S       uwait   0xfffffe0057667900  syz-fuzzer
100116                   S       uwait   0xfffffe0057667100  syz-fuzzer
100117                   S       wait    0xfffffe0057b7bb00  syz-fuzzer
100118                   S       wait    0xfffffe0057b7bb00  syz-fuzzer
100120                   S       wait    0xfffffe0057b7bb00  syz-fuzzer
100132                   RunQ                                syz-fuzzer
101897                   S       uwait   0xfffffe0057a80980  syz-fuzzer
  772   770   772     0  Ss      pause   0xfffffe0058f4e670  csh
  770   688   770     0  Ss      select  0xfffffe009274d340  sshd
  754     1   754     0  Rs+                                 getty
  753     1   753     0  Ss+     ttyin   0xfffffe00543628b0  getty
  752     1   752     0  Ss+     ttyin   0xfffffe00576730b0  getty
  751     1   751     0  Ss+     ttyin   0xfffffe00576738b0  getty
  750     1   750     0  Ss+     ttyin   0xfffffe00543630b0  getty
  749     1   749     0  Ss+     ttyin   0xfffffe00576740b0  getty
  748     1   748     0  Ss+     ttyin   0xfffffe00576748b0  getty
  747     1   747     0  Ss+     ttyin   0xfffffe00543638b0  getty
  746     1   746     0  Ss+     ttyin   0xfffffe00543640b0  getty
  692     1   692     0  Ss      nanslp  0xffffffff836d5840  cron
  688     1   688     0  Ss      select  0xfffffe009274d8c0  sshd
  501     1   501     0  Ss      select  0xfffffe009274d9c0  syslogd
  430     1   430     0  Ss      wait    0xfffffe0058f4cae0  devd
  429     1   429    65  Ss      select  0xfffffe00925847c0  dhclient
  344     1   344     0  Ss      select  0xfffffe009274df40  dhclient
  341     1   341     0  Ss      select  0xfffffe0092584a40  dhclient
   17     0     0     0  RL                                  [syncer]
   16     0     0     0  DL      vlruwt  0xfffffe005718c000  [vnlru]
   15     0     0     0  DL      (threaded)                  [bufdaemon]
100079                   D       psleep  0xffffffff837e5300  [bufdaemon]
100082                   D       -       0xffffffff82c0a140  [bufspacedaemon-0]
100094                   D       sdflush 0xfffffe0058d3b0e8  [/ worker]
    9     0     0     0  DL      psleep  0xffffffff8381cb40  [vmdaemon]
    8     0     0     0  DL      (threaded)                  [pagedaemon]
100077                   D       psleep  0xffffffff838109f8  [dom0]
100080                   D       launds  0xffffffff83810a04  [laundry: dom0]
100081                   D       umarcl  0xffffffff81d2b650  [uma]
    7     0     0     0  DL      -       0xffffffff83499e48  [rand_harvestq]
    6     0     0     0  RL      CPU 0                       [pf purge]
    5     0     0     0  DL      waiting 0xffffffff8408e1c0  [sctp_iterator]
    4     0     0     0  DL      (threaded)                  [cam]
100044                   D       -       0xffffffff8347c340  [doneq0]
100045                   D       -       0xffffffff8347c2c0  [async]
100076                   D       -       0xffffffff8347c140  [scanner]
   14     0     0     0  DL      seqstat 0xfffffe00543a3088  [sequencer 00]
    3     0     0     0  DL      (threaded)                  [crypto]
100040                   D       crypto_ 0xffffffff8380c2a0  [crypto]
100041                   D       crypto_ 0xfffffe00085f6c30  [crypto returns 0]
100042                   D       crypto_ 0xfffffe00085f6c80  [crypto returns 1]
   13     0     0     0  DL      (threaded)                  [geom]
100035                   D       -       0xffffffff836ab680  [g_event]
100036                   D       -       0xffffffff836ab6a0  [g_up]
100037                   D       -       0xffffffff836ab6c0  [g_down]
    2     0     0     0  RL      (threaded)                  [clock]
100029                   Run     CPU 1                       [clock (0)]
100030                   I                                   [clock (1)]
   12     0     0     0  WL      (threaded)                  [intr]
100011                   I                                   [swi6: task queue]
100016                   I                                   [swi6: Giant taskq]
100018                   I                                   [swi5: fast taskq]
100031                   I                                   [swi1: netisr 0]
100032                   I                                   [swi1: hpts]
100033                   I                                   [swi1: hpts]
100046                   I                                   [irq24: virtio_pci0]
100047                   I                                   [irq25: virtio_pci0]
100048                   I                                   [irq26: virtio_pci0]
100049                   I                                   [irq27: virtio_pci0]
100050                   I                                   [irq28: virtio_pci1]
100051                   I                                   [irq29: virtio_pci1]
100052                   I                                   [irq30: virtio_pci1]
100053                   I                                   [irq31: virtio_pci1]
100054                   I                                   [irq32: virtio_pci1]
100059                   I                                   [irq33: virtio_pci2]
100060                   I                                   [irq34: virtio_pci2]
100061                   I                                   [irq35: virtio_pci2]
100063                   I                                   [irq1: atkbd0]
100064                   I                                   [irq12: psm0]
100065                   I                                   [swi0: uart uart++]
100069                   I                                   [swi1: pf send]
   11     0     0     0  RL      (threaded)                  [idle]
100003                   CanRun                              [idle: cpu0]
100004                   CanRun                              [idle: cpu1]
    1     0     1     0  SLs     wait    0xfffffe00541e3040  [init]
   10     0     0     0  DL      audit_w 0xffffffff8380cce0  [audit]
    0     0     0     0  DLs     (threaded)                  [kernel]
100000                   D       swapin  0xffffffff836ac0a0  [swapper]
100005                   D       -       0xfffffe0054286800  [if_io_tqg_0]
100006                   D       -       0xfffffe0054286700  [if_io_tqg_1]
100007                   D       -       0xfffffe0054286600  [if_config_tqg_0]
100008                   D       -       0xfffffe0054286500  [softirq_0]
100009                   D       -       0xfffffe0054286400  [softirq_1]
100010                   D       -       0xfffffe00085f7d00  [linuxkpi_irq_wq]
100012                   D       -       0xfffffe00085f7b00  [inm_free taskq]
100013                   D       -       0xfffffe00085f7a00  [aiod_kick taskq]
100014                   D       -       0xfffffe00085f7900  [deferred_unmount ta]
100015                   D       -       0xfffffe00085f7800  [in6m_free taskq]
100017                   D       -       0xfffffe00085f7600  [thread taskq]
100019                   D       -       0xfffffe00085f7400  [kqueue_ctx taskq]
100020                   D       -       0xfffffe00085f7300  [pci_hp taskq]
100021                   D       -       0xfffffe00085f7200  [linuxkpi_short_wq_0]
100022                   D       -       0xfffffe00085f7200  [linuxkpi_short_wq_1]
100023                   D       -       0xfffffe00085f7200  [linuxkpi_short_wq_2]
100024                   D       -       0xfffffe00085f7200  [linuxkpi_short_wq_3]
100025                   D       -       0xfffffe00085f7100  [linuxkpi_long_wq_0]
100026                   D       -       0xfffffe00085f7100  [linuxkpi_long_wq_1]
100027                   D       -       0xfffffe00085f7100  [linuxkpi_long_wq_2]
100028                   D       -       0xfffffe00085f7100  [linuxkpi_long_wq_3]
100034                   D       -       0xfffffe00085f7000  [firmware taskq]
100038                   D       -       0xfffffe00085f6d00  [crypto_0]
100039                   D       -       0xfffffe00085f6d00  [crypto_1]
100055                   D       -       0xfffffe00085f6900  [vtnet0 rxq 0]
100056                   D       -       0xfffffe00085f6800  [vtnet0 txq 0]
100057                   D       -       0xfffffe00085f6700  [vtnet0 rxq 1]
100058                   D       -       0xfffffe00085f6600  [vtnet0 txq 1]
100062                   D       vtbslp  0xfffffe0057161380  [virtio_balloon]
100066                   D       -       0xffffffff826aa860  [deadlkres]
100070                   D       -       0xfffffe0058823300  [acpi_task_0]
100071                   D       -       0xfffffe0058823300  [acpi_task_1]
100072                   D       -       0xfffffe0058823300  [acpi_task_2]
100073                   D       -       0xfffffe00085f8100  [mca taskq]
100075                   D       -       0xfffffe00085f6a00  [CAM taskq]
db> show all locks
Process 19520 (syz-executor.0) thread 0xfffffe0092d9d3a0 (122171)
shared rw vmobject (vmobject) r = 0 (0xfffffe0092dc5a50) locked @ /syzkaller/managers/main/kernel/sys/vm/vm_fault.c:367
shared sx vm map (user) (vm map (user)) r = 0 (0xfffffe0099908e98) locked @ /syzkaller/managers/main/kernel/sys/vm/vm_map.c:4930
Process 6 (pf purge) thread 0xfffffe0057a73000 (100068)
shared sx vnet_sxlock (vnet_sxlock) r = 0 (0xffffffff837ea280) locked @ /syzkaller/managers/main/kernel/sys/netpfil/pf/pf.c:1858
exclusive sx pf end thread (pf end thread) r = 0 (0xffffffff8456a5c0) locked @ /syzkaller/managers/main/kernel/sys/netpfil/pf/pf.c:1854
Process 2 (clock) thread 0xfffffe005429d3a0 (100029)
exclusive sleep mutex sctp-tcb (tcb) r = 0 (0xfffffe009ae77190) locked @ /syzkaller/managers/main/kernel/sys/netinet/sctputil.c:1778
db> show malloc
              Type        InUse        MemUse     Requests
           pf_hash            5        11524K            5
          tcp_hpts            7         4801K            7
            devbuf         4216         4323K         4244
         sysctloid        34801         2051K        34872
             vtbuf           24         1968K           46
               pcb         1121         1900K        34575
              kobj          328         1312K          490
            newblk           11         1027K        78467
          vfscache            3         1025K            3
          filedesc           78          618K        36780
          inodedep           41          527K        23554
         ufs_quota            1          512K            1
          vfs_hash            1          512K            1
           callout            2          512K            2
         sctp_stro          474          474K         6094
              intr            4          472K            4
           subproc          218          430K        19643
         sctp_atcl         1021          383K        23642
              vmem            3          274K            6
            acpica         1674          184K        57915
           tidhash            3          141K            3
           pagedep           12          131K        18356
        tfo_ccache            1          128K            1
          IP reass            1          128K            1
            linker          324          127K          961
         vnet_data            1          112K            1
           pf_osfp          905          112K          905
            DEVFS1          109          109K          135
               sem            4          106K            4
               BPF           49           90K          410
               bus          993           81K         5160
          mtx_pool            2           72K            2
     NFSD srvcache            3           68K            3
          syncache            1           68K            1
          acpitask            1           64K            1
       ddb_capture            1           64K            1
            module          510           64K          510
         sctp_atky         1495           62K        30106
              umtx          462           58K          462
           kdtrace          292           55K        46642
              temp           36           53K         5407
            DEVFS3          128           32K          141
         hostcache            1           32K            1
               shm            1           32K           12
               msg            4           30K            4
            kbdmux            6           28K            6
         sctp_timw          103           26K          103
        gtaskqueue           18           26K           18
          routetbl          305           22K         5051
            ifaddr           72           21K          101
        DEVFS_RULE           56           20K           56
         ufs_mount            4           17K            5
              proc            3           17K            3
               tty           16           16K           16
         sctp_athm         1021           16K        24012
           ithread           97           16K           97
          sctp_map          948           15K        12188
            bus-sc           34           15K         1658
             ifnet            8           15K           10
      eventhandler          156           13K          156
            KTRACE          100           13K          100
           lltable           41           13K          113
       ether_multi          152           13K          259
              kenv           95           12K           95
              rman           88           11K          431
              GEOM           61           11K          481
         CAM queue            5           11K         1528
         in6_multi           65            9K          103
         bmsafemap            3            9K        21659
            kqueue           98            9K        19624
               rpc            4            9K            4
              UART           12            9K           12
           devstat            4            9K            4
              ksem            1            8K         1835
       pfs_vncache            1            8K            1
             shmfd            1            8K           28
     audit_evclass          237            8K          297
            dirrem           27            7K        20257
         taskqueue           63            7K           63
              cred           26            7K          307
            sglist            5            7K            5
           CAM DEV            3            6K          510
            plimit           24            6K          535
           pwddesc           96            6K        19522
         pfs_nodes           20            5K           20
       ufs_dirhash           24            5K           24
          pf_ifnet           11            5K         2572
            DEVFSP           70            5K         2631
               UMA          267            5K          267
           session           34            5K           63
                vt           11            5K           11
           memdesc            1            4K            1
               MCA           32            4K           32
             evdev            4            4K            4
         proc-args          124            4K        21155
             lockf           34            4K           83
           acpisem           28            4K           28
          freefile           27            4K        20220
             hhook           15            4K           17
             selfd           52            4K       269465
          kcovinfo           52            4K           91
          terminal           11            3K           11
            select           19            3K           87
             clone            9            3K            9
           uidinfo            3            3K           21
            ip6ndp           13            3K           21
        local_apic            1            2K            1
           io_apic            1            2K            1
       fpukern_ctx            2            2K            2
         ipsec-saq            2            2K            2
          sctp_ifa           14            2K           21
            Unitno           29            2K           67
           CAM XPT           22            2K          543
               msi           12            2K           12
          in_multi            6            2K           11
             mkdir           10            2K        36664
       ipsecpolicy            2            2K            2
           acpidev           20            2K           20
       inpcbpolicy           39            2K        22782
               tun            7            2K           10
          freework            5            2K        42769
      NFSD session            1            1K            1
           softdep            1            1K            1
          freeblks            4            1K        21804
            sahead            1            1K            1
          secasvar            1            1K            1
             nhops            6            1K            8
       vnodemarker            2            1K          108
            diradd            7            1K        20298
        CAM periph            4            1K          271
             ipsec            3            1K            3
          sctp_ifn            6            1K           21
         newdirblk            6            1K        18332
               mld            6            1K            9
            CC Mem            6            1K        16104
              igmp            6            1K            9
         toponodes            6            1K            6
            isadev            6            1K            6
             mount           16            1K           89
          pci_link           10            1K           10
            crypto            4            1K           71
 encap_export_host           12            1K           12
          procdesc            5            1K           24
              pfil            4            1K            4
              cdev            2            1K            2
               osd           11            1K        16117
    chacha20random            1            1K            1
            biobuf            1            1K            1
      NFSD lckfile            1            1K            1
     NFSD V4client            1            1K            1
             DEVFS            9            1K           10
            vnodes            1            1K            1
           CAM SIM            2            1K            2
            feeder            7            1K            7
           tcpfunc            3            1K            3
        loginclass            3            1K            6
            prison            6            1K            6
       lkpikmalloc            5            1K            6
        aesni_data            2            1K            2
            soname            6            1K        50334
         cryptodev            2            1K          542
          nexusdev            8            1K            8
            apmdev            1            1K            1
          atkbddev            2            1K            2
           netlink            1            1K            1
     CAM dev queue            2            1K            2
 CAM I/O Scheduler            1            1K            1
               aio            4            1K            8
          CAM path            4            1K         1034
          pmchooks            1            1K            1
          filecaps            5            1K          183
          sctp_vrf            1            1K            1
              vnet            1            1K            1
           entropy            2            1K           52
               pmc            1            1K            1
          acpiintr            1            1K            1
              cpus            2            1K            2
    vnet_data_free            1            1K            1
           Per-cpu            1            1K            1
          p1003.1b            1            1K            1
            ipcomp            0            0K            0
               esp            0            0K            0
                ah            0            0K            0
          pf_table            0            0K         1032
           pf_rule            0            0K         1254
           pf_altq            0            0K            0
     pf_krule_item            0            0K            0
           pf_temp            0            0K            0
            mqdata            0            0K            0
           filemon            0            0K         2110
            tcp_do            0            0K            0
           tcp_fsb            0            0K         3190
        sctp_mcore            0            0K            0
        sctp_socko            0            0K        10350
         sctp_iter            0            0K           25
         sctp_mvrf            0            0K            0
         sctp_cpal            0            0K            0
         sctp_cmsg            0            0K            0
         sctp_stre            0            0K            0
         sctp_athi            0            0K            0
         sctp_a_it            0            0K           25
         sctp_aadr            0            0K            0
         sctp_stri            0            0K          740
       md_ddf_data            0            0K            0
         raid_data            0            0K           72
        madt_table            0            0K            2
          smartpqi            0            0K            0
     geom_flashmap            0            0K            0
         tmpfs dir            0            0K            0
               ixl            0            0K            0
        tmpfs name            0            0K            0
       tmpfs mount            0            0K            0
     tmpfs extattr            0            0K            0
           NFS FHA            0            0K            0
         newnfsmnt            0            0K            0
        ice-resmgr            0            0K            0
         ice-osdep            0            0K            0
               ice            0            0K            0
              iavf            0            0K            0
             axgbe            0            0K            0
  newnfsclient_req            0            0K            0
   NFSCL layrecall            0            0K            0
     NFSCL session            0            0K            0
     NFSCL sockreq            0            0K            0
     NFSCL devinfo            0            0K            0
     NFSCL flayout            0            0K            0
      NFSCL layout            0            0K            0
     NFSD rollback            0            0K            0
      NFSCL diroff            0            0K            0
          xen_intr            0            0K            0
       NEWdirectio            0            0K            0
        NEWNFSnode            0            0K            0
           xen_hvm            0            0K            0
         legacydrv            0            0K            0
            bounce            0            0K            0
            busdma            0            0K            0
            qpidrv            0            0K            0
         NFSCL lck            0            0K            0
      NFSCL lckown            0            0K            0
      dmar_idpgtbl            0            0K            0
          dmar_dom            0            0K            0
          dmar_ctx            0            0K            0
      NFSCL client            0            0K            0
       NFSCL deleg            0            0K            0
        NFSCL open            0            0K            0
              isci            0            0K            0
      iommu_dmamap            0            0K            0
       NFSCL owner            0            0K            0
     hyperv_socket            0            0K            0
           bxe_ilt            0            0K            0
            NFS fh            0            0K            0
            xenbus            0            0K            0
           NFS req            0            0K            0
     NFSD usrgroup            0            0K            0
       NFSD string            0            0K            0
     vm_fictitious            0            0K            0
       NFSD V4lock            0            0K            0
      NFSD V4state            0            0K            0
       msdosfs_fat            0            0K            0
     msdosfs_mount            0            0K            0
      msdosfs_node            0            0K            0
           UMAHash            0            0K            0
            DEVFS4            0            0K            0
         vm_pgdata            0            0K            0
           jblocks            0            0K            0
          savedino            0            0K        34778
          sentinel            0            0K            0
            jfsync            0            0K            0
            jtrunc            0            0K            0
             sbdep            0            0K           50
           jsegdep            0            0K            0
              jseg            0            0K            0
         jfreefrag            0            0K            0
          jfreeblk            0            0K            0
           jnewblk            0            0K            0
            jmvref            0            0K            0
           jremref            0            0K            0
           jaddref            0            0K            0
           freedep            0            0K            0
          freefrag            0            0K            2
        allocindir            0            0K            0
          indirdep            0            0K        36697
       allocdirect            0            0K            0
          ufs_trim            0            0K            0
           mactemp            0            0K            0
     audit_trigger            0            0K            0
 audit_pipe_presel            0            0K            0
     audit_pipeent            0            0K            0
        audit_pipe            0            0K            0
      audit_evname            0            0K            0
         audit_bsm            0            0K            0
      audit_gidset            0            0K            0
        audit_text            0            0K            0
        audit_path            0            0K            0
        audit_data            0            0K            0
        audit_cred            0            0K            0
            DEVFS2            0            0K            0
            gntdev            0            0K            0
       privcmd_dev            0            0K            0
        evtchn_dev            0            0K            0
          xenstore            0            0K            0
         scsi_pass            0            0K            0
         ciss_data            0            0K            0
               xnb            0            0K            0
          xen_acpi            0            0K            0
              xbbd            0            0K            0
               xbd            0            0K            0
           Balloon            0            0K            0
          sysmouse            0            0K            0
            vtfont            0            0K            0
          ktls_ocf            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
      MLX5E_TLS_RX            0            0K            0
        MLX5EEPROM            0            0K            0
         MLX5E_TLS            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
            MLX5EN            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
          MLX5DUMP            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
       simple_attr            0            0K            0
          seq_file            0            0K            0
           lkpiskb            0            0K            0
             radix            0            0K            0
               idr            0            0K            0
          lkpindev            0            0K            0
           lkpimhi            0            0K            0
            lkpifw            0            0K            0
         lkpi80211            0            0K            0
               NLM            0            0K            0
    ipsec-spdcache            0            0K            0
         ipsec-reg            0            0K            0
        ipsec-misc            0            0K            0
      ipsecrequest            0            0K            0
            ip6opt            0            0K          109
       ip6_msource            0            0K            0
      ip6_moptions            0            0K            0
       in6_mfilter            0            0K            0
             frag6            0            0K            0
            tcplog            0            0K            0
        tcp_hwpace            0            0K            0
         BACKLIGHT            0            0K            0
           ath_hal            0            0K            0
               LRO            0            0K            0
        ip_msource            0            0K            0
       ip_moptions            0            0K            5
        in_mfilter            0            0K            0
              ipid            0            0K            0
         80211scan            0            0K            0
      80211ratectl            0            0K            0
        80211power            0            0K            0
       80211nodeie            0            0K            0
         80211node            0            0K            0
      80211mesh_gt            0            0K            0
      80211mesh_rt            0            0K            0
         80211perr            0            0K            0
         80211prep            0            0K            0
         80211preq            0            0K            0
          80211dfs            0            0K            0
       80211crypto            0            0K            0
          80211vap            0            0K            0
             iflib            0            0K            0
              vlan            0            0K            0
               gif            0            0K            0
           ifdescr            0            0K            0
              zlib            0            0K            0
           fadvise            0            0K            0
           VN POLL            0            0K            0
            athdev            0            0K            0
            statfs            0            0K        18624
     namei_tracker            0            0K            0
       export_host            0            0K            0
        cl_savebuf            0            0K            2
           ata_pci            0            0K            0
           ata_dma            0            0K            0
       ata_generic            0            0K            0
            pvscsi            0            0K            0
           scsi_da            0            0K           69
            ata_da            0            0K            0
           scsi_ch            0            0K            0
           scsi_cd            0            0K            0
       AHCI driver            0            0K            0
            USBdev            0            0K            0
               USB            0            0K            0
               agp            0            0K            0
           nvme_da            0            0K            0
           acpipwr            0            0K            0
         acpi_perf            0            0K            0
            twsbuf            0            0K            0
      twe_commands            0            0K            0
       tcp_log_dev            0            0K         2313
               lio            0            0K            6
               acl            0            0K            0
      midi buffers            0            0K            0
          mbuf_tag            0            0K            0
              ktls            0            0K            0
             mixer            0            0K            0
              ac97            0            0K            0
             hdacc            0            0K            0
              hdac            0            0K            0
              hdaa            0            0K            0
         acpicmbat            0            0K            0
       SIIS driver            0            0K            0
           CAM CCB            0            0K          523
               PUC            0            0K            0
          ppbusdev            0            0K            0
            sr_iov            0            0K            0
               OCS            0            0K            0
               OCS            0            0K            0
              nvme            0            0K            0
               nvd            0            0K            0
            netmap            0            0K            0
            mwldev            0            0K            0
        MVS driver            0            0K            0
     CAM ccb queue            0            0K            0
              accf            0            0K            0
               pts            0            0K            0
               iov            0            0K        31391
          ioctlops            0            0K        20321
           eventfd            0            0K           82
           Witness            0            0K            0
             stack            0            0K            0
          mrsasbuf            0            0K            0
          mpt_user            0            0K            0
          mps_user            0            0K            0
            MPSSAS            0            0K            0
               mps            0            0K            0
              sbuf            0            0K          288
          mpr_user            0            0K            0
          firmware            0            0K            0
        compressor            0            0K            0
            MPRSAS            0            0K            0
              SWAP            0            0K            0
               mpr            0            0K            0
            mfibuf            0            0K            0
         sysctltmp            0            0K         1087
            sysctl            0            0K            3
        md_sectors            0            0K            0
              ekcd            0            0K            0
            dumper            0            0K            0
          sendfile            0            0K            0
              rctl            0            0K            0
           md_disk            0            0K            0
           malodev            0            0K            0
               LED            0            0K            0
          ix_sriov            0            0K            0
             cache            0            0K            0
        aacraidcam            0            0K            0
      prison_racct            0            0K            0
       Fail Points            0            0K            0
             sigio            0            0K            1
filedesc_to_leader            0            0K            0
               pwd            0            0K            0
       tty console            0            0K            0
                ix            0            0K            0
            ipsbuf            0            0K            0
       aacraid_buf            0            0K            0
            aaccam            0            0K            0
         boottrace            0            0K            0
            aacbuf            0            0K            0
              zstd            0            0K            0
            XZ_DEC            0            0K            0
            nvlist            0            0K            0
          SCSI ENC            0            0K            0
           SCSI sa            0            0K            0
        isofs_node            0            0K            0
       isofs_mount            0            0K            0
     tr_raid5_data            0            0K            0
    tr_raid1e_data            0            0K            0
     tr_raid1_data            0            0K            0
     tr_raid0_data            0            0K            0
    tr_concat_data            0            0K            0
       md_sii_data            0            0K            0
   md_promise_data            0            0K            0
    md_nvidia_data            0            0K            0
   md_jmicron_data            0            0K            0
     md_intel_data            0            0K            0
db> show uma
              Zone   Size    Used    Free    Requests  Sleeps  Bucket  Total Mem    XFree
   mbuf_jumbo_page   4096    8391    1007     1556856       0     254   38494208        0
         sctp_asoc   2264     474    1816        6094       0     254    5184560        0
              mbuf    256   12208    5075     5735973       0     254    4424448        0
       malloc-2048   2048     551    1399       18216       0       8    3993600        0
           sctp_ep   1176     547    1743       17178       0     254    2693040        0
        RADIX NODE    144   17728     467      474994       0      64    2620080        0
           tcp_log    416       0    5589       77696       0     254    2325024        0
              pbuf   2624       0     778           0       0       2    2041472        0
       malloc-1024   1024     484    1348        6612       0      16    1875968        0
          BUF TRIE    144     204   11612       68699       0      62    1701504        0
        malloc-128    128   12479     138       34100       0     126    1614976        0
        malloc-384    384    4191       9        4193       0      30    1612800        0
      mbuf_cluster   2048     762       0         762       0     254    1560576        0
        malloc-384    384    1022    2998       23643       0      30    1543680        0
        sctp_raddr    736     474    1561        6099       0     254    1497760        0
       UMA Slabs 0    112   12493     137       12604       0     126    1414560        0
       malloc-4096   4096     330       6       19118       0       2    1376256        0
         vmem btag     56   22522     125       22528       0     254    1268232        0
        sctp_chunk    152    2020    3830       12214       0     254     889200        0
         VM OBJECT    264    2942     148      397298       0      30     815760        0
        256 Bucket   2048     350      42       25296       0       8     802816        0
      malloc-16384  16384      39       6       18387       0       1     737280        0
            socket    960     162     602       41653       0     254     733440        0
    ertt_txseginfo     40     461   17618     3192828       0     254     723160        0
         FFS inode   1160     552      36       20773       0       8     682080        0
        malloc-256    256     691    1484       20585       0      62     556800        0
       malloc-4096   4096     119       5       20207       0       2     507904        0
         MAP ENTRY     96    4426     488     1051575       0     126     471744        0
        malloc-384    384      65    1075       23740       0      30     437760        0
            THREAD   1824     195      36       27120       0       8     421344        0
          lkpicurr    168       2    2350           2       0      62     395136        0
      malloc-65536  65536       4       2         426       0       1     393216        0
            lkpimm    168       1    2327           1       0      62     391104        0
        malloc-256    256     202    1103       41229       0      62     334080        0
             VNODE    448     593     100       20819       0      30     310464        0
         malloc-16     16   15416    3334       77173       0     254     300000        0
         tcp_inpcb   1304       6     219       16104       0       8     293400        0
         malloc-64     64    4020     327       23964       0     254     278208        0
      malloc-32768  32768       0       7       34940       0       1     229376        0
       malloc-2048   2048       8     104        2108       0       8     229376        0
            DEVCTL   1024      29     191         192       0       0     225280        0
       tcp_bbr_map    128     339    1304      138251       0     126     210304        0
        malloc-256    256      32     778      143057       0      62     207360        0
     FPU_save_area    832     197      46       43452       0      16     202176        0
      malloc-65536  65536       3       0           3       0       1     196608        0
       mbuf_packet    256     161     601       51560       0     254     195072        0
        malloc-128    128    1193     326       66445       0     126     194432        0
        malloc-256    256      55     695       38967       0      62     192000        0
         UMA Zones    768     239       0         239       0      16     183552        0
         malloc-32     32    5387     283       28014       0     254     181440        0
       FFS2 dinode    256     552     138       20772       0      62     176640        0
              PROC   1376      95      26       19520       0       8     166496        0
       malloc-1024   1024     136      24        1994       0      16     163840        0
       S VFS Cache    104    1031     490       22882       0     126     158184        0
        malloc-128    128      30    1117       21839       0     126     146816        0
        malloc-128    128    1104      43        2109       0     126     146816        0
sctp_stream_msg_out    112     456     840        8395       0     254     145152        0
         malloc-32     32    1047    3363       24026       0     254     141120        0
         filedesc0   1072      96      30       19522       0       8     135072        0
        128 Bucket   1024      90      41        4312       0      16     134144        0
         malloc-64     64     477    1602        7552       0     254     133056        0
      malloc-65536  65536       2       0           2       0       1     131072        0
      malloc-65536  65536       0       2           5       0       1     131072        0
      malloc-65536  65536       0       2          74       0       1     131072        0
             unpcb    256      20     490        1629       0     254     130560        0
         64 Bucket    512     138      94       39123       0      30     118784        0
          ksiginfo    112     103     941       16802       0     126     116928        0
       malloc-8192   8192       5       8        2115       0       1     106496        0
        malloc-256    256     225     150       58787       0      62      96000        0
         32 Bucket    256     205     170       11825       0      62      96000        0
          UMA Kegs    384     225       8         225       0      30      89472        0
              pipe    728      25      96         896       0      16      88088        0
         malloc-64     64     633     690       42634       0     254      84672        0
            clpbuf   2624       0      32         100       0      16      83968        0
        malloc-128    128     396     255        1074       0     126      83328        0
      malloc-16384  16384       5       0          15       0       1      81920        0
        malloc-384    384     143      67        2660       0      30      80640        0
        sctp_readq    152       0     520         356       0     254      79040        0
             g_bio    408       0     180      496978       0      30      73440        0
         malloc-16     16    1033    3467       24212       0     254      72000        0
             ripcb    392      27     153        5352       0      30      70560        0
      malloc-65536  65536       0       1         126       0       1      65536        0
      malloc-32768  32768       2       0           2       0       1      65536        0
      malloc-32768  32768       2       0           2       0       1      65536        0
       malloc-4096   4096      14       2          25       0       2      65536        0
       malloc-2048   2048       6      26         545       0       8      65536        0
        malloc-256    256      96     159        2404       0      62      65280        0
         udp_inpcb    424       6     147         785       0      30      64872        0
             Files     80     360     440       98560       0     126      64000        0
           VMSPACE    520      71      49       19465       0      16      62400        0
       tcp_bbr_pcb    832       2      70        9363       0      16      59904        0
       malloc-4096   4096      10       4          68       0       2      57344        0
            pcpu-8      8    4870    2298       59629       0     254      57344        0
         16 Bucket    144     164     228        5580       0      62      56448        0
     udplite_inpcb    424       0     126         541       0      30      53424        0
         malloc-64     64      58     761      269555       0     254      52416        0
         malloc-64     64     231     588       19657       0     254      52416        0
         malloc-64     64     394     425        3035       0     254      52416        0
         malloc-64     64     461     358         778       0     254      52416        0
        malloc-128    128      94     309       39717       0     126      51584        0
        malloc-256    256      86     109         254       0      62      49920        0
      tcp_rack_pcb   1024       0      48        1595       0      16      49152        0
           DIRHASH   1024      35      13          35       0      16      49152        0
             NAMEI   1024       0      48      122853       0      16      49152        0
       malloc-8192   8192       6       0           6       0       1      49152        0
       malloc-4096   4096       3       9        1604       0       2      49152        0
        malloc-512    512      15      81         388       0      30      49152        0
          8 Bucket     80     253     347        8469       0     126      48000        0
            da_ccb    544       0      84      124369       0      16      45696        0
          syncache    168       0     264           4       0     254      44352        0
       malloc-8192   8192       4       1           6       0       1      40960        0
       malloc-8192   8192       5       0           5       0       1      40960        0
         hostcache     64       3     564           3       0     254      36288        0
              ertt     72       6     498       16104       0     126      36288        0
               PWD     32      52    1082       18434       0     254      36288        0
         malloc-64     64       6     561          57       0     254      36288        0
      tcp_rack_map    128       0     279        4361       0     126      35712        0
        malloc-128    128      24     255          75       0     126      35712        0
        malloc-128    128      26     253         717       0     126      35712        0
     routing nhops    256      28     107          49       0      62      34560        0
           ttyoutq    256      72      63         160       0      62      34560        0
        malloc-256    256      52      83          54       0      62      34560        0
         TURNSTILE    136     232      20         232       0      62      34272        0
        SLEEPQUEUE     88     232     152         232       0     126      33792        0
      malloc-32768  32768       1       0           1       0       1      32768        0
      malloc-32768  32768       0       1         120       0       1      32768        0
      malloc-16384  16384       0       2          16       0       1      32768        0
       malloc-8192   8192       2       2           8       0       1      32768        0
       malloc-2048   2048       0      16          12       0       8      32768        0
       malloc-2048   2048       2      14          41       0       8      32768        0
       malloc-2048   2048       8       8         312       0       8      32768        0
       malloc-2048   2048       1      15          89       0       8      32768        0
       malloc-2048   2048       5      11        7986       0       8      32768        0
       malloc-1024   1024       2      30          42       0      16      32768        0
       malloc-1024   1024       1      31          32       0      16      32768        0
       malloc-1024   1024      14      18          14       0      16      32768        0
       malloc-1024   1024       5      27        3318       0      16      32768        0
       malloc-1024   1024       4      28         155       0      16      32768        0
       malloc-1024   1024       2      30          14       0      16      32768        0
        malloc-512    512       1      63         119       0      30      32768        0
        malloc-512    512       2      62          16       0      30      32768        0
        malloc-512    512       2      62         113       0      30      32768        0
        malloc-512    512       8      56         112       0      30      32768        0
        malloc-512    512       1      63         742       0      30      32768        0
           pcpu-64     64     487      25         487       0     254      32768        0
             KNOTE    160      28     172      188097       0      62      32000        0
            ttyinq    160     135      65         300       0      62      32000        0
            cpuset    104       7     272           7       0     126      29016        0
        sctp_laddr     48       4     584         437       0     254      28224        0
   tcp_inpcb ports     32       4     878        9733       0     254      28224        0
         malloc-32     32     280     602         378       0     254      28224        0
         malloc-32     32      76     806       25703       0     254      28224        0
          2 Bucket     32      69     813        8377       0     254      28224        0
               AIO    208       0     133          36       0      62      27664        0
       malloc-8192   8192       2       1          28       0       1      24576        0
              PGRP     88      34     242          63       0     126      24288        0
          rl_entry     40     105     501         105       0     254      24240        0
           rtentry    168      30     114          49       0      62      24192        0
        malloc-384    384      11      49          11       0      30      23040        0
   udp_inpcb ports     32       3     627         126       0     254      20160        0
         malloc-32     32      46     584       18458       0     254      20160        0
         malloc-32     32      76     554         757       0     254      20160        0
         malloc-32     32     311     319        1045       0     254      20160        0
           cryptop    280       0      70         123       0      30      19600        0
             AIOCB    552       0      35          43       0      16      19320        0
       L VFS Cache    320       0      60           4       0      30      19200        0
            AIOLIO    272       0      70           6       0      30      19040        0
 epoch_record pcpu    256       4      60           4       0      62      16384        0
      malloc-16384  16384       1       0           1       0       1      16384        0
      malloc-16384  16384       1       0           1       0       1      16384        0
      malloc-16384  16384       0       1         160       0       1      16384        0
      malloc-16384  16384       1       0           1       0       1      16384        0
       malloc-8192   8192       1       1           2       0       1      16384        0
       malloc-8192   8192       1       1         102       0       1      16384        0
       malloc-4096   4096       0       4           6       0       2      16384        0
       malloc-4096   4096       1       3        4980       0       2      16384        0
        malloc-512    512       1      31           1       0      30      16384        0
           SMR CPU     32       7     504           7       0     254      16352        0
          4 Bucket     48       1     335           1       0     254      16128        0
      vtnet_tx_hdr     24       1     667      862620       0     254      16032        0
         malloc-16     16      19     981       16153       0     254      16000        0
              kenv    258      15      45        1057       0      30      15480        0
            mqnode    416       3      33           3       0      30      14976        0
              vmem   1856       1       7           1       0       8      14848        0
        SMR SHARED     24       7     504           7       0     254      12264        0
         malloc-32     32      45     333         130       0     254      12096        0
         malloc-16     16      31     719          87       0     254      12000        0
         malloc-16     16     264     486         264       0     254      12000        0
         malloc-16     16      67     683         474       0     254      12000        0
         malloc-16     16      26     724       32641       0     254      12000        0
        malloc-384    384       1      29           1       0      30      11520        0
       Mountpoints   2816       2       2           2       0       4      11264        0
         malloc-16     16     186     314        3073       0     254       8000        0
           pcpu-16     16       4     252           4       0     254       4096        0
       UMA Slabs 1    176      13       9          13       0      62       3872        0
        KMAP ENTRY     96      12      27          14       0       0       3744        0
       FFS1 dinode    128       0       0           0       0     126          0        0
           ada_ccb    272       0       0           0       0      30          0        0
             swblk    136       0       0           0       0      62          0        0
          swpctrie    144       0       0           0       0      62          0        0
   pf state scrubs     40       0       0           0       0     254          0        0
   pf frag entries     40       0       0           0       0     254          0        0
          pf frags    248       0       0           0       0      62          0        0
  pf table entries    160       0       0           0       0     254          0        0
pf table entry counters     64       0       0           0       0     254          0        0
   pf source nodes    152       0       0           0       0     254          0        0
     pf state keys     88       0       0           0       0     126          0        0
         pf states    336       0       0           0       0       0          0        0
           pf tags    104       0       0           0       0     126          0        0
          pf mtags    184       0       0           0       0      62          0        0
tfo_ccache_entries     80       0       0           0       0     126          0        0
               tfo      4       0       0           0       0     254          0        0
          sackhole     32       0       0           0       0     254          0        0
               ipq     56       0       0           0       0     254          0        0
   tcp_log_id_node    120       0       0           0       0     126          0        0
 tcp_log_id_bucket    176       0       0           0       0      62          0        0
          tcpreass     48       0       0           0       0     254          0        0
   sctp_asconf_ack     48       0       0           0       0     254          0        0
       sctp_asconf     40       0       0           0       0     254          0        0
       ripcb ports     32       0       0           0       0     254          0        0
udplite_inpcb ports     32       0       0           0       0     254          0        0
    IPsec SA lft_c     16       0       0           0       0     254          0        0
            itimer    352       0       0           0       0      30          0        0
        TMPFS node    232       0       0           0       0      62          0        0
           NCLNODE    608       0       0           0       0      16          0        0
        mqnotifier    216       0       0           0       0      62          0        0
            mvdata     64       0       0           0       0     254          0        0
            mqueue    248       0       0           0       0      62          0        0
     LTS VFS Cache    360       0       0           0       0      30          0        0
     STS VFS Cache    144       0       0           0       0      62          0        0
  linux_dma_object     32       0       0           0       0     254          0        0
  linux_dma_pctrie    144       0       0           0       0      62          0        0
   IOMMU_MAP_ENTRY    104       0       0           0       0     126          0        0
    mbuf_jumbo_16k  16384       0       0           0       0     254          0        0
     mbuf_jumbo_9k   9216       0       0           0       0     254          0        0
      audit_record   1280       0       0           0       0       8          0        0
         domainset     40       0       0           0       0     254          0        0
        MAC labels     40       0       0           0       0     254          0        0
            vnpbuf   2624       0       0           0       0      64          0        0
            mdpbuf   2624       0       0           0       0       3          0        0
           nfspbuf   2624       0       0           0       0      16          0        0
            swwbuf   2624       0       0           0       0       8          0        0
            swrbuf   2624       0       0           0       0      16          0        0
          umtx_shm     88       0       0           0       0     126          0        0
           umtx pi     96       0       0           0       0     126          0        0
rangeset pctrie nodes    144       0       0           0       0      62          0        0
      malloc-65536  65536       0       0           0       0       1          0        0
      malloc-65536  65536       0       0           0       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
      malloc-16384  16384       0       0           0       0       1          0        0
       malloc-4096   4096       0       0           0       0       2          0        0
        malloc-512    512       0       0           0       0      30          0        0
        malloc-384    384       0       0           0       0      30          0        0
        malloc-384    384       0       0           0       0      30          0        0
           pcpu-32     32       0       0           0       0     254          0        0
            pcpu-4      4       0       0           0       0     254          0        0
            fakepg    104       0       0           0       0     126          0        0
          UMA Hash    256       0       0           0       0      62          0        0

Crashes (1):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2023/05/06 21:42 freebsd-src 113f56ba4930 ee50e71c console log report ci-freebsd-main Fatal trap NUM: page fault in in6_selecthlim
* Struck through repros no longer work on HEAD.