syzbot


panic: inconsistent boundary count NUM

Status: upstream: reported on 2025/04/18 21:37
Reported-by: syzbot+f4262880d28811174b80@syzkaller.appspotmail.com
First crash: 114d, last: 10d

Sample crash report:
panic: inconsistent boundary count 4
cpuid = 0
time = 1754038050
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0xc6/frame 0xfffffe0057042690
kdb_backtrace() at kdb_backtrace+0xd0/frame 0xfffffe00570427f0
vpanic() at vpanic+0x257/frame 0xfffffe00570429b0
panic() at panic+0xb5/frame 0xfffffe0057042a80
thread_single_end() at thread_single_end+0x37d/frame 0xfffffe0057042ad0
fork1() at fork1+0x8e1/frame 0xfffffe0057042bf0
sys_rfork() at sys_rfork+0x1b7/frame 0xfffffe0057042d10
amd64_syscall() at amd64_syscall+0x4e2/frame 0xfffffe0057042f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0057042f30
--- syscall (198, FreeBSD ELF64, __syscall), rip = 0x3a1afa, rsp = 0x8274eaf08, rbp = 0x8274eaf80 ---
KDB: enter: panic
[ thread pid 1034 tid 100543 ]
Stopped at      kdb_enter+0x6e: movq    $0,0x25c43e7(%rip)
db> 
db> set $lines = 0
db> set $maxwidth = 0
db> show registers
cs                        0x20
ds                        0x3b
es                        0x3b
fs                        0x13
gs                        0x1b
ss                        0x28
rax                       0x12
rcx         0xfffffe0075800000
rdx                    0x7ffff
rbx         0xffffffff827cc4a0  .str.27
rsp         0xfffffe00570427d0
rbp         0xfffffe00570427f0
rsi                    0x80001
rdi         0xffffffff81614c79  printf+0x149
r8                           0
r9                  0xffffffff
r10                          0
r11                       0x85
r12         0xfffffe0054172780
r13         0xfffffffffffffffe
r14         0xffffffff827cc4a0  .str.27
r15                          0
rip         0xffffffff815fe7ae  kdb_enter+0x6e
rflags                    0x46
kdb_enter+0x6e: movq    $0,0x25c43e7(%rip)
db> show proc
Process 1034 (syz-executor) at 0xfffffe0054139060:
 state: NORMAL
 uid: 0  gids: 0, 5
 parent: pid 765 at 0xfffffe00540bcb00
 ABI: FreeBSD ELF64
 flag: 0x10020080  flag2: 0
 arguments: ./syz-executor exec
 reaper: 0xfffffe0007809040 reapsubtree: 1
 sigparent: 20
 vmspace: 0xfffffe0007810000
   (map 0xfffffe0007810000)
   (map.pmap 0xfffffe00078100a0)
   (pmap 0xfffffe0007810110)
 threads: 5
100506                   s                                   syz-executor
100540                   s                                   syz-executor
100541                   s                                   syz-executor
100543                   Run     CPU 0                       syz-executor
100544                   s                                   syz-executor
db> ps
  pid  ppid  pgrp   uid  state   wmesg   wchan               cmd
 1039   914   914     0  RE      CPU 1                       syz-executor
 1037   763   763     0  R       (threaded)                  syz-executor
100102                   RunQ                                syz-executor
100546                   S       sigwait 0xfffffe00540ed0f0  syz-executor
100547                   RunQ                                syz-executor
 1036  1035   765     0  S       uwait   0xfffffe0070701180  syz-executor
 1035  1034   765     0  SV      wait    0xfffffe0054136ac0  syz-executor
 1034   765   765     0  T       (threaded)                  syz-executor
100506                   s                                   syz-executor
100540                   s                                   syz-executor
100541                   s                                   syz-executor
100543                   Run     CPU 0                       syz-executor
100544                   s                                   syz-executor
 1033     1   763     0  S       uwait   0xfffffe0057e18680  syz-executor
 1013     1   764     0  S       uwait   0xfffffe0070700c80  syz-executor
 1009     1   914     0  SV      uwait   0xfffffe0057e16380  syz-executor
 1008     1   914     0  S       uwait   0xfffffe00584f3400  syz-executor
  997     1   997     0  SVs     uwait   0xfffffe0070700e80  syz-executor
  993     1   765     0  S       uwait   0xfffffe0053e11100  syz-executor
  992     1   764     0  S       uwait   0xfffffe0070700a80  syz-executor
  989     0     0     0  DL      mdwait  0xfffffe00ae8d5000  [md3]
  985     1   763     0  S       uwait   0xfffffe0070701680  syz-executor
  966     0     0     0  DL      -       0xffffffff83cb3e00  [soaiod4]
  965     0     0     0  DL      -       0xffffffff83cb3e00  [soaiod3]
  964     0     0     0  DL      -       0xffffffff83cb3e00  [soaiod2]
  963     0     0     0  DL      -       0xffffffff83cb3e00  [soaiod1]
  959     0     0     0  DL      (threaded)                  [so_splice]
100400                   D       -       0xfffffe008b9b7700  [thr_0]
100401                   D       -       0xfffffe008b9b7740  [thr_1]
  957     1   763     0  S       uwait   0xfffffe008c31bc00  syz-executor
  949     1   765     0  T       uwait   0xfffffe00584f3200  syz-executor
  934     1   764     0  T       umtxn   0xfffffe0053e11e80  syz-executor
  930     0     0     0  DL      mdwait  0xfffffe0070009000  [md2]
  917     1   763     0  T       uwait   0xfffffe0057e15200  syz-executor
  914   762   914     0  R                                   syz-executor
  906     0     0     0  DL      mdwait  0xfffffe00596bb000  [md1]
  895     1   766     0  T       uwait   0xfffffe0057e15700  syz-executor
  888     1   888     0  Ts                                  rtsol
  887     1   887     0  Ts      select  0xfffffe00798281c0  rtsol
  886     1   886     0  Ts      select  0xfffffe0059684ec0  rtsol
  883   784   423     0  S       select  0xfffffe0079828340  rtsol
  880     0     0     0  DL      mdwait  0xfffffe007000a000  [md0]
  872     1   872     0  Ts+     ttyin   0xfffffe00585c00b0  getty
  871     1   871     0  Ts+     ttyin   0xfffffe00585bfcb0  getty
  870     1   870     0  Ts+     ttyin   0xfffffe00585bf8b0  getty
  869     1   869     0  Ts+     ttyin   0xfffffe00585bf4b0  getty
  868     1   868     0  Ts+     ttyin   0xfffffe00585bf0b0  getty
  867     1   867     0  Ts+     ttyin   0xfffffe00585becb0  getty
  866     1   866     0  Ts+     ttyin   0xfffffe00585be8b0  getty
  865     1   865     0  Ts+     ttyin   0xfffffe00585be4b0  getty
  864     1   864     0  Ts+     ttyin   0xfffffe0058298cb0  getty
  863     1   765     0  T       uwait   0xfffffe00584f2e80  syz-executor
  849     0     0     0  DL      (threaded)                  [KTLS]
100133                   D       -       0xfffffe0057dd6400  [thr_0]
100153                   D       -       0xfffffe0057dd6480  [thr_1]
100154                   D       -       0xffffffff83cb5628  [reclaim_0]
  819     1   766     0  T       uwait   0xfffffe00584f3900  syz-executor
  815     0     0     0  DL      aiordy  0xfffffe005410b000  [aiod4]
  814     0     0     0  DL      aiordy  0xfffffe005410c580  [aiod3]
  813     0     0     0  DL      aiordy  0xfffffe005410cae0  [aiod2]
  812     0     0     0  DL      aiordy  0xfffffe00540ee5c0  [aiod1]
  784   772   423     0  S       wait    0xfffffe005410db00  sh
  772     1   423     0  T       wait    0xfffffe005410b560  sh
  765   762   765     0  S       wait    0xfffffe00540bcb00  syz-executor
  764   762   764     0  R                                   syz-executor
  763   762   763     0  R                                   syz-executor
  762   760   760     0  S       select  0xfffffe0059684ac0  syz-executor
  760   758   760     0  Ss      sigsusp 0xfffffe005411e0b0  csh
  758     1   758     0  Ts      select  0xfffffe0059684bc0  sshd
  736     1    17     0  T+                                  sleep
   16     0     0     0  DL      syncer  0xffffffff83cc1820  [syncer]
   15     0     0     0  DL      vlruwt  0xfffffe000780a060  [vnlru]
   14     0     0     0  DL      (threaded)                  [bufdaemon]
100079                   D       psleep  0xffffffff83cbfd60  [bufdaemon]
100082                   D       -       0xffffffff83001ec0  [bufspacedaemon-0]
100092                   D       sdflush 0xfffffe0057dc74e8  [/ worker]
    9     0     0     0  DL      psleep  0xffffffff83d0acc0  [vmdaemon]
    8     0     0     0  DL      (threaded)                  [pagedaemon]
100077                   D       psleep  0xffffffff83cf0d88  [dom0]
100083                   D       launds  0xffffffff83cf0d94  [laundry: dom0]
100084                   D       umarcls 0xffffffff827d0b81  [uma]
    7     0     0     0  DL      -       0xffffffff8391c5d8  [rand_harvestq]
    6     0     0     0  DL      pftm    0xffffffff848579e0  [pf purge]
    5     0     0     0  DL      waiting 0xffffffff846a8700  [sctp_iterator]
    4     0     0     0  DL      (threaded)                  [cam]
100045                   D       -       0xffffffff838e6340  [doneq0]
100046                   D       -       0xffffffff838e62c0  [async]
100075                   D       -       0xffffffff838e6140  [scanner]
    3     0     0     0  DL      (threaded)                  [crypto]
100042                   D       crypto_ 0xffffffff83cec640  [crypto]
100043                   D       crypto_ 0xfffffe0053ea9030  [crypto returns 0]
100044                   D       crypto_ 0xfffffe0053ea9080  [crypto returns 1]
   13     0     0     0  DL      (threaded)                  [geom]
100037                   D       -       0xffffffff83b4c600  [g_event]
100038                   D       -       0xffffffff83b4c620  [g_up]
100039                   D       -       0xffffffff83b4c640  [g_down]
    2     0     0     0  WL      (threaded)                  [clock]
100031                   I                                   [clock (0)]
100032                   I                                   [clock (1)]
   12     0     0     0  WL      (threaded)                  [intr]
100013                   I                                   [swi6: task queue]
100014                   I                                   [swi6: Giant taskq]
100016                   I                                   [swi5: fast taskq]
100033                   I                                   [swi1: netisr 0]
100034                   I                                   [swi1: hpts]
100035                   I                                   [swi1: hpts]
100047                   I                                   [irq24: virtio_pci0]
100048                   I                                   [irq25: virtio_pci0]
100049                   I                                   [irq26: virtio_pci0]
100050                   I                                   [irq27: virtio_pci0]
100051                   I                                   [irq28: virtio_pci1]
100052                   I                                   [irq29: virtio_pci1]
100053                   I                                   [irq30: virtio_pci1]
100054                   I                                   [irq31: virtio_pci1]
100055                   I                                   [irq32: virtio_pci1]
100060                   I                                   [irq10: virtio_pci2]
100062                   I                                   [irq1: atkbd0]
100063                   I                                   [irq12: psm0]
100064                   I                                   [swi0: uart uart++]
100068                   I                                   [swi1: pf send]
   11     0     0     0  RL      (threaded)                  [idle]
100003                   CanRun                              [idle: cpu0]
100004                   CanRun                              [idle: cpu1]
    1     0     1     0  SLs     wait    0xfffffe0007809040  [init]
   10     0     0     0  DL      audit_w 0xffffffff83ced0e0  [audit]
    0     0     0     0  DLs     (threaded)                  [kernel]
100000                   D       parked  0xffffffff84c3dff0  [swapper]
100005                   D       -       0xfffffe00083f7000  [softirq_0]
100006                   D       -       0xfffffe00083f6e00  [softirq_1]
100007                   D       -       0xfffffe00083f6d00  [if_io_tqg_0]
100008                   D       -       0xfffffe00083f6c00  [if_io_tqg_1]
100009                   D       -       0xfffffe00083f6b00  [if_config_tqg_0]
100010                   D       -       0xfffffe00083f6a00  [kqueue_ctx taskq]
100011                   D       -       0xfffffe00083f6900  [jail_remove taskq]
100012                   D       -       0xfffffe00083f6800  [bus taskq]
100015                   D       -       0xfffffe00083f6500  [thread taskq]
100017                   D       -       0xfffffe00083f6300  [aiod_kick taskq]
100018                   D       -       0xfffffe00083f6200  [deferred_unmount ta]
100019                   D       -       0xfffffe00083f6100  [inm_free taskq]
100020                   D       -       0xfffffe00083f6000  [in6m_free taskq]
100021                   D       -       0xfffffe00083f5e00  [linuxkpi_irq_wq]
100022                   D       -       0xfffffe00083f5d00  [linuxkpi_short_wq_0]
100023                   D       -       0xfffffe00083f5d00  [linuxkpi_short_wq_1]
100024                   D       -       0xfffffe00083f5d00  [linuxkpi_short_wq_2]
100025                   D       -       0xfffffe00083f5d00  [linuxkpi_short_wq_3]
100026                   D       -       0xfffffe00083f5c00  [linuxkpi_long_wq_0]
100027                   D       -       0xfffffe00083f5c00  [linuxkpi_long_wq_1]
100028                   D       -       0xfffffe00083f5c00  [linuxkpi_long_wq_2]
100029                   D       -       0xfffffe00083f5c00  [linuxkpi_long_wq_3]
100036                   D       -       0xfffffe00083f5b00  [firmware taskq]
100040                   D       -       0xfffffe00083f5a00  [crypto_0]
100041                   D       -       0xfffffe00083f5a00  [crypto_1]
100056                   D       -       0xfffffe00083f5800  [vtnet0 rxq 0]
100057                   D       -       0xfffffe00083f5700  [vtnet0 txq 0]
100058                   D       -       0xfffffe00083f5600  [vtnet0 rxq 1]
100059                   D       -       0xfffffe00083f5500  [vtnet0 txq 1]
100061                   D       vtbslp  0xfffffe0057d80e00  [virtio_balloon]
100065                   D       -       0xffffffff827d0b80  [deadlkres]
100069                   D       -       0xfffffe005940b300  [acpi_task_0]
100070                   D       -       0xfffffe005940b300  [acpi_task_1]
100071                   D       -       0xfffffe005940b300  [acpi_task_2]
100073                   D       -       0xfffffe00083f7100  [mca taskq]
100074                   D       -       0xfffffe00083f5900  [CAM taskq]
100076                   D       -       0xfffffe00083f5400  [ipsec_offload]
100202                   D       -       0xfffffe00083f5000  [system_taskq_0]
100203                   D       -       0xfffffe00083f5000  [system_taskq_1]
100204                   D       -       0xfffffe00083f5200  [system_delay_taskq_]
100205                   D       -       0xfffffe00083f5200  [system_delay_taskq_]
100206                   D       -       0xfffffe00083f5300  [zvol_tq-0_0]
100207                   D       -       0xfffffe00083f5300  [zvol_tq-0_1]
100208                   D       -       0xfffffe00083f5300  [zvol_tq-0_2]
100209                   D       -       0xfffffe00083f5300  [zvol_tq-0_3]
100210                   D       -       0xfffffe00083f5300  [zvol_tq-0_4]
100211                   D       -       0xfffffe00083f5300  [zvol_tq-0_5]
100212                   D       -       0xfffffe00083f5300  [zvol_tq-0_6]
100213                   D       -       0xfffffe00083f5300  [zvol_tq-0_7]
100214                   D       -       0xfffffe00083f5300  [zvol_tq-0_8]
100215                   D       -       0xfffffe00083f5300  [zvol_tq-0_9]
100216                   D       -       0xfffffe00083f5300  [zvol_tq-0_10]
100217                   D       -       0xfffffe00083f5300  [zvol_tq-0_11]
100218                   D       -       0xfffffe00083f5300  [zvol_tq-0_12]
100219                   D       -       0xfffffe00083f5300  [zvol_tq-0_13]
100220                   D       -       0xfffffe00083f5300  [zvol_tq-0_14]
100221                   D       -       0xfffffe00083f5300  [zvol_tq-0_15]
100222                   D       -       0xfffffe00083f5300  [zvol_tq-0_16]
100223                   D       -       0xfffffe00083f5300  [zvol_tq-0_17]
100224                   D       -       0xfffffe00083f5300  [zvol_tq-0_18]
100225                   D       -       0xfffffe00083f5300  [zvol_tq-0_19]
100226                   D       -       0xfffffe00083f5300  [zvol_tq-0_20]
100227                   D       -       0xfffffe00083f5300  [zvol_tq-0_21]
100228                   D       -       0xfffffe00083f5300  [zvol_tq-0_22]
100229                   D       -       0xfffffe00083f5300  [zvol_tq-0_23]
100230                   D       -       0xfffffe00083f5300  [zvol_tq-0_24]
100231                   D       -       0xfffffe00083f5300  [zvol_tq-0_25]
100232                   D       -       0xfffffe00083f5300  [zvol_tq-0_26]
100233                   D       -       0xfffffe00083f5300  [zvol_tq-0_27]
100234                   D       -       0xfffffe00083f5300  [zvol_tq-0_28]
100235                   D       -       0xfffffe00083f5300  [zvol_tq-0_29]
100236                   D       -       0xfffffe00083f5300  [zvol_tq-0_30]
100237                   D       -       0xfffffe00083f5300  [zvol_tq-0_31]
100240                   D       -       0xfffffe005940a600  [arc_prune]
100241                   D       -       0xfffffe005940ad00  [arc_flush_0]
100242                   D       -       0xfffffe005940ad00  [arc_flush_1]
100251                   D       -       0xfffffe00083f4400  [dbu_evict]
100268                   D       -       0xfffffe00083f5100  [z_vdev_file_0]
100269                   D       -       0xfffffe00083f5100  [z_vdev_file_1]
100270                   D       -       0xfffffe00083f5100  [z_vdev_file_2]
100271                   D       -       0xfffffe00083f5100  [z_vdev_file_3]
100272                   D       -       0xfffffe00083f5100  [z_vdev_file_4]
100273                   D       -       0xfffffe00083f5100  [z_vdev_file_5]
100274                   D       -       0xfffffe00083f5100  [z_vdev_file_6]
100275                   D       -       0xfffffe00083f5100  [z_vdev_file_7]
100276                   D       -       0xfffffe00083f5100  [z_vdev_file_8]
100277                   D       -       0xfffffe00083f5100  [z_vdev_file_9]
100278                   D       -       0xfffffe00083f5100  [z_vdev_file_10]
100279                   D       -       0xfffffe00083f5100  [z_vdev_file_11]
100280                   D       -       0xfffffe00083f5100  [z_vdev_file_12]
100281                   D       -       0xfffffe00083f5100  [z_vdev_file_13]
100282                   D       -       0xfffffe00083f5100  [z_vdev_file_14]
100283                   D       -       0xfffffe00083f5100  [z_vdev_file_15]
100296                   D       -       0xfffffe005940ac00  [zfsvfs]
db> show all locks
Process 1039 (syz-executor) thread 0xfffffe0054170000 (100536)
exclusive rw pmap pv list (pmap pv list) r = 0 (0xfffffe00074ca400) locked @ /syzkaller/managers/main/kernel/sys/amd64/amd64/pmap.c:8605
exclusive sleep mutex pmap (pmap) r = 0 (0xfffffe00540cd5a0) locked @ /syzkaller/managers/main/kernel/sys/amd64/amd64/pmap.c:8515
Process 1037 (syz-executor) thread 0xfffffe00540ea000 (100102)
exclusive sleep mutex umtxql (umtxql) r = 0 (0xffffffff83bb33b0) locked @ /syzkaller/managers/main/kernel/sys/kern/kern_umtx.c:1313
Process 1037 (syz-executor) thread 0xfffffe005416f780 (100547)
exclusive sleep mutex pmap (pmap) r = 0 (0xfffffe00540cd110) locked @ /syzkaller/managers/main/kernel/sys/amd64/amd64/pmap.c:7145
shared sx vm map (user) (vm map (user)) r = 0 (0xfffffe00540cd060) locked @ /syzkaller/managers/main/kernel/sys/vm/vm_map.c:4998
Process 1034 (syz-executor) thread 0xfffffe0054172780 (100543)
exclusive sleep mutex process lock (process lock) r = 0 (0xfffffe0054139188) locked @ /syzkaller/managers/main/kernel/sys/kern/kern_fork.c:358
db> show malloc
              Type        InUse        MemUse     Requests
        md_sectors         4116        16464K         4364
           pf_hash            6        12804K            6
            linker          401        12294K          759
          tcp_hpts            7         4801K            7
            devbuf         4187         4323K         4217
           solaris         2246         3597K         4472
         sysctloid        45261         2659K        45490
             vtbuf           24         1968K           46
              kobj          330         1320K          538
              vmem            5         1044K            9
            newblk            6         1026K         1816
          vfscache            3         1025K            3
               pcb           47          688K          224
          inodedep           10          516K          431
         ufs_quota            1          512K            1
          vfs_hash            1          512K            1
           callout            2          512K            2
              intr            4          472K            4
          filedesc           43          341K          382
           subproc          164          330K         1130
         vnet_data            2          224K            2
          acpitask            1          224K            1
            KTRACE          101          201K         9388
            acpica         1674          184K        54450
           md_disk         4120          145K         4370
           tidhash            3          141K            3
           pagedep           11          131K          191
        tfo_ccache            1          128K            1
          IP reass            1          128K            1
            DEVFS1          112          112K          131
               sem            4          106K            4
        gtaskqueue           18           98K           18
               bus         1008           82K         5098
          mtx_pool            3           74K            3
          syncache            1           68K            1
     NFSD srvcache            3           68K            3
            module          525           66K          533
       ddb_capture            1           64K            1
           kdtrace          286           58K         1598
              umtx          448           56K          448
            DEVFS3          132           33K          142
         hostcache            1           32K            1
               shm            1           32K            6
               msg            4           30K            4
            kbdmux            6           28K            6
              temp           36           21K         2072
               LRO           20           21K           20
            ifaddr           75           21K           77
        DEVFS_RULE           56           20K           56
        kstat_data           19           19K           19
          routetbl          160           19K          482
         ufs_mount            4           17K            5
              proc            3           17K            3
               tty           16           16K           16
           lltable           51           16K           53
       ether_multi          185           15K          231
           ithread           90           15K           90
            bus-sc           34           15K         1659
             ifnet            8           15K            8
              GEOM           69           15K          539
      eventhandler          166           14K          166
              kenv           95           12K           95
         CAM queue            5           11K         1528
         in6_multi           75           10K           80
         taskqueue           93           10K          111
              rman           82           10K          477
             shmfd            4           10K           13
               rpc            8            9K            8
              cred           23            9K          224
         bmsafemap            2            9K          356
           devstat            4            9K            4
              UART           12            9K           12
              ksem            1            8K            2
       pfs_vncache            1            8K            1
            kqueue           84            8K         1223
     audit_evclass          240            8K          303
            plimit           20            8K          482
               UMA          343            7K          344
            sglist            6            7K            6
           CAM DEV            3            6K          510
         pfs_nodes           22            6K           22
             mount           24            6K          550
           pwddesc           73            5K         1058
          pf_ifnet           11            5K           22
       ufs_dirhash           16            5K           27
                vt           11            5K           11
           memdesc            1            4K            1
               MCA           32            4K           32
             evdev            4            4K            4
         sctp_atcl           10            4K           71
           acpisem           28            4K           28
            DEVFSP           53            4K          105
          kcovinfo           45            3K           45
          terminal           11            3K           11
           acpidev           20            3K           20
         proc-args           85            3K         2112
             hhook            8            3K           10
             clone            9            3K            9
           uidinfo            3            3K           16
           session           18            3K           45
            ip6ndp           14            3K           16
         sctp_stro            2            2K            7
        local_apic            1            2K            1
           io_apic            1            2K            1
         ipsec-saq            2            2K            2
          in_multi            8            2K           13
             selfd           32            2K        39531
               osd           77            2K          186
          sctp_ifa           15            2K           16
            CC Mem           15            2K          106
               tun            5            2K            5
            Unitno           26            2K          200
           CAM XPT           22            2K          543
       vnodemarker            3            2K           43
         toponodes            6            2K            6
       ipsecpolicy            2            2K            2
               msi            9            2K            9
           netlink            2            2K           91
         sctp_timw            4            1K            4
           softdep            1            1K            1
            sahead            1            1K            1
          secasvar            1            1K            1
             nhops            6            1K            8
      NFSD session            1            1K            1
             lockf            8            1K           89
       inpcbpolicy           29            1K          380
          sctp_ifn            7            1K           16
               mld            7            1K            7
              igmp            7            1K            7
               BPF            7            1K           27
            select            7            1K           41
        CAM periph            4            1K          271
             ipsec            3            1K            3
            diradd            6            1K          298
              pfil            6            1K            6
            isadev            6            1K           14
          pci_link           10            1K           10
         newdirblk            5            1K          159
             mkdir            5            1K          318
            crypto            4            1K           31
 encap_export_host           12            1K           12
              cdev            2            1K            2
       lkpikmalloc            8            1K            9
         sctp_atky           12            1K           79
      counter_rate           13            1K           13
    chacha20random            1            1K            1
            biobuf            1            1K            1
          procdesc            3            1K           10
             DEVFS           10            1K           11
            dirrem            1            1K          280
       ip6_msource            4            1K           19
            vnodes            1            1K            1
              ktls            1            1K           11
      NFSD lckfile            1            1K            1
     NFSD V4client            1            1K            1
           CAM SIM            2            1K            2
            prison            8            1K            8
            feeder            7            1K            7
             taskq            2            1K            2
         cryptodev            3            1K          100
       in6_mfilter            3            1K           45
           tcpfunc            3            1K            3
        loginclass            3            1K            5
         sctp_athm           10            1K           73
          nexusdev            8            1K            8
            apmdev            1            1K            1
          atkbddev            2            1K            2
          freefile            1            1K          245
        ip_msource            2            1K            9
               aio            4            1K            7
          pmchooks            1            1K            1
          CAM path            4            1K         1034
     CAM dev queue            2            1K            2
 CAM I/O Scheduler            1            1K            1
        in_mfilter            2            1K           17
          filecaps            3            1K           78
          sctp_vrf            1            1K            1
         sctp_aadr            1            1K            1
          sctp_map            4            1K           14
       ip_moptions            1            1K            9
              vnet            1            1K            1
               pmc            1            1K            1
           entropy            2            1K           34
          acpiintr            1            1K            1
            DEVFS4            2            1K            2
              cpus            2            1K            2
      ip6_moptions            1            1K           25
    vnet_data_free            1            1K            1
           Per-cpu            1            1K            1
          freework            1            1K          497
          p1003.1b            1            1K            1
         sfs_nodes            0            0K            0
        zones_data            0            0K            0
          pf_table            0            0K            0
           pf_rule            0            0K            0
           pf_altq            0            0K            0
           pf_osfp            0            0K            0
     pf_krule_item            0            0K            0
           pf_temp            0            0K            0
            ipcomp            0            0K            0
               esp            0            0K            0
                ah            0            0K            0
        sctp_mcore            0            0K            0
        sctp_socko            0            0K           16
         sctp_iter            0            0K           14
         sctp_mvrf            0            0K            0
         sctp_cpal            0            0K            0
         sctp_cmsg            0            0K            0
         sctp_stre            0            0K            0
         sctp_athi            0            0K            0
         sctp_a_it            0            0K           14
         sctp_stri            0            0K            6
            mqdata            0            0K            0
           filemon            0            0K            4
      tcp_pcm_rack            0            0K            1
       tcp_do_rack            0            0K            0
      tcp_fsb_rack            0            0K            2
        madt_table            0            0K            2
          smartpqi            0            0K            0
               ixl            0            0K            0
        ice-resmgr            0            0K            0
         ice-osdep            0            0K            0
               ice            0            0K            0
              iavf            0            0K            0
             axgbe            0            0K            0
       fpukern_ctx            0            0K            0
          xen_intr            0            0K            0
           xen_hvm            0            0K            0
         legacydrv            0            0K            0
      NMI handlers            0            0K            0
            bounce            0            0K            0
            busdma            0            0K            0
            qpidrv            0            0K            0
      dmar_idpgtbl            0            0K            0
          dmar_dom            0            0K            0
          dmar_ctx            0            0K            0
      amdiommu_dom            0            0K            0
      amdiommu_ctx            0            0K            0
              isci            0            0K            0
      iommu_dmamap            0            0K            0
     hyperv_socket            0            0K            0
           bxe_ilt            0            0K            0
        aesni_data            0            0K            0
            xenbus            0            0K            0
     vm_fictitious            0            0K            0
           UMAHash            0            0K            0
         vm_pgdata            0            0K            0
           jblocks            0            0K            0
          savedino            0            0K          392
          sentinel            0            0K            0
            jfsync            0            0K            0
            jtrunc            0            0K            0
             sbdep            0            0K           20
           jsegdep            0            0K            0
              jseg            0            0K            0
         jfreefrag            0            0K            0
          jfreeblk            0            0K            0
           jnewblk            0            0K            0
            jmvref            0            0K            0
           jremref            0            0K            0
           jaddref            0            0K            0
           freedep            0            0K            0
          freeblks            0            0K          223
          freefrag            0            0K          100
        allocindir            0            0K            0
          indirdep            0            0K          331
       allocdirect            0            0K            0
          ufs_trim            0            0K            0
           mactemp            0            0K            0
     audit_trigger            0            0K            0
 audit_pipe_presel            0            0K            0
     audit_pipeent            0            0K            0
        audit_pipe            0            0K            0
      audit_evname            0            0K            0
         audit_bsm            0            0K            0
      audit_gidset            0            0K            0
        audit_text            0            0K            0
        audit_path            0            0K            0
        audit_data            0            0K            0
        audit_cred            0            0K            0
          ktls_ocf            0            0K            1
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
      MLX5E_TLS_RX            0            0K            0
        MLX5EEPROM            0            0K            0
         MLX5E_TLS            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
            MLX5EN            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
          MLX5DUMP            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
       simple_attr            0            0K            0
          seq_file            0            0K            0
           lkpiskb            0            0K            0
             radix            0            0K            0
               idr            0            0K            0
          lkpindev            0            0K            0
           lkpimhi            0            0K            0
            lkpifw            0            0K            0
         lkpi80211            0            0K            0
               NLM            0            0K            0
    ipsec-spdcache            0            0K            0
         ipsec-reg            0            0K            0
        ipsec-misc            0            0K            0
      ipsecrequest            0            0K            0
            ip6opt            0            0K           18
             frag6            0            0K            7
            tcplog            0            0K            0
        tcp_hwpace            0            0K            0
              ipid            0            0K            0
         80211scan            0            0K            0
      80211ratectl            0            0K            0
        80211power            0            0K            0
       80211nodeie            0            0K            0
         80211node            0            0K            0
      80211mesh_gt            0            0K            0
      80211mesh_rt            0            0K            0
         80211perr            0            0K            0
         80211prep            0            0K            0
         80211preq            0            0K            0
          80211dfs            0            0K            0
       80211crypto            0            0K            0
          80211vap            0            0K            0
             iflib            0            0K            0
              vlan            0            0K            0
               gif            0            0K            0
           ifdescr            0            0K            0
              zlib            0            0K           28
           fadvise            0            0K            2
           VN POLL            0            0K            5
            statfs            0            0K          224
     namei_tracker            0            0K            3
           inotify            0            0K            3
       export_host            0            0K            0
        cl_savebuf            0            0K           54
               lio            0            0K            6
               acl            0            0K            0
            soname            0            0K         3440
          mbuf_tag            0            0K            0
              accf            0            0K            0
               pts            0            0K            0
           timerfd            0            0K            0
               iov            0            0K        14688
          ioctlops            0            0K          133
           eventfd            0            0K            3
           Witness            0            0K            0
             stack            0            0K            0
              sbuf            0            0K          358
          firmware            0            0K            0
        compressor            0            0K            0
              SWAP            0            0K            0
         sysctltmp            0            0K          657
            sysctl            0            0K            3
              ekcd            0            0K            0
            dumper            0            0K            0
          sendfile            0            0K            6
              rctl            0            0K            0
             cache            0            0K            0
      prison_racct            0            0K            0
       Fail Points            0            0K            0
             sigio            0            0K            2
filedesc_to_leader            0            0K            0
               pwd            0            0K            0
       tty console            0            0K            0
         boottrace            0            0K            0
        isofs_node            0            0K            0
       isofs_mount            0            0K            0
     tr_raid5_data            0            0K            0
    tr_raid1e_data            0            0K            0
     tr_raid1_data            0            0K            0
     tr_raid0_data            0            0K            0
    tr_concat_data            0            0K            0
       md_sii_data            0            0K            0
   md_promise_data            0            0K            0
    md_nvidia_data            0            0K            0
   md_jmicron_data            0            0K            0
     md_intel_data            0            0K            0
       md_ddf_data            0            0K            0
         raid_data            0            0K           96
     geom_flashmap            0            0K            0
         tmpfs dir            0            0K            0
        tmpfs name            0            0K            0
       tmpfs mount            0            0K            0
     tmpfs extattr            0            0K            0
           NFS FHA            0            0K            0
         newnfsmnt            0            0K            0
  newnfsclient_req            0            0K            0
   NFSCL layrecall            0            0K            0
     NFSCL session            0            0K            0
     NFSCL sockreq            0            0K            0
     NFSCL devinfo            0            0K            0
     NFSCL flayout            0            0K            0
      NFSCL layout            0            0K            0
     NFSD rollback            0            0K            0
      NFSCL diroff            0            0K            0
        NEWNFSnode            0            0K            0
         NFSCL lck            0            0K            0
      NFSCL lckown            0            0K            0
      NFSCL client            0            0K            0
       NFSCL deleg            0            0K            0
        NFSCL open            0            0K            0
       NFSCL owner            0            0K            0
            NFS fh            0            0K            0
           NFS req            0            0K            0
     NFSD usrgroup            0            0K            0
       NFSD string            0            0K            0
       NFSD V4lock            0            0K            0
      NFSD V4state            0            0K            0
       msdosfs_fat            0            0K            0
     msdosfs_mount            0            0K            0
      msdosfs_node            0            0K            0
            DEVFS2            0            0K            0
            gntdev            0            0K            0
       privcmd_dev            0            0K            0
        evtchn_dev            0            0K            0
          xenstore            0            0K            0
               xnb            0            0K            0
          xen_acpi            0            0K            0
              xbbd            0            0K            0
               xbd            0            0K            0
           Balloon            0            0K            0
          sysmouse            0            0K            0
            vtfont            0            0K            0
            pvscsi            0            0K            0
            USBdev            0            0K            0
               USB            0            0K            0
            twsbuf            0            0K            0
       tcp_log_dev            0            0K            1
      midi buffers            0            0K            0
             mixer            0            0K            0
              ac97            0            0K            0
             hdacc            0            0K            0
              hdac            0            0K            0
              hdaa            0            0K            0
       SIIS driver            0            0K            0
               PUC            0            0K            0
          ppbusdev            0            0K            0
            sr_iov            0            0K            0
               OCS            0            0K            0
               OCS            0            0K            0
              nvme            0            0K            0
               nvd            0            0K            0
            netmap            0            0K            0
            mwldev            0            0K            0
        MVS driver            0            0K            0
         mpi3mrbuf            0            0K            0
          mrsasbuf            0            0K            0
          mpt_user            0            0K            0
          mps_user            0            0K            0
            MPSSAS            0            0K            0
               mps            0            0K            0
          mpr_user            0            0K            0
            MPRSAS            0            0K            0
               mpr            0            0K            0
            mfibuf            0            0K            0
           malodev            0            0K            0
               LED            0            0K            0
          ix_sriov            0            0K            0
                ix            0            0K            0
            ipsbuf            0            0K            0
         ciss_data            0            0K            0
         BACKLIGHT            0            0K            0
           ath_hal            0            0K            0
            athdev            0            0K            0
           ata_pci            0            0K            0
           ata_dma            0            0K            0
       ata_generic            0            0K            0
       AHCI driver            0            0K            0
               agp            0            0K            0
           acpipwr            0            0K            0
         acpi_perf            0            0K            0
         acpicmbat            0            0K            0
        aacraidcam            0            0K            0
       aacraid_buf            0            0K            0
            aaccam            0            0K            0
            aacbuf            0            0K            0
              zstd            0            0K            0
            XZ_DEC            0            0K            0
            nvlist            0            0K          350
          SCSI ENC            0            0K            0
           SCSI sa            0            0K            0
         scsi_pass            0            0K            0
           scsi_da            0            0K           70
            ata_da            0            0K            0
           scsi_ch            0            0K            0
           scsi_cd            0            0K            0
           nvme_da            0            0K            0
           CAM CCB            0            0K          523
     CAM ccb queue            0            0K            0
db> show uma
              Zone   Size    Used    Free    Requests  Sleeps  Bucket  Total Mem    XFree
   mbuf_jumbo_page   4096    8322       2       15269       0      62   34095104        0
         vmem btag     56  286532   15691      304541       0     254   16924488        0
       malloc-4096   4096    4129       0        4392       0       2   16912384        0
        RADIX NODE    152   25826     923       54202       0      62    4065848        0
              mbuf    256    8746     932       63870       0     254    2477568        0
        malloc-128    128   15408      92       16219       0     126    1984000        0
          BUF TRIE    152     257   11547        1830       0      62    1794208        0
       UMA Slabs 0    112   13322    1648       15645       0     126    1676640        0
        malloc-384    384    4161       9        4206       0      30    1601280        0
       malloc-4096   4096     337       1        1107       0       2    1384448        0
      malloc-65536  65536      13       0          18       0       1     851968        0
         FFS inode   1168     538      22         786       0       8     654080        0
              pbuf   2624       0     243           0       0       2     637632        0
        malloc-256    256    2237      43        2491       0      62     583680        0
               md3      1  524296       8      524296       0     254     524304        0
               md2      1  524296       8      524296       0     254     524304        0
               md1      1  524296       8      524296       0     254     524304        0
               md0      1  524296       8      524296       0     254     524304        0
          lkpicurr    168       2    3094           2       0      62     520128        0
      malloc-16384  16384      26       3         206       0       1     475136        0
           tcp_log    416     573     471       38771       0      83     434304        0
            THREAD   1860     211      13         550       0       8     416640        0
         malloc-64     64    5025     141        5174       0     254     330624        0
       malloc-4096   4096      75       1        1048       0       2     311296        0
         VM OBJECT    248    1143     105       16037       0      62     309504        0
         malloc-16     16   18597     653       19103       0     254     308000        0
             VNODE    440     578      88         829       0      30     293040        0
         UMA Zones    768     315       4         316       0      16     244992        0
         malloc-32     32    7254     180        7419       0     254     237888        0
      malloc-32768  32768       7       0           7       0       1     229376        0
       malloc-2048   2048     110       2         232       0       8     229376        0
     FPU_save_area    832     213      30         691       0      16     202176        0
      malloc-65536  65536       3       0           3       0       1     196608        0
            lkpimm     56       1    3095           1       0     254     173376        0
        malloc-128    128    1164     107       25654       0     126     162688        0
         MAP ENTRY     96    1457     181       52338       0     126     157248        0
         malloc-32     32    4491     171        6713       0     254     149184        0
       FFS2 dinode    256     538      32         786       0      62     145920        0
            DEVCTL   1024      36     100         162       0       0     139264        0
       malloc-1024   1024     130       2         160       0      16     135168        0
       S VFS Cache    104    1007     280        1291       0     126     133848        0
      malloc-65536  65536       2       0           2       0       1     131072        0
              PROC   1376      73      15        1046       0       8     121088        0
          UMA Kegs    384     301       2         302       0      30     116352        0
        malloc-256    256     308     127        1180       0      62     111360        0
         filedesc0   1072      73      11        1058       0       8      90048        0
        malloc-128    128     499      90         556       0     126      75392        0
       malloc-8192   8192       9       0          22       0       1      73728        0
         64 Bucket    512       8     128        5951       0      30      69632        0
         malloc-64     64     117     954       41196       0     254      68544        0
            socket   1024      46      18        1706       0      73      65536        0
        malloc-256    256      48     207        2035       0      62      65280        0
        malloc-128    128     330     166        1138       0     126      63488        0
        malloc-256    256     163      77        1246       0      62      61440        0
         malloc-64     64     683     262        3141       0     254      60480        0
         malloc-64     64     513     306        1561       0     254      52416        0
       malloc-4096   4096      12       0          98       0       2      49152        0
        malloc-384    384      52      68         970       0      30      46080        0
            pcpu-8      8    5298     334        5588       0     254      45056        0
         TURNSTILE    136     225      90         225       0      62      42840        0
       malloc-8192   8192       5       0           5       0       1      40960        0
           VMSPACE    584      44      26        1015       0      16      40880        0
         tcp_inpcb   1304      15      15         105       0       8      39120        0
        malloc-384    384      91       9          94       0      30      38400        0
      mbuf_cluster   2048      12       6         512       0      67      36864        0
       malloc-2048   2048      17       1          50       0       8      36864        0
           pcpu-64     64     503      73         503       0     254      36864        0
         udp_inpcb    408       7      83         215       0      30      36720        0
      malloc-16384  16384       2       0           2       0       1      32768        0
       malloc-8192   8192       4       0          87       0       1      32768        0
       malloc-2048   2048      13       3          44       0       8      32768        0
           sctp_ep   1152       8      20          59       0      67      32256        0
              PGRP    120      23     241          51       0     126      31680        0
        256 Bucket   2048       7       7       22083       0       8      28672        0
         malloc-64     64     289     152       14744       0     254      28224        0
            ttyinq    160     135      40         570       0      62      28000        0
           ttyoutq    256      72      33         304       0      62      26880        0
        malloc-384    384      53      17          78       0      30      26880        0
        malloc-256    256      50      55         331       0      62      26880        0
        malloc-256    256      52      53         153       0      62      26880        0
        malloc-256    256      21      84         818       0      62      26880        0
         32 Bucket    256      11      94        1225       0      62      26880        0
        SLEEPQUEUE     88     225      63         225       0     126      25344        0
           DIRHASH   1024      19       5          36       0      16      24576        0
       malloc-8192   8192       3       0           3       0       1      24576        0
              pipe    736      18      15         331       0      16      24288        0
             Files     80     164     136        8219       0     126      24000        0
        malloc-128    128      96      90         947       0     126      23808        0
        malloc-128    128     115      71         147       0     126      23808        0
             ripcb    376       7      53          52       0      30      22560        0
       Mountpoints   2816       2       6           4       0       4      22528        0
       malloc-2048   2048       6       4         526       0       8      20480        0
       malloc-1024   1024      20       0        1075       0      16      20480        0
       malloc-1024   1024      19       1        2161       0      16      20480        0
         malloc-64     64     117     198         150       0     254      20160        0
        malloc-128    128      51     104         215       0     126      19840        0
        malloc-128    128      36     119        3655       0     126      19840        0
        malloc-384    384      34      16          99       0      30      19200        0
        malloc-384    384      23      27         566       0      30      19200        0
        malloc-256    256      20      55        1273       0      62      19200        0
             NAMEI   1024       1      15       14465       0      16      16384        0
      malloc-16384  16384       1       0           1       0       1      16384        0
      malloc-16384  16384       1       0         191       0       1      16384        0
       malloc-8192   8192       2       0           2       0       1      16384        0
       malloc-8192   8192       2       0          30       0       1      16384        0
       malloc-2048   2048       6       2          17       0       8      16384        0
               PWD     40      25     379         231       0     254      16160        0
          ksiginfo    112      68      76         150       0     126      16128        0
          rl_entry     48      14     322          19       0     254      16128        0
         malloc-64     64      11     241         207       0     254      16128        0
         malloc-64     64      24     228        1779       0     254      16128        0
         malloc-32     32      72     432         481       0     254      16128        0
         malloc-32     32      49     455         486       0     254      16128        0
         malloc-32     32     158     346        4069       0     254      16128        0
         malloc-32     32     175     329         806       0     254      16128        0
         malloc-32     32      40     464        2683       0     254      16128        0
     routing nhops    256      31      29          38       0      62      15360        0
        128 Bucket   1024       3      12         298       0      16      15360        0
            cpuset    200       9      55          65       0      62      12800        0
       malloc-4096   4096       3       0           3       0       2      12288        0
       malloc-4096   4096       2       1          82       0       2      12288        0
       malloc-4096   4096       3       0         237       0       2      12288        0
       malloc-1024   1024       4       8          69       0      16      12288        0
       malloc-1024   1024      11       1         519       0      16      12288        0
       malloc-1024   1024      10       2          62       0      16      12288        0
        malloc-512    512      10      14          40       0      30      12288        0
           rtentry    168      34      38          38       0      62      12096        0
         malloc-16     16      20     730         275       0     254      12000        0
         malloc-16     16      44     706         367       0     254      12000        0
         malloc-16     16      53     697         126       0     254      12000        0
         malloc-16     16     245     505        4759       0     254      12000        0
         malloc-16     16     309     441         334       0     254      12000        0
         malloc-16     16      20     730       24819       0     254      12000        0
             unpcb    320       9      27        1215       0      83      11520        0
         sctp_asoc   2256       2       3           7       0      64      11280        0
     udplite_inpcb    408       0      27           8       0      30      11016        0
              vmem   1856       2       3           2       0       8       9280        0
       malloc-8192   8192       1       0          63       0       1       8192        0
       malloc-8192   8192       1       0           2       0       1       8192        0
       malloc-2048   2048       4       0          60       0       8       8192        0
       malloc-2048   2048       2       2         575       0       8       8192        0
       malloc-2048   2048       2       2         195       0       8       8192        0
       malloc-1024   1024       5       3         163       0      16       8192        0
        malloc-512    512       2      14          16       0      30       8192        0
        malloc-512    512       2      14          37       0      30       8192        0
           pcpu-16     16       8     504           8       0     254       8192        0
        sctp_raddr    736       2       9           7       0      73       8096        0
       tcp_bbr_pcb    896       1       8           8       0      16       8064        0
         hostcache     64       3     123           3       0     254       8064        0
              ertt     72      15      97         105       0     126       8064        0
         16 Bucket    144       3      53         401       0      62       8064        0
         malloc-16     16       4     496        3457       0     254       8000        0
          8 Bucket     80       5      95         476       0     126       8000        0
       tcp_bbr_map    128       3      59        2010       0     126       7936        0
              kenv    258      17      13        1074       0      30       7740        0
       L VFS Cache    320       2      22          10       0      30       7680        0
        malloc-384    384       7      13           7       0      30       7680        0
 epoch_record pcpu    256       4      12           4       0      62       4096        0
       malloc-1024   1024       2       2          26       0      16       4096        0
        malloc-512    512       5       3          24       0      30       4096        0
        malloc-512    512       5       3          96       0      30       4096        0
        malloc-512    512       1       7           2       0      30       4096        0
arc_buf_hdr_t_full    368       4       7           4       0      30       4048        0
 tcp_log_id_bucket    176       1      22           1       0      62       4048        0
    ertt_txseginfo     40       1     100       43153       0     254       4040        0
        sctp_laddr     48       5      79          27       0     254       4032        0
         malloc-32     32      11     115          84       0     254       4032        0
      vtnet_tx_hdr     24       0     167       44370       0     254       4008        0
             KNOTE    160       2      23          68       0      62       4000        0
   tcp_log_id_node    120       1      32           1       0     126       3960        0
        sctp_readq    152       1      25           2       0     107       3952        0
        sctp_chunk    152       1      25           9       0     107       3952        0
               AIO    208       2      17          28       0      62       3952        0
            itimer    352       2       9           3       0      30       3872        0
       UMA Slabs 1    176      10      12          10       0      62       3872        0
            splice    184       1      20           4       0      62       3864        0
            mqnode    416       3       6           3       0      30       3744        0
        KMAP ENTRY     96      15      24          57       0       0       3744        0
       mbuf_packet    256      12       0         347       0     254       3072        0
           SMR CPU     32       8      87           8       0     254       3040        0
        SMR SHARED     24       8      87           8       0     254       2280        0
   zfs_znode_cache    464       0       0           0       0      30          0        0
zap_attr_long_cache   1056       0       0           0       0       8          0        0
     zap_name_long   1096       0       0           0       0       8          0        0
    zap_attr_cache    288       0       0           0       0      30          0        0
          zap_name    328       0       0           0       0      30          0        0
       sio_cache_2    168       0       0           0       0      62          0        0
       sio_cache_1    152       0       0           0       0      62          0        0
       sio_cache_0    136       0       0           0       0      62          0        0
     zil_zcw_cache     80       0       0           0       0     126          0        0
     zil_lwb_cache    376       0       0           0       0      30          0        0
dbuf_dirty_record_t    368       0       0           0       0      30          0        0
    dmu_buf_impl_t    376       0       0           0       0      30          0        0
         arc_buf_t     32       0       0           0       0     254          0        0
arc_buf_hdr_t_l2only     96       0       0           0       0     126          0        0
           dnode_t    968       0       0           0       0      16          0        0
          sa_cache    272       0       0           0       0      30          0        0
         abd_chunk   4096       0       0           0       0       2          0        0
zio_buf_comb_16777216 16777216       0       0           0       0       1          0        0
zio_buf_comb_12582912 12582912       0       0           0       0       1          0        0
zio_buf_comb_8388608 8388608       0       0           0       0       1          0        0
zio_buf_comb_6291456 6291456       0       0           0       0       1          0        0
zio_buf_comb_4194304 4194304       0       0           0       0       1          0        0
zio_buf_comb_3145728 3145728       0       0           0       0       1          0        0
zio_buf_comb_2097152 2097152       0       0           0       0       1          0        0
zio_buf_comb_1572864 1572864       0       0           0       0       1          0        0
zio_buf_comb_1048576 1048576       0       0          15       0       1          0        0
zio_buf_comb_786432 786432       0       0           0       0       1          0        0
zio_buf_comb_524288 524288       0       0           0       0       1          0        0
zio_buf_comb_393216 393216       0       0           0       0       1          0        0
zio_buf_comb_262144 262144       0       0           0       0       1          0        0
zio_buf_comb_196608 196608       0       0           0       0       1          0        0
zio_buf_comb_131072 131072       0       0           1       0       1          0        0
zio_buf_comb_98304  98304       0       0           0       0       1          0        0
zio_buf_comb_65536  65536       0       0           0       0       1          0        0
zio_buf_comb_49152  49152       0       0           0       0       1          0        0
zio_buf_comb_32768  32768       0       0           0       0       1          0        0
zio_buf_comb_24576  24576       0       0           0       0       1          0        0
zio_data_buf_16384  16384       0       0           9       0       1          0        0
     zio_buf_16384  16384       0       0          10       0       1          0        0
zio_data_buf_12288  12288       0       0           0       0       1          0        0
     zio_buf_12288  12288       0       0           0       0       1          0        0
 zio_data_buf_8192   8192       0       0           0       0       1          0        0
      zio_buf_8192   8192       0       0           0       0       1          0        0
 zio_data_buf_6144   6144       0       0           0       0       1          0        0
      zio_buf_6144   6144       0       0           0       0       1          0        0
 zio_data_buf_4096   4096       0       0           0       0       2          0        0
      zio_buf_4096   4096       0       0           0       0       2          0        0
 zio_data_buf_3072   3072       0       0           0       0       4          0        0
      zio_buf_3072   3072       0       0           0       0       4          0        0
 zio_data_buf_2048   2048       0       0           0       0       8          0        0
      zio_buf_2048   2048       0       0           0       0       8          0        0
 zio_data_buf_1536   1536       0       0           0       0       8          0        0
      zio_buf_1536   1536       0       0           0       0       8          0        0
 zio_data_buf_1024   1024       0       0           0       0      16          0        0
      zio_buf_1024   1024       0       0           0       0      16          0        0
  zio_data_buf_512    512       0       0           0       0      30          0        0
       zio_buf_512    512       0       0           0       0      30          0        0
    zio_link_cache     48       0       0           0       0     254          0        0
         zio_cache   1216       0       0           0       0       8          0        0
ddt_log_entry_trad_cache    328       0       0           0       0      30          0        0
ddt_log_entry_flat_cache    144       0       0           0       0      62          0        0
ddt_entry_trad_cache    368       0       0           0       0      30          0        0
ddt_entry_flat_cache    184       0       0           0       0      62          0        0
         ddt_cache  29240       0       0           0       0       1          0        0
   brt_entry_cache    168       0       0           0       0      62          0        0
metaslab_alloc_trace_cache     72       0       0           0       0     126          0        0
zfs_btree_leaf_cache   4096       0       0           0       0       2          0        0
   reference_cache     48       0       0           0       0     254          0        0
        taskq_zone    160       0       0           0       0      62          0        0
      ktls_session    256       0       0           1       0      62          0        0
       FFS1 dinode    128       0       0           0       0     126          0        0
            da_ccb    544       0       0        3107       0      16          0        0
           ada_ccb    272       0       0           0       0      30          0        0
             swblk    136       0       0           0       0      62          0        0
          swpctrie    152       0       0           0       0      62          0        0
   cdg_qdiffsample     16       0       0           6       0     254          0        0
   pf state scrubs     40       0       0           0       0     254          0        0
   pf frag entries     40       0       0           0       0     254          0        0
  pf fragment node     72       0       0           0       0     126          0        0
          pf frags    232       0       0           0       0      62          0        0
  pf table entries    160       0       0           0       0     107          0        0
pf table entry counters     64       0       0           0       0     254          0        0
   pf UDP mappings    104       0       0           0       0     126          0        0
   pf source nodes    152       0       0           0       0     107          0        0
     pf state keys     88       0       0           0       0     126          0        0
         pf states    384       0       0           0       0      83          0        0
           pf tags    104       0       0           0       0     126          0        0
          pf mtags    184       0       0           0       0      62          0        0
      tcp_rack_pcb   1088       0       0           1       0       8          0        0
      tcp_rack_map    128       0       0           0       0     126          0        0
tfo_ccache_entries     80       0       0           0       0     126          0        0
               tfo      4       0       0           0       0     254          0        0
          sackhole     32       0       0           0       0     254          0        0
          syncache    168       0       0           3       0     107          0        0
               ipq     56       0       0           1       0     254          0        0
   sctp_asconf_ack     48       0       0           0       0     254          0        0
       sctp_asconf     40       0       0           0       0     254          0        0
sctp_stream_msg_out    112       0       0           2       0     155          0        0
          tcpreass     48       0       0           0       0     254          0        0
    IPsec SA lft_c     16       0       0           0       0     254          0        0
            AIOLIO    272       0       0           6       0      30          0        0
             AIOCB    552       0       0          46       0      16          0        0
        mqnotifier    216       0       0           0       0      62          0        0
            mvdata     64       0       0           0       0     254          0        0
            mqueue    248       0       0           0       0      62          0        0
        TMPFS node    240       0       0           0       0      62          0        0
           NCLNODE    608       0       0           0       0      16          0        0
     LTS VFS Cache    360       0       0           0       0      30          0        0
     STS VFS Cache    144       0       0           0       0      62          0        0
           cryptop    280       0       0           4       0      30          0        0
  linux_dma_object     32       0       0           0       0     254          0        0
  linux_dma_pctrie    152       0       0           0       0      62          0        0
             g_bio    408       0       0       11836       0      30          0        0
   IOMMU_MAP_ENTRY    112       0       0           0       0     126          0        0
            skbuff   1808       0       0           0       0       8          0        0
    mbuf_jumbo_16k  16384       0       0           0       0      61          0        0
     mbuf_jumbo_9k   9216       0       0           0       0      61          0        0
      audit_record   1280       0       0           0       0       8          0        0
         domainset     40       0       0          48       0     254          0        0
        MAC labels     40       0       0           0       0     254          0        0
            clpbuf   2624       0       0         105       0       4          0        0
            vnpbuf   2624       0       0           2       0       4          0        0
           nfspbuf   2624       0       0           0       0       4          0        0
            swwbuf   2624       0       0           0       0       2          0        0
            swrbuf   2624       0       0           0       0       4          0        0
          umtx_shm     88       0       0           0       0     126          0        0
           umtx pi     96       0       0           0       0     126          0        0
rangeset pctrie nodes    152       0       0           0       0      62          0        0
      malloc-65536  65536       0       0           0       0       1          0        0
      malloc-65536  65536       0       0          67       0       1          0        0
      malloc-65536  65536       0       0         110       0       1          0        0
      malloc-65536  65536       0       0           0       0       1          0        0
      malloc-65536  65536       0       0           8       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
      malloc-32768  32768       0       0          19       0       1          0        0
      malloc-32768  32768       0       0          21       0       1          0        0
      malloc-32768  32768       0       0         120       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
      malloc-32768  32768       0       0         266       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
      malloc-16384  16384       0       0           0       0       1          0        0
      malloc-16384  16384       0       0           0       0       1          0        0
      malloc-16384  16384       0       0           0       0       1          0        0
      malloc-16384  16384       0       0           0       0       1          0        0
       malloc-4096   4096       0       0           3       0       2          0        0
        malloc-512    512       0       0         113       0      30          0        0
        malloc-512    512       0       0          41       0      30          0        0
        malloc-384    384       0       0           0       0      30          0        0
           pcpu-32     32       0       0           0       0     254          0        0
            pcpu-4      4       0       0           0       0     254          0        0
            fakepg     88       0       0           0       0     126          0        0
          4 Bucket     48       0       0          16       0     254          0        0
          2 Bucket     32       0       0        2611       0     254          0        0
          UMA Hash    256       0       0           0       0      62          0        0
db> show all tcpcbs/bl

Crashes (3):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2025/08/01 08:47 freebsd-src f61c48f4403f 8e9d1dc1 console log report ci-freebsd-main panic: inconsistent boundary count NUM
2025/06/25 13:08 freebsd-src eab94b59a774 26d77996 console log report ci-freebsd-main panic: inconsistent boundary count NUM
2025/04/18 21:36 freebsd-src 7121e9414f29 2a20f901 console log report ci-freebsd-main panic: inconsistent boundary count NUM
* Struck through repros no longer work on HEAD.