syzbot


panic: /syzkaller/managers/main/kernel/sys/netinet/in_pcb.c:LINE: in_pcblbgroup_insert: Bad list head ADDR first->prev !

Status: upstream: reported on 2025/05/04 09:46
Reported-by: syzbot+880f3a35135a853c89b2@syzkaller.appspotmail.com
First crash: 27d, last: 16d

Sample crash report:
panic: /syzkaller/managers/main/kernel/sys/netinet/in_pcb.c:341: in_pcblbgroup_insert: Bad list head 0xfffffe00546e5610 first->prev != head
cpuid = 0
time = 2
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0xc6/frame 0xfffffe005784c610
kdb_backtrace() at kdb_backtrace+0xd0/frame 0xfffffe005784c770
vpanic() at vpanic+0x257/frame 0xfffffe005784c930
panic() at panic+0xb5/frame 0xfffffe005784ca00
in_pcblbgroup_insert() at in_pcblbgroup_insert+0x1f8/frame 0xfffffe005784ca40
in_pcbinslbgrouphash() at in_pcbinslbgrouphash+0x576/frame 0xfffffe005784cab0
in_pcbinshash() at in_pcbinshash+0x414/frame 0xfffffe005784cb20
in_pcbbind() at in_pcbbind+0x19d/frame 0xfffffe005784cb70
tcp_usr_bind() at tcp_usr_bind+0x271/frame 0xfffffe005784cbc0
sobind() at sobind+0xc3/frame 0xfffffe005784cc10
kern_bindat() at kern_bindat+0x2c6/frame 0xfffffe005784ccd0
sys_bind() at sys_bind+0xf5/frame 0xfffffe005784cd10
amd64_syscall() at amd64_syscall+0x4af/frame 0xfffffe005784cf30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe005784cf30
--- syscall (198, FreeBSD ELF64, __syscall), rip = 0x3a197a, rsp = 0x823897f08, rbp = 0x823897f80 ---
KDB: enter: panic
[ thread pid 1110 tid 100660 ]
Stopped at      kdb_enter+0x6e: movq    $0,0x25bda37(%rip)
db> 
db> set $lines = 0
db> set $maxwidth = 0
db> show registers
cs                        0x20
ds                        0x3b
es                        0x3b
fs                        0x13
gs                        0x1b
ss                        0x28
rax                       0x12
rcx         0xfffffe006ec00000
rdx                    0x7ffff
rbx         0xffffffff827b0020  .str.27
rsp         0xfffffe005784c750
rbp         0xfffffe005784c770
rsi                    0x80001
rdi         0xffffffff816145e9  printf+0x149
r8                           0
r9                  0xffffffff
r10                          0
r11         0xfffffe00549a7c60
r12         0xfffffe00549a7740
r13         0xfffffffffffffffe
r14         0xffffffff827b0020  .str.27
r15                          0
rip         0xffffffff815fe75e  kdb_enter+0x6e
rflags                    0x46
kdb_enter+0x6e: movq    $0,0x25bda37(%rip)
db> show proc
Process 1110 (syz-executor) at 0xfffffe0054990580:
 state: NORMAL
 uid: 0  gids: 0, 0, 5
 parent: pid 764 at 0xfffffe00548cc000
 ABI: FreeBSD ELF64
 flag: 0x10000080  flag2: 0
 arguments: ./syz-executor exec
 reaper: 0xfffffe0008009040 reapsubtree: 1
 sigparent: 20
 vmspace: 0xfffffe00549b2248
   (map 0xfffffe00549b2248)
   (map.pmap 0xfffffe00549b22e8)
   (pmap 0xfffffe00549b2358)
 threads: 2
100543                   RunQ                                syz-executor
100660                   Run     CPU 0                       syz-executor
db> ps
  pid  ppid  pgrp   uid  state   wmesg   wchan               cmd
 1110   764   764     0  R       (threaded)                  syz-executor
100543                   RunQ                                syz-executor
100660                   Run     CPU 0                       syz-executor
 1108  1103  1103     0  S       uwait   0xfffffe0007f7e700  syz-executor
 1107  1103   765     0  S       uwait   0xfffffe006eb5ed80  syz-executor
 1103   765  1103     0  Rs      (threaded)                  syz-executor
100578                   D       vm map  0xfffffe005499c738  syz-executor
100647                   S       pipdwt  0xfffffe005a04a420  syz-executor
100649                   S       pipdwt  0xfffffe0078dbf9e0  syz-executor
100652                   RunQ                                syz-executor
100655                   S       uwait   0xfffffe0058d0ab80  syz-executor
 1102   767   767     0  T       (threaded)                  syz-executor
100454                   s                                   syz-executor
100646                   D       biowr   0xfffffe00086a67f8  syz-executor
100648                   D       ranged1 0xfffffe00791cef50  syz-executor
 1099  1095  1095     0  S       uwait   0xfffffe006eb60280  syz-executor
 1095   766  1095     0  Rs      (threaded)                  syz-executor
100610                   RunQ                                syz-executor
100636                   S       pipdwt  0xfffffe0078dbf420  syz-executor
100638                   S       pipdwt  0xfffffe0078dbf700  syz-executor
100640                   S       uwait   0xfffffe00781ab180  syz-executor
100658                   S       uwait   0xfffffe005894f300  syz-executor
 1092     1   766     0  S       uwait   0xfffffe006eb5ea80  syz-executor
 1090     1   764     0  S       uwait   0xfffffe006eb5fa80  syz-executor
 1084     1   765     0  SV      uwait   0xfffffe0058952980  syz-executor
 1069     1  1063     0  S       uwait   0xfffffe006eb5f800  syz-executor
 1068     1  1062     0  S       uwait   0xfffffe006eb5fb80  syz-executor
 1067     1   766     0  S       uwait   0xfffffe005894f380  syz-executor
 1061     1  1059     0  S       uwait   0xfffffe005894f780  syz-executor
 1055     1   764     0  S       uwait   0xfffffe005894fa80  syz-executor
 1054     1   767     0  S       uwait   0xfffffe0058d07e00  syz-executor
 1042     1   765     0  S       uwait   0xfffffe0058d08000  syz-executor
 1039     1  1034     0  S       uwait   0xfffffe006eb5f400  syz-executor
 1033     1  1033     0  S       uwait   0xfffffe006eb5f000  syz-executor
 1024     1   764     0  S       uwait   0xfffffe0058952500  syz-executor
 1021     1   765     0  S       uwait   0xfffffe00781abe80  syz-executor
 1017     1  1013     0  S       uwait   0xfffffe0058952a80  syz-executor
 1008     1   764     0  S       uwait   0xfffffe006eb5f100  syz-executor
 1004     0     0     0  DL      -       0xffffffff83cad400  [soaiod4]
 1003     0     0     0  DL      -       0xffffffff83cad400  [soaiod3]
 1002     0     0     0  DL      -       0xffffffff83cad400  [soaiod2]
 1001     0     0     0  DL      -       0xffffffff83cad400  [soaiod1]
  995     1   765     0  SV      sigwait 0xfffffe0054959b70  syz-executor
  984     1   982     0  S       uwait   0xfffffe0058d07b00  syz-executor
  979     1   766     0  S       uwait   0xfffffe006eb5ff00  syz-executor
  966     0     0     0  DL      (threaded)                  [so_splice]
100214                   D       -       0xfffffe0058e3c900  [thr_0]
100382                   D       -       0xfffffe0058e3c940  [thr_1]
  964     1   962     0  S       uwait   0xfffffe0058d07500  syz-executor
  961     1   764     0  S       uwait   0xfffffe005894fa00  syz-executor
  959     1   956     0  S       uwait   0xfffffe00781ab400  syz-executor
  958     1   765     0  S       uwait   0xfffffe00781ab800  syz-executor
  948     0     0     0  DL      mdwait  0xfffffe0078711000  [md2]
  943     0     0     0  DL      mdwait  0xfffffe005a101000  [md1]
  940     1   765     0  S       uwait   0xfffffe006eb60480  syz-executor
  939     1   933     0  S       uwait   0xfffffe0058d07000  syz-executor
  935     1   767     0  S       uwait   0xfffffe00781ab700  syz-executor
  931     1   764     0  S       uwait   0xfffffe0058d08980  syz-executor
  930     1   764     0  S       uwait   0xfffffe0058952e80  syz-executor
  921     1   914     0  S       uwait   0xfffffe0058952600  syz-executor
  920     1   765     0  S       uwait   0xfffffe0007f7e580  syz-executor
  912     1   766     0  S       uwait   0xfffffe006eb60080  syz-executor
  903     1   765     0  S       uwait   0xfffffe0058d08100  syz-executor
  902     1   899     0  S       uwait   0xfffffe00781ab580  syz-executor
  901     1   767     0  S       uwait   0xfffffe0058d07b80  syz-executor
  898     1   896     0  S       uwait   0xfffffe006eb60a00  syz-executor
  897     1   764     0  S       uwait   0xfffffe0058d08900  syz-executor
  895     1   764     0  S       uwait   0xfffffe006eb60600  syz-executor
  893     1   767     0  S       uwait   0xfffffe0058952700  syz-executor
  892     1   765     0  S       uwait   0xfffffe00781ac300  syz-executor
  883     1   765     0  S       uwait   0xfffffe0058d09100  syz-executor
  879     1   767     0  S       uwait   0xfffffe005894f080  syz-executor
  878     1   766     0  S       uwait   0xfffffe0058952d80  syz-executor
  870     1   765     0  S       uwait   0xfffffe006eb61380  syz-executor
  868     1   766     0  SV      uwait   0xfffffe006eb60400  syz-executor
  866     1   765     0  S       uwait   0xfffffe00781abd80  syz-executor
  861     1   766     0  S       uwait   0xfffffe006eb60b00  syz-executor
  860     1   766     0  S       uwait   0xfffffe00781ac000  syz-executor
  856     1   765     0  S       uwait   0xfffffe0058952300  syz-executor
  848     1   766     0  S       uwait   0xfffffe0058952200  syz-executor
  847     1   765     0  S       uwait   0xfffffe006eb60700  syz-executor
  845     1   766     0  S       uwait   0xfffffe0007f7e680  syz-executor
  844     1   767     0  S       uwait   0xfffffe0058d08400  syz-executor
  840     1   838     0  S       uwait   0xfffffe00781ac400  syz-executor
  839     1   764     0  S       uwait   0xfffffe0058d09000  syz-executor
  837     1   764     0  S       uwait   0xfffffe0058952b80  syz-executor
  836     1   765     0  S       uwait   0xfffffe0058952c80  syz-executor
  835     1   764     0  S       umtxn   0xfffffe0007f7e380  syz-executor
  833     1   765     0  S       uwait   0xfffffe0007f7ee00  syz-executor
  830     1   827     0  S       uwait   0xfffffe005894fd80  syz-executor
  829     1   767     0  S       uwait   0xfffffe0007f7ef00  syz-executor
  826     1   766     0  S       uwait   0xfffffe0058d08600  syz-executor
  824     0     0     0  DL      aiordy  0xfffffe005490a5a0  [aiod4]
  823     0     0     0  DL      aiordy  0xfffffe0054902040  [aiod3]
  822     0     0     0  DL      aiordy  0xfffffe005490ab00  [aiod2]
  821     0     0     0  DL      aiordy  0xfffffe00548ceb00  [aiod1]
  820     1   766     0  S       uwait   0xfffffe0058d08800  syz-executor
  819   807   819     0  Ss      select  0xfffffe006eb6e7c0  dhclient
  818     0     0     0  DL      mdwait  0xfffffe005a102000  [md0]
  814     1   814     0  Ss      select  0xfffffe0059ea9bc0  dhclient
  807   786   424    65  S       select  0xfffffe0059ea9c40  dhclient
  786   424   424     0  S       wait    0xfffffe0054900560  sh
  767   763   767     0  S       nanslp  0xffffffff83b9d500  syz-executor
  766   763   766     0  S       nanslp  0xffffffff83b9d500  syz-executor
  765   763   765     0  S       nanslp  0xffffffff83b9d501  syz-executor
  764   763   764     0  S       nanslp  0xffffffff83b9d500  syz-executor
  763   761   761     0  S       select  0xfffffe0059ea9cc0  syz-executor
  761   759   761     0  Ss      pause   0xfffffe00548cc610  csh
  759   682   759     0  Ss      select  0xfffffe0059ea9d40  sshd
  748     1   748     0  Ss+     ttyin   0xfffffe0058a9c8b0  getty
  747     1   747     0  Ss+     ttyin   0xfffffe0059cec0b0  getty
  746     1   746     0  Ss+     ttyin   0xfffffe0059cec8b0  getty
  745     1   745     0  Ss+     ttyin   0xfffffe005476d0b0  getty
  744     1   744     0  Ss+     ttyin   0xfffffe0058aa04b0  getty
  743     1   743     0  Ss+     ttyin   0xfffffe005476d8b0  getty
  742     1   742     0  Ss+     ttyin   0xfffffe005476e0b0  getty
  741     1   741     0  Ss+     ttyin   0xfffffe005476e8b0  getty
  740     1   740     0  Ss+     ttyin   0xfffffe00547700b0  getty
  738     1    18     0  S+      piperd  0xfffffe005a058420  logger
  737   736    18     0  S+      nanslp  0xffffffff83b9d500  sleep
  736     1    18     0  S+      wait    0xfffffe0054807020  sh
  686     1   686     0  Ss      nanslp  0xffffffff83b9d501  cron
  682     1   682     0  Ss      select  0xfffffe006e3df640  sshd
  495     1   495     0  Ss      select  0xfffffe006e3dfd40  syslogd
  424     1   424     0  Ss      wait    0xfffffe0054806ac0  devd
  423     1   423    65  Ss      select  0xfffffe006e3dfdc0  dhclient
  338     1   338     0  Ss      select  0xfffffe006e3df3c0  dhclient
  335     1   335     0  Ss      select  0xfffffe006e3df540  dhclient
   17     0     0     0  DL      syncer  0xffffffff83cbada0  [syncer]
   16     0     0     0  DL      vlruwt  0xfffffe0008028040  [vnlru]
   15     0     0     0  DL      (threaded)                  [bufdaemon]
100080                   D       psleep  0xffffffff83cb9360  [bufdaemon]
100081                   D       -       0xffffffff83002140  [bufspacedaemon-0]
100092                   D       sdflush 0xfffffe0058ddfce8  [/ worker]
    9     0     0     0  DL      psleep  0xffffffff83d04380  [vmdaemon]
    8     0     0     0  DL      (threaded)                  [pagedaemon]
100078                   D       psleep  0xffffffff83cea2f8  [dom0]
100082                   D       launds  0xffffffff83cea304  [laundry: dom0]
100083                   D       umarcl  0xffffffff81dcf0a0  [uma]
    7     0     0     0  DL      -       0xffffffff8391acd0  [rand_harvestq]
    6     0     0     0  DL      pftm    0xffffffff84856850  [pf purge]
    5     0     0     0  DL      waiting 0xffffffff84725700  [sctp_iterator]
    4     0     0     0  DL      (threaded)                  [cam]
100046                   D       -       0xffffffff838e5340  [doneq0]
100047                   D       -       0xffffffff838e52c0  [async]
100076                   D       -       0xffffffff838e5140  [scanner]
    3     0     0     0  DL      (threaded)                  [crypto]
100043                   D       crypto_ 0xffffffff83ce5b40  [crypto]
100044                   D       crypto_ 0xfffffe0058566330  [crypto returns 0]
100045                   D       crypto_ 0xfffffe0058566380  [crypto returns 1]
   14     0     0     0  DL      seqstat 0xfffffe00547edc88  [sequencer 00]
   13     0     0     0  DL      (threaded)                  [geom]
100037                   D       -       0xffffffff83b45f00  [g_event]
100038                   D       -       0xffffffff83b45f20  [g_up]
100039                   D       -       0xffffffff83b45f40  [g_down]
    2     0     0     0  RL      (threaded)                  [clock]
100031                   I                                   [clock (0)]
100032                   Run     CPU 1                       [clock (1)]
   12     0     0     0  WL      (threaded)                  [intr]
100013                   I                                   [swi6: task queue]
100014                   I                                   [swi6: Giant taskq]
100016                   I                                   [swi5: fast taskq]
100033                   I                                   [swi1: netisr 0]
100034                   I                                   [swi1: hpts]
100035                   I                                   [swi1: hpts]
100048                   I                                   [irq24: virtio_pci0]
100049                   I                                   [irq25: virtio_pci0]
100050                   I                                   [irq26: virtio_pci0]
100051                   I                                   [irq27: virtio_pci0]
100052                   I                                   [irq28: virtio_pci1]
100053                   I                                   [irq29: virtio_pci1]
100054                   I                                   [irq30: virtio_pci1]
100055                   I                                   [irq31: virtio_pci1]
100056                   I                                   [irq32: virtio_pci1]
100061                   I                                   [irq10: virtio_pci2]
100063                   I                                   [irq1: atkbd0]
100064                   I                                   [irq12: psm0]
100065                   I                                   [swi0: uart uart++]
100069                   I                                   [swi1: pf send]
   11     0     0     0  RL      (threaded)                  [idle]
100003                   CanRun                              [idle: cpu0]
100004                   CanRun                              [idle: cpu1]
    1     0     1     0  SLs     wait    0xfffffe0008009040  [init]
   10     0     0     0  DL      audit_w 0xffffffff83ce65e0  [audit]
    0     0     0     0  DLs     (threaded)                  [kernel]
100000                   D       parked  0xffffffff84c2cff0  [swapper]
100005                   D       -       0xfffffe005462d700  [softirq_0]
100006                   D       -       0xfffffe005462d600  [softirq_1]
100007                   D       -       0xfffffe005462d500  [if_io_tqg_0]
100008                   D       -       0xfffffe005462d400  [if_io_tqg_1]
100009                   D       -       0xfffffe005462d300  [if_config_tqg_0]
100010                   D       -       0xfffffe0008bf9500  [kqueue_ctx taskq]
100011                   D       -       0xfffffe0008bf9300  [jail_remove taskq]
100012                   D       -       0xfffffe0008bf9100  [bus taskq]
100015                   D       -       0xfffffe0008bf8a00  [thread taskq]
100017                   D       -       0xfffffe0008bf8600  [aiod_kick taskq]
100018                   D       -       0xfffffe0008bf8400  [deferred_unmount ta]
100019                   D       -       0xfffffe0008bf8200  [inm_free taskq]
100020                   D       -       0xfffffe0008bf8000  [in6m_free taskq]
100021                   D       -       0xfffffe0008bf7d00  [linuxkpi_irq_wq]
100022                   D       -       0xfffffe0008bf7b00  [linuxkpi_short_wq_0]
100023                   D       -       0xfffffe0008bf7b00  [linuxkpi_short_wq_1]
100024                   D       -       0xfffffe0008bf7b00  [linuxkpi_short_wq_2]
100025                   D       -       0xfffffe0008bf7b00  [linuxkpi_short_wq_3]
100026                   D       -       0xfffffe0008bf7600  [linuxkpi_long_wq_0]
100027                   D       -       0xfffffe0008bf7600  [linuxkpi_long_wq_1]
100028                   D       -       0xfffffe0008bf7600  [linuxkpi_long_wq_2]
100029                   D       -       0xfffffe0008bf7600  [linuxkpi_long_wq_3]
100036                   D       -       0xfffffe0008bf6a00  [firmware taskq]
100041                   D       -       0xfffffe0008bf6300  [crypto_0]
100042                   D       -       0xfffffe0008bf6300  [crypto_1]
100057                   D       -       0xfffffe0058565900  [vtnet0 rxq 0]
100058                   D       -       0xfffffe0058565800  [vtnet0 txq 0]
100059                   D       -       0xfffffe0058565700  [vtnet0 rxq 1]
100060                   D       -       0xfffffe0058565600  [vtnet0 txq 1]
100062                   D       vtbslp  0xfffffe005858d000  [virtio_balloon]
100066                   D       -       0xffffffff827b5361  [deadlkres]
100070                   D       -       0xfffffe0058d0dd00  [acpi_task_0]
100071                   D       -       0xfffffe0058d0dd00  [acpi_task_1]
100072                   D       -       0xfffffe0058d0dd00  [acpi_task_2]
100074                   D       -       0xfffffe0008bfa100  [mca taskq]
100075                   D       -       0xfffffe0058566000  [CAM taskq]
100077                   D       -       0xfffffe0058564400  [ipsec_offload]
100165                   D       -       0xfffffe006eb7ac00  [netlink_socket (PID]
100506                   D       -       0xfffffe006eb79c00  [netlink_socket (PID]
 1097  1095   766     0  Z                                   syz-executor
db> show all locks
Process 1110 (syz-executor) thread 0xfffffe00549a7740 (100660)
exclusive sleep mutex tcphash (tcphash) r = 0 (0xfffffe0008249a70) locked @ /syzkaller/managers/main/kernel/sys/netinet/tcp_usrreq.c:261
exclusive rw tcpinp (tcpinp) r = 0 (0xfffffe0078df6020) locked @ /syzkaller/managers/main/kernel/sys/netinet/tcp_usrreq.c:229
Process 1103 (syz-executor) thread 0xfffffe0054998000 (100652)
exclusive sleep mutex pmap (pmap) r = 0 (0xfffffe005499c7e8) locked @ /syzkaller/managers/main/kernel/sys/amd64/amd64/pmap.c:7253
shared sx vm map (user) (vm map (user)) r = 0 (0xfffffe005499c738) locked @ /syzkaller/managers/main/kernel/sys/vm/vm_map.c:4993
Process 1102 (syz-executor) thread 0xfffffe0054989740 (100646)
exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00086a6878) locked @ /syzkaller/managers/main/kernel/sys/kern/vfs_bio.c:1752
exclusive lockmgr ufs (ufs) r = 0 (0xfffffe00791cee30) locked @ /syzkaller/managers/main/kernel/sys/kern/vfs_vnops.c:1229
Process 1095 (syz-executor) thread 0xfffffe0054999740 (100610)
exclusive sx vm map (user) (vm map (user)) r = 0 (0xfffffe0054958738) locked @ /syzkaller/managers/main/kernel/sys/vm/vm_map.c:2808
db> show malloc
              Type        InUse        MemUse     Requests
           pf_hash            6        12804K            6
            linker          400         5458K          590
          tcp_hpts            7         4801K            7
         sctp_stro            4         4618K           11
            devbuf         4188         4324K         4216
         sysctloid        35125         2069K        35200
             vtbuf           24         1968K           46
              kobj          331         1324K          522
          filedesc          138         1099K          615
            newblk           53         1037K         3176
          vfscache            3         1025K            3
               pcb           63          706K          373
           subproc          287          579K         1268
          inodedep           22          520K          544
         ufs_quota            1          512K            1
          vfs_hash            1          512K            1
           callout            2          512K            2
              intr            4          472K            4
              vmem            5          272K            8
         vnet_data            2          224K            2
          acpitask            1          224K            1
            KTRACE          101          201K        82663
            acpica         1674          184K        54426
           tidhash            3          141K            3
        md_sectors           34          136K           34
           pagedep           12          131K          264
        tfo_ccache            1          128K            1
          IP reass            1          128K            1
           filemon           15          120K           89
            DEVFS1          112          112K          129
               sem            4          106K            4
        gtaskqueue           18           98K           18
               bus          997           82K         5063
          mtx_pool            3           74K            3
          syncache            1           68K            1
     NFSD srvcache            3           68K            3
            module          522           66K          523
       ddb_capture            1           64K            1
           kdtrace          344           62K         1772
              umtx          448           56K          448
              temp           37           38K         1982
               BPF           23           36K          101
               shm            2           34K           14
            DEVFS3          131           33K          141
         hostcache            1           32K            1
               msg            4           30K            4
            kbdmux            6           28K            6
        DEVFS_RULE           56           20K           56
            ifaddr           67           19K           69
               LRO           18           19K           18
         ufs_mount            4           17K            5
              proc            3           17K            3
               tty           16           16K           16
          routetbl          130           16K          410
           ithread           90           15K           90
            bus-sc           34           15K         1647
           lltable           44           14K           50
              GEOM           82           14K          570
      eventhandler          163           14K          163
           md_disk           37           14K           38
             ifnet            7           13K            7
       ether_multi          152           13K          222
              kenv           95           12K           95
             shmfd            7           11K           24
         CAM queue            5           11K         1528
              rman           82           10K          437
            plimit           25           10K          359
            kqueue          134           10K         1524
              ksem            4           10K            5
               rpc            8            9K            8
         in6_multi           65            9K           65
         bmsafemap            2            9K          458
           devstat            4            9K            4
           pwddesc          129            9K         1134
              UART           12            9K           12
              cred           32            8K          305
       pfs_vncache            1            8K            1
         taskqueue           75            8K          108
         sctp_atcl           20            8K          147
     audit_evclass          239            8K          301
            sglist            6            7K            6
           CAM DEV            3            6K          510
         pfs_nodes           22            6K           22
             mount           24            6K          630
           session           38            5K           54
       ufs_dirhash           24            5K           30
            DEVFSP           71            5K          284
               UMA          268            5K          268
          pf_ifnet           10            5K           19
      tcp_fsb_rack            2            5K           10
                vt           11            5K           11
           memdesc            1            4K            1
               MCA           32            4K           32
             evdev            4            4K            4
          freework           16            4K          781
         proc-args          147            4K         2144
           acpisem           28            4K           28
             selfd           48            3K        99622
             lockf           29            3K          144
          terminal           11            3K           11
            dirrem           10            3K          403
           acpidev           20            3K           20
           uidinfo            4            3K           19
             hhook            8            3K           10
            CC Mem           18            3K          191
             clone            9            3K           10
          kcovinfo           36            3K           36
           pf_rule            1            2K            1
        local_apic            1            2K            1
           io_apic            1            2K            1
         ipsec-saq            2            2K            2
            ip6ndp           12            2K           13
         sctp_timw            7            2K            7
            Unitno           28            2K           58
          sctp_ifa           13            2K           14
            crypto            5            2K           21
           CAM XPT           22            2K          543
          in_multi            6            2K           21
               tun            4            2K            4
         toponodes            6            2K            6
       ipsecpolicy            2            2K            2
            select           11            2K           51
       inpcbpolicy           38            2K          541
               msi            9            2K            9
           netlink            2            2K           83
           softdep            1            1K            1
            sahead            1            1K            1
          secasvar            1            1K            1
             nhops            6            1K            8
       vnodemarker            2            1K           30
      NFSD session            1            1K            1
         sctp_atky           24            1K          162
             mkdir            7            1K          470
            diradd            7            1K          422
        CAM periph            4            1K          271
         cryptodev           13            1K          156
               osd           23            1K          207
          sctp_ifn            6            1K           14
             ipsec            3            1K            3
         newdirblk            6            1K          235
          freeblks            3            1K          297
               mld            6            1K            6
              igmp            6            1K            6
              pfil            6            1K            6
            isadev            6            1K            6
          pci_link           10            1K           10
          freefile            5            1K          303
 encap_export_host           12            1K           12
            ip6opt            3            1K           34
          indirdep            2            1K          479
              cdev            2            1K            2
       lkpikmalloc            8            1K            9
    chacha20random            1            1K            1
            biobuf            1            1K            1
         sctp_athm           20            1K          149
      tcp_pcm_rack            1            1K            5
           VN POLL            2            1K            4
            vnodes            1            1K            3
          procdesc            2            1K            8
      NFSD lckfile            1            1K            1
     NFSD V4client            1            1K            1
             DEVFS            9            1K           10
           CAM SIM            2            1K            2
            feeder            7            1K            7
       ip6_msource            3            1K            5
             frag6            2            1K            2
           tcpfunc            3            1K            3
        ip_msource            3            1K           16
               iov            3            1K        15399
        loginclass            3            1K            5
            prison            6            1K            6
          sctp_map            8            1K           22
          nexusdev            8            1K            8
            apmdev            1            1K            1
          atkbddev            2            1K            2
       in6_mfilter            2            1K            9
               aio            4            1K           11
            soname            5            1K         3671
          pmchooks            1            1K            1
          filecaps            5            1K           73
          CAM path            4            1K         1034
     CAM dev queue            2            1K            2
 CAM I/O Scheduler            1            1K            1
        in_mfilter            2            1K           55
          sctp_vrf            1            1K            1
       ip_moptions            1            1K           28
              vnet            1            1K            1
               pmc            1            1K            1
             sigio            1            1K            4
           entropy            2            1K           33
          acpiintr            1            1K            1
              cpus            2            1K            2
      ip6_moptions            1            1K            5
    vnet_data_free            1            1K            1
           Per-cpu            1            1K            1
          p1003.1b            1            1K            1
        ext2_mount            0            0K            0
         ext2_node            0            0K            0
      ext2_extents            0            0K            0
          pf_table            0            0K            0
           pf_altq            0            0K            0
           pf_osfp            0            0K            0
     pf_krule_item            0            0K            0
           pf_temp            0            0K            0
        sctp_mcore            0            0K            0
        sctp_socko            0            0K           85
         sctp_iter            0            0K           10
         sctp_mvrf            0            0K            0
         sctp_cpal            0            0K            0
         sctp_cmsg            0            0K            0
         sctp_stre            0            0K            0
         sctp_athi            0            0K            0
         sctp_a_it            0            0K           10
         sctp_aadr            0            0K            0
         sctp_stri            0            0K            4
            mqdata            0            0K            0
            ipcomp            0            0K            0
               esp            0            0K            0
                ah            0            0K            0
       tcp_do_rack            0            0K            0
        madt_table            0            0K            2
          smartpqi            0            0K            0
               ixl            0            0K            0
        ice-resmgr            0            0K            0
         ice-osdep            0            0K            0
               ice            0            0K            0
              iavf            0            0K            0
             axgbe            0            0K            0
       fpukern_ctx            0            0K            0
          xen_intr            0            0K            0
           xen_hvm            0            0K            0
         legacydrv            0            0K            0
      NMI handlers            0            0K            0
            bounce            0            0K            0
            busdma            0            0K            0
            qpidrv            0            0K            0
      dmar_idpgtbl            0            0K            0
          dmar_dom            0            0K            0
          dmar_ctx            0            0K            0
      amdiommu_dom            0            0K            0
      amdiommu_ctx            0            0K            0
              isci            0            0K            0
      iommu_dmamap            0            0K            0
     hyperv_socket            0            0K            0
           bxe_ilt            0            0K            0
        aesni_data            0            0K            0
            xenbus            0            0K            0
     vm_fictitious            0            0K            0
           UMAHash            0            0K            0
         vm_pgdata            0            0K            0
           jblocks            0            0K            0
          savedino            0            0K          419
          sentinel            0            0K            0
            jfsync            0            0K            0
            jtrunc            0            0K            0
             sbdep            0            0K           13
           jsegdep            0            0K            0
              jseg            0            0K            0
         jfreefrag            0            0K            0
          jfreeblk            0            0K            0
           jnewblk            0            0K            0
            jmvref            0            0K            0
           jremref            0            0K            0
           jaddref            0            0K            0
           freedep            0            0K            0
          freefrag            0            0K          217
        allocindir            0            0K            0
       allocdirect            0            0K            0
          ufs_trim            0            0K            0
           mactemp            0            0K            0
     audit_trigger            0            0K            0
 audit_pipe_presel            0            0K            0
     audit_pipeent            0            0K            0
        audit_pipe            0            0K            0
      audit_evname            0            0K            0
         audit_bsm            0            0K            0
      audit_gidset            0            0K            0
        audit_text            0            0K            0
        audit_path            0            0K            0
        audit_data            0            0K            0
        audit_cred            0            0K            0
          ktls_ocf            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
      MLX5E_TLS_RX            0            0K            0
        MLX5EEPROM            0            0K            0
         MLX5E_TLS            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
            MLX5EN            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
          MLX5DUMP            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
       simple_attr            0            0K            0
          seq_file            0            0K            0
           lkpiskb            0            0K            0
             radix            0            0K            0
               idr            0            0K            0
          lkpindev            0            0K            0
           lkpimhi            0            0K            0
            lkpifw            0            0K            0
         lkpi80211            0            0K            0
               NLM            0            0K            0
    ipsec-spdcache            0            0K            0
         ipsec-reg            0            0K            0
        ipsec-misc            0            0K            0
      ipsecrequest            0            0K            0
            tcplog            0            0K            0
        tcp_hwpace            0            0K            0
              ipid            0            0K            0
         80211scan            0            0K            0
      80211ratectl            0            0K            0
        80211power            0            0K            0
       80211nodeie            0            0K            0
         80211node            0            0K            0
      80211mesh_gt            0            0K            0
      80211mesh_rt            0            0K            0
         80211perr            0            0K            0
         80211prep            0            0K            0
         80211preq            0            0K            0
          80211dfs            0            0K            0
       80211crypto            0            0K            0
          80211vap            0            0K            0
             iflib            0            0K            0
              vlan            0            0K            0
               gif            0            0K            0
           ifdescr            0            0K            0
              zlib            0            0K           21
           fadvise            0            0K            2
            statfs            0            0K          194
     namei_tracker            0            0K            1
       export_host            0            0K            0
        cl_savebuf            0            0K          139
               lio            0            0K            6
               acl            0            0K            0
          mbuf_tag            0            0K            0
              ktls            0            0K            1
              accf            0            0K            0
               pts            0            0K            0
           timerfd            0            0K            0
          ioctlops            0            0K          211
           eventfd            0            0K            2
           Witness            0            0K            0
             stack            0            0K            0
              sbuf            0            0K          364
          firmware            0            0K            0
        compressor            0            0K            0
              SWAP            0            0K            0
         sysctltmp            0            0K          653
            sysctl            0            0K            3
              ekcd            0            0K            0
            dumper            0            0K            0
          sendfile            0            0K            3
              rctl            0            0K            0
             cache            0            0K            0
      prison_racct            0            0K            0
       Fail Points            0            0K            0
filedesc_to_leader            0            0K            1
               pwd            0            0K            0
       tty console            0            0K            0
         boottrace            0            0K            0
        isofs_node            0            0K            0
       isofs_mount            0            0K            0
     tr_raid5_data            0            0K            0
    tr_raid1e_data            0            0K            0
     tr_raid1_data            0            0K            0
     tr_raid0_data            0            0K            0
    tr_concat_data            0            0K            0
       md_sii_data            0            0K            0
   md_promise_data            0            0K            0
    md_nvidia_data            0            0K            0
   md_jmicron_data            0            0K            0
     md_intel_data            0            0K            0
       md_ddf_data            0            0K            0
         raid_data            0            0K           90
     geom_flashmap            0            0K            0
         tmpfs dir            0            0K            0
        tmpfs name            0            0K            0
       tmpfs mount            0            0K            0
     tmpfs extattr            0            0K            0
           NFS FHA            0            0K            0
         newnfsmnt            0            0K            0
  newnfsclient_req            0            0K            0
   NFSCL layrecall            0            0K            0
     NFSCL session            0            0K            0
     NFSCL sockreq            0            0K            0
     NFSCL devinfo            0            0K            0
     NFSCL flayout            0            0K            0
      NFSCL layout            0            0K            0
     NFSD rollback            0            0K            0
      NFSCL diroff            0            0K            0
        NEWNFSnode            0            0K            0
         NFSCL lck            0            0K            0
      NFSCL lckown            0            0K            0
      NFSCL client            0            0K            0
       NFSCL deleg            0            0K            0
        NFSCL open            0            0K            0
       NFSCL owner            0            0K            0
            NFS fh            0            0K            0
           NFS req            0            0K            0
     NFSD usrgroup            0            0K            0
       NFSD string            0            0K            0
       NFSD V4lock            0            0K            0
      NFSD V4state            0            0K            0
       msdosfs_fat            0            0K            0
     msdosfs_mount            0            0K            0
      msdosfs_node            0            0K            0
            DEVFS4            0            0K            0
            DEVFS2            0            0K            0
            gntdev            0            0K            0
       privcmd_dev            0            0K            0
        evtchn_dev            0            0K            0
          xenstore            0            0K            0
               xnb            0            0K            0
          xen_acpi            0            0K            0
              xbbd            0            0K            0
               xbd            0            0K            0
           Balloon            0            0K            0
          sysmouse            0            0K            0
            vtfont            0            0K            0
            pvscsi            0            0K            0
            USBdev            0            0K            0
               USB            0            0K            0
            twsbuf            0            0K            0
       tcp_log_dev            0            0K            1
      midi buffers            0            0K            0
             mixer            0            0K            0
              ac97            0            0K            0
             hdacc            0            0K            0
              hdac            0            0K            0
              hdaa            0            0K            0
       SIIS driver            0            0K            0
               PUC            0            0K            0
          ppbusdev            0            0K            0
            sr_iov            0            0K            0
               OCS            0            0K            0
               OCS            0            0K            0
              nvme            0            0K            0
               nvd            0            0K            0
            netmap            0            0K            0
            mwldev            0            0K            0
        MVS driver            0            0K            0
         mpi3mrbuf            0            0K            0
          mrsasbuf            0            0K            0
          mpt_user            0            0K            0
          mps_user            0            0K            0
            MPSSAS            0            0K            0
               mps            0            0K            0
          mpr_user            0            0K            0
            MPRSAS            0            0K            0
               mpr            0            0K            0
            mfibuf            0            0K            0
           malodev            0            0K            0
               LED            0            0K            0
          ix_sriov            0            0K            0
                ix            0            0K            0
            ipsbuf            0            0K            0
         ciss_data            0            0K            0
         BACKLIGHT            0            0K            0
           ath_hal            0            0K            0
            athdev            0            0K            0
           ata_pci            0            0K            0
           ata_dma            0            0K            0
       ata_generic            0            0K            0
       AHCI driver            0            0K            0
               agp            0            0K            0
           acpipwr            0            0K            0
         acpi_perf            0            0K            0
         acpicmbat            0            0K            0
        aacraidcam            0            0K            0
       aacraid_buf            0            0K            0
            aaccam            0            0K            0
            aacbuf            0            0K            0
              zstd            0            0K            0
            XZ_DEC            0            0K            0
            nvlist            0            0K          175
          SCSI ENC            0            0K            0
           SCSI sa            0            0K            0
         scsi_pass            0            0K            0
           scsi_da            0            0K           70
            ata_da            0            0K            0
           scsi_ch            0            0K            0
           scsi_cd            0            0K            0
           nvme_da            0            0K            0
           CAM CCB            0            0K          523
     CAM ccb queue            0            0K            0
db> show uma
              Zone   Size    Used    Free    Requests  Sleeps  Bucket  Total Mem    XFree
   mbuf_jumbo_page   4096    8324    1074       14798       0     254   38494208        0
              mbuf    256    8700     962       32968       0     254    2473472        0
          BUF TRIE    152     390   11414        2574       0      62    1794208        0
        RADIX NODE    152   11161     326       51167       0      62    1746024        0
        malloc-384    384    4169      31        4189       0      30    1612800        0
        malloc-128    128   11537     181       15264       0     126    1499904        0
       malloc-4096   4096     354       4        1116       0       2    1466368        0
       UMA Slabs 0    112   11279      19       11279       0     126    1265376        0
      malloc-16384  16384      73       2         311       0       1    1228800        0
         sctp_asoc   2256       4     506          11       0     254    1150560        0
      malloc-65536  65536      16       1          22       0       1    1114112        0
         vmem btag     56   19182      81       19182       0     254    1078728        0
      mbuf_cluster   2048     508       0         508       0     254    1040384        0
         FFS inode   1168     593      23         899       0       8     719488        0
       malloc-4096   4096     164       0        1148       0       2     671744        0
       malloc-8192   8192      19      57         143       0       1     622592        0
           sctp_ep   1152      16     495         134       0     254     588672        0
            socket   1024      68     440        2073       0     254     520192        0
          lkpicurr    168       2    3094           2       0      62     520128        0
         VM OBJECT    248    1903      81       16847       0      62     492032        0
              pbuf   2624       0     182           0       0       2     477568        0
            THREAD   1824     213      11         660       0       8     408576        0
        sctp_raddr    736       5     512          12       0     254     380512        0
        256 Bucket   2048     168       8        1314       0       8     360448        0
         MAP ENTRY     96    3313     215       56534       0     126     338688        0
             VNODE    440     633      87         941       0      30     316800        0
         malloc-64     64     342    4509      100187       0     254     310464        0
         malloc-64     64    4275     324       72956       0     254     294336        0
       malloc-2048   2048     109      27         809       0       8     278528        0
      malloc-32768  32768       2       6         399       0       1     262144        0
         malloc-16     16   14591     409       23347       0     254     240000        0
        malloc-256    256      54     876        3643       0      62     238080        0
            DEVCTL   1024      27     193         154       0       0     225280        0
           tcp_log    416      12     501          25       0     254     213408        0
              PROC   1376     129      25        1110       0       8     211904        0
     FPU_save_area    832     215      28         878       0      16     202176        0
      malloc-65536  65536       1       2          15       0       1     196608        0
      malloc-32768  32768       0       6          20       0       1     196608        0
        malloc-128    128    1311     208       25815       0     126     194432        0
         malloc-32     32    5657     265       15709       0     254     189504        0
         UMA Zones    768     240       4         240       0      16     187392        0
       FFS2 dinode    256     593      97         898       0      62     176640        0
            lkpimm     56       1    3095           1       0     254     173376        0
             unpcb    320      14     502        1349       0     254     165120        0
       malloc-2048   2048       9      71         628       0       8     163840        0
       malloc-1024   1024     145      15         168       0      16     163840        0
         filedesc0   1072     129      18        1134       0       8     157584        0
       S VFS Cache    104    1012     392        1441       0     126     146016        0
      malloc-65536  65536       0       2          63       0       1     131072        0
      malloc-65536  65536       0       2         110       0       1     131072        0
       mbuf_packet    256      48     460        1923       0     254     130048        0
         tcp_inpcb   1304      18      72         191       0       8     117360        0
          ksiginfo    112     121     923         258       0     126     116928        0
        malloc-128    128     649     250        2079       0     126     115072        0
       malloc-2048   2048      19      37         139       0       8     114688        0
      malloc-32768  32768       3       0           3       0       1      98304        0
        malloc-256    256     249     126        1875       0      62      96000        0
        malloc-384    384     184      56         706       0      30      92160        0
          UMA Kegs    384     227       6         227       0      30      89472        0
             g_bio    408       4     206       13139       0      30      85680        0
        128 Bucket   1024      57      26         285       0      16      84992        0
       tcp_bbr_map    128       0     651        1177       0     126      83328        0
        malloc-128    128     514     137        1664       0     126      83328        0
         64 Bucket    512      99      61        3725       0      30      81920        0
        malloc-256    256     189     126         783       0      62      80640        0
           VMSPACE    584     100      33        1076       0      16      77672        0
    ertt_txseginfo     40       0    1818        5994       0     254      72720        0
         malloc-64     64     648     423       16469       0     254      68544        0
        malloc-128    128     301     226         370       0     126      67456        0
               md2      8    8192     192        8192       0     254      67072        0
               md0      8    8192     192        8192       0     254      67072        0
      malloc-65536  65536       1       0           1       0       1      65536        0
      malloc-32768  32768       0       2         120       0       1      65536        0
      malloc-32768  32768       2       0           2       0       1      65536        0
       malloc-4096   4096      13       3          26       0       2      65536        0
       malloc-2048   2048      17      15          37       0       8      65536        0
        malloc-256    256      78     177        2065       0      62      65280        0
         32 Bucket    256      85     170        1135       0      62      65280        0
              pipe    736      51      37         382       0      16      64768        0
        malloc-512    512       7     113         129       0      30      61440        0
sctp_stream_msg_out    112       0     540           3       0     254      60480        0
       malloc-8192   8192       6       1           8       0       1      57344        0
       malloc-8192   8192       6       1           8       0       1      57344        0
         malloc-64     64     458     361         658       0     254      52416        0
             Files     80     335     315        9136       0     126      52000        0
        malloc-128    128       7     396         274       0     126      51584        0
        malloc-256    256     115      80         289       0      62      49920        0
        malloc-256    256      78     117         180       0      62      49920        0
        malloc-256    256      68     127         945       0      62      49920        0
           DIRHASH   1024      34      14          38       0      16      49152        0
             NAMEI   1024       0      48       15306       0      16      49152        0
       malloc-1024   1024      13      35         528       0      16      49152        0
           pcpu-64     64     499     269         499       0     254      49152        0
            da_ccb    544       1      83        3445       0      16      45696        0
             ripcb    376       7     113         110       0      30      45120        0
            pcpu-8      8    4791     841        5472       0     254      45056        0
          syncache    168       0     264           3       0     254      44352        0
         TURNSTILE    136     225      90         225       0      62      42840        0
            vnpbuf   2624       0      16           2       0      16      41984        0
        sctp_readq    152       0     260           2       0     254      39520        0
        sctp_chunk    152       4     256           7       0     254      39520        0
         udp_inpcb    408      12      78         223       0      30      36720        0
         hostcache     64       3     564           3       0     254      36288        0
         malloc-64     64     106     461         257       0     254      36288        0
         malloc-64     64      16     551          39       0     254      36288        0
         malloc-64     64      50     517         314       0     254      36288        0
         malloc-64     64      26     541         796       0     254      36288        0
        malloc-128    128     129     150         303       0     126      35712        0
        malloc-128    128      10     269          79       0     126      35712        0
     routing nhops    256      27     108          34       0      62      34560        0
           ttyoutq    256      72      63         160       0      62      34560        0
        malloc-384    384      63      27          63       0      30      34560        0
        malloc-384    384      46      44         507       0      30      34560        0
        malloc-256    256      30     105         426       0      62      34560        0
        SLEEPQUEUE     88     225     159         225       0     126      33792        0
      malloc-32768  32768       1       0           1       0       1      32768        0
      malloc-16384  16384       2       0           2       0       1      32768        0
      malloc-16384  16384       2       0           2       0       1      32768        0
      malloc-16384  16384       0       2         190       0       1      32768        0
       malloc-8192   8192       2       2          24       0       1      32768        0
       malloc-8192   8192       4       0           4       0       1      32768        0
       malloc-4096   4096       6       2         331       0       2      32768        0
       malloc-4096   4096       3       5          80       0       2      32768        0
       malloc-2048   2048       1      15          13       0       8      32768        0
       malloc-2048   2048       7       9           7       0       8      32768        0
       malloc-2048   2048       0      16          50       0       8      32768        0
       malloc-2048   2048       3      13         196       0       8      32768        0
       malloc-1024   1024       2      30          54       0      16      32768        0
       malloc-1024   1024       9      23        1037       0      16      32768        0
       malloc-1024   1024       5      27         104       0      16      32768        0
       malloc-1024   1024      10      22         167       0      16      32768        0
        malloc-512    512       2      62         112       0      30      32768        0
        malloc-512    512       4      60          73       0      30      32768        0
        malloc-512    512       5      59          10       0      30      32768        0
        malloc-512    512       2      62         120       0      30      32768        0
        malloc-512    512       8      56          10       0      30      32768        0
       tcp_bbr_pcb    896       2      34           9       0      16      32256        0
            ttyinq    160     135      65         300       0      62      32000        0
              PGRP    120      43     221          60       0     126      31680        0
            clpbuf   2624       0      12         168       0       4      31488        0
        sctp_laddr     48      12     576          25       0     254      28224        0
          rl_entry     48      14     574         193       0     254      28224        0
         16 Bucket    144      66     130         574       0      62      28224        0
          4 Bucket     48       7     581          20       0     254      28224        0
               AIO    208       0     133          39       0      62      27664        0
     udplite_inpcb    408       1      62          17       0      30      25704        0
            cpuset    200       7     121          24       0      62      25600        0
       malloc-8192   8192       1       2           9       0       1      24576        0
       malloc-8192   8192       1       2          82       0       1      24576        0
       malloc-4096   4096       4       2          10       0       2      24576        0
               PWD     40      68     538         295       0     254      24240        0
           rtentry    168      30     114          34       0      62      24192        0
          8 Bucket     80      66     234         458       0     126      24000        0
            itimer    352       0      66           4       0      30      23232        0
            splice    184       0     126           5       0      62      23184        0
        malloc-384    384       1      59           9       0      30      23040        0
        malloc-384    384       1      59          72       0      30      23040        0
        malloc-384    384       1      59         344       0      30      23040        0
        malloc-384    384      21      39          24       0      30      23040        0
         domainset     40       0     567          14       0     254      22680        0
       Mountpoints   2816       2       6           5       0       4      22528        0
              ertt     72      18     262         191       0     126      20160        0
         malloc-32     32      72     558         119       0     254      20160        0
         malloc-32     32      80     550         114       0     254      20160        0
         malloc-32     32     119     511        1289       0     254      20160        0
         malloc-32     32     119     511         518       0     254      20160        0
         malloc-32     32      33     597         763       0     254      20160        0
         malloc-32     32      71     559        2709       0     254      20160        0
         malloc-32     32      93     537        1202       0     254      20160        0
          2 Bucket     32      98     532         644       0     254      20160        0
             KNOTE    160       1     124         111       0      62      20000        0
      tcp_rack_map    128       0     155           3       0     126      19840        0
           cryptop    280       0      70           9       0      30      19600        0
             AIOCB    552       0      35          50       0      16      19320        0
       L VFS Cache    320       0      60          31       0      30      19200        0
            AIOLIO    272       0      70           6       0      30      19040        0
              vmem   1856       2       7           2       0       8      16704        0
 epoch_record pcpu    256       4      60           4       0      62      16384        0
      malloc-16384  16384       0       1           1       0       1      16384        0
       malloc-8192   8192       2       0           2       0       1      16384        0
       malloc-4096   4096       0       4          42       0       2      16384        0
       malloc-1024   1024       1      15           1       0      16      16384        0
       malloc-1024   1024       0      16           4       0      16      16384        0
        malloc-512    512       0      32           5       0      30      16384        0
           SMR CPU     32       8     503           8       0     254      16352        0
               ipq     56       1     287           1       0     254      16128        0
   tcp_log_id_node    120       0     132           1       0     126      15840        0
              kenv    258      17      43        1066       0      30      15480        0
      tcp_rack_pcb   1088       1      13           5       0       8      15232        0
            mqnode    416       3      33           3       0      30      14976        0
        SMR SHARED     24       8     503           8       0     254      12264        0
 tcp_log_id_bucket    176       0      69           1       0      62      12144        0
      vtnet_tx_hdr     24       0     501        5402       0     254      12024        0
         malloc-16     16      45     705         277       0     254      12000        0
         malloc-16     16      18     732          89       0     254      12000        0
         malloc-16     16     300     450         810       0     254      12000        0
         malloc-16     16      54     696         194       0     254      12000        0
         malloc-16     16     188     562        3017       0     254      12000        0
         malloc-16     16      36     714       24921       0     254      12000        0
         malloc-16     16      39     711         199       0     254      12000        0
       malloc-4096   4096       1       1           4       0       2       8192        0
           pcpu-16     16       8     504           8       0     254       8192        0
       UMA Slabs 1    176      10      12          10       0      62       3872        0
        KMAP ENTRY     96      15      24          22       0       0       3744        0
       FFS1 dinode    128       0       0           0       0     126          0        0
           ada_ccb    272       0       0           0       0      30          0        0
             swblk    136       0       0           0       0      62          0        0
          swpctrie    152       0       0           0       0      62          0        0
   cdg_qdiffsample     16       0       0           0       0     254          0        0
   pf state scrubs     40       0       0           0       0     254          0        0
   pf frag entries     40       0       0           0       0     254          0        0
          pf frags    256       0       0           0       0      62          0        0
  pf table entries    160       0       0           0       0     254          0        0
pf table entry counters     64       0       0           0       0     254          0        0
   pf UDP mappings    104       0       0           0       0     126          0        0
   pf source nodes    152       0       0           0       0     254          0        0
     pf state keys     88       0       0           0       0     126          0        0
         pf states    384       0       0           0       0     254          0        0
           pf tags    104       0       0           0       0     126          0        0
          pf mtags    184       0       0           0       0      62          0        0
tfo_ccache_entries     80       0       0           0       0     126          0        0
               tfo      4       0       0           0       0     254          0        0
          sackhole     32       0       0           0       0     254          0        0
   sctp_asconf_ack     48       0       0           0       0     254          0        0
       sctp_asconf     40       0       0           0       0     254          0        0
          tcpreass     48       0       0           0       0     254          0        0
    IPsec SA lft_c     16       0       0           0       0     254          0        0
        mqnotifier    216       0       0           0       0      62          0        0
            mvdata     64       0       0           0       0     254          0        0
            mqueue    248       0       0           0       0      62          0        0
        TMPFS node    240       0       0           0       0      62          0        0
           NCLNODE    608       0       0           0       0      16          0        0
     LTS VFS Cache    360       0       0           0       0      30          0        0
     STS VFS Cache    144       0       0           0       0      62          0        0
  linux_dma_object     32       0       0           0       0     254          0        0
  linux_dma_pctrie    152       0       0           0       0      62          0        0
   IOMMU_MAP_ENTRY    112       0       0           0       0     126          0        0
            skbuff   1808       0       0           0       0       8          0        0
    mbuf_jumbo_16k  16384       0       0           0       0     254          0        0
     mbuf_jumbo_9k   9216       0       0           0       0     254          0        0
      audit_record   1280       0       0           0       0       8          0        0
        MAC labels     40       0       0           0       0     254          0        0
           nfspbuf   2624       0       0           0       0       4          0        0
            swwbuf   2624       0       0           0       0       2          0        0
            swrbuf   2624       0       0           0       0       4          0        0
          umtx_shm     88       0       0           0       0     126          0        0
           umtx pi     96       0       0           0       0     126          0        0
rangeset pctrie nodes    152       0       0           0       0      62          0        0
      malloc-65536  65536       0       0           0       0       1          0        0
      malloc-65536  65536       0       0           0       0       1          0        0
      malloc-65536  65536       0       0           0       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
      malloc-16384  16384       0       0           0       0       1          0        0
      malloc-16384  16384       0       0           0       0       1          0        0
      malloc-16384  16384       0       0           0       0       1          0        0
        malloc-512    512       0       0           0       0      30          0        0
           pcpu-32     32       0       0           0       0     254          0        0
            pcpu-4      4       0       0           0       0     254          0        0
            fakepg    104       0       0           0       0     126          0        0
          UMA Hash    256       0       0           0       0      62          0        0

Crashes (2):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2025/05/15 02:07 freebsd-src a6bac0a9efa1 d6b2ee52 console log report ci-freebsd-main panic: /syzkaller/managers/main/kernel/sys/netinet/in_pcb.c:LINE: in_pcblbgroup_insert: Bad list head ADDR first->prev !
2025/05/04 09:45 freebsd-src 75d173a84836 b0714e37 console log report ci-freebsd-main panic: /syzkaller/managers/main/kernel/sys/netinet/in_pcb.c:LINE: in_pcblbgroup_insert: Bad list head ADDR first->prev !
* Struck through repros no longer work on HEAD.