syzbot


Fatal trap 12: page fault in filt_timerdetach

Status: fixed on 2021/09/02 07:46
Reported-by: syzbot+4a4cebb3ec07892cb040@syzkaller.appspotmail.com
Fix commit: c511383de7a0 kevent: Fix races between timer detach and kqtimer_proc_continue()
First crash: 1248d, last: 1248d

Sample crash report:
Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 00
fault virtual address	= 0x5f
fault code		= supervisor read data, page not present
instruction pointer	= 0x20:0xffffffff8103b0a0
stack pointer	        = 0x0:0xfffffe009a644780
frame pointer	        = 0x0:0xfffffe009a6447a0
code segment		= base 0x0, limit 0xfffff, type 0x1b
			= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags	= interrupt enabled, resume, IOPL = 0
current process		= 18114 (syz-executor.2)
trap number		= 12
panic: page fault
cpuid = 0
time = 1624559677
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x47/frame 0xfffffe009a6443d0
vpanic() at vpanic+0x1cc/frame 0xfffffe009a644430
panic() at panic+0x43/frame 0xfffffe009a644490
trap_fatal() at trap_fatal+0x4cd/frame 0xfffffe009a644510
trap_pfault() at trap_pfault+0xdb/frame 0xfffffe009a644590
trap() at trap+0x398/frame 0xfffffe009a6446b0
calltrap() at calltrap+0x8/frame 0xfffffe009a6446b0
--- trap 0xc, rip = 0xffffffff8103b0a0, rsp = 0xfffffe009a644780, rbp = 0xfffffe009a6447a0 ---
filt_timerdetach() at filt_timerdetach+0x70/frame 0xfffffe009a6447a0
kqueue_drain() at kqueue_drain+0x394/frame 0xfffffe009a6447f0
kqueue_close() at kqueue_close+0x9d/frame 0xfffffe009a644840
_fdrop() at _fdrop+0x3a/frame 0xfffffe009a644870
closef() at closef+0x28b/frame 0xfffffe009a644900
fdescfree_fds() at fdescfree_fds+0x194/frame 0xfffffe009a644960
fdescfree() at fdescfree+0x5c2/frame 0xfffffe009a644a30
exit1() at exit1+0x731/frame 0xfffffe009a644aa0
sys_sys_exit() at sys_sys_exit+0xd/frame 0xfffffe009a644ab0
ia32_syscall() at ia32_syscall+0x23a/frame 0xfffffe009a644bf0
int0x80_syscall_common() at int0x80_syscall_common+0x9c/frame 0xffffd5d8
KDB: enter: panic
[ thread pid 18114 tid 114741 ]
Stopped at      kdb_enter+0x67: movq    $0,0x164097e(%rip)
db> set $lines = 0
db> set $maxwidth = 0
db> show registers
cs                        0x20
ds                        0x3b
es                        0x3b
fs                        0x13
gs                        0x1b
ss                           0
rax                       0x12
rcx         0xffffffff81131ef0  vprintf+0x140
rdx                        0x1
rbx                          0
rsp         0xfffffe009a6443b0
rbp         0xfffffe009a6443d0
rsi                          0
rdi         0xffffffff81131f26  vprintf+0x176
r8                           0
r9          0x8080808080808080
r10         0xfffffe009a6442a0
r11              0x1ff65fff59c
r12         0xffffffff82267d30  ddb_dbbe
r13         0xffffffff81981d00
r14         0xffffffff81a74f96
r15         0xffffffff81a74f96
rip         0xffffffff81128f87  kdb_enter+0x67
rflags                0x200082  kernload+0x82
kdb_enter+0x67: movq    $0,0x164097e(%rip)
db> show proc
Process 18114 (syz-executor.2) at 0xfffff8001805aa60:
 state: NORMAL
 uid: 0  gids: 0, 0, 5
 parent: pid 796 at 0xfffff800263a6000
 ABI: FreeBSD ELF32
 flag: 0x10002000  flag2: 0
 arguments: /root/syz-executor.2
 reaper: 0xfffff80004bda530 reapsubtree: 1
 sigparent: 20
 vmspace: 0xfffffe00950bc3e0
   (map 0xfffffe00950bc3e0)
   (map.pmap 0xfffffe00950bc4a0)
   (pmap 0xfffffe00950bc500)
 threads: 1
114741                   Run     CPU 0                       syz-executor.2
db> ps
  pid  ppid  pgrp   uid  state   wmesg   wchan               cmd
18114   796   796     0  RE      CPU 0                       syz-executor.2
18109   783   783     0  T       (threaded)                  syz-executor.0
114443                   s                                   syz-executor.0
118816                   D       biowr   0xfffffe000392dae0  syz-executor.0
118823                   D       biowr   0xfffffe000391cdb8  syz-executor.0
16195     1   811     0  S       uwait   0xfffff800264d1700  syz-executor.3
16194     1   811     0  S       uwait   0xfffff80026be9300  syz-executor.3
 5408     0     0     0  DL      aiordy  0xfffff80031107000  [aiod4]
 5407     0     0     0  DL      aiordy  0xfffff80026e2f530  [aiod3]
 5406     0     0     0  DL      aiordy  0xfffff8002623e000  [aiod2]
 5405     0     0     0  DL      aiordy  0xfffff80026fb8530  [aiod1]
 3622     1  3622    65  Ss      select  0xfffff80031368740  dhclient
 2777     1  2777     0  Ss      select  0xfffff80026ae02c0  dhclient
 2774     1  2774     0  Ss      select  0xfffff800311a8140  dhclient
 2755     1  2755    65  Ss      select  0xfffff800311888c0  dhclient
 2216     1  2216     0  Ss      select  0xfffff800313b28c0  dhclient
 2210     1  2210     0  Ss      select  0xfffff80026d1b2c0  dhclient
 2187     1  2187    65  Ss      select  0xfffff800313b2140  dhclient
 1652     1  1652     0  Ss      select  0xfffff80026f33d40  dhclient
 1649     1  1649     0  Ss      select  0xfffff80015f3b5c0  dhclient
 1630     1  1630    65  Ss      select  0xfffff80026fc22c0  dhclient
 1051     1  1051     0  Ss      select  0xfffff80026a3a440  dhclient
 1048     1  1048     0  Ss      select  0xfffff80026fae5c0  dhclient
  811   780   811     0  Ss      piperd  0xfffff80015e525d0  syz-executor.3
  796   780   796     0  Ss      wait    0xfffff800263a6000  syz-executor.2
  784   780   784     0  Ss      piperd  0xfffff800262ff8b8  syz-executor.1
  783   780   783     0  Ss      wait    0xfffff80015ec7530  syz-executor.0
  780   778   778     0  R       (threaded)                  syz-fuzzer
100102                   S       uwait   0xfffff80015e64500  syz-fuzzer
100114                   S       uwait   0xfffff80015d68300  syz-fuzzer
100115                   S       uwait   0xfffff80015d68500  syz-fuzzer
100116                   S       uwait   0xfffff80015d68700  syz-fuzzer
100117                   S       uwait   0xfffff80015d68b00  syz-fuzzer
100118                   S       uwait   0xfffff8002638a500  syz-fuzzer
100119                   S       uwait   0xfffff8002638a700  syz-fuzzer
100121                   S       uwait   0xfffff80015e64900  syz-fuzzer
100122                   RunQ                                syz-fuzzer
  778   776   778     0  Ss      pause   0xfffff80015deb0b0  csh
  776   694   776     0  Ss      select  0xfffff800266735c0  sshd
  761     1   761     0  Rs+                                 getty
  760     1   760     0  Ss+     ttyin   0xfffff80015b2b4b0  getty
  759     1   759     0  Ss+     ttyin   0xfffff80015b2bcb0  getty
  758     1   758     0  Ss+     ttyin   0xfffff80015b2f4b0  getty
  757     1   757     0  Ss+     ttyin   0xfffff80015b2fcb0  getty
  756     1   756     0  Ss+     ttyin   0xfffff80015ab64b0  getty
  755     1   755     0  Ss+     ttyin   0xfffff80015ab6cb0  getty
  754     1   754     0  Ss+     ttyin   0xfffff80015abc4b0  getty
  753     1   753     0  Ss+     ttyin   0xfffff80015abccb0  getty
  698     1   698     0  Ss      nanslp  0xffffffff8273d0a1  cron
  694     1   694     0  Ss      select  0xfffff80015f3c2c0  sshd
  507     1   507     0  Ss      select  0xfffff80015e32d40  syslogd
  436     1   436     0  Ss      select  0xfffff80015e32440  devd
  435     1   435    65  Ss      select  0xfffff80026477d40  dhclient
  350     1   350     0  Ss      select  0xfffff80015dc8140  dhclient
  347     1   347     0  Ss      select  0xfffff80015f12740  dhclient
   23     0     0     0  DL      vlruwt  0xfffff80015b12000  [vnlru]
   22     0     0     0  DL      syncer  0xffffffff8282c450  [syncer]
   21     0     0     0  DL      (threaded)                  [bufdaemon]
100081                   D       qsleep  0xffffffff8282b520  [bufdaemon]
100088                   D       -       0xffffffff8220aec0  [bufspacedaemon-0]
100098                   D       sdflush 0xfffff80004ddd4e8  [/ worker]
   20     0     0     0  DL      psleep  0xffffffff82853388  [vmdaemon]
   19     0     0     0  DL      (threaded)                  [pagedaemon]
100079                   D       psleep  0xffffffff828477f8  [dom0]
100086                   D       launds  0xffffffff82847804  [laundry: dom0]
100087                   D       umarcl  0xffffffff815c4f40  [uma]
   18     0     0     0  RL                                  [rand_harvestq]
   17     0     0     0  DL      waiting 0xffffffff830148b8  [sctp_iterator]
   16     0     0     0  DL      pftm    0xffffffff82e3d410  [pf purge]
   15     0     0     0  DL      -       0xffffffff82828bdc  [soaiod4]
    9     0     0     0  DL      -       0xffffffff82828bdc  [soaiod3]
    8     0     0     0  DL      -       0xffffffff82828bdc  [soaiod2]
    7     0     0     0  DL      -       0xffffffff82828bdc  [soaiod1]
    6     0     0     0  RL      (threaded)                  [cam]
100044                   RunQ                                [doneq0]
100045                   D       -       0xffffffff82448ac0  [async]
100078                   D       -       0xffffffff82448990  [scanner]
   14     0     0     0  DL      seqstat 0xfffff80004d8a488  [sequencer 00]
    5     0     0     0  DL      crypto_ 0xfffff80004d53d80  [crypto returns 1]
    4     0     0     0  DL      crypto_ 0xfffff80004d53d30  [crypto returns 0]
    3     0     0     0  DL      crypto_ 0xffffffff82844ce0  [crypto]
   13     0     0     0  DL      (threaded)                  [geom]
100035                   D       -       0xffffffff8271c8e0  [g_event]
100036                   D       -       0xffffffff8271c8e8  [g_up]
100037                   D       -       0xffffffff8271c8f0  [g_down]
    2     0     0     0  DL      (threaded)                  [KTLS]
100028                   D       -       0xfffff80004c69100  [thr_0]
100029                   D       -       0xfffff80004c69180  [thr_1]
   12     0     0     0  RL      (threaded)                  [intr]
100011                   I                                   [swi5: fast taskq]
100014                   I                                   [swi6: task queue]
100016                   I                                   [swi6: Giant taskq]
100030                   I                                   [swi3: vm]
100031                   I                                   [swi4: clock (0)]
100032                   Run     CPU 1                       [swi4: clock (1)]
100033                   I                                   [swi1: netisr 0]
100046                   I                                   [irq24: virtio_pci0]
100047                   I                                   [irq25: virtio_pci0]
100048                   I                                   [irq26: virtio_pci0]
100049                   I                                   [irq27: virtio_pci0]
100050                   I                                   [irq28: virtio_pci1]
100051                   I                                   [irq29: virtio_pci1]
100052                   I                                   [irq30: virtio_pci1]
100053                   I                                   [irq31: virtio_pci1]
100054                   I                                   [irq32: virtio_pci1]
100059                   I                                   [irq10: virtio_pci2]
100061                   I                                   [irq1: atkbd0]
100062                   I                                   [irq12: psm0]
100063                   I                                   [swi0: uart uart++]
100071                   I                                   [swi1: pf send]
100084                   I                                   [swi1: hpts]
100085                   I                                   [swi1: hpts]
   11     0     0     0  RL      (threaded)                  [idle]
100003                   CanRun                              [idle: cpu0]
100004                   CanRun                              [idle: cpu1]
    1     0     1     0  SLs     wait    0xfffff80004bda530  [init]
   10     0     0     0  DL      audit_w 0xffffffff828451f0  [audit]
    0     0     0     0  DLs     (threaded)                  [kernel]
100000                   D       swapin  0xffffffff8271ce70  [swapper]
100005                   D       -       0xfffff8000443b500  [if_io_tqg_0]
100006                   D       -       0xfffff8000443b100  [if_io_tqg_1]
100007                   D       -       0xfffff80004c78d00  [if_config_tqg_0]
100008                   D       -       0xfffff80004c78900  [softirq_0]
100009                   D       -       0xfffff80004c78500  [softirq_1]
100010                   D       -       0xfffff80004c78100  [aiod_kick taskq]
100012                   D       -       0xfffff80004c75900  [kqueue_ctx taskq]
100013                   D       -       0xfffff80004c75500  [pci_hp taskq]
100015                   D       -       0xfffff80004c6ed00  [inm_free taskq]
100017                   D       -       0xfffff80004c6e500  [linuxkpi_irq_wq]
100018                   D       -       0xfffff80004c6e100  [thread taskq]
100019                   D       -       0xfffff80004c69d00  [in6m_free taskq]
100020                   D       -       0xfffff80004c69900  [linuxkpi_short_wq_0]
100021                   D       -       0xfffff80004c69900  [linuxkpi_short_wq_1]
100022                   D       -       0xfffff80004c69900  [linuxkpi_short_wq_2]
100023                   D       -       0xfffff80004c69900  [linuxkpi_short_wq_3]
100024                   D       -       0xfffff80004c69500  [linuxkpi_long_wq_0]
100025                   D       -       0xfffff80004c69500  [linuxkpi_long_wq_1]
100026                   D       -       0xfffff80004c69500  [linuxkpi_long_wq_2]
100027                   D       -       0xfffff80004c69500  [linuxkpi_long_wq_3]
100034                   D       -       0xfffff80004cd3d00  [firmware taskq]
100038                   D       -       0xfffff80004cd3900  [crypto_0]
100039                   D       -       0xfffff80004cd3900  [crypto_1]
100055                   D       -       0xfffff800153ecd00  [vtnet0 rxq 0]
100056                   D       -       0xfffff800153ec900  [vtnet0 txq 0]
100057                   D       -       0xfffff800153ec500  [vtnet0 rxq 1]
100058                   D       -       0xfffff800153ec100  [vtnet0 txq 1]
100060                   D       vtbslp  0xfffff80015463700  [virtio_balloon]
100064                   D       -       0xfffff80015469900  [mca taskq]
100066                   D       -       0xffffffff81e217a1  [deadlkres]
100074                   D       -       0xfffff80015ac5100  [acpi_task_0]
100075                   D       -       0xfffff80015ac5100  [acpi_task_1]
100076                   D       -       0xfffff80015ac5100  [acpi_task_2]
100077                   D       -       0xfffff80004cd3500  [CAM taskq]
13940     1   811     0  Z                                   syz-executor.3
13948     1   811     0  Z                                   syz-executor.3
13950     1   811     0  Z                                   syz-executor.3
13962     1   811     0  Z                                   syz-executor.3
13969     1   811     0  Z                                   syz-executor.3
13978     1   811     0  Z                                   syz-executor.3
13984     1   811     0  Z                                   syz-executor.3
13989     1   811     0  Z                                   syz-executor.3
13994     1   811     0  Z                                   syz-executor.3
13996     1   811     0  Z                                   syz-executor.3
13999     1   811     0  Z                                   syz-executor.3
14005     1   811     0  Z                                   syz-executor.3
14009     1   811     0  Z                                   syz-executor.3
14011     1   811     0  Z                                   syz-executor.3
14016     1   811     0  Z                                   syz-executor.3
14020     1   811     0  Z                                   syz-executor.3
14025     1   811     0  Z                                   syz-executor.3
14030     1   811     0  Z                                   syz-executor.3
14035     1   811     0  Z                                   syz-executor.3
14039     1   811     0  Z                                   syz-executor.3
14042     1   811     0  Z                                   syz-executor.3
14045     1   811     0  Z                                   syz-executor.3
14056     1   811     0  Z                                   syz-executor.3
14060     1   811     0  Z                                   syz-executor.3
14065     1   811     0  Z                                   syz-executor.3
14067     1   811     0  Z                                   syz-executor.3
14072     1   811     0  Z                                   syz-executor.3
14076     1   811     0  Z                                   syz-executor.3
14080     1   811     0  Z                                   syz-executor.3
14090     1   811     0  Z                                   syz-executor.3
14096     1   811     0  Z                                   syz-executor.3
14102     1   811     0  Z                                   syz-executor.3
db> show all locks
Process 18114 (syz-executor.2) thread 0xfffffe009fb2e560 (114741)
exclusive sleep mutex process lock (process lock) r = 0 (0xfffff8001805ab88) locked @ /syzkaller/managers/i386/kernel/sys/kern/kern_event.c:866
Process 18109 (syz-executor.0) thread 0xfffffe009fc44560 (118816)
exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0003926ea0) locked @ /syzkaller/managers/i386/kernel/sys/kern/vfs_bio.c:1684
exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe000392db60) locked @ /syzkaller/managers/i386/kernel/sys/kern/vfs_bio.c:3928
exclusive lockmgr ufs (ufs) r = 0 (0xfffff80031dd9cb0) locked @ /syzkaller/managers/i386/kernel/sys/kern/vfs_vnops.c:1157
Process 18109 (syz-executor.0) thread 0xfffffe009fb26e40 (118823)
exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe000391ce38) locked @ /syzkaller/managers/i386/kernel/sys/kern/vfs_bio.c:3953
exclusive lockmgr ufs (ufs) r = 0 (0xfffff80026c97e70) locked @ /syzkaller/managers/i386/kernel/sys/kern/vfs_vnops.c:1157
db> show malloc
              Type        InUse        MemUse     Requests
         sctp_stro          196        14876K        10161
         sysctloid        34288        12858K        34355
           pf_hash            5        11560K            5
            devbuf         4216         6982K         4244
          tcp_hpts            5         3219K            5
              kobj          326         2608K          486
               pcb          424         2396K        47443
             vtbuf           24         2064K           46
            newblk           22         1043K        22469
          vfscache            3         1035K            3
           subproc          216          902K        18203
            acpica         1674          649K        54806
          inodedep           70          589K        17508
           callout            2          528K            2
         ufs_quota            1          520K            1
          vfs_hash            1          520K            1
              intr            4          480K            4
         sctp_atcl          394          394K        34519
               bus          986          377K         3469
               BPF           46          337K           46
          filedesc           18          275K        34185
            linker          348          270K          409
           kdtrace          294          233K        36941
         sctp_atky          590          222K        46044
            DEVFS1          107          214K          124
              umtx          440          193K          440
            module          510          192K          510
         vnet_data            1          176K            1
           tidhash            3          164K            3
         sctp_athm          394          148K        35242
          sctp_map          392          147K        20236
           pagedep           10          141K        17114
        tfo_ccache            1          136K            1
               sem            4          120K            4
               UMA          270          102K          270
         sctp_timw          202          101K          202
     audit_evclass          236           89K          294
              temp           36           81K         3634
          mtx_pool            2           80K            2
          routetbl          140           77K         1261
          syncache            1           76K            1
              vmem            3           72K            5
               msg            4           68K            4
            ifaddr           70           66K           72
          indirdep            2           65K         1344
          acpitask            1           64K            1
       ddb_capture            1           64K            1
            DEVFS3          126           63K          136
       ether_multi          152           57K          162
        gtaskqueue           18           57K           18
        DEVFS_RULE           56           54K           56
              kenv           95           52K           95
      eventhandler          133           50K          133
            kqueue          104           49K        18190
           ithread           99           43K           99
              rman           84           42K          425
            KTRACE          100           38K          100
           lltable           43           37K          105
         taskqueue           60           36K           60
              proc            3           34K            3
         ufs_mount            5           34K            6
            bus-sc           33           34K         1684
           devstat            4           33K            4
         hostcache            1           32K            1
               tty           16           32K           16
               shm            1           32K            2
            DEVFSP           80           30K          924
            dirrem           58           29K        17396
              GEOM           60           29K          489
         in6_multi           65           29K           65
            kbdmux            6           28K            6
              cred           26           26K          263
           pwddesc           66           25K        18084
             ifnet            7           25K            7
            plimit           24           24K          441
          kcovinfo           64           24K           68
          freefile           58           22K        17393
         CAM queue            5           21K         1528
             selfd           55           21K       244427
         pfs_nodes           20           20K           20
         proc-args           52           20K          693
              UART           12           18K           12
           session           35           18K           51
         bmsafemap            2           17K        17638
              ksem            1           16K          294
               rpc            2           16K            2
             shmfd            1           16K          135
       pfs_vncache            1           16K            1
       ufs_dirhash           24           14K           24
            sglist            5           13K            5
               MCA           32           12K           32
           CAM DEV            3           12K          510
             lockf           32           12K           57
                vt           11           11K           11
            Unitno           29           11K           55
           acpisem           28           11K           28
           CAM XPT           22           11K          543
          pf_ifnet           13           10K          228
           uidinfo            3            9K           14
          pf_table            2            8K          210
           memdesc            1            8K            1
         ipsec-saq            2            8K            2
           CAM CCB            2            8K         9923
             evdev            4            8K            4
           acpidev           20            8K           20
             hhook           15            8K           17
            select           19            8K           99
             mount           16            7K           90
       fpukern_ctx            3            6K            3
       inpcbpolicy           16            6K         4036
          terminal           11            6K           11
            ip6ndp           12            6K           14
          sctp_ifa           13            5K           14
       ipsecpolicy            2            5K            2
 encap_export_host           12            5K           12
             clone            9            5K            9
        local_apic            1            4K            1
           io_apic            1            4K            1
            sahead            1            4K            1
          secasvar            1            4K            1
             nhops            6            4K            8
          pci_link           10            4K           10
               msi            9            4K            9
             DEVFS            9            4K           10
               tun            7            4K            7
               osd            8            4K         2842
             ipsec            3            3K            3
           pf_osfp            8            3K            8
             mkdir            8            3K        34158
          in_multi            6            3K            8
          nexusdev            7            3K            7
            feeder            7            3K            7
          procdesc            5            3K           18
          freework            5            3K        20787
          sctp_ifn            6            3K           14
            diradd            6            3K        17438
               mld            6            3K            6
              igmp            6            3K            6
         toponodes            6            3K            6
            prison            6            3K            6
            isadev            6            3K            6
           softdep            1            2K            1
          freeblks            4            2K        17536
       vnodemarker            2            2K           56
      NFSD session            1            2K            1
         newdirblk            5            2K        17079
             linux            5            2K            6
        CAM periph            4            2K          271
          filecaps            5            2K          116
            crypto            4            2K            4
              pfil            4            2K            4
          CAM path            4            2K         1034
            soname            4            2K        25008
               iov            4            2K        22945
           tcpfunc            3            2K            3
        loginclass            3            2K            6
    chacha20random            1            1K            1
            vnodes            1            1K            1
           CAM SIM            2            1K            2
              ktls            1            1K            1
              cdev            2            1K            2
        aesni_data            2            1K            2
              cpus            2            1K            2
          atkbddev            2            1K            2
     CAM dev queue            2            1K            2
             xform            2            1K          906
           entropy            2            1K           47
      NFSD lckfile            1            1K            1
     NFSD V4client            1            1K            1
          pmchooks            1            1K            1
          sctp_vrf            1            1K            1
           pf_rule            1            1K          175
            apmdev            1            1K            1
 CAM I/O Scheduler            1            1K            1
        ip_msource            1            1K            1
    vnet_data_free            1            1K            1
              vnet            1            1K            1
           Per-cpu            1            1K            1
          p1003.1b            1            1K            1
          acpiintr            1            1K            1
               pmc            1            1K            1
         htcp data            0            0K            0
        sctp_mcore            0            0K            0
        sctp_socko            0            0K        12225
         sctp_iter            0            0K          148
         sctp_mvrf            0            0K            0
         sctp_cpal            0            0K          138
         sctp_cmsg            0            0K            0
         sctp_stre            0            0K            0
         sctp_athi            0            0K            0
         sctp_a_it            0            0K           10
         sctp_aadr            0            0K            0
         sctp_stri            0            0K         2396
            mqdata            0            0K            0
          chd data            0            0K            0
           pf_altq            0            0K            0
           pf_temp            0            0K            0
        vegas data            0            0K           15
          cdg data            0            0K           17
        cubic data            0            0K            0
            tcp_do            0            0K            0
           tcp_fsb            0            0K          603
        dctcp data            0            0K            0
      NFSCL lckown            0            0K            0
      NFSCL client            0            0K            0
        madt_table            0            0K            2
          smartpqi            0            0K            0
       NFSCL deleg            0            0K            0
        NFSCL open            0            0K            0
       NFSCL owner            0            0K            0
            NFS fh            0            0K            0
           NFS req            0            0K            0
     NFSD usrgroup            0            0K            0
       NFSD string            0            0K            0
              iavf            0            0K            0
               ixl            0            0K            0
       NFSD V4lock            0            0K            0
      NFSD V4state            0            0K            0
     NFSD srvcache            0            0K            0
       msdosfs_fat            0            0K            0
     msdosfs_mount            0            0K            0
      msdosfs_node            0            0K            0
        ice-resmgr            0            0K            0
         ice-osdep            0            0K            0
               ice            0            0K            0
             axgbe            0            0K            0
            DEVFS4            0            0K            0
            DEVFS2            0            0K            0
            gntdev            0            0K            0
       privcmd_dev            0            0K            0
        evtchn_dev            0            0K            0
          xen_intr            0            0K            0
          xenstore            0            0K            0
         ciss_data            0            0K            0
           xen_hvm            0            0K            0
         legacydrv            0            0K            0
            qpidrv            0            0K            0
         BACKLIGHT            0            0K            0
               xnb            0            0K            0
      dmar_idpgtbl            0            0K            0
          dmar_dom            0            0K            0
          dmar_ctx            0            0K            0
              xbbd            0            0K            0
               xbd            0            0K            0
           Balloon            0            0K            0
              isci            0            0K            0
      iommu_dmamap            0            0K            0
          sysmouse            0            0K            0
     hyperv_socket            0            0K            0
           bxe_ilt            0            0K            0
            xenbus            0            0K            0
            vtfont            0            0K            0
     vm_fictitious            0            0K            0
           ath_hal            0            0K            0
            athdev            0            0K            0
           ata_pci            0            0K            0
           ata_dma            0            0K            0
       ata_generic            0            0K            0
               amr            0            0K            0
            pvscsi            0            0K            0
           scsi_da            0            0K           69
            ata_da            0            0K            0
           scsi_ch            0            0K            0
           UMAHash            0            0K            0
           scsi_cd            0            0K            0
       AHCI driver            0            0K            0
         vm_pgdata            0            0K            0
           jblocks            0            0K            0
          savedino            0            0K        14877
          sentinel            0            0K            0
            jfsync            0            0K            0
            jtrunc            0            0K            0
             sbdep            0            0K           25
           jsegdep            0            0K            0
              jseg            0            0K            0
         jfreefrag            0            0K            0
          jfreeblk            0            0K            0
           jnewblk            0            0K            0
            jmvref            0            0K            0
           jremref            0            0K            0
           jaddref            0            0K            0
           freedep            0            0K            0
          freefrag            0            0K            6
        allocindir            0            0K            0
       allocdirect            0            0K            0
          ufs_trim            0            0K            0
           mactemp            0            0K            0
     audit_trigger            0            0K            0
 audit_pipe_presel            0            0K            0
     audit_pipeent            0            0K            0
        audit_pipe            0            0K            0
      audit_evname            0            0K            0
         audit_bsm            0            0K            0
      audit_gidset            0            0K            0
        audit_text            0            0K            0
        audit_path            0            0K            0
        audit_data            0            0K            0
        audit_cred            0            0K            0
            USBdev            0            0K            0
               USB            0            0K            0
               agp            0            0K            0
           nvme_da            0            0K            0
           acpipwr            0            0K            0
         acpi_perf            0            0K            0
          ktls_ocf            0            0K            0
            twsbuf            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
         MLX5E_TLS            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
            MLX5EN            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
          MLX5DUMP            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
          seq_file            0            0K            0
             radix            0            0K            0
               idr            0            0K            0
            lkpifw            0            0K            0
               NLM            0            0K            0
    ipsec-spdcache            0            0K            0
         ipsec-reg            0            0K            0
        ipsec-misc            0            0K            0
      ipsecrequest            0            0K            0
            ip6opt            0            0K            8
       ip6_msource            0            0K            0
      ip6_moptions            0            0K            0
       in6_mfilter            0            0K            0
             frag6            0            0K            0
            tcplog            0            0K            0
        tcp_hwpace            0            0K            0
      twe_commands            0            0K            0
               LRO            0            0K            0
      newreno data            0            0K            0
       ip_moptions            0            0K            6
        in_mfilter            0            0K            4
              ipid            0            0K            0
         80211scan            0            0K            0
      80211ratectl            0            0K            0
        80211power            0            0K            0
       80211nodeie            0            0K            0
         80211node            0            0K            0
      80211mesh_gt            0            0K            0
      80211mesh_rt            0            0K            0
         80211perr            0            0K            0
         80211prep            0            0K            0
         80211preq            0            0K            0
          80211dfs            0            0K            0
       80211crypto            0            0K            0
          80211vap            0            0K            0
             iflib            0            0K            0
              vlan            0            0K            0
               gif            0            0K            0
           ifdescr            0            0K            0
              zlib            0            0K            0
           fadvise            0            0K            0
           VN POLL            0            0K            0
      twa_commands            0            0K            0
            statfs            0            0K        17271
     namei_tracker            0            0K            2
       export_host            0            0K            0
        cl_savebuf            0            0K            4
       tcp_log_dev            0            0K          352
      midi buffers            0            0K            0
             mixer            0            0K            0
              ac97            0            0K            0
             hdacc            0            0K            0
              hdac            0            0K            0
              hdaa            0            0K            0
         acpicmbat            0            0K            0
       SIIS driver            0            0K            0
               PUC            0            0K            0
          ppbusdev            0            0K            0
agtiapi_MemAlloc malloc            0            0K            0
    osti_cacheable            0            0K            0
          tempbuff            0            0K            0
            biobuf            0            0K            0
              aios            0            0K            0
               lio            0            0K            0
               acl            0            0K            0
          tempbuff            0            0K            0
          mbuf_tag            0            0K          120
ag_tgt_map_t malloc            0            0K            0
ag_slr_map_t malloc            0            0K            0
lDevFlags * malloc            0            0K            0
tiDeviceHandle_t * malloc            0            0K            0
ag_portal_data_t malloc            0            0K            0
ag_device_t malloc            0            0K            0
     STLock malloc            0            0K            0
          CCB List            0            0K            0
            sr_iov            0            0K            0
               OCS            0            0K            0
               OCS            0            0K            0
              nvme            0            0K            0
               nvd            0            0K            0
            netmap            0            0K            0
            mwldev            0            0K            0
        MVS driver            0            0K            0
     CAM ccb queue            0            0K            0
          mrsasbuf            0            0K            0
          mpt_user            0            0K            0
          mps_user            0            0K            0
              accf            0            0K            0
               pts            0            0K            0
          ioctlops            0            0K          622
           eventfd            0            0K            0
           Witness            0            0K            0
             stack            0            0K            0
            MPSSAS            0            0K            0
               mps            0            0K            0
          mpr_user            0            0K            0
            MPRSAS            0            0K            0
               mpr            0            0K            0
            mfibuf            0            0K            0
              sbuf            0            0K          288
        md_sectors            0            0K            0
          firmware            0            0K            0
        compressor            0            0K            0
           md_disk            0            0K            0
              SWAP            0            0K            0
           malodev            0            0K            0
               LED            0            0K            0
         sysctltmp            0            0K          860
            sysctl            0            0K            3
              ekcd            0            0K            0
            dumper            0            0K            0
          sendfile            0            0K            0
              rctl            0            0K            0
          ix_sriov            0            0K            0
        aacraidcam            0            0K            0
       aacraid_buf            0            0K            0
                ix            0            0K            0
            ipsbuf            0            0K            0
             cache            0            0K            0
            iirbuf            0            0K            0
      prison_racct            0            0K            0
       Fail Points            0            0K            0
             sigio            0            0K            3
filedesc_to_leader            0            0K           31
               pwd            0            0K            0
       tty console            0            0K            0
            aaccam            0            0K            0
            aacbuf            0            0K            0
              zstd            0            0K            0
            XZ_DEC            0            0K            0
            nvlist            0            0K            0
          SCSI ENC            0            0K            0
           SCSI sa            0            0K            0
         scsi_pass            0            0K            0
        isofs_node            0            0K            0
       isofs_mount            0            0K            0
     tr_raid5_data            0            0K            0
    tr_raid1e_data            0            0K            0
     tr_raid1_data            0            0K            0
     tr_raid0_data            0            0K            0
    tr_concat_data            0            0K            0
       md_sii_data            0            0K            0
   md_promise_data            0            0K            0
    md_nvidia_data            0            0K            0
   md_jmicron_data            0            0K            0
     md_intel_data            0            0K            0
       md_ddf_data            0            0K            0
         raid_data            0            0K           72
     geom_flashmap            0            0K            0
         tmpfs dir            0            0K            0
        tmpfs name            0            0K            0
       tmpfs mount            0            0K            0
           NFS FHA            0            0K            0
         newnfsmnt            0            0K            0
  newnfsclient_req            0            0K            0
   NFSCL layrecall            0            0K            0
     NFSCL session            0            0K            0
     NFSCL sockreq            0            0K            0
     NFSCL devinfo            0            0K            0
     NFSCL flayout            0            0K            0
      NFSCL layout            0            0K            0
     NFSD rollback            0            0K            0
      NFSCL diroff            0            0K            0
       NEWdirectio            0            0K            0
        NEWNFSnode            0            0K            0
         NFSCL lck            0            0K            0
db> show uma
              Zone   Size    Used    Free    Requests  Sleeps  Bucket  Total Mem    XFree
   mbuf_jumbo_page   4096    8321     987     1097908       0     254   38125568        0
        malloc-384    384   35885     195       59328       0      30   13854720        0
       malloc-1024   1024    4174       6        4177       0      16    4280320        0
           tcp_log    416       0    9999       84767       0     254    4159584        0
       malloc-1024   1024     147    2905       18106       0      16    3125248        0
       malloc-8192   8192     328       2        1099       0       1    2703360        0
              pbuf   2624       0     989           0       0       2    2595136        0
              mbuf    256    8967     648     2017894       0     254    2461440        0
       malloc-8192   8192     200      90       22703       0       1    2375680        0
          BUF TRIE    144     194   13274        3226       0      62    1939392        0
        RADIX NODE    144   11438     683      492058       0      63    1745424        0
       malloc-1024   1024     133    1567       16485       0      16    1740800        0
       UMA Slabs 0    112   14200      17       14200       0     126    1592304        0
        malloc-512    512     200    2904       18400       0      30    1589248        0
        malloc-384    384     599    2911       83620       0      30    1347840        0
      mbuf_cluster   2048     615       1         615       0     254    1261568        0
        malloc-384    384    2065     485      348924       0      30     979200        0
       malloc-8192   8192     100       6       18086       0       1     868352        0
         sctp_asoc   2288     196     144       10118       0     254     777920        0
           sctp_ep   1280     198     390       22698       0     254     752640        0
        malloc-384    384    1729      31       53917       0      30     675840        0
         FFS inode   1160     520      26       17913       0       8     633360        0
       malloc-1024   1024     399     193       37342       0      16     606208        0
      malloc-65536  65536       4       5        1038       0       1     589824        0
       malloc-2048   2048     192      86       11365       0       8     569344        0
      malloc-32768  32768      11       6       17093       0       1     557056        0
       malloc-1024   1024     406     102       42075       0      16     520192        0
            THREAD   1808     194      26       18824       0       8     397760        0
      malloc-16384  16384      24       0          25       0       1     393216        0
            lkpimm    160       1    2324           1       0      62     372000        0
          lkpicurr    160       2    2323           2       0      62     372000        0
         VM OBJECT    264    1296      84      257068       0      30     364320        0
        256 Bucket   2048     155      15       18519       0       8     348160        0
        malloc-512    512      44     548       24231       0      30     303104        0
             VNODE    448     558      81       17953       0      30     286272        0
       tcp_bbr_map    128       0    2232       45235       0     126     285696        0
        sctp_raddr    736     196     189       16723       0     254     283360        0
            socket    944      43     257       28475       0     254     283200        0
      malloc-65536  65536       4       0           4       0       1     262144        0
       malloc-2048   2048     125       3         142       0       8     262144        0
        malloc-384    384     615      65        4732       0      30     261120        0
    ertt_txseginfo     40       0    6262      196990       0     254     250480        0
            DEVCTL   1024       0     220         153       0       0     225280        0
      malloc-16384  16384      11       2         247       0       1     212992        0
       malloc-8192   8192      23       3          39       0       1     212992        0
         MAP ENTRY     96    1681     377      967321       0     126     197568        0
         UMA Zones    768     242       2         242       0      16     187392        0
         vmem btag     56    3107     121        3107       0     254     180768        0
        malloc-384    384     397      63       72304       0      30     176640        0
       malloc-4096   4096      11      31       11094       0       2     172032        0
         tcp_inpcb    488       4     332        2830       0     254     163968        0
       mbuf_packet    256      92     523       31795       0     254     157440        0
        malloc-384    384     350      60       20408       0      30     157440        0
        malloc-512    512     196     108       39297       0      30     155648        0
              PROC   1328      98      19       18115       0       8     155376        0
       S VFS Cache    104    1028     376       18959       0     126     146016        0
       FFS2 dinode    256     520      50       17913       0      62     145920        0
       malloc-1024   1024     130       6         136       0      16     139264        0
      malloc-65536  65536       2       0           2       0       1     131072        0
      malloc-65536  65536       0       2         176       0       1     131072        0
        malloc-512    512     241      15       17389       0      30     131072        0
           VMSPACE   2544      40      11       18095       0       4     129744        0
        malloc-512    512     216      16         665       0      30     118784        0
          ksiginfo    112     102     942        1032       0     126     116928        0
      malloc-16384  16384       2       5          32       0       1     114688        0
         32 Bucket    256     307     128       21504       0      62     111360        0
      malloc-32768  32768       1       2         121       0       1      98304        0
         filedesc0   1072      67      24       18084       0       8      97552        0
        malloc-512    512     119      65       18167       0      30      94208        0
             tcpcb   1080       4      80        2830       0     254      90720        0
          UMA Kegs    384     227       6         227       0      30      89472        0
        128 Bucket   1024      56      31        3098       0      16      89088        0
       malloc-4096   4096      13       5         487       0       2      73728        0
         16 Bucket    144     347     129        4872       0      62      68544        0
      malloc-65536  65536       0       1           1       0       1      65536        0
      malloc-32768  32768       1       1          16       0       1      65536        0
      malloc-16384  16384       4       0           4       0       1      65536        0
             g_bio    408       8     152       37157       0      30      65280        0
       malloc-2048   2048      11      19         539       0       8      61440        0
        malloc-384    384     101      59       29017       0      30      61440        0
       malloc-8192   8192       2       5       17292       0       1      57344        0
       malloc-4096   4096       7       6          41       0       2      53248        0
        malloc-512    512      27      77        1553       0      30      53248        0
      malloc-16384  16384       3       0           3       0       1      49152        0
      malloc-16384  16384       2       1           6       0       1      49152        0
      malloc-16384  16384       3       0           3       0       1      49152        0
       malloc-8192   8192       3       3           9       0       1      49152        0
            pcpu-8      8    4761    1383        9581       0     254      49152        0
         64 Bucket    512      44      52       11694       0      30      49152        0
        sctp_chunk    152     173     139        7112       0     254      47424        0
        malloc-512    512      35      53         597       0      30      45056        0
            clpbuf   2624       0      16          20       0      16      41984        0
           DIRHASH   1024      34       6          34       0      16      40960        0
       malloc-2048   2048      16       4          25       0       8      40960        0
             Files     80     238     262       57788       0     126      40000        0
             NAMEI   1024       0      36       86214       0      16      36864        0
       malloc-2048   2048       2      16         228       0       8      36864        0
         TURNSTILE    136     221      31         221       0      62      34272        0
              pipe    744      23      22         921       0      16      33480        0
      malloc-32768  32768       1       0           1       0       1      32768        0
      malloc-32768  32768       1       0           1       0       1      32768        0
      malloc-32768  32768       1       0           1       0       1      32768        0
       malloc-4096   4096       6       2          10       0       2      32768        0
           pcpu-64     64     487      25         487       0     254      32768        0
       tcp_bbr_pcb    832       0      36        1370       0      16      29952        0
sctp_stream_msg_out    112      52     200        1631       0     254      28224        0
             KNOTE    160      29     146      243664       0      62      28000        0
       malloc-8192   8192       0       3          13       0       1      24576        0
       malloc-8192   8192       1       2          52       0       1      24576        0
       malloc-4096   4096       1       5          10       0       2      24576        0
               PWD     32      20     736       17174       0     254      24192        0
          2 Bucket     32     142     614        7592       0     254      24192        0
            ttyinq    160     135      15         300       0      62      24000        0
          8 Bucket     80      55     245        3789       0     126      24000        0
           ttyoutq    256      72      18         160       0      62      23040        0
        SLEEPQUEUE     88     221      35         221       0     126      22528        0
       malloc-4096   4096       3       2         109       0       2      20480        0
       Mountpoints   2752       2       5           2       0       4      19264        0
      malloc-16384  16384       1       0           1       0       1      16384        0
       malloc-4096   4096       2       2         399       0       2      16384        0
      vtnet_tx_hdr     24       0     668      695613       0     254      16032        0
     udplite_inpcb    488       0      32         671       0     254      15616        0
             unpcb    256      20      40        1698       0     254      15360        0
      tcp_rack_pcb    832       0      18         603       0      16      14976        0
       malloc-2048   2048       3       3         163       0       8      12288        0
       malloc-2048   2048       2       4           6       0       8      12288        0
           rtentry    176      30      39          34       0      62      12144        0
              ertt     72       4     164        2830       0     126      12096        0
        sctp_readq    152       0      78         648       0     254      11856        0
             ripcb    488       5      19         183       0     254      11712        0
         udp_inpcb    488       7      17         352       0     254      11712        0
              kenv    258      15      30        1042       0      30      11610        0
     routing nhops    256      27      18          34       0      62      11520        0
       malloc-2048   2048       4       0           4       0       8       8192        0
       malloc-1024   1024       1       7           9       0      16       8192        0
              PGRP     88      35      57          51       0     126       8096        0
          rl_entry     40      88     114          88       0     254       8080        0
        sctp_laddr     48      92      76        6126       0     254       8064        0
      tcp_rack_map    112       0      72         994       0     126       8064        0
             udpcb     32       7     245        1023       0     254       8064        0
              AIOP     32       4     248           4       0     254       8064        0
          4 Bucket     48       7     161         370       0     254       8064        0
               AIO    208       0      38           3       0      62       7904        0
             AIOCB    552       0      14           4       0      16       7728        0
     FPU_save_area    832       1       8           1       0      16       7488        0
            cpuset    104       7      55          34       0     126       6448        0
         domainset     40       0     126          23       0     254       5040        0
 epoch_record pcpu    256       4      12           4       0      62       4096        0
       malloc-4096   4096       1       0           1       0       2       4096        0
           pcpu-16     16       7     249           7       0     254       4096        0
         hostcache     64       1      62           1       0     254       4032        0
          syncache    168       0      24           4       0     254       4032        0
            itimer    352       0      11           2       0      30       3872        0
       UMA Slabs 1    176      11      11          11       0      62       3872        0
            mqnode    416       3       6           3       0      30       3744        0
        KMAP ENTRY     96      12      27          12       0       0       3744        0
              vmem   1856       1       1           1       0       8       3712        0
           SMR CPU     32       3      60           3       0     254       2016        0
        SMR SHARED     24       3      60           3       0     254       1512        0
       FFS1 dinode    128       0       0           0       0     126          0        0
            da_ccb    544       0       0           0       0      16          0        0
           ada_ccb    272       0       0           0       0      30          0        0
             swblk    136       0       0           0       0      62          0        0
          swpctrie    144       0       0           0       0      62          0        0
   sctp_asconf_ack     48       0       0           0       0     254          0        0
       sctp_asconf     40       0       0           0       0     254          0        0
   cdg_qdiffsample     16       0       0           0       0     254          0        0
   pf state scrubs     40       0       0           0       0     254          0        0
   pf frag entries     40       0       0           0       0     254          0        0
          pf frags    248       0       0           0       0      62          0        0
  pf table entries    160       0       0           0       0      62          0        0
pf table entry counters     64       0       0           0       0     254          0        0
   pf source nodes    136       0       0           0       0     254          0        0
     pf state keys     88       0       0           0       0     126          0        0
         pf states    304       0       0           0       0     254          0        0
           pf tags    104       0       0           0       0     126          0        0
          pf mtags     48       0       0           0       0     254          0        0
      tcp_log_node    120       0       0           0       0     126          0        0
    tcp_log_bucket    176       0       0           0       0      62          0        0
          tcpreass     48       0       0           0       0     254          0        0
tfo_ccache_entries     80       0       0           0       0     126          0        0
               tfo      4       0       0           0       0     254          0        0
          sackhole     32       0       0           0       0     254          0        0
             tcptw     88       0       0           0       0     254          0        0
               ipq     56       0       0           0       0     254          0        0
    IPsec SA lft_c     16       0       0           0       0     254          0        0
            AIOLIO    272       0       0           0       0      30          0        0
        mqnotifier    216       0       0           0       0      62          0        0
            mvdata     64       0       0           0       0     254          0        0
            mqueue    248       0       0           0       0      62          0        0
           NCLNODE    584       0       0           0       0      16          0        0
        TMPFS node    224       0       0           0       0      62          0        0
     LTS VFS Cache    360       0       0           0       0      30          0        0
       L VFS Cache    320       0       0           0       0      30          0        0
     STS VFS Cache    144       0       0           0       0      62          0        0
           cryptop    280       0       0           0       0      30          0        0
  linux_dma_object     24       0       0           0       0     254          0        0
  linux_dma_pctrie    144       0       0           0       0      62          0        0
   IOMMU_MAP_ENTRY    120       0       0           0       0     126          0        0
      ktls_session    128       0       0           0       0     126          0        0
    mbuf_jumbo_16k  16384       0       0           0       0     254          0        0
     mbuf_jumbo_9k   9216       0       0           0       0     254          0        0
      audit_record   1280       0       0           0       0       8          0        0
        MAC labels     40       0       0           0       0     254          0        0
            vnpbuf   2624       0       0           0       0      64          0        0
            mdpbuf   2624       0       0           0       0       3          0        0
           nfspbuf   2624       0       0           0       0      16          0        0
            swwbuf   2624       0       0           0       0       8          0        0
            swrbuf   2624       0       0           0       0      16          0        0
          umtx_shm     88       0       0           0       0     126          0        0
           umtx pi     96       0       0           0       0     126          0        0
rangeset pctrie nodes    144       0       0           0       0      62          0        0
      malloc-65536  65536       0       0           0       0       1          0        0
      malloc-65536  65536       0       0           0       0       1          0        0
      malloc-65536  65536       0       0           0       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
       malloc-1024   1024       0       0           0       0      16          0        0
        malloc-256    256       0       0           0       0      62          0        0
        malloc-256    256       0       0           0       0      62          0        0
        malloc-256    256       0       0           0       0      62          0        0
        malloc-256    256       0       0           0       0      62          0        0
        malloc-256    256       0       0           0       0      62          0        0
        malloc-256    256       0       0           0       0      62          0        0
        malloc-256    256       0       0           0       0      62          0        0
        malloc-256    256       0       0           0       0      62          0        0
        malloc-128    128       0       0           0       0     126          0        0
        malloc-128    128       0       0           0       0     126          0        0
        malloc-128    128       0       0           0       0     126          0        0
        malloc-128    128       0       0           0       0     126          0        0
        malloc-128    128       0       0           0       0     126          0        0
        malloc-128    128       0       0           0       0     126          0        0
        malloc-128    128       0       0           0       0     126          0        0
        malloc-128    128       0       0           0       0     126          0        0
         malloc-64     64       0       0           0       0     254          0        0
         malloc-64     64       0       0           0       0     254          0        0
         malloc-64     64       0       0           0       0     254          0        0
         malloc-64     64       0       0           0       0     254          0        0
         malloc-64     64       0       0           0       0     254          0        0
         malloc-64     64       0       0           0       0     254          0        0
         malloc-64     64       0       0           0       0     254          0        0
         malloc-64     64       0       0           0       0     254          0        0
         malloc-32     32       0       0           0       0     254          0        0
         malloc-32     32       0       0           0       0     254          0        0
         malloc-32     32       0       0           0       0     254          0        0
         malloc-32     32       0       0           0       0     254          0        0
         malloc-32     32       0       0           0       0     254          0        0
         malloc-32     32       0       0           0       0     254          0        0
         malloc-32     32       0       0           0       0     254          0        0
         malloc-32     32       0       0           0       0     254          0        0
         malloc-16     16       0       0           0       0     254          0        0
         malloc-16     16       0       0           0       0     254          0        0
         malloc-16     16       0       0           0       0     254          0        0
         malloc-16     16       0       0           0       0     254          0        0
         malloc-16     16       0       0           0       0     254          0        0
         malloc-16     16       0       0           0       0     254          0        0
         malloc-16     16       0       0           0       0     254          0        0
         malloc-16     16       0       0           0       0     254          0        0
           pcpu-32     32       0       0           0       0     254          0        0
            pcpu-4      4       0       0           0       0     254          0        0
            fakepg    104       0       0           0       0     126          0        0
          UMA Hash    256       0       0           0       0      62          0        0

Crashes (1):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2021/06/24 18:33 freebsd-src e6caac717b4f ec865f6a console log report ci-freebsd-i386 Fatal trap 12: page fault in filt_timerdetach
* Struck through repros no longer work on HEAD.