Fatal trap 12: page fault while in kernel mode (3)

Fatal trap 12: page fault while in kernel mode (3)

Status: fixed on 2021/09/18 04:00
Reported-by: syzbot+104d8ee3430361cb2795@syzkaller.appspotmail.com
Fix commit: ade1daa5c0d6 socket: Synchronize soshutdown() with listen(2) and AIO
First crash: 1556d, last: 949d

▶ ▼ Similar bugs (7)

Kernel	Title	Repro	Count	Last	Reported	Patched	Status
freebsd	Fatal trap 12: page fault while in kernel mode	C	103	1862d	1867d	0/2	closed as dup on 2019/03/22 15:29
freebsd	Fatal trap 12: page fault while in kernel mode (2)		2	1666d	1782d	0/2	auto-closed as invalid on 2019/12/31 21:21
freebsd	Fatal trap NUM: page fault while in kernel mode (3)		3	848d	862d	0/2	auto-closed as invalid on 2022/03/28 07:44
freebsd	Fatal trap NUM: page fault while in kernel mode (2)		1	873d	873d	2/2	fixed on 2021/12/14 01:02
freebsd	Fatal trap NUM: page fault while in kernel mode (4)	C	7	432d	757d	0/2	closed as invalid on 2023/10/05 09:23
freebsd	Fatal trap NUM: page fault while in kernel mode		177	938d	942d	2/2	fixed on 2021/09/29 10:05
freebsd	Fatal trap NUM: page fault while in kernel mode (5)		15	15d	92d	0/2	upstream: reported on 2024/01/23 18:25

Sample crash report:

Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 00
fault virtual address	= 0x0
fault code		= supervisor read instruction, page not present
instruction pointer	= 0x20:0x0
stack pointer	        = 0x28:0xfffffe00516f4b78
frame pointer	        = 0x28:0xfffffe00516f4bb0
code segment		= base 0x0, limit 0xfffff, type 0x1b
			= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags	= interrupt enabled, resume, IOPL = 0
current process		= 7 (soaiod1)
trap number		= 12
panic: page fault
cpuid = 0
time = 1622986360
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x47/frame 0xfffffe00516f47d0
vpanic() at vpanic+0x1c7/frame 0xfffffe00516f4830
panic() at panic+0x43/frame 0xfffffe00516f4890
trap_fatal() at trap_fatal+0x4cd/frame 0xfffffe00516f4910
trap_pfault() at trap_pfault+0xd4/frame 0xfffffe00516f4980
trap() at trap+0x3cd/frame 0xfffffe00516f4aa0
calltrap() at calltrap+0x8/frame 0xfffffe00516f4aa0
--- trap 0xc, rip = 0, rsp = 0xfffffe00516f4b78, rbp = 0xfffffe00516f4bb0 ---
??() at 0/frame 0xfffffe00516f4bb0
fork_exit() at fork_exit+0xb3/frame 0xfffffe00516f4bf0
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00516f4bf0
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
KDB: enter: panic
[ thread pid 7 tid 100065 ]
Stopped at      kdb_enter+0x67: movq    $0,0x1635ede(%rip)
db> 
db> set $lines = 0
db> set $maxwidth = 0
db> show registers
cs                        0x20
ds                        0x3b
es                        0x3b
fs                        0x13
gs                        0x1b
ss                        0x28
rax                       0x12
rcx                       0x80
rdx         0xffffffff819cacda
rbx                          0
rsp         0xfffffe00516f47b0
rbp         0xfffffe00516f47d0
rsi                        0x1
rdi                          0
r8                           0
r9          0x8080808080808080
r10         0xfffffe00516f46a0
r11              0x1ffaefff59c
r12         0xffffffff82267ba0  ddb_dbbe
r13                          0
r14         0xffffffff81a7c9c8
r15         0xffffffff81a7c9c8
rip         0xffffffff811332a7  kdb_enter+0x67
rflags                    0x82
kdb_enter+0x67: movq    $0,0x1635ede(%rip)
db> show proc
Process 7 (soaiod1) at 0xfffff80004de8000:
 state: NORMAL
 uid: 0  gids: 0
 parent: pid 0 at 0xffffffff8271c6b0
 ABI: null
 flag: 0x10000204  flag2: 0
 reaper: 0xffffffff8271c6b0 reapsubtree: 7
 sigparent: 20
 vmspace: 0xffffffff8271d310
   (map 0xffffffff8271d310)
   (map.pmap 0xffffffff8271d3d0)
   (pmap 0xffffffff8271d430)
 threads: 1
100065                   Run     CPU 0                       [soaiod1]
db> ps
  pid  ppid  pgrp   uid  state   wmesg   wchan               cmd
  789     0     0     0  DL      aiordy  0xfffff8005b2b5000  [aiod4]
  788     0     0     0  DL      aiordy  0xfffff8005b31c000  [aiod3]
  787     0     0     0  DL      aiordy  0xfffff8005b39aa60  [aiod2]
  786     0     0     0  DL      aiordy  0xfffff80015e86a60  [aiod1]
  785   783   783     0  R       (threaded)                  syz-executor1196331
100107                   Run     CPU 1                       syz-executor1196331
100122                   RunQ                                syz-executor1196331
100123                   RunQ                                syz-executor1196331
  783   781   783     0  Ss      pause   0xfffff8005b31c5e0  csh
  781   694   781     0  Ss      select  0xfffff8005b548bc0  sshd
  760     1   760     0  Ss+     ttyin   0xfffff8001541bcb0  getty
  759     1   759     0  Ss+     ttyin   0xfffff80015aaa4b0  getty
  758     1   758     0  Ss+     ttyin   0xfffff80015aaacb0  getty
  757     1   757     0  Ss+     ttyin   0xfffff80015aae4b0  getty
  756     1   756     0  Ss+     ttyin   0xfffff80015aaecb0  getty
  755     1   755     0  Ss+     ttyin   0xfffff80015a354b0  getty
  754     1   754     0  Ss+     ttyin   0xfffff80015a35cb0  getty
  753     1   753     0  Ss+     ttyin   0xfffff80015a3c4b0  getty
  752     1   752     0  Ss+     ttyin   0xfffff80015a3ccb0  getty
  750     1    24     0  S+      piperd  0xfffff8005b2b88b8  logger
  749   748    24     0  S+      nanslp  0xffffffff8273c8e1  sleep
  748     1    24     0  S+      wait    0xfffff8005b2b5530  sh
  698     1   698     0  Ss      nanslp  0xffffffff8273c8e0  cron
  694     1   694     0  Ss      select  0xfffff8005b3c9ec0  sshd
  507     1   507     0  Ss      select  0xfffff8005b297440  syslogd
  436     1   436     0  Ss      select  0xfffff8005b325740  devd
  435     1   435    65  Ss      select  0xfffff8005b3255c0  dhclient
  350     1   350     0  Ss      select  0xfffff8005b2978c0  dhclient
  347     1   347     0  Ss      select  0xfffff8005b297740  dhclient
   23     0     0     0  DL      vlruwt  0xfffff80015c4b530  [vnlru]
   22     0     0     0  DL      syncer  0xffffffff8282bcd0  [syncer]
   21     0     0     0  DL      (threaded)                  [bufdaemon]
100081                   D       qsleep  0xffffffff8282ada0  [bufdaemon]
100086                   D       -       0xffffffff8220aec0  [bufspacedaemon-0]
100097                   D       sdflush 0xfffff80004d594e8  [/ worker]
   20     0     0     0  DL      psleep  0xffffffff82852c08  [vmdaemon]
   19     0     0     0  DL      (threaded)                  [pagedaemon]
100079                   D       psleep  0xffffffff82847078  [dom0]
100087                   D       launds  0xffffffff82847084  [laundry: dom0]
100088                   D       umarcl  0xffffffff815d0a90  [uma]
   18     0     0     0  DL      -       0xffffffff82570c88  [rand_harvestq]
   17     0     0     0  DL      waiting 0xffffffff82f93828  [sctp_iterator]
   16     0     0     0  DL      pftm    0xffffffff830993c0  [pf purge]
   15     0     0     0  DL      -       0xffffffff8282845c  [soaiod4]
    9     0     0     0  DL      -       0xffffffff8282845c  [soaiod3]
    8     0     0     0  DL      -       0xffffffff8282845c  [soaiod2]
    7     0     0     0  RL      CPU 0                       [soaiod1]
    6     0     0     0  DL      (threaded)                  [cam]
100044                   D       -       0xffffffff82448140  [doneq0]
100045                   D       -       0xffffffff824480c0  [async]
100078                   D       -       0xffffffff82447f90  [scanner]
   14     0     0     0  DL      seqstat 0xfffff80004debc88  [sequencer 00]
    5     0     0     0  DL      crypto_ 0xfffff80004d3dd80  [crypto returns 1]
    4     0     0     0  DL      crypto_ 0xfffff80004d3dd30  [crypto returns 0]
    3     0     0     0  DL      crypto_ 0xffffffff82844560  [crypto]
   13     0     0     0  DL      (threaded)                  [geom]
100035                   D       -       0xffffffff8271c120  [g_event]
100036                   D       -       0xffffffff8271c128  [g_up]
100037                   D       -       0xffffffff8271c130  [g_down]
    2     0     0     0  DL      (threaded)                  [KTLS]
100028                   D       -       0xfffff80004c4ad00  [thr_0]
100029                   D       -       0xfffff80004c4ad80  [thr_1]
   12     0     0     0  WL      (threaded)                  [intr]
100011                   I                                   [swi5: fast taskq]
100014                   I                                   [swi6: task queue]
100016                   I                                   [swi6: Giant taskq]
100030                   I                                   [swi3: vm]
100031                   I                                   [swi4: clock (0)]
100032                   I                                   [swi4: clock (1)]
100033                   I                                   [swi1: netisr 0]
100046                   I                                   [irq24: virtio_pci0]
100047                   I                                   [irq25: virtio_pci0]
100048                   I                                   [irq26: virtio_pci0]
100049                   I                                   [irq27: virtio_pci0]
100050                   I                                   [irq28: virtio_pci1]
100051                   I                                   [irq29: virtio_pci1]
100052                   I                                   [irq30: virtio_pci1]
100053                   I                                   [irq31: virtio_pci1]
100054                   I                                   [irq32: virtio_pci1]
100059                   I                                   [irq10: virtio_pci2]
100061                   I                                   [irq1: atkbd0]
100062                   I                                   [irq12: psm0]
100063                   I                                   [swi0: uart uart++]
100071                   I                                   [swi1: pf send]
100084                   I                                   [swi1: hpts]
100085                   I                                   [swi1: hpts]
   11     0     0     0  RL      (threaded)                  [idle]
100003                   CanRun                              [idle: cpu0]
100004                   CanRun                              [idle: cpu1]
    1     0     1     0  SLs     wait    0xfffff80004bd7530  [init]
   10     0     0     0  DL      audit_w 0xffffffff82844a70  [audit]
    0     0     0     0  DLs     (threaded)                  [kernel]
100000                   D       swapin  0xffffffff8271c6b0  [swapper]
100005                   D       -       0xfffff8000443a500  [if_io_tqg_0]
100006                   D       -       0xfffff8000443a100  [if_io_tqg_1]
100007                   D       -       0xfffff80004c73d00  [if_config_tqg_0]
100008                   D       -       0xfffff80004c73900  [softirq_0]
100009                   D       -       0xfffff80004c73500  [softirq_1]
100010                   D       -       0xfffff80004c73100  [aiod_kick taskq]
100012                   D       -       0xfffff80004c70900  [kqueue_ctx taskq]
100013                   D       -       0xfffff80004c70500  [pci_hp taskq]
100015                   D       -       0xfffff80004c66d00  [inm_free taskq]
100017                   D       -       0xfffff80004c66500  [linuxkpi_irq_wq]
100018                   D       -       0xfffff80004c66100  [thread taskq]
100019                   D       -       0xfffff80004c63d00  [in6m_free taskq]
100020                   D       -       0xfffff80004c63900  [linuxkpi_short_wq_0]
100021                   D       -       0xfffff80004c63900  [linuxkpi_short_wq_1]
100022                   D       -       0xfffff80004c63900  [linuxkpi_short_wq_2]
100023                   D       -       0xfffff80004c63900  [linuxkpi_short_wq_3]
100024                   D       -       0xfffff80004c63500  [linuxkpi_long_wq_0]
100025                   D       -       0xfffff80004c63500  [linuxkpi_long_wq_1]
100026                   D       -       0xfffff80004c63500  [linuxkpi_long_wq_2]
100027                   D       -       0xfffff80004c63500  [linuxkpi_long_wq_3]
100034                   D       -       0xfffff80004c63100  [firmware taskq]
100038                   D       -       0xfffff80004db8d00  [crypto_0]
100039                   D       -       0xfffff80004db8d00  [crypto_1]
100055                   D       -       0xfffff80004db8100  [vtnet0 rxq 0]
100056                   D       -       0xfffff80015361d00  [vtnet0 txq 0]
100057                   D       -       0xfffff80015361900  [vtnet0 rxq 1]
100058                   D       -       0xfffff80015361500  [vtnet0 txq 1]
100060                   D       vtbslp  0xfffff80015372300  [virtio_balloon]
100064                   D       -       0xfffff80015361100  [mca taskq]
100066                   D       -       0xffffffff81e29961  [deadlkres]
100074                   D       -       0xfffff80015a43100  [acpi_task_0]
100075                   D       -       0xfffff80015a43100  [acpi_task_1]
100076                   D       -       0xfffff80015a43100  [acpi_task_2]
100077                   D       -       0xfffff80004db8500  [CAM taskq]
db> show all locks
Process 785 (syz-executor1196331) thread 0xfffffe005599fc80 (100107)
exclusive sleep mutex umtxql (umtxql) r = 0 (0xffffffff8275de80) locked @ /syzkaller/managers/main/kernel/sys/kern/kern_umtx.c:946
db> show malloc
              Type        InUse        MemUse     Requests
         sysctloid        34288        12858K        34355
           pf_hash            5        11560K            5
            devbuf         4216         6982K         4241
          tcp_hpts            5         3219K            5
              kobj          328         2624K          488
             vtbuf           24         2064K           46
            newblk          560         1312K          605
          vfscache            3         1035K            3
            acpica         1674          649K        54692
               pcb           24          613K           78
          inodedep           27          546K           71
           callout            2          528K            2
         ufs_quota            1          520K            1
          vfs_hash            1          520K            1
              intr            4          480K            4
           subproc          108          458K          848
               bus          990          378K         3485
            linker          348          270K          397
            DEVFS1          103          206K          112
            module          512          192K          512
         vnet_data            1          176K            1
           tidhash            3          164K            3
           kdtrace          174          143K          914
           pagedep            8          140K           18
        tfo_ccache            1          136K            1
               sem            4          120K            4
              umtx          264          116K          264
               UMA          270          102K          270
     audit_evclass          236           89K          294
          mtx_pool            2           80K            2
          syncache            1           76K            1
              temp           18           71K         1613
               msg            4           68K            4
               BPF           10           68K           10
          acpitask            1           64K            1
       ddb_capture            1           64K            1
            DEVFS3          122           61K          132
        gtaskqueue           18           57K           18
              vmem            3           56K            4
        DEVFS_RULE           56           54K           56
              kenv           95           52K           95
      eventhandler          133           50K          133
           ithread           99           43K           99
              rman           84           42K          425
            ifaddr           30           40K           32
            KTRACE          100           38K          100
         taskqueue           60           36K           60
              proc            3           34K            3
         ufs_mount            5           34K            6
            bus-sc           33           34K         1696
          routetbl           50           34K          176
           devstat            4           33K            4
         hostcache            1           32K            1
               tty           16           32K           16
               shm            1           32K            1
              GEOM           60           29K          489
            kbdmux            6           28K            6
              cred           23           23K          234
         CAM queue            5           21K         1528
         pfs_nodes           20           20K           20
            kqueue           50           19K          792
           pwddesc           50           19K          790
              UART           12           18K           12
            plimit           17           17K          322
         bmsafemap            2           17K           39
              ksem            1           16K            1
               rpc            2           16K            2
             shmfd            1           16K            1
       pfs_vncache            1           16K            1
       ether_multi           40           15K           50
         proc-args           39           15K          488
       ufs_dirhash           24           14K           24
            sglist            5           13K            5
               MCA           32           12K           32
           CAM DEV            3           12K          510
                vt           11           11K           11
         in6_multi           25           11K           25
           acpisem           28           11K           28
           CAM XPT           22           11K          543
             selfd           27           11K         9143
            Unitno           27           11K           39
           lltable           12           10K           12
           session           20           10K           31
           uidinfo            3            9K            8
             ifnet            3            9K            3
           memdesc            1            8K            1
         ipsec-saq            2            8K            2
             evdev            4            8K            4
          filedesc            1            8K            1
           acpidev           20            8K           20
             hhook           15            8K           17
             mount           16            7K           90
          pf_ifnet            5            6K            6
       fpukern_ctx            3            6K            3
             lockf           15            6K           22
          terminal           11            6K           11
          freefile           13            5K           22
       ipsecpolicy            2            5K            2
 encap_export_host           12            5K           12
             clone            9            5K            9
       inpcbpolicy           11            5K          138
        local_apic            1            4K            1
           io_apic            1            4K            1
            sahead            1            4K            1
          secasvar            1            4K            1
          pci_link           10            4K           10
               msi            9            4K            9
             DEVFS            9            4K           10
               osd            8            4K           20
             ipsec            3            3K            3
             nhops            6            3K            6
          nexusdev            7            3K            7
            diradd            7            3K           36
            feeder            7            3K            7
            select            7            3K           29
         toponodes            6            3K            6
            prison            6            3K            6
            isadev            6            3K            6
           softdep            1            2K            1
            dirrem            4            2K           28
       vnodemarker            2            2K           10
      NFSD session            1            2K            1
          sctp_ifa            5            2K            6
             linux            5            2K            6
        CAM periph            4            2K          271
            soname            5            2K         3232
            crypto            4            2K            4
            ip6ndp            4            2K            5
            DEVFSP            4            2K            9
         newdirblk            4            2K            8
             mkdir            4            2K           16
          indirdep            3            2K            3
              pfil            4            2K            4
          CAM path            4            2K         1034
          filecaps            4            2K           66
           tcpfunc            3            2K            3
               tun            3            2K            3
        loginclass            3            2K            7
          in_multi            2            1K            4
    chacha20random            1            1K            1
            vnodes            1            1K            1
           CAM SIM            2            1K            2
              ktls            1            1K            1
              cdev            2            1K            2
        aesni_data            2            1K            2
          sctp_ifn            2            1K            6
              cpus            2            1K            2
          atkbddev            2            1K            2
     CAM dev queue            2            1K            2
             xform            2            1K           49
               mld            2            1K            2
              igmp            2            1K            2
           entropy            2            1K           35
      NFSD lckfile            1            1K            1
     NFSD V4client            1            1K            1
          procdesc            1            1K            6
          pmchooks            1            1K            1
          sctp_vrf            1            1K            1
            apmdev            1            1K            1
          freework            1            1K           26
 CAM I/O Scheduler            1            1K            1
    vnet_data_free            1            1K            1
              vnet            1            1K            1
           Per-cpu            1            1K            1
          p1003.1b            1            1K            1
          acpiintr            1            1K            1
               pmc            1            1K            1
          pf_table            0            0K            0
           pf_rule            0            0K            0
           pf_altq            0            0K            0
           pf_osfp            0            0K            0
           pf_temp            0            0K            0
        sctp_mcore            0            0K            0
        sctp_socko            0            0K            0
         sctp_iter            0            0K            3
         sctp_mvrf            0            0K            0
         sctp_timw            0            0K            0
         sctp_cpal            0            0K            0
         sctp_cmsg            0            0K            0
         sctp_stre            0            0K            0
         sctp_athi            0            0K            0
         sctp_athm            0            0K            0
         sctp_atky            0            0K            0
         sctp_atcl            0            0K            0
         sctp_a_it            0            0K            3
         sctp_aadr            0            0K            0
         sctp_stro            0            0K            0
         sctp_stri            0            0K            0
          sctp_map            0            0K            0
        cubic data            0            0K            0
        vegas data            0            0K            0
            tcp_do            0            0K            0
           tcp_fsb            0            0K            0
         htcp data            0            0K            0
            mqdata            0            0K            0
          cdg data            0            0K            0
          chd data            0            0K            0
        dctcp data            0            0K            0
      NFSCL lckown            0            0K            0
      NFSCL client            0            0K            0
        madt_table            0            0K            2
          smartpqi            0            0K            0
       NFSCL deleg            0            0K            0
        NFSCL open            0            0K            0
       NFSCL owner            0            0K            0
            NFS fh            0            0K            0
           NFS req            0            0K            0
     NFSD usrgroup            0            0K            0
       NFSD string            0            0K            0
              iavf            0            0K            0
               ixl            0            0K            0
       NFSD V4lock            0            0K            0
      NFSD V4state            0            0K            0
     NFSD srvcache            0            0K            0
       msdosfs_fat            0            0K            0
     msdosfs_mount            0            0K            0
      msdosfs_node            0            0K            0
        ice-resmgr            0            0K            0
         ice-osdep            0            0K            0
               ice            0            0K            0
             axgbe            0            0K            0
            DEVFS4            0            0K            0
            DEVFS2            0            0K            0
            gntdev            0            0K            0
       privcmd_dev            0            0K            0
        evtchn_dev            0            0K            0
          xen_intr            0            0K            0
          xenstore            0            0K            0
         ciss_data            0            0K            0
           xen_hvm            0            0K            0
         legacydrv            0            0K            0
            qpidrv            0            0K            0
         BACKLIGHT            0            0K            0
               xnb            0            0K            0
      dmar_idpgtbl            0            0K            0
          dmar_dom            0            0K            0
          dmar_ctx            0            0K            0
              xbbd            0            0K            0
               xbd            0            0K            0
           Balloon            0            0K            0
              isci            0            0K            0
      iommu_dmamap            0            0K            0
          sysmouse            0            0K            0
     hyperv_socket            0            0K            0
           bxe_ilt            0            0K            0
            xenbus            0            0K            0
            vtfont            0            0K            0
     vm_fictitious            0            0K            0
           ath_hal            0            0K            0
            athdev            0            0K            0
           ata_pci            0            0K            0
           ata_dma            0            0K            0
       ata_generic            0            0K            0
               amr            0            0K            0
            pvscsi            0            0K            0
           scsi_da            0            0K           69
            ata_da            0            0K            0
           scsi_ch            0            0K            0
           UMAHash            0            0K            0
           scsi_cd            0            0K            0
       AHCI driver            0            0K            0
         vm_pgdata            0            0K            0
           jblocks            0            0K            0
          savedino            0            0K           17
          sentinel            0            0K            0
            jfsync            0            0K            0
            jtrunc            0            0K            0
             sbdep            0            0K            3
           jsegdep            0            0K            0
              jseg            0            0K            0
         jfreefrag            0            0K            0
          jfreeblk            0            0K            0
           jnewblk            0            0K            0
            jmvref            0            0K            0
           jremref            0            0K            0
           jaddref            0            0K            0
           freedep            0            0K            0
          freeblks            0            0K           25
          freefrag            0            0K            7
        allocindir            0            0K            0
       allocdirect            0            0K            0
          ufs_trim            0            0K            0
           mactemp            0            0K            0
     audit_trigger            0            0K            0
 audit_pipe_presel            0            0K            0
     audit_pipeent            0            0K            0
        audit_pipe            0            0K            0
      audit_evname            0            0K            0
         audit_bsm            0            0K            0
      audit_gidset            0            0K            0
        audit_text            0            0K            0
        audit_path            0            0K            0
        audit_data            0            0K            0
        audit_cred            0            0K            0
            USBdev            0            0K            0
               USB            0            0K            0
               agp            0            0K            0
           nvme_da            0            0K            0
           acpipwr            0            0K            0
         acpi_perf            0            0K            0
          ktls_ocf            0            0K            0
            twsbuf            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
         MLX5E_TLS            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
            MLX5EN            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
          MLX5DUMP            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
          seq_file            0            0K            0
             radix            0            0K            0
               idr            0            0K            0
            lkpifw            0            0K            0
               NLM            0            0K            0
    ipsec-spdcache            0            0K            0
         ipsec-reg            0            0K            0
        ipsec-misc            0            0K            0
      ipsecrequest            0            0K            0
            ip6opt            0            0K            3
       ip6_msource            0            0K            0
      ip6_moptions            0            0K            0
       in6_mfilter            0            0K            0
             frag6            0            0K            0
            tcplog            0            0K            0
        tcp_hwpace            0            0K            0
      twe_commands            0            0K            0
               LRO            0            0K            0
      newreno data            0            0K            0
        ip_msource            0            0K            0
       ip_moptions            0            0K            0
        in_mfilter            0            0K            0
              ipid            0            0K            0
         80211scan            0            0K            0
      80211ratectl            0            0K            0
        80211power            0            0K            0
       80211nodeie            0            0K            0
         80211node            0            0K            0
      80211mesh_gt            0            0K            0
      80211mesh_rt            0            0K            0
         80211perr            0            0K            0
         80211prep            0            0K            0
         80211preq            0            0K            0
          80211dfs            0            0K            0
       80211crypto            0            0K            0
          80211vap            0            0K            0
             iflib            0            0K            0
              vlan            0            0K            0
               gif            0            0K            0
           ifdescr            0            0K            0
              zlib            0            0K            0
           fadvise            0            0K            0
           VN POLL            0            0K            0
      twa_commands            0            0K            0
            statfs            0            0K          196
     namei_tracker            0            0K            0
       export_host            0            0K            0
        cl_savebuf            0            0K            6
       tcp_log_dev            0            0K            0
      midi buffers            0            0K            0
             mixer            0            0K            0
              ac97            0            0K            0
             hdacc            0            0K            0
              hdac            0            0K            0
              hdaa            0            0K            0
         acpicmbat            0            0K            0
       SIIS driver            0            0K            0
           CAM CCB            0            0K         1798
               PUC            0            0K            0
          ppbusdev            0            0K            0
agtiapi_MemAlloc malloc            0            0K            0
    osti_cacheable            0            0K            0
          tempbuff            0            0K            0
            biobuf            0            0K            0
              aios            0            0K            0
               lio            0            0K            0
               acl            0            0K            0
          tempbuff            0            0K            0
          mbuf_tag            0            0K           27
ag_tgt_map_t malloc            0            0K            0
ag_slr_map_t malloc            0            0K            0
lDevFlags * malloc            0            0K            0
tiDeviceHandle_t * malloc            0            0K            0
ag_portal_data_t malloc            0            0K            0
ag_device_t malloc            0            0K            0
     STLock malloc            0            0K            0
          CCB List            0            0K            0
            sr_iov            0            0K            0
               OCS            0            0K            0
               OCS            0            0K            0
              nvme            0            0K            0
               nvd            0            0K            0
            netmap            0            0K            0
            mwldev            0            0K            0
        MVS driver            0            0K            0
     CAM ccb queue            0            0K            0
          mrsasbuf            0            0K            0
          mpt_user            0            0K            0
          mps_user            0            0K            0
              accf            0            0K            0
               pts            0            0K            0
               iov            0            0K        13513
          ioctlops            0            0K           86
           eventfd            0            0K            0
           Witness            0            0K            0
             stack            0            0K            0
            MPSSAS            0            0K            0
               mps            0            0K            0
          mpr_user            0            0K            0
            MPRSAS            0            0K            0
               mpr            0            0K            0
            mfibuf            0            0K            0
              sbuf            0            0K          288
        md_sectors            0            0K            0
          firmware            0            0K            0
        compressor            0            0K            0
           md_disk            0            0K            0
              SWAP            0            0K            0
           malodev            0            0K            0
               LED            0            0K            0
         sysctltmp            0            0K          618
            sysctl            0            0K            3
              ekcd            0            0K            0
            dumper            0            0K            0
          sendfile            0            0K            0
              rctl            0            0K            0
          ix_sriov            0            0K            0
        aacraidcam            0            0K            0
       aacraid_buf            0            0K            0
                ix            0            0K            0
            ipsbuf            0            0K            0
             cache            0            0K            0
            iirbuf            0            0K            0
          kcovinfo            0            0K            0
      prison_racct            0            0K            0
       Fail Points            0            0K            0
             sigio            0            0K            1
filedesc_to_leader            0            0K            0
               pwd            0            0K            0
       tty console            0            0K            0
            aaccam            0            0K            0
            aacbuf            0            0K            0
              zstd            0            0K            0
            XZ_DEC            0            0K            0
            nvlist            0            0K            0
          SCSI ENC            0            0K            0
           SCSI sa            0            0K            0
         scsi_pass            0            0K            0
        isofs_node            0            0K            0
       isofs_mount            0            0K            0
     tr_raid5_data            0            0K            0
    tr_raid1e_data            0            0K            0
     tr_raid1_data            0            0K            0
     tr_raid0_data            0            0K            0
    tr_concat_data            0            0K            0
       md_sii_data            0            0K            0
   md_promise_data            0            0K            0
    md_nvidia_data            0            0K            0
   md_jmicron_data            0            0K            0
     md_intel_data            0            0K            0
       md_ddf_data            0            0K            0
         raid_data            0            0K           72
     geom_flashmap            0            0K            0
         tmpfs dir            0            0K            0
        tmpfs name            0            0K            0
       tmpfs mount            0            0K            0
           NFS FHA            0            0K            0
         newnfsmnt            0            0K            0
  newnfsclient_req            0            0K            0
   NFSCL layrecall            0            0K            0
     NFSCL session            0            0K            0
     NFSCL sockreq            0            0K            0
     NFSCL devinfo            0            0K            0
     NFSCL flayout            0            0K            0
      NFSCL layout            0            0K            0
     NFSD rollback            0            0K            0
      NFSCL diroff            0            0K            0
       NEWdirectio            0            0K            0
        NEWNFSnode            0            0K            0
         NFSCL lck            0            0K            0
db> show uma
              Zone   Size    Used    Free    Requests  Sleeps  Bucket  Total Mem    XFree
   mbuf_jumbo_page   4096    8320     703       13326       0     254   36958208        0
        malloc-384    384   35242      18       35491       0      30   13539840        0
       malloc-1024   1024    4165      19        4187       0      16    4284416        0
       malloc-8192   8192     379       0        1279       0       1    3104768        0
              pbuf   2624       0     973           0       0       2    2553152        0
              mbuf    256    8579     691       15534       0     254    2373120        0
          BUF TRIE    144     169   13299         455       0      62    1939392        0
       UMA Slabs 0    112   11194      35       11194       0     126    1257648        0
        malloc-384    384    1696      34       53644       0      30     664320        0
         FFS inode   1160     486      25         509       0       8     592760        0
        malloc-384    384    1006      14        3198       0      30     391680        0
            lkpimm    160       1    2324           1       0      62     372000        0
          lkpicurr    160       2    2323           2       0      62     372000        0
        RADIX NODE    144    2133     160       20272       0      62     330192        0
        malloc-512    512     600       8         797       0      30     311296        0
      malloc-65536  65536       4       0           4       0       1     262144        0
         VM OBJECT    264     892      53       12697       0      30     249480        0
             VNODE    448     516      33         541       0      30     245952        0
       malloc-2048   2048     116       2         125       0       8     241664        0
            THREAD   1808     123       9         123       0       8     238656        0
            DEVCTL   1024       0     216         116       0       0     221184        0
        malloc-384    384     501      49       26223       0      30     211200        0
      malloc-65536  65536       1       2         177       0       1     196608        0
        malloc-384    384     483      27        1684       0      30     195840        0
         UMA Zones    768     242       2         242       0      16     187392        0
        malloc-384    384     450      30        4852       0      30     184320        0
      malloc-16384  16384       6       5          40       0       1     180224        0
      malloc-16384  16384      11       0          11       0       1     180224        0
      malloc-16384  16384       9       1          13       0       1     163840        0
       malloc-4096   4096       2      37        1840       0       2     159744        0
       malloc-1024   1024     148       4         455       0      16     155648        0
       malloc-8192   8192      16       1          43       0       1     139264        0
        256 Bucket   2048      58       8        9824       0       8     135168        0
         vmem btag     56    2332      32        2332       0     254     132384        0
      malloc-65536  65536       2       0           2       0       1     131072        0
      malloc-65536  65536       2       0           2       0       1     131072        0
       FFS2 dinode    256     486      24         508       0      62     130560        0
          ksiginfo    112      40    1004          56       0     126     116928        0
         MAP ENTRY     96     840     378       38046       0     126     116928        0
       S VFS Cache    104     966      48        1006       0     126     105456        0
      malloc-32768  32768       3       0          18       0       1      98304        0
          UMA Kegs    384     227       6         227       0      30      89472        0
        malloc-384    384     178      52         449       0      30      88320        0
       malloc-1024   1024      48      36         100       0      16      86016        0
            clpbuf   2624       0      32          20       0      16      83968        0
        malloc-512    512     150      10         448       0      30      81920        0
       malloc-1024   1024      59      17         308       0      16      77824        0
        malloc-512    512     144       8         215       0      30      77824        0
             g_bio    408       0     190        4645       0      30      77520        0
           VMSPACE   2544      23       7         764       0       4      76320        0
              PROC   1328      49       8         789       0       8      75696        0
       malloc-8192   8192       9       0           9       0       1      73728        0
       malloc-1024   1024      66       6          66       0      16      73728        0
       malloc-1024   1024      62       6         653       0      16      69632        0
      mbuf_cluster   2048      30       2          30       0     254      65536        0
      malloc-65536  65536       0       1           1       0       1      65536        0
      malloc-32768  32768       0       2         130       0       1      65536        0
      malloc-32768  32768       2       0           2       0       1      65536        0
       malloc-2048   2048      11      21        1391       0       8      65536        0
       malloc-4096   4096       8       7         531       0       2      61440        0
        malloc-512    512     104      16         475       0      30      61440        0
         filedesc0   1072      50       6         790       0       8      60032        0
        malloc-512    512      71      41         333       0      30      57344        0
      malloc-16384  16384       3       0           3       0       1      49152        0
      malloc-16384  16384       1       2         232       0       1      49152        0
       malloc-4096   4096       7       5          36       0       2      49152        0
         32 Bucket    256      65     115        8319       0      62      46080        0
           DIRHASH   1024      34       6          34       0      16      40960        0
       malloc-8192   8192       2       3         613       0       1      40960        0
       malloc-8192   8192       3       2         199       0       1      40960        0
        malloc-512    512      68      12         268       0      30      40960        0
             NAMEI   1024       0      36       11997       0      16      36864        0
            pcpu-8      8    4220     388        4248       0     254      36864        0
        128 Bucket   1024      22      13         139       0      16      35840        0
      malloc-32768  32768       1       0           1       0       1      32768        0
      malloc-32768  32768       1       0           1       0       1      32768        0
      malloc-16384  16384       2       0           2       0       1      32768        0
      malloc-16384  16384       2       0           2       0       1      32768        0
       malloc-2048   2048       3      13         152       0       8      32768        0
       malloc-2048   2048      16       0          16       0       8      32768        0
           pcpu-64     64     487      25         487       0     254      32768        0
        malloc-384    384      50      30         228       0      30      30720        0
       malloc-4096   4096       2       5          11       0       2      28672        0
        malloc-512    512      14      42        1412       0      30      28672        0
         64 Bucket    512      44      12        1297       0      30      28672        0
            socket    944      19       9        1254       0     254      26432        0
       malloc-4096   4096       6       0          10       0       2      24576        0
       malloc-4096   4096       6       0           6       0       2      24576        0
       malloc-4096   4096       3       3         450       0       2      24576        0
            ttyinq    160     135      15         300       0      62      24000        0
           ttyoutq    256      72      18         160       0      62      23040        0
        malloc-512    512      20      20          44       0      30      20480        0
          2 Bucket     32      80     550        1171       0     254      20160        0
         TURNSTILE    136     133      14         133       0      62      19992        0
       Mountpoints   2752       2       5           2       0       4      19264        0
              pipe    744       7      18         284       0      16      18600        0
        SLEEPQUEUE     88     133      59         133       0     126      16896        0
      malloc-16384  16384       1       0           1       0       1      16384        0
       malloc-8192   8192       0       2          12       0       1      16384        0
       malloc-2048   2048       4       4         167       0       8      16384        0
       malloc-2048   2048       8       0           8       0       8      16384        0
             tcpcb   1064       4      10           8       0     254      14896        0
       malloc-1024   1024       7       5          12       0      16      12288        0
             Files     80      72      78        6502       0     126      12000        0
         udp_inpcb    488       6      18         126       0     254      11712        0
              kenv    258      15      30        1032       0      30      11610        0
             unpcb    256       7      38        1099       0     254      11520        0
       malloc-8192   8192       1       0           2       0       1       8192        0
       malloc-4096   4096       2       0           2       0       2       8192        0
       malloc-1024   1024       3       5         428       0      16       8192        0
           rtentry    176      13      33          17       0      62       8096        0
              PGRP     88      20      72          31       0     126       8096        0
          rl_entry     40      33     169          33       0     254       8080        0
        sctp_laddr     48       0     168           4       0     254       8064        0
             udpcb     32       6     246         126       0     254       8064        0
              ertt     72       4     108           8       0     126       8064        0
               PWD     32      10     242         100       0     254       8064        0
         16 Bucket    144      38      18        1310       0      62       8064        0
          4 Bucket     48       5     163          54       0     254       8064        0
      vtnet_tx_hdr     24       0     334        1378       0     254       8016        0
             KNOTE    160       0      50           8       0      62       8000        0
          8 Bucket     80      32      68         333       0     126       8000        0
             ripcb    488       1      15           4       0     254       7808        0
         tcp_inpcb    488       4      12           8       0     254       7808        0
     routing nhops    256      10      20          17       0      62       7680        0
       mbuf_packet    256       0      30          93       0     254       7680        0
     FPU_save_area    832       1       8           1       0      16       7488        0
            cpuset    104       7      55           7       0     126       6448        0
 epoch_record pcpu    256       4      12           4       0      62       4096        0
       malloc-2048   2048       2       0           2       0       8       4096        0
           pcpu-16     16       7     249           7       0     254       4096        0
    ertt_txseginfo     40       1     100         207       0     254       4040        0
         hostcache     64       1      62           1       0     254       4032        0
          syncache    168       0      24           5       0     254       4032        0
              AIOP     32       4     122           4       0     254       4032        0
               AIO    208       1      18           1       0      62       3952        0
       UMA Slabs 1    176       8      14           8       0      62       3872        0
             AIOCB    552       1       6           1       0      16       3864        0
            mqnode    416       3       6           3       0      30       3744        0
        KMAP ENTRY     96      12      27          12       0       0       3744        0
              vmem   1856       1       1           1       0       8       3712        0
           SMR CPU     32       3      60           3       0     254       2016        0
        SMR SHARED     24       3      60           3       0     254       1512        0
       FFS1 dinode    128       0       0           0       0     126          0        0
            da_ccb    544       0       0           0       0      16          0        0
           ada_ccb    272       0       0           0       0      30          0        0
             swblk    136       0       0           0       0      62          0        0
          swpctrie    144       0       0           0       0      62          0        0
   sctp_asconf_ack     48       0       0           0       0     254          0        0
       sctp_asconf     40       0       0           0       0     254          0        0
sctp_stream_msg_out    112       0       0           0       0     254          0        0
        sctp_readq    152       0       0           0       0     254          0        0
        sctp_chunk    152       0       0           0       0     254          0        0
        sctp_raddr    736       0       0           0       0     254          0        0
         sctp_asoc   2288       0       0           0       0     254          0        0
           sctp_ep   1280       0       0           0       0     254          0        0
   cdg_qdiffsample     16       0       0           0       0     254          0        0
   pf state scrubs     40       0       0           0       0     254          0        0
   pf frag entries     40       0       0           0       0     254          0        0
          pf frags    248       0       0           0       0      62          0        0
  pf table entries    160       0       0           0       0      62          0        0
pf table entry counters     64       0       0           0       0     254          0        0
   pf source nodes    136       0       0           0       0     254          0        0
     pf state keys     88       0       0           0       0     126          0        0
         pf states    304       0       0           0       0     254          0        0
           pf tags    104       0       0           0       0     126          0        0
          pf mtags     48       0       0           0       0     254          0        0
       tcp_bbr_pcb    832       0       0           0       0      16          0        0
       tcp_bbr_map    128       0       0           0       0     126          0        0
      tcp_rack_pcb    832       0       0           0       0      16          0        0
      tcp_rack_map    112       0       0           0       0     126          0        0
     udplite_inpcb    488       0       0           0       0     254          0        0
      tcp_log_node    120       0       0           0       0     126          0        0
    tcp_log_bucket    176       0       0           0       0      62          0        0
           tcp_log    416       0       0           0       0     254          0        0
          tcpreass     48       0       0           0       0     254          0        0
tfo_ccache_entries     80       0       0           0       0     126          0        0
               tfo      4       0       0           0       0     254          0        0
          sackhole     32       0       0           0       0     254          0        0
             tcptw     88       0       0           0       0     254          0        0
               ipq     56       0       0           0       0     254          0        0
    IPsec SA lft_c     16       0       0           0       0     254          0        0
            itimer    352       0       0           0       0      30          0        0
            AIOLIO    272       0       0           0       0      30          0        0
        mqnotifier    216       0       0           0       0      62          0        0
            mvdata     64       0       0           0       0     254          0        0
            mqueue    248       0       0           0       0      62          0        0
        TMPFS node    224       0       0           0       0      62          0        0
           NCLNODE    584       0       0           0       0      16          0        0
     LTS VFS Cache    360       0       0           0       0      30          0        0
       L VFS Cache    320       0       0           0       0      30          0        0
     STS VFS Cache    144       0       0           0       0      62          0        0
           cryptop    280       0       0           0       0      30          0        0
  linux_dma_object     24       0       0           0       0     254          0        0
  linux_dma_pctrie    144       0       0           0       0      62          0        0
   IOMMU_MAP_ENTRY    120       0       0           0       0     126          0        0
      ktls_session    128       0       0           0       0     126          0        0
    mbuf_jumbo_16k  16384       0       0           0       0     254          0        0
     mbuf_jumbo_9k   9216       0       0           0       0     254          0        0
      audit_record   1280       0       0           0       0       8          0        0
         domainset     40       0       0           0       0     254          0        0
        MAC labels     40       0       0           0       0     254          0        0
            vnpbuf   2624       0       0           0       0      64          0        0
            mdpbuf   2624       0       0           0       0       3          0        0
           nfspbuf   2624       0       0           0       0      16          0        0
            swwbuf   2624       0       0           0       0       8          0        0
            swrbuf   2624       0       0           0       0      16          0        0
          umtx_shm     88       0       0           0       0     126          0        0
           umtx pi     96       0       0           0       0     126          0        0
rangeset pctrie nodes    144       0       0           0       0      62          0        0
      malloc-65536  65536       0       0           0       0       1          0        0
      malloc-65536  65536       0       0           0       0       1          0        0
      malloc-65536  65536       0       0           0       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
       malloc-8192   8192       0       0           0       0       1          0        0
       malloc-2048   2048       0       0           0       0       8          0        0
        malloc-256    256       0       0           0       0      62          0        0
        malloc-256    256       0       0           0       0      62          0        0
        malloc-256    256       0       0           0       0      62          0        0
        malloc-256    256       0       0           0       0      62          0        0
        malloc-256    256       0       0           0       0      62          0        0
        malloc-256    256       0       0           0       0      62          0        0
        malloc-256    256       0       0           0       0      62          0        0
        malloc-256    256       0       0           0       0      62          0        0
        malloc-128    128       0       0           0       0     126          0        0
        malloc-128    128       0       0           0       0     126          0        0
        malloc-128    128       0       0           0       0     126          0        0
        malloc-128    128       0       0           0       0     126          0        0
        malloc-128    128       0       0           0       0     126          0        0
        malloc-128    128       0       0           0       0     126          0        0
        malloc-128    128       0       0           0       0     126          0        0
        malloc-128    128       0       0           0       0     126          0        0
         malloc-64     64       0       0           0       0     254          0        0
         malloc-64     64       0       0           0       0     254          0        0
         malloc-64     64       0       0           0       0     254          0        0
         malloc-64     64       0       0           0       0     254          0        0
         malloc-64     64       0       0           0       0     254          0        0
         malloc-64     64       0       0           0       0     254          0        0
         malloc-64     64       0       0           0       0     254          0        0
         malloc-64     64       0       0           0       0     254          0        0
         malloc-32     32       0       0           0       0     254          0        0
         malloc-32     32       0       0           0       0     254          0        0
         malloc-32     32       0       0           0       0     254          0        0
         malloc-32     32       0       0           0       0     254          0        0
         malloc-32     32       0       0           0       0     254          0        0
         malloc-32     32       0       0           0       0     254          0        0
         malloc-32     32       0       0           0       0     254          0        0
         malloc-32     32       0       0           0       0     254          0        0
         malloc-16     16       0       0           0       0     254          0        0
         malloc-16     16       0       0           0       0     254          0        0
         malloc-16     16       0       0           0       0     254          0        0
         malloc-16     16       0       0           0       0     254          0        0
         malloc-16     16       0       0           0       0     254          0        0
         malloc-16     16       0       0           0       0     254          0        0
         malloc-16     16       0       0           0       0     254          0        0
         malloc-16     16       0       0           0       0     254          0        0
           pcpu-32     32       0       0           0       0     254          0        0
            pcpu-4      4       0       0           0       0     254          0        0
            fakepg    104       0       0           0       0     126          0        0
          UMA Hash    256       0       0           0       0      62          0        0

Crashes (140):
Time	Kernel	Commit	Syzkaller	Log	Report	Syz repro	C repro	Manager	Title
2021/06/06 13:34	freebsd-src	a5df139ec614	500c2339	console log	report	syz	C	ci-freebsd-main	Fatal trap 12: page fault while in kernel mode
2020/01/20 15:30	freebsd	7b465d316297	c40da18c	console log	report	syz		ci-freebsd-i386
2021/08/08 22:04	freebsd-src	9748eb742791	6972b106	console log	report			ci-freebsd-main	Fatal trap 12: page fault while in kernel mode
2021/08/07 14:59	freebsd-src	c18c74a87c15	6972b106	console log	report			ci-freebsd-main	Fatal trap 12: page fault while in kernel mode
2021/08/06 14:08	freebsd-src	b3e87f133454	2f537099	console log	report			ci-freebsd-main	Fatal trap 12: page fault while in kernel mode
2021/07/26 23:01	freebsd-src	ccc510b46340	fd511809	console log	report			ci-freebsd-main	Fatal trap 12: page fault while in kernel mode
2021/07/24 15:51	freebsd-src	47aeda7b7055	4d1b57d4	console log	report			ci-freebsd-main	Fatal trap 12: page fault while in kernel mode
2021/07/06 22:48	freebsd-src	e41fde3ed71c	cca78469	console log	report			ci-freebsd-main	Fatal trap 12: page fault while in kernel mode
2021/07/06 20:55	freebsd-src	e41fde3ed71c	cca78469	console log	report			ci-freebsd-main	Fatal trap 12: page fault while in kernel mode
2021/07/06 14:01	freebsd-src	e41fde3ed71c	6c4484eb	console log	report			ci-freebsd-main	Fatal trap 12: page fault while in kernel mode
2021/07/06 07:25	freebsd-src	e41fde3ed71c	6c4484eb	console log	report			ci-freebsd-main	Fatal trap 12: page fault while in kernel mode
2021/07/06 05:03	freebsd-src	e41fde3ed71c	55aa55c2	console log	report			ci-freebsd-main	Fatal trap 12: page fault while in kernel mode
2021/07/05 09:16	freebsd-src	4060e77f49d1	55aa55c2	console log	report			ci-freebsd-main	Fatal trap 12: page fault while in kernel mode
2021/07/04 21:59	freebsd-src	f28455344483	55aa55c2	console log	report			ci-freebsd-main	Fatal trap 12: page fault while in kernel mode
2021/07/04 19:36	freebsd-src	f28455344483	55aa55c2	console log	report			ci-freebsd-main	Fatal trap 12: page fault while in kernel mode
2021/07/04 16:04	freebsd-src	f28455344483	55aa55c2	console log	report			ci-freebsd-main	Fatal trap 12: page fault while in kernel mode
2021/07/04 14:37	freebsd-src	f28455344483	55aa55c2	console log	report			ci-freebsd-main	Fatal trap 12: page fault while in kernel mode
2021/07/04 12:13	freebsd-src	f28455344483	55aa55c2	console log	report			ci-freebsd-main	Fatal trap 12: page fault while in kernel mode
2021/07/03 04:28	freebsd-src	c95156691588	55aa55c2	console log	report			ci-freebsd-main	Fatal trap 12: page fault while in kernel mode
2021/07/02 19:36	freebsd-src	c95156691588	55aa55c2	console log	report			ci-freebsd-main	Fatal trap 12: page fault while in kernel mode
2020/12/16 21:12	freebsd	175422a03e51	04201c06	console log	report			ci-freebsd-main
2021/09/17 22:14	freebsd-src	ac8af1938085	70b76c1d	console log	report			ci-freebsd-main	Fatal trap NUM: page fault while in kernel mode
2021/09/17 00:28	freebsd-src	12061d2626e0	7612dc77	console log	report			ci-freebsd-main	Fatal trap NUM: page fault while in kernel mode
2021/09/16 22:43	freebsd-src	12061d2626e0	7612dc77	console log	report			ci-freebsd-main	Fatal trap NUM: page fault while in kernel mode
2021/09/16 18:44	freebsd-src	12061d2626e0	7612dc77	console log	report			ci-freebsd-main	Fatal trap NUM: page fault while in kernel mode
2021/09/16 10:21	freebsd-src	12061d2626e0	07e953c1	console log	report			ci-freebsd-main	Fatal trap NUM: page fault while in kernel mode
2021/09/15 20:33	freebsd-src	548a706608d7	07e953c1	console log	report			ci-freebsd-main	Fatal trap NUM: page fault while in kernel mode
2021/09/15 14:35	freebsd-src	6c2d4404161a	07e953c1	console log	report			ci-freebsd-main	Fatal trap NUM: page fault while in kernel mode
2021/09/13 23:46	freebsd-src	45feade38ec3	58d09404	console log	report			ci-freebsd-main	Fatal trap NUM: page fault while in kernel mode
2021/09/13 20:11	freebsd-src	45feade38ec3	58d09404	console log	report			ci-freebsd-main	Fatal trap NUM: page fault while in kernel mode
2021/09/13 06:27	freebsd-src	4181fa2a209e	3ce60af8	console log	report			ci-freebsd-main	Fatal trap NUM: page fault while in kernel mode
2021/09/12 14:58	freebsd-src	ae87a08c410d	3ce60af8	console log	report			ci-freebsd-main	Fatal trap NUM: page fault while in kernel mode
2021/09/11 14:09	freebsd-src	71a1ae7cebd3	3ce60af8	console log	report			ci-freebsd-main	Fatal trap NUM: page fault while in kernel mode
2021/09/11 11:41	freebsd-src	141fe2dceeae	3ce60af8	console log	report			ci-freebsd-main	Fatal trap NUM: page fault while in kernel mode
2021/09/11 09:09	freebsd-src	141fe2dceeae	3ce60af8	console log	report			ci-freebsd-main	Fatal trap NUM: page fault while in kernel mode
2021/09/11 05:45	freebsd-src	141fe2dceeae	3ce60af8	console log	report			ci-freebsd-main	Fatal trap NUM: page fault while in kernel mode
2021/09/10 19:57	freebsd-src	35aa1d6e4542	5ae8508a	console log	report			ci-freebsd-main	Fatal trap NUM: page fault while in kernel mode
2021/09/10 14:07	freebsd-src	35aa1d6e4542	5ae8508a	console log	report			ci-freebsd-main	Fatal trap NUM: page fault while in kernel mode
2021/09/10 06:28	freebsd-src	35aa1d6e4542	e2776ee4	console log	report			ci-freebsd-main	Fatal trap NUM: page fault while in kernel mode
2021/09/09 18:25	freebsd-src	395db99f32bc	e2776ee4	console log	report			ci-freebsd-main	Fatal trap NUM: page fault while in kernel mode
2021/09/09 09:59	freebsd-src	103b207536f9	e2776ee4	console log	report			ci-freebsd-main	Fatal trap NUM: page fault while in kernel mode
2021/09/08 17:19	freebsd-src	4ccbbe5f0689	e2776ee4	console log	report			ci-freebsd-main	Fatal trap NUM: page fault while in kernel mode
2021/09/08 00:36	freebsd-src	686aa9287c6b	064c9eb7	console log	report			ci-freebsd-main	Fatal trap NUM: page fault while in kernel mode
2021/09/07 03:09	freebsd-src	936f4a42fa2a	6ca60148	console log	report			ci-freebsd-main	Fatal trap NUM: page fault while in kernel mode
2021/09/06 02:14	freebsd-src	bb61ccd530b7	d236a457	console log	report			ci-freebsd-main	Fatal trap NUM: page fault while in kernel mode
2021/09/04 22:49	freebsd-src	88a3af4da1aa	d236a457	console log	report			ci-freebsd-main	Fatal trap NUM: page fault while in kernel mode
2021/08/28 06:05	freebsd-src	08b9cc316a31	d5a29e53	console log	report			ci-freebsd-main	Fatal trap NUM: page fault while in kernel mode
2021/08/28 00:14	freebsd-src	b54eec836660	57b01c6e	console log	report			ci-freebsd-main	Fatal trap NUM: page fault while in kernel mode
2021/08/22 15:05	freebsd-src	efa485d5c390	b599f2fc	console log	report			ci-freebsd-main	Fatal trap NUM: page fault while in kernel mode
2021/08/21 09:20	freebsd-src	c4622b01d2f1	b599f2fc	console log	report			ci-freebsd-main	Fatal trap NUM: page fault while in kernel mode
2021/09/17 08:06	freebsd-src	fd0765933c3c	5b989942	console log	report			ci-freebsd-i386	Fatal trap NUM: page fault while in kernel mode
2021/09/16 15:27	freebsd-src	12061d2626e0	7612dc77	console log	report			ci-freebsd-i386	Fatal trap NUM: page fault while in kernel mode
2021/09/13 22:21	freebsd-src	45feade38ec3	58d09404	console log	report			ci-freebsd-i386	Fatal trap NUM: page fault while in kernel mode
2021/09/12 00:35	freebsd-src	71a1ae7cebd3	3ce60af8	console log	report			ci-freebsd-i386	Fatal trap NUM: page fault while in kernel mode
2021/09/06 05:11	freebsd-src	bb61ccd530b7	d236a457	console log	report			ci-freebsd-i386	Fatal trap NUM: page fault while in kernel mode

* ~~Struck through~~ repros no longer work on HEAD.