Fatal trap NUM: page fault in pf_krule_global_RB_INSERT

Status: fixed on 2022/03/29 23:00
Reported-by: syzbot+665b700afc6f69f1766a@syzkaller.appspotmail.com
Fix commit: e123e2294cb5 pf: guard against DIOCADDRULE without DIOCXBEGIN
First crash: 1602d, last: 1601d
▶ ▼ Similar bugs (1)
Kernel Title Rank 🛈 Repro Cause bisect Fix bisect Count Last Reported Patched Status
freebsd Fatal trap NUM: page fault in pf_krule_global_RB_INSERT (2) -1 syz, C 27 1540d 1557d 2/2 fixed on 2022/06/01 03:42

Sample crash report:
Fatal trap 12: page fault while in kernel mode
cpuid = 1; apic id = 01
fault virtual address	= 0x0
fault code		= supervisor read data, page not present
instruction pointer	= 0x20:0xffffffff845a8164
stack pointer	        = 0x28:0xfffffe008fde6220
frame pointer	        = 0x28:0xfffffe008fde6260
code segment		= base 0x0, limit 0xfffff, type 0x1b
			= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags	= interrupt enabled, resume, IOPL = 0
current process		= 779 (syz-executor1394238)
trap number		= 12
panic: page fault
cpuid = 1
time = 1648577967
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0xc7/frame 0xfffffe008fde5a30
kdb_backtrace() at kdb_backtrace+0xd3/frame 0xfffffe008fde5b90
vpanic() at vpanic+0x2b8/frame 0xfffffe008fde5c70
panic() at panic+0xb5/frame 0xfffffe008fde5d30
trap_fatal() at trap_fatal+0x6a4/frame 0xfffffe008fde5e30
trap_pfault() at trap_pfault+0x186/frame 0xfffffe008fde5f70
trap() at trap+0x5ad/frame 0xfffffe008fde6150
calltrap() at calltrap+0x8/frame 0xfffffe008fde6150
--- trap 0xc, rip = 0xffffffff845a8164, rsp = 0xfffffe008fde6220, rbp = 0xfffffe008fde6260 ---
pf_krule_global_RB_INSERT() at pf_krule_global_RB_INSERT+0x24/frame 0xfffffe008fde6260
pf_ioctl_addrule() at pf_ioctl_addrule+0xe06/frame 0xfffffe008fde62f0
pfioctl() at pfioctl+0x553d/frame 0xfffffe008fde7610
devfs_ioctl() at devfs_ioctl+0x22a/frame 0xfffffe008fde76f0
VOP_IOCTL_APV() at VOP_IOCTL_APV+0xb0/frame 0xfffffe008fde7730
vn_ioctl() at vn_ioctl+0x215/frame 0xfffffe008fde7a80
devfs_ioctl_f() at devfs_ioctl_f+0x71/frame 0xfffffe008fde7ad0
kern_ioctl() at kern_ioctl+0x631/frame 0xfffffe008fde7bd0
sys_ioctl() at sys_ioctl+0x31f/frame 0xfffffe008fde7d30
amd64_syscall() at amd64_syscall+0x40c/frame 0xfffffe008fde7f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe008fde7f30
--- syscall (0, FreeBSD ELF64, nosys), rip = 0x2b3bea, rsp = 0x8205be908, rbp = 0x8205be920 ---
KDB: enter: panic
[ thread pid 779 tid 100099 ]
Stopped at      kdb_enter+0x6b: movq    $0,0x270a03a(%rip)
db> 
db> set $lines = 0
db> set $maxwidth = 0
db> show registers
cs                        0x20
ds                        0x3b
es                        0x3b
fs                        0x13
gs                        0x1b
ss                        0x28
rax                       0x12
rcx         0xb78c8ee34b757bf8
rdx         0xdffff7c000000000
rbx                          0
rsp         0xfffffe008fde5b70
rbp         0xfffffe008fde5b90
rsi                        0x1
rdi                          0
r8                         0x3
r9                  0xffffffff
r10                          0
r11                          0
r12         0xfffffe0058df7000
r13         0xfffffe008fde5b01
r14         0xffffffff82bb9d00  .str.26
r15         0xffffffff82bb9d00  .str.26
rip         0xffffffff8176e1db  kdb_enter+0x6b
rflags                    0x46
kdb_enter+0x6b: movq    $0,0x270a03a(%rip)
db> show proc
Process 779 (syz-executor1394238) at 0xfffffe0092460000:
 state: NORMAL
 uid: 0  gids: 0, 0, 5
 parent: pid 777 at 0xfffffe0092d49a90
 ABI: FreeBSD ELF64
 flag: 0x10004000  flag2: 0
 arguments: ./syz-executor139423859
 reaper: 0xfffffe0053dde000 reapsubtree: 1
 sigparent: 20
 vmspace: 0xfffffe00927ba9f8
   (map 0xfffffe00927ba9f8)
   (map.pmap 0xfffffe00927baab8)
   (pmap 0xfffffe00927bab20)
 threads: 1
100099                   Run     CPU 1                       syz-executor1394238
db> ps
  pid  ppid  pgrp   uid  state   wmesg   wchan               cmd
  779   777   777     0  R       CPU 1                       syz-executor1394238
  777   775   777     0  Ss      pause   0xfffffe0092d49b40  csh
  775   688   775     0  Ss      select  0xfffffe00588cd440  sshd
  754     1   754     0  Ss+     ttyin   0xfffffe00574d7cb0  getty
  753     1   753     0  Ss+     ttyin   0xfffffe005873dcb0  getty
  752     1   752     0  Ss+     ttyin   0xfffffe00574d50b0  getty
  751     1   751     0  Ss+     ttyin   0xfffffe00574d54b0  getty
  750     1   750     0  Ss+     ttyin   0xfffffe00574d58b0  getty
  749     1   749     0  Ss+     ttyin   0xfffffe00574d5cb0  getty
  748     1   748     0  Ss+     ttyin   0xfffffe00574d60b0  getty
  747     1   747     0  Ss+     ttyin   0xfffffe00574d64b0  getty
  746     1   746     0  Ss+     ttyin   0xfffffe00574d68b0  getty
  744     1    18     0  S+      piperd  0xfffffe0058b5f8b8  logger
  743   742    18     0  S+      nanslp  0xffffffff83e458c0  sleep
  742     1    18     0  S+      wait    0xfffffe0092670a90  sh
  692     1   692     0  Ss      nanslp  0xffffffff83e458c0  cron
  688     1   688     0  Ss      select  0xfffffe0058aadb40  sshd
  501     1   501     0  Ss      select  0xfffffe009233bcc0  syslogd
  430     1   430     0  Ss      select  0xfffffe00588cd540  devd
  429     1   429    65  Ss      select  0xfffffe0058aadbc0  dhclient
  344     1   344     0  Ss      select  0xfffffe0058aadc40  dhclient
  341     1   341     0  Ss      select  0xfffffe009233b740  dhclient
   17     0     0     0  DL      syncer  0xffffffff83f6b0e0  [syncer]
   16     0     0     0  DL      vlruwt  0xfffffe00587e0a90  [vnlru]
   15     0     0     0  DL      (threaded)                  [bufdaemon]
100080                   D       psleep  0xffffffff83f696e0  [bufdaemon]
100083                   D       -       0xffffffff83211f80  [bufspacedaemon-0]
100094                   D       sdflush 0xfffffe00588e94e8  [/ worker]
    9     0     0     0  DL      psleep  0xffffffff83f9d180  [vmdaemon]
    8     0     0     0  DL      (threaded)                  [pagedaemon]
100078                   D       psleep  0xffffffff83f91038  [dom0]
100081                   D       launds  0xffffffff83f91044  [laundry: dom0]
100082                   D       umarcl  0xffffffff81ea4ba0  [uma]
    7     0     0     0  DL      -       0xffffffff83c01688  [rand_harvestq]
    6     0     0     0  DL      pftm    0xffffffff84567530  [pf purge]
    5     0     0     0  DL      waiting 0xffffffff84b804e0  [sctp_iterator]
    4     0     0     0  DL      (threaded)                  [cam]
100045                   D       -       0xffffffff83aa35c0  [doneq0]
100046                   D       -       0xffffffff83aa3540  [async]
100077                   D       -       0xffffffff83aa33c0  [scanner]
   14     0     0     0  DL      seqstat 0xfffffe0056ec5488  [sequencer 00]
    3     0     0     0  DL      (threaded)                  [crypto]
100041                   D       crypto_ 0xffffffff83f8c840  [crypto]
100042                   D       crypto_ 0xfffffe0053ed6c30  [crypto returns 0]
100043                   D       crypto_ 0xfffffe0053ed6c80  [crypto returns 1]
   13     0     0     0  DL      (threaded)                  [geom]
100036                   D       -       0xffffffff83e1ae80  [g_event]
100037                   D       -       0xffffffff83e1aea0  [g_up]
100038                   D       -       0xffffffff83e1aec0  [g_down]
    2     0     0     0  WL      (threaded)                  [clock]
100030                   I                                   [clock (0)]
100031                   I                                   [clock (1)]
   12     0     0     0  WL      (threaded)                  [intr]
100010                   I                                   [swi6: Giant taskq]
100017                   I                                   [swi5: fast taskq]
100020                   I                                   [swi6: task queue]
100029                   I                                   [swi1: netisr 0]
100032                   I                                   [swi3: busdma]
100033                   I                                   [swi1: hpts]
100034                   I                                   [swi1: hpts]
100047                   I                                   [irq24: virtio_pci0]
100048                   I                                   [irq25: virtio_pci0]
100049                   I                                   [irq26: virtio_pci0]
100050                   I                                   [irq27: virtio_pci0]
100051                   I                                   [irq28: virtio_pci1]
100052                   I                                   [irq29: virtio_pci1]
100053                   I                                   [irq30: virtio_pci1]
100054                   I                                   [irq31: virtio_pci1]
100055                   I                                   [irq32: virtio_pci1]
100060                   I                                   [irq33: virtio_pci2]
100061                   I                                   [irq34: virtio_pci2]
100062                   I                                   [irq35: virtio_pci2]
100064                   I                                   [irq1: atkbd0]
100065                   I                                   [irq12: psm0]
100066                   I                                   [swi0: uart uart++]
100070                   I                                   [swi1: pf send]
   11     0     0     0  RL      (threaded)                  [idle]
100003                   Run     CPU 0                       [idle: cpu0]
100004                   CanRun                              [idle: cpu1]
    1     0     1     0  SLs     wait    0xfffffe0053dde000  [init]
   10     0     0     0  DL      audit_w 0xffffffff83f8d340  [audit]
    0     0     0     0  DLs     (threaded)                  [kernel]
100000                   D       swapin  0xffffffff83e1b8c0  [swapper]
100005                   D       -       0xfffffe0053c95b00  [softirq_0]
100006                   D       -       0xfffffe0053c95900  [softirq_1]
100007                   D       -       0xfffffe0053c95700  [if_io_tqg_0]
100008                   D       -       0xfffffe0053c95500  [if_io_tqg_1]
100009                   D       -       0xfffffe0053c95300  [if_config_tqg_0]
100011                   D       -       0xfffffe0008181c00  [aiod_kick taskq]
100012                   D       -       0xfffffe0008181b00  [inm_free taskq]
100013                   D       -       0xfffffe0008181a00  [linuxkpi_irq_wq]
100014                   D       -       0xfffffe0008181900  [in6m_free taskq]
100015                   D       -       0xfffffe0008181800  [deferred_unmount ta]
100016                   D       -       0xfffffe0008181700  [thread taskq]
100018                   D       -       0xfffffe0008181500  [kqueue_ctx taskq]
100019                   D       -       0xfffffe0008181400  [pci_hp taskq]
100021                   D       -       0xfffffe0008181200  [linuxkpi_short_wq_0]
100022                   D       -       0xfffffe0008181200  [linuxkpi_short_wq_1]
100023                   D       -       0xfffffe0008181200  [linuxkpi_short_wq_2]
100024                   D       -       0xfffffe0008181200  [linuxkpi_short_wq_3]
100025                   D       -       0xfffffe0008181100  [linuxkpi_long_wq_0]
100026                   D       -       0xfffffe0008181100  [linuxkpi_long_wq_1]
100027                   D       -       0xfffffe0008181100  [linuxkpi_long_wq_2]
100028                   D       -       0xfffffe0008181100  [linuxkpi_long_wq_3]
100035                   D       -       0xfffffe0053f33300  [firmware taskq]
100039                   D       -       0xfffffe0053f33200  [crypto_0]
100040                   D       -       0xfffffe0053f33200  [crypto_1]
100056                   D       -       0xfffffe0053f32d00  [vtnet0 rxq 0]
100057                   D       -       0xfffffe0053f32c00  [vtnet0 txq 0]
100058                   D       -       0xfffffe0053f32b00  [vtnet0 rxq 1]
100059                   D       -       0xfffffe0053f32a00  [vtnet0 txq 1]
100063                   D       vtbslp  0xfffffe0056fa1480  [virtio_balloon]
100067                   D       -       0xffffffff82bbfb80  [deadlkres]
100071                   D       -       0xfffffe0008182100  [mca taskq]
100073                   D       -       0xfffffe0053f32500  [acpi_task_0]
100074                   D       -       0xfffffe0053f32500  [acpi_task_1]
100075                   D       -       0xfffffe0053f32500  [acpi_task_2]
100076                   D       -       0xfffffe0053f32e00  [CAM taskq]
db> show all locks
Process 779 (syz-executor1394238) thread 0xfffffe0058df7000 (100099)
exclusive sx pf config (pf config) r = 0 (0xffffffff8461f2c0) locked @ /syzkaller/managers/main/kernel/sys/netpfil/pf/pf_ioctl.c:2114
db> show malloc
              Type        InUse        MemUse     Requests
           pf_hash            5        11524K            5
          tcp_hpts            6         4801K            6
            devbuf         4217         4323K         4242
         sysctloid        35306         2080K        35377
             vtbuf           24         1968K           46
              kobj          327         1308K          488
            newblk          706         1201K          719
          vfscache            3         1025K            3
               pcb           19          537K           38
          inodedep           49          530K           71
         ufs_quota            1          512K            1
          vfs_hash            1          512K            1
           callout            2          512K            2
              intr            4          472K            4
            acpica         1674          184K        56014
           subproc           98          182K          838
         vnet_data            1          168K            1
           tidhash            3          141K            3
              vmem            3          137K            3
            linker          358          134K          386
           pagedep           14          132K           18
        tfo_ccache            1          128K            1
               sem            4          106K            4
            DEVFS1          105          105K          114
               bus          991           81K         5140
          mtx_pool            2           72K            2
          syncache            1           68K            1
            module          512           64K          512
          acpitask            1           64K            1
       ddb_capture            1           64K            1
              umtx          264           33K          264
              temp           17           33K         1606
         hostcache            1           32K            1
               shm            1           32K            1
           kdtrace          158           32K          898
            DEVFS3          124           31K          134
               msg            4           30K            4
        gtaskqueue           18           26K           18
            kbdmux            6           22K            6
        DEVFS_RULE           56           20K           56
               BPF           10           18K           10
         ufs_mount            4           17K            5
              proc            3           17K            3
               tty           16           16K           16
           ithread          100           16K          100
            bus-sc           34           15K         1651
            KTRACE          100           13K          100
              kenv           95           12K           95
      eventhandler          134           12K          134
            ifaddr           30           12K           32
              rman           88           11K          429
              GEOM           61           11K          490
          routetbl           50           11K          176
         CAM queue            5           11K         1528
              cred           36            9K          234
         bmsafemap            4            9K           40
              UART           12            9K           12
           devstat            4            9K            4
              ksem            1            8K            1
               rpc            2            8K            2
             shmfd            1            8K            1
       pfs_vncache            1            8K            1
         pfs_nodes           20            8K           20
     audit_evclass          237            8K          296
         taskqueue           63            7K           63
            sglist            5            7K            5
           CAM DEV            3            6K          510
       ufs_dirhash           24            5K           24
               UMA          272            5K          272
            dirrem           17            5K           28
            plimit           17            5K          322
                vt           11            5K           11
             ifnet            3            5K            3
           memdesc            1            4K            1
               MCA           32            4K           32
          ioctlops            1            4K           87
          filedesc            1            4K            1
             evdev            4            4K            4
           acpisem           28            4K           28
             hhook           15            4K           17
       ether_multi           40            4K           50
            diradd           25            4K           36
           lltable           11            4K           11
          pf_ifnet            5            3K            6
         in6_multi           25            3K           25
          terminal           11            3K           11
           session           20            3K           31
            kqueue           40            3K          782
           pwddesc           40            3K          780
           uidinfo            3            3K            8
         proc-args           62            3K         1720
           pf_rule            1            2K            1
        local_apic            1            2K            1
           io_apic            1            2K            1
       fpukern_ctx            2            2K            2
         ipsec-saq            2            2K            2
             selfd           27            2K        10935
            Unitno           27            2K           39
           CAM XPT           22            2K          543
             lockf           15            2K           22
               msi           12            2K           12
       ipsecpolicy            2            2K            2
           acpidev           20            2K           20
             clone            9            2K            9
           softdep            1            1K            1
            sahead            1            1K            1
          secasvar            1            1K            1
       vnodemarker            2            1K            8
      NFSD session            1            1K            1
        CAM periph            4            1K          271
            select            7            1K           29
             ipsec            3            1K            3
          indirdep            3            1K            3
             nhops            6            1K            6
         toponodes            6            1K            6
            isadev            6            1K            6
             mount           16            1K           89
          pci_link           10            1K           10
          sctp_ifa            5            1K            6
            crypto            4            1K            4
            ip6ndp            4            1K            5
 encap_export_host           12            1K           12
         newdirblk            4            1K            8
             mkdir            4            1K           16
          in_multi            2            1K            4
              pfil            4            1K            4
              cdev            2            1K            2
    chacha20random            1            1K            1
               osd            7            1K           18
       inpcbpolicy           10            1K          139
          sctp_ifn            2            1K            6
      NFSD lckfile            1            1K            1
     NFSD V4client            1            1K            1
            DEVFSP            4            1K            9
             DEVFS            9            1K           10
          freework            1            1K           26
               mld            2            1K            2
              igmp            2            1K            2
            vnodes            1            1K            1
           CAM SIM            2            1K            2
            feeder            7            1K            7
           tcpfunc            3            1K            3
            CC Mem            3            1K            7
        loginclass            3            1K            7
            prison            6            1K            6
       lkpikmalloc            5            1K            6
        aesni_data            2            1K            2
         cryptodev            2            1K           49
          nexusdev            8            1K            8
            apmdev            1            1K            1
          atkbddev            2            1K            2
     CAM dev queue            2            1K            2
 CAM I/O Scheduler            1            1K            1
          CAM path            4            1K         1034
          procdesc            1            1K            6
          pmchooks            1            1K            1
            soname            4            1K         3471
          filecaps            4            1K           66
               tun            3            1K            3
          sctp_vrf            1            1K            1
              vnet            1            1K            1
           entropy            2            1K           35
               pmc            1            1K            1
          acpiintr            1            1K            1
              cpus            2            1K            2
    vnet_data_free            1            1K            1
           Per-cpu            1            1K            1
          p1003.1b            1            1K            1
        sctp_mcore            0            0K            0
        sctp_socko            0            0K            0
         sctp_iter            0            0K            4
         sctp_mvrf            0            0K            0
         sctp_timw            0            0K            0
         sctp_cpal            0            0K            0
         sctp_cmsg            0            0K            0
         sctp_stre            0            0K            0
         sctp_athi            0            0K            0
         sctp_athm            0            0K            0
         sctp_atky            0            0K            0
         sctp_atcl            0            0K            0
         sctp_a_it            0            0K            4
         sctp_aadr            0            0K            0
         sctp_stro            0            0K            0
         sctp_stri            0            0K            0
          sctp_map            0            0K            0
            tcp_do            0            0K            0
           tcp_fsb            0            0K            0
            mqdata            0            0K            0
            ipcomp            0            0K            0
               esp            0            0K            0
                ah            0            0K            0
           filemon            0            0K            0
          pf_table            0            0K            0
           pf_altq            0            0K            0
           pf_osfp            0            0K            0
           pf_temp            0            0K            0
     NFSCL session            0            0K            0
     NFSCL sockreq            0            0K            0
        madt_table            0            0K            2
          smartpqi            0            0K            0
     NFSCL devinfo            0            0K            0
     NFSCL flayout            0            0K            0
      NFSCL layout            0            0K            0
               ixl            0            0K            0
     NFSD rollback            0            0K            0
      NFSCL diroff            0            0K            0
       NEWdirectio            0            0K            0
        NEWNFSnode            0            0K            0
         NFSCL lck            0            0K            0
      NFSCL lckown            0            0K            0
      NFSCL client            0            0K            0
        ice-resmgr            0            0K            0
         ice-osdep            0            0K            0
               ice            0            0K            0
              iavf            0            0K            0
             axgbe            0            0K            0
       NFSCL deleg            0            0K            0
        NFSCL open            0            0K            0
       NFSCL owner            0            0K            0
            NFS fh            0            0K            0
           NFS req            0            0K            0
     NFSD usrgroup            0            0K            0
       NFSD string            0            0K            0
       NFSD V4lock            0            0K            0
      NFSD V4state            0            0K            0
          xen_intr            0            0K            0
     NFSD srvcache            0            0K            0
           xen_hvm            0            0K            0
         legacydrv            0            0K            0
            bounce            0            0K            0
            busdma            0            0K            0
            qpidrv            0            0K            0
       msdosfs_fat            0            0K            0
     msdosfs_mount            0            0K            0
      dmar_idpgtbl            0            0K            0
          dmar_dom            0            0K            0
          dmar_ctx            0            0K            0
      msdosfs_node            0            0K            0
              isci            0            0K            0
      iommu_dmamap            0            0K            0
     hyperv_socket            0            0K            0
           bxe_ilt            0            0K            0
            DEVFS4            0            0K            0
            xenbus            0            0K            0
            DEVFS2            0            0K            0
     vm_fictitious            0            0K            0
            gntdev            0            0K            0
       privcmd_dev            0            0K            0
        evtchn_dev            0            0K            0
          xenstore            0            0K            0
         scsi_pass            0            0K            0
         ciss_data            0            0K            0
               xnb            0            0K            0
              xbbd            0            0K            0
               xbd            0            0K            0
           Balloon            0            0K            0
          sysmouse            0            0K            0
           UMAHash            0            0K            0
            vtfont            0            0K            0
         vm_pgdata            0            0K            0
           jblocks            0            0K            0
          savedino            0            0K           16
          sentinel            0            0K            0
            jfsync            0            0K            0
            jtrunc            0            0K            0
             sbdep            0            0K            2
           jsegdep            0            0K            0
              jseg            0            0K            0
         jfreefrag            0            0K            0
          jfreeblk            0            0K            0
           jnewblk            0            0K            0
            jmvref            0            0K            0
           jremref            0            0K            0
           jaddref            0            0K            0
           freedep            0            0K            0
          freefile            0            0K            9
          freeblks            0            0K           25
          freefrag            0            0K            1
        allocindir            0            0K            0
       allocdirect            0            0K            0
          ufs_trim            0            0K            0
           mactemp            0            0K            0
     audit_trigger            0            0K            0
 audit_pipe_presel            0            0K            0
     audit_pipeent            0            0K            0
        audit_pipe            0            0K            0
      audit_evname            0            0K            0
         audit_bsm            0            0K            0
      audit_gidset            0            0K            0
        audit_text            0            0K            0
        audit_path            0            0K            0
        audit_data            0            0K            0
        audit_cred            0            0K            0
         BACKLIGHT            0            0K            0
           ath_hal            0            0K            0
            athdev            0            0K            0
           ata_pci            0            0K            0
           ata_dma            0            0K            0
       ata_generic            0            0K            0
            pvscsi            0            0K            0
           scsi_da            0            0K           69
            ata_da            0            0K            0
           scsi_ch            0            0K            0
           scsi_cd            0            0K            0
          ktls_ocf            0            0K            0
       AHCI driver            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
      MLX5E_TLS_RX            0            0K            0
        MLX5EEPROM            0            0K            0
         MLX5E_TLS            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
            MLX5EN            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
          MLX5DUMP            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
          seq_file            0            0K            0
           lkpiskb            0            0K            0
             radix            0            0K            0
               idr            0            0K            0
          lkpindev            0            0K            0
            lkpifw            0            0K            0
         lkpi80211            0            0K            0
               NLM            0            0K            0
    ipsec-spdcache            0            0K            0
         ipsec-reg            0            0K            0
        ipsec-misc            0            0K            0
      ipsecrequest            0            0K            0
            ip6opt            0            0K            3
       ip6_msource            0            0K            0
      ip6_moptions            0            0K            0
       in6_mfilter            0            0K            0
             frag6            0            0K            0
            tcplog            0            0K            0
        tcp_hwpace            0            0K            0
            USBdev            0            0K            0
               USB            0            0K            0
               LRO            0            0K            0
        ip_msource            0            0K            0
       ip_moptions            0            0K            0
        in_mfilter            0            0K            0
              ipid            0            0K            0
         80211scan            0            0K            0
      80211ratectl            0            0K            0
        80211power            0            0K            0
       80211nodeie            0            0K            0
         80211node            0            0K            0
      80211mesh_gt            0            0K            0
      80211mesh_rt            0            0K            0
         80211perr            0            0K            0
         80211prep            0            0K            0
         80211preq            0            0K            0
          80211dfs            0            0K            0
       80211crypto            0            0K            0
          80211vap            0            0K            0
             iflib            0            0K            0
              vlan            0            0K            0
               gif            0            0K            0
           ifdescr            0            0K            0
              zlib            0            0K            0
           fadvise            0            0K            0
           VN POLL            0            0K            0
               agp            0            0K            0
            statfs            0            0K          195
     namei_tracker            0            0K            0
       export_host            0            0K            0
        cl_savebuf            0            0K            5
           nvme_da            0            0K            0
           acpipwr            0            0K            0
         acpi_perf            0            0K            0
            twsbuf            0            0K            0
      twe_commands            0            0K            0
       tcp_log_dev            0            0K            0
      midi buffers            0            0K            0
             mixer            0            0K            0
              ac97            0            0K            0
             hdacc            0            0K            0
              hdac            0            0K            0
              hdaa            0            0K            0
         acpicmbat            0            0K            0
       SIIS driver            0            0K            0
           CAM CCB            0            0K          523
            biobuf            0            0K            0
              aios            0            0K            0
               lio            0            0K            0
               acl            0            0K            0
          mbuf_tag            0            0K           27
              ktls            0            0K            0
               PUC            0            0K            0
          ppbusdev            0            0K            0
agtiapi_MemAlloc malloc            0            0K            0
    osti_cacheable            0            0K            0
          tempbuff            0            0K            0
          tempbuff            0            0K            0
ag_tgt_map_t malloc            0            0K            0
ag_slr_map_t malloc            0            0K            0
lDevFlags * malloc            0            0K            0
tiDeviceHandle_t * malloc            0            0K            0
ag_portal_data_t malloc            0            0K            0
ag_device_t malloc            0            0K            0
     STLock malloc            0            0K            0
          CCB List            0            0K            0
            sr_iov            0            0K            0
               OCS            0            0K            0
               OCS            0            0K            0
              nvme            0            0K            0
               nvd            0            0K            0
            netmap            0            0K            0
            mwldev            0            0K            0
        MVS driver            0            0K            0
     CAM ccb queue            0            0K            0
              accf            0            0K            0
               pts            0            0K            0
               iov            0            0K        13647
           eventfd            0            0K            0
           Witness            0            0K            0
             stack            0            0K            0
          mrsasbuf            0            0K            0
          mpt_user            0            0K            0
          mps_user            0            0K            0
            MPSSAS            0            0K            0
               mps            0            0K            0
              sbuf            0            0K          288
          mpr_user            0            0K            0
          firmware            0            0K            0
        compressor            0            0K            0
            MPRSAS            0            0K            0
              SWAP            0            0K            0
               mpr            0            0K            0
            mfibuf            0            0K            0
         sysctltmp            0            0K          658
            sysctl            0            0K            3
        md_sectors            0            0K            0
              ekcd            0            0K            0
            dumper            0            0K            0
          sendfile            0            0K            0
              rctl            0            0K            0
           md_disk            0            0K            0
           malodev            0            0K            0
               LED            0            0K            0
          ix_sriov            0            0K            0
             cache            0            0K            0
        aacraidcam            0            0K            0
          kcovinfo            0            0K            0
      prison_racct            0            0K            0
       Fail Points            0            0K            0
             sigio            0            0K            1
filedesc_to_leader            0            0K            0
               pwd            0            0K            0
       tty console            0            0K            0
                ix            0            0K            0
            ipsbuf            0            0K            0
       aacraid_buf            0            0K            0
            aaccam            0            0K            0
         boottrace            0            0K            0
            aacbuf            0            0K            0
              zstd            0            0K            0
            XZ_DEC            0            0K            0
            nvlist            0            0K            0
          SCSI ENC            0            0K            0
           SCSI sa            0            0K            0
        isofs_node            0            0K            0
       isofs_mount            0            0K            0
     tr_raid5_data            0            0K            0
    tr_raid1e_data            0            0K            0
     tr_raid1_data            0            0K            0
     tr_raid0_data            0            0K            0
    tr_concat_data            0            0K            0
       md_sii_data            0            0K            0
   md_promise_data            0            0K            0
    md_nvidia_data            0            0K            0
   md_jmicron_data            0            0K            0
     md_intel_data            0            0K            0
       md_ddf_data            0            0K            0
         raid_data            0            0K           72
     geom_flashmap            0            0K            0
         tmpfs dir            0            0K            0
        tmpfs name            0            0K            0
       tmpfs mount            0            0K            0
           NFS FHA            0            0K            0
         newnfsmnt            0            0K            0
  newnfsclient_req            0            0K            0
   NFSCL layrecall            0            0K            0
db> show uma
              Zone   Size    Used    Free    Requests  Sleeps  Bucket  Total Mem    XFree
   mbuf_jumbo_page   4096    8320    1078       14559       0     254   38494208        0
              mbuf    256    8578    1084       17462       0     254    2473472        0
              pbuf   2624       0     794           0       0       2    2083456        0
          BUF TRIE    144     183   11605         504       0      62    1697472        0
        malloc-384    384    4155      15        4156       0      30    1601280        0
        malloc-128    128   12353     140       12404       0     126    1599104        0
       malloc-4096   4096     327       1         488       0       2    1343488        0
       UMA Slabs 0    112   10577       1       10577       0     126    1184736        0
      mbuf_cluster   2048     508       0         508       0     254    1040384        0
         vmem btag     56   16238      73       16238       0     254     913416        0
         FFS inode   1160     499      19         508       0       8     600880        0
        RADIX NODE    144    3294     201       19794       0      62     503280        0
            socket    960      18     490        1335       0     254     487680        0
         VM OBJECT    264    1411     119       24436       0      30     403920        0
          lkpicurr    168       2    2350           2       0      62     395136        0
            lkpimm    168       1    2327           1       0      62     391104        0
             tcpcb   1104       3     256           7       0     254     285936        0
        256 Bucket   2048     120      18         996       0       8     282624        0
      malloc-65536  65536       4       0           4       0       1     262144        0
         malloc-64     64    3875     220       14816       0     254     262080        0
             VNODE    448     530      46         541       0      30     258048        0
         malloc-16     16   14625     375       14729       0     254     240000        0
            THREAD   1808     117      15         117       0       8     238656        0
            DEVCTL   1024       0     220         126       0       0     225280        0
        malloc-256    256     728      82         860       0      62     207360        0
      malloc-65536  65536       3       0           3       0       1     196608        0
         MAP ENTRY     96    1560     456       84320       0     126     193536        0
         UMA Zones    768     244       0         244       0      16     187392        0
         malloc-32     32    5312     358        6533       0     254     181440        0
       malloc-4096   4096      41       3         785       0       2     180224        0
        malloc-128    128    1132     263       26321       0     126     178560        0
       FFS2 dinode    256     499      71         508       0      62     145920        0
      malloc-65536  65536       0       2          46       0       1     131072        0
      malloc-65536  65536       1       1         137       0       1     131072        0
       malloc-1024   1024     119       9         129       0      16     131072        0
             unpcb    256       7     503        1179       0     254     130560        0
       mbuf_packet    256       0     508          77       0     254     130048        0
       S VFS Cache    104     966     204        1006       0     126     121680        0
          ksiginfo    112      39    1005          54       0     126     116928        0
       malloc-2048   2048       5      51         537       0       8     114688        0
     FPU_save_area    832     119      16         131       0      16     112320        0
       malloc-4096   4096      23       1          34       0       2      98304        0
          UMA Kegs    384     230       3         230       0      30      89472        0
        128 Bucket   1024      44      39         478       0      16      84992        0
           VMSPACE   2552      23      10         764       0       4      84216        0
        malloc-256    256     203     112         343       0      62      80640        0
              PROC   1352      39      18         779       0       8      77064        0
             g_bio    408       0     180        4481       0      30      73440        0
         malloc-64     64     545     526        2228       0     254      68544        0
         malloc-64     64     517     554        1644       0     254      68544        0
        malloc-128    128     295     232         351       0     126      67456        0
      malloc-65536  65536       1       0           1       0       1      65536        0
      malloc-65536  65536       0       1           8       0       1      65536        0
      malloc-32768  32768       0       2         120       0       1      65536        0
        malloc-256    256     149     106         481       0      62      65280        0
         filedesc0   1072      40      16         780       0       8      60032        0
       malloc-8192   8192       6       1          34       0       1      57344        0
       malloc-8192   8192       6       1           8       0       1      57344        0
       malloc-8192   8192       4       3         105       0       1      57344        0
         64 Bucket    512      66      38        1591       0      30      53248        0
        malloc-128    128     147     256         221       0     126      51584        0
        malloc-128    128     179     224         586       0     126      51584        0
        malloc-256    256      94     101         380       0      62      49920        0
         32 Bucket    256      62     133        1664       0      62      49920        0
           DIRHASH   1024      34      14          34       0      16      49152        0
             NAMEI   1024       0      48       12228       0      16      49152        0
      malloc-16384  16384       3       0           3       0       1      49152        0
      malloc-16384  16384       1       2         161       0       1      49152        0
       malloc-2048   2048       2      22         575       0       8      49152        0
       malloc-1024   1024       6      42        1382       0      16      49152        0
       malloc-1024   1024      16      32          20       0      16      49152        0
        malloc-384    384      79      41          79       0      30      46080        0
          syncache    168       0     264           5       0     254      44352        0
            clpbuf   2624       0      16          23       0      16      41984        0
       malloc-8192   8192       5       0           5       0       1      40960        0
       Mountpoints   2752       2      12           2       0       4      38528        0
         udp_inpcb    424       6      84         128       0      30      38160        0
            da_ccb    544       0      70        1240       0      16      38080        0
            pcpu-8      8    4228     380        4256       0     254      36864        0
         malloc-64     64       7     560          23       0     254      36288        0
         malloc-64     64     271     296       13596       0     254      36288        0
         malloc-64     64     165     402        1443       0     254      36288        0
         malloc-64     64       7     560          35       0     254      36288        0
         malloc-64     64      46     521         275       0     254      36288        0
        malloc-128    128      44     235         104       0     126      35712        0
        malloc-128    128      54     225        3380       0     126      35712        0
        malloc-128    128     104     175         755       0     126      35712        0
     routing nhops    256      10     125          17       0      62      34560        0
           ttyoutq    256      72      63         160       0      62      34560        0
        malloc-384    384      48      42          71       0      30      34560        0
        malloc-256    256      16     119         735       0      62      34560        0
        malloc-256    256      21     114          84       0      62      34560        0
        malloc-256    256      79      56         404       0      62      34560        0
        malloc-256    256       7     128         582       0      62      34560        0
         TURNSTILE    136     133     119         133       0      62      34272        0
      malloc-32768  32768       1       0           1       0       1      32768        0
      malloc-32768  32768       1       0           1       0       1      32768        0
      malloc-32768  32768       1       0           1       0       1      32768        0
      malloc-16384  16384       1       1          16       0       1      32768        0
       malloc-4096   4096       4       4         625       0       2      32768        0
       malloc-2048   2048       1      15          13       0       8      32768        0
       malloc-2048   2048       8       8           8       0       8      32768        0
       malloc-2048   2048       9       7           9       0       8      32768        0
       malloc-2048   2048       3      13          12       0       8      32768        0
       malloc-2048   2048       2      14           2       0       8      32768        0
       malloc-2048   2048       1      15         194       0       8      32768        0
       malloc-1024   1024       4      28          44       0      16      32768        0
       malloc-1024   1024       2      30          21       0      16      32768        0
       malloc-1024   1024       4      28         157       0      16      32768        0
       malloc-1024   1024      17      15          17       0      16      32768        0
       malloc-1024   1024       1      31           5       0      16      32768        0
        malloc-512    512       0      64           9       0      30      32768        0
        malloc-512    512       2      62          51       0      30      32768        0
        malloc-512    512       2      62           9       0      30      32768        0
        malloc-512    512       9      55          10       0      30      32768        0
           pcpu-64     64     492      20         492       0     254      32768        0
            ttyinq    160     135      65         300       0      62      32000        0
            cpuset    104       7     272           7       0     126      29016        0
        sctp_laddr     48       0     588           4       0     254      28224        0
         malloc-32     32     297     585         891       0     254      28224        0
         16 Bucket    144      47     149         234       0      62      28224        0
          4 Bucket     48       6     582          53       0     254      28224        0
             ripcb    424       1      62           4       0      30      26712        0
              pipe    744       7      28         284       0      16      26040        0
       malloc-4096   4096       3       3         198       0       2      24576        0
           rtentry    176      13     125          17       0      62      24288        0
              PGRP     88      20     256          31       0     126      24288        0
    ertt_txseginfo     40       1     605         243       0     254      24240        0
          rl_entry     40      31     575          31       0     254      24240        0
             Files     80      72     228        6581       0     126      24000        0
          8 Bucket     80      43     257         241       0     126      24000        0
        malloc-384    384      52       8         392       0      30      23040        0
        malloc-384    384       2      58          12       0      30      23040        0
        malloc-384    384       7      53           9       0      30      23040        0
        malloc-384    384       1      59          20       0      30      23040        0
        SLEEPQUEUE     88     133     123         133       0     126      22528        0
         hostcache     64       1     314           1       0     254      20160        0
             udpcb     32       6     624         128       0     254      20160        0
   udp_inpcb ports     32       3     627          40       0     254      20160        0
               PWD     32      10     620         100       0     254      20160        0
         malloc-32     32     128     502         163       0     254      20160        0
         malloc-32     32      44     586         751       0     254      20160        0
         malloc-32     32      23     607          42       0     254      20160        0
         malloc-32     32      79     551         256       0     254      20160        0
         malloc-32     32      46     584        2801       0     254      20160        0
          2 Bucket     32      47     583         290       0     254      20160        0
 epoch_record pcpu    256       4      60           4       0      62      16384        0
      malloc-16384  16384       1       0           1       0       1      16384        0
      malloc-16384  16384       1       0           1       0       1      16384        0
       malloc-8192   8192       2       0           2       0       1      16384        0
       malloc-4096   4096       2       2           4       0       2      16384        0
       malloc-4096   4096       1       3           4       0       2      16384        0
        malloc-512    512       2      30         120       0      30      16384        0
        malloc-512    512       3      29           3       0      30      16384        0
           SMR CPU     32       7     504           7       0     254      16352        0
              kenv    258      15      45        1023       0      30      15480        0
         tcp_inpcb    424       3      33           7       0      30      15264        0
            mqnode    416       3      33           3       0      30      14976        0
              vmem   1856       1       7           1       0       8      14848        0
        SMR SHARED     24       7     504           7       0     254      12264        0
   tcp_inpcb ports     32       1     377           1       0     254      12096        0
              ertt     72       3     165           7       0     126      12096        0
         malloc-32     32       4     374          53       0     254      12096        0
             KNOTE    160       0      75           8       0      62      12000        0
         malloc-16     16      11     739          56       0     254      12000        0
         malloc-16     16      51     699         254       0     254      12000        0
         malloc-16     16      38     712         202       0     254      12000        0
         malloc-16     16     199     551        3075       0     254      12000        0
         malloc-16     16     286     464        1505       0     254      12000        0
         malloc-16     16      22     728       25463       0     254      12000        0
        malloc-384    384       4      26           4       0      30      11520        0
       malloc-8192   8192       1       0           1       0       1       8192        0
       malloc-8192   8192       1       0           1       0       1       8192        0
       malloc-8192   8192       1       0           1       0       1       8192        0
           pcpu-16     16      14     498          14       0     254       8192        0
      vtnet_tx_hdr     24       0     334        1995       0     254       8016        0
         malloc-16     16       8     492           8       0     254       8000        0
       UMA Slabs 1    176       8      14           8       0      62       3872        0
        KMAP ENTRY     96      12      27          14       0       0       3744        0
       FFS1 dinode    128       0       0           0       0     126          0        0
           ada_ccb    272       0       0           0       0      30          0        0
             swblk    136       0       0           0       0      62          0        0
          swpctrie    144       0       0           0       0      62          0        0
   cdg_qdiffsample     16       0       0           0       0     254          0        0
   pf state scrubs     40       0       0           0       0     254          0        0
   pf frag entries     40       0       0           0       0     254          0        0
          pf frags    248       0       0           0       0      62          0        0
  pf table entries    160       0       0           0       0      62          0        0
pf table entry counters     64       0       0           0       0     254          0        0
   pf source nodes    136       0       0           0       0     254          0        0
     pf state keys     88       0       0           0       0     126          0        0
         pf states    312       0       0           0       0     254          0        0
           pf tags    104       0       0           0       0     126          0        0
          pf mtags     56       0       0           0       0     254          0        0
       tcp_bbr_pcb    832       0       0           0       0      16          0        0
       tcp_bbr_map    128       0       0           0       0     126          0        0
      tcp_rack_pcb    896       0       0           0       0      16          0        0
      tcp_rack_map    120       0       0           0       0     126          0        0
tfo_ccache_entries     80       0       0           0       0     126          0        0
               tfo      4       0       0           0       0     254          0        0
          sackhole     32       0       0           0       0     254          0        0
             tcptw     72       0       0           0       0     254          0        0
               ipq     56       0       0           0       0     254          0        0
   sctp_asconf_ack     48       0       0           0       0     254          0        0
       sctp_asconf     40       0       0           0       0     254          0        0
sctp_stream_msg_out    112       0       0           0       0     254          0        0
        sctp_readq    152       0       0           0       0     254          0        0
        sctp_chunk    152       0       0           0       0     254          0        0
        sctp_raddr    736       0       0           0       0     254          0        0
         sctp_asoc   2288       0       0           0       0     254          0        0
           sctp_ep   1208       0       0           0       0     254          0        0
      tcp_log_node    120       0       0           0       0     126          0        0
    tcp_log_bucket    176       0       0           0       0      62          0        0
           tcp_log    416       0       0           0       0     254          0        0
          tcpreass     48       0       0           0       0     254          0        0
       ripcb ports     32       0       0           0       0     254          0        0
udplite_inpcb ports     32       0       0           0       0     254          0        0
     udplite_inpcb    424       0       0           0       0      30          0        0
    IPsec SA lft_c     16       0       0           0       0     254          0        0
            itimer    352       0       0           0       0      30          0        0
            AIOLIO    272       0       0           0       0      30          0        0
             AIOCB    552       0       0           0       0      16          0        0
              AIOP     32       0       0           0       0     254          0        0
               AIO    208       0       0           0       0      62          0        0
        TMPFS node    224       0       0           0       0      62          0        0
           NCLNODE    608       0       0           0       0      16          0        0
        mqnotifier    216       0       0           0       0      62          0        0
            mvdata     64       0       0           0       0     254          0        0
            mqueue    248       0       0           0       0      62          0        0
     LTS VFS Cache    360       0       0           0       0      30          0        0
       L VFS Cache    320       0       0           0       0      30          0        0
     STS VFS Cache    144       0       0           0       0      62          0        0
           cryptop    280       0       0           0       0      30          0        0
  linux_dma_object     32       0       0           0       0     254          0        0
  linux_dma_pctrie    144       0       0           0       0      62          0        0
   IOMMU_MAP_ENTRY    120       0       0           0       0     126          0        0
    mbuf_jumbo_16k  16384       0       0           0       0     254          0        0
     mbuf_jumbo_9k   9216       0       0           0       0     254          0        0
      audit_record   1280       0       0           0       0       8          0        0
         domainset     40       0       0           0       0     254          0        0
        MAC labels     40       0       0           0       0     254          0        0
            vnpbuf   2624       0       0           0       0      64          0        0
            mdpbuf   2624       0       0           0       0       3          0        0
           nfspbuf   2624       0       0           0       0      16          0        0
            swwbuf   2624       0       0           0       0       8          0        0
            swrbuf   2624       0       0           0       0      16          0        0
          umtx_shm     88       0       0           0       0     126          0        0
           umtx pi     96       0       0           0       0     126          0        0
rangeset pctrie nodes    144       0       0           0       0      62          0        0
      malloc-65536  65536       0       0           0       0       1          0        0
      malloc-65536  65536       0       0           0       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
      malloc-16384  16384       0       0           0       0       1          0        0
      malloc-16384  16384       0       0           0       0       1          0        0
      malloc-16384  16384       0       0           0       0       1          0        0
       malloc-4096   4096       0       0           0       0       2          0        0
        malloc-512    512       0       0           0       0      30          0        0
        malloc-512    512       0       0           0       0      30          0        0
           pcpu-32     32       0       0           0       0     254          0        0
            pcpu-4      4       0       0           0       0     254          0        0
            fakepg    104       0       0           0       0     126          0        0
          UMA Hash    256       0       0           0       0      62          0        0

Crashes (81):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2022/03/29 18:21 freebsd-src ae6aa2d43daa 7c337266 console log report syz C ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/29 17:55 freebsd-src ae6aa2d43daa 7c337266 console log report syz C ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/29 05:36 freebsd-src 8601fca7895c 7c337266 console log report syz C ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/29 05:01 freebsd-src 8601fca7895c 7c337266 console log report syz C ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/28 21:41 freebsd-src 8601fca7895c 7c337266 console log report syz C ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/29 22:43 freebsd-src ae6aa2d43daa 7c337266 console log report ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/29 21:51 freebsd-src ae6aa2d43daa 7c337266 console log report ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/29 20:42 freebsd-src ae6aa2d43daa 7c337266 console log report ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/29 15:35 freebsd-src ae6aa2d43daa 7c337266 console log report ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/29 13:11 freebsd-src ae6aa2d43daa 7c337266 console log report ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/29 12:10 freebsd-src ae6aa2d43daa 7c337266 console log report ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/29 10:55 freebsd-src ae6aa2d43daa 7c337266 console log report ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/29 09:40 freebsd-src ae6aa2d43daa 7c337266 console log report ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/29 09:24 freebsd-src ae6aa2d43daa 7c337266 console log report ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/29 07:42 freebsd-src 8601fca7895c 7c337266 console log report ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/29 04:39 freebsd-src 8601fca7895c 7c337266 console log report ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/29 04:05 freebsd-src 8601fca7895c 7c337266 console log report ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/29 03:57 freebsd-src 8601fca7895c 7c337266 console log report ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/29 03:51 freebsd-src 8601fca7895c 7c337266 console log report ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/29 02:41 freebsd-src 8601fca7895c 7c337266 console log report ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/29 02:15 freebsd-src 8601fca7895c 7c337266 console log report ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/29 02:10 freebsd-src 8601fca7895c 7c337266 console log report ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/29 02:00 freebsd-src 8601fca7895c 7c337266 console log report ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/29 01:46 freebsd-src 8601fca7895c 7c337266 console log report ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/29 01:18 freebsd-src 8601fca7895c 7c337266 console log report ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/29 01:03 freebsd-src 8601fca7895c 7c337266 console log report ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/28 22:59 freebsd-src 8601fca7895c 7c337266 console log report ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/28 22:28 freebsd-src 8601fca7895c 7c337266 console log report ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/28 22:21 freebsd-src 8601fca7895c 7c337266 console log report ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/28 22:12 freebsd-src 8601fca7895c 7c337266 console log report ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/28 22:11 freebsd-src 8601fca7895c 7c337266 console log report ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/28 22:07 freebsd-src 8601fca7895c 7c337266 console log report ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/28 21:51 freebsd-src 8601fca7895c 7c337266 console log report ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/28 21:50 freebsd-src 8601fca7895c 7c337266 console log report ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/28 20:37 freebsd-src 8601fca7895c 7c337266 console log report ci-freebsd-main Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/29 06:41 freebsd-src bba12ee45394 7c337266 console log report ci-freebsd-i386 Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/29 04:55 freebsd-src bba12ee45394 7c337266 console log report ci-freebsd-i386 Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/29 04:36 freebsd-src bba12ee45394 7c337266 console log report ci-freebsd-i386 Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/29 04:36 freebsd-src bba12ee45394 7c337266 console log report ci-freebsd-i386 Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/29 02:18 freebsd-src bba12ee45394 7c337266 console log report ci-freebsd-i386 Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/29 02:14 freebsd-src bba12ee45394 7c337266 console log report ci-freebsd-i386 Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/29 02:09 freebsd-src bba12ee45394 7c337266 console log report ci-freebsd-i386 Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/29 01:11 freebsd-src bba12ee45394 7c337266 console log report ci-freebsd-i386 Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/28 22:56 freebsd-src bba12ee45394 7c337266 console log report ci-freebsd-i386 Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/28 21:36 freebsd-src bba12ee45394 7c337266 console log report ci-freebsd-i386 Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/28 21:32 freebsd-src bba12ee45394 7c337266 console log report ci-freebsd-i386 Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/28 20:54 freebsd-src bba12ee45394 7c337266 console log report ci-freebsd-i386 Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/28 20:45 freebsd-src bba12ee45394 7c337266 console log report ci-freebsd-i386 Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
2022/03/28 18:59 freebsd-src bba12ee45394 7c337266 console log report ci-freebsd-i386 Fatal trap NUM: page fault in pf_krule_global_RB_INSERT
* Struck through repros no longer work on HEAD.