panic: in_pcblookup_hash_locked: invalid local address (2)

panic: in_pcblookup_hash_locked: invalid local address (2)

Status: fixed on 2023/10/07 19:39
Reported-by: syzbot+81ccc423a2737ed031ac@syzkaller.appspotmail.com
Fix commit: abca3ae7734f udp: fix sending of IPv4-mapped addresses
First crash: 1259d, last: 1049d

▶ ▼ Similar bugs (1)

Kernel	Title	Rank 🛈	Repro	Cause bisect	Fix bisect	Count	Last	Reported	Patched	Status
freebsd	panic: in_pcblookup_hash_locked: invalid local address	2	syz			165751	1260d	1291d	2/2	fixed on 2023/03/07 10:19

Sample crash report:

panic: in_pcblookup_hash_locked: invalid local address
cpuid = 1
time = 1696432979
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0xc6/frame 0xfffffe0007b43d10
kdb_backtrace() at kdb_backtrace+0xd0/frame 0xfffffe0007b43e70
vpanic() at vpanic+0x271/frame 0xfffffe0007b44010
panic() at panic+0xb5/frame 0xfffffe0007b440d0
in_pcblookup_hash_locked() at in_pcblookup_hash_locked+0x639/frame 0xfffffe0007b441e0
in_pcb_lport_dest() at in_pcb_lport_dest+0x465/frame 0xfffffe0007b44290
in_pcbconnect_setup() at in_pcbconnect_setup+0x879/frame 0xfffffe0007b443f0
udp_send() at udp_send+0x1968/frame 0xfffffe0007b44630
udp6_send() at udp6_send+0x613/frame 0xfffffe0007b44920
sosend_dgram() at sosend_dgram+0x68b/frame 0xfffffe0007b449a0
sousrsend() at sousrsend+0x116/frame 0xfffffe0007b44a30
kern_sendit() at kern_sendit+0x5a2/frame 0xfffffe0007b44ba0
sendit() at sendit+0x157/frame 0xfffffe0007b44bf0
sys_sendto() at sys_sendto+0x181/frame 0xfffffe0007b44d10
amd64_syscall() at amd64_syscall+0x47a/frame 0xfffffe0007b44f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0007b44f30
--- syscall (0, FreeBSD ELF64, syscall), rip = 0x233dfa, rsp = 0x8204289e8, rbp = 0x820428a00 ---
KDB: enter: panic
[ thread pid 773 tid 100086 ]
Stopped at      kdb_enter+0x6e: movq    $0,0x217bc57(%rip)
db> 
db> set $lines = 0
db> set $maxwidth = 0
db> show registers
cs                        0x20
ds                        0x3b
es                        0x3b
fs                        0x13
gs                        0x1b
ss                        0x28
rax                       0x12
rcx         0xfffffe00033eee30
rdx         0xdffff7c000000000
rbx         0xffffffff826e0a40  .str.28
rsp         0xfffffe0007b43e50
rbp         0xfffffe0007b43e70
rsi                        0x1
rdi                          0
r8                           0
r9                  0xffffffff
r10                 0x7d24cd2c
r11                 0xe7f254ab
r12                          0
r13         0xfffffe0057561020
r14         0xffffffff826e0a40  .str.28
r15                          0
rip         0xffffffff815c4c3e  kdb_enter+0x6e
rflags                    0x46
kdb_enter+0x6e: movq    $0,0x217bc57(%rip)
db> show proc
Process 773 (syz-executor1834333) at 0xfffffe005422c5c0:
 state: NORMAL
 uid: 0  gids: 0, 0, 5
 parent: pid 771 at 0xfffffe00571d75a0
 ABI: FreeBSD ELF64
 flag: 0x10004000  flag2: 0
 arguments: ./syz-executor1834333797
 reaper: 0xfffffe005422b040 reapsubtree: 1
 sigparent: 20
 vmspace: 0xfffffe006a39f9a0
   (map 0xfffffe006a39f9a0)
   (map.pmap 0xfffffe006a39fa60)
   (pmap 0xfffffe006a39fad0)
 threads: 1
100086                   Run     CPU 1                       syz-executor1834333
db> ps
  pid  ppid  pgrp   uid  state   wmesg   wchan               cmd
  773   771   771     0  R       CPU 1                       syz-executor1834333
  771   769   771     0  Ss      pause   0xfffffe00571d7650  csh
  769   682   769     0  Rs      CPU 0                       sshd
  748     1   748     0  Ss+     ttyin   0xfffffe00576c2cb0  getty
  747     1   747     0  Ss+     ttyin   0xfffffe00587c88b0  getty
  746     1   746     0  Ss+     ttyin   0xfffffe00587c8cb0  getty
  745     1   745     0  Ss+     ttyin   0xfffffe00587c90b0  getty
  744     1   744     0  Ss+     ttyin   0xfffffe00587c94b0  getty
  743     1   743     0  Ss+     ttyin   0xfffffe00587c98b0  getty
  742     1   742     0  Ss+     ttyin   0xfffffe00587c9cb0  getty
  741     1   741     0  Ss+     ttyin   0xfffffe00576c18b0  getty
  740     1   740     0  Ss+     ttyin   0xfffffe00576c1cb0  getty
  738     1    18     0  S+      piperd  0xfffffe00589ebc70  logger
  737   736    18     0  S+      nanslp  0xffffffff83721c41  sleep
  736     1    18     0  S+      wait    0xfffffe0007c02b00  sh
  686     1   686     0  Ss      nanslp  0xffffffff83721c40  cron
  682     1   682     0  Ss      select  0xfffffe006cc0d5c0  sshd
  495     1   495     0  Ss      select  0xfffffe00571a6440  syslogd
  424     1   424     0  Ss      select  0xfffffe00571a6540  devd
  423     1   423    65  Ss      select  0xfffffe006cc0d540  dhclient
  338     1   338     0  Ss      select  0xfffffe006cc0d4c0  dhclient
  335     1   335     0  Ss      select  0xfffffe00571a64c0  dhclient
   17     0     0     0  DL      syncer  0xffffffff8383f360  [syncer]
   16     0     0     0  DL      vlruwt  0xfffffe00571d8060  [vnlru]
   15     0     0     0  DL      (threaded)                  [bufdaemon]
100079                   D       psleep  0xffffffff8383d980  [bufdaemon]
100082                   D       -       0xffffffff82c0a140  [bufspacedaemon-0]
100095                   D       sdflush 0xfffffe00085fd8e8  [/ worker]
    9     0     0     0  DL      psleep  0xffffffff838b0540  [vmdaemon]
    8     0     0     0  DL      (threaded)                  [pagedaemon]
100077                   D       psleep  0xffffffff838983f8  [dom0]
100080                   D       launds  0xffffffff83898404  [laundry: dom0]
100081                   D       umarcl  0xffffffff81d4f8a0  [uma]
    7     0     0     0  DL      -       0xffffffff834b6c28  [rand_harvestq]
    6     0     0     0  DL      pftm    0xffffffff845603d0  [pf purge]
    5     0     0     0  DL      waiting 0xffffffff8437c4e0  [sctp_iterator]
    4     0     0     0  DL      (threaded)                  [cam]
100044                   D       -       0xffffffff83481340  [doneq0]
100045                   D       -       0xffffffff834812c0  [async]
100076                   D       -       0xffffffff83481140  [scanner]
    3     0     0     0  DL      (threaded)                  [crypto]
100041                   D       crypto_ 0xffffffff83893c60  [crypto]
100042                   D       crypto_ 0xfffffe00540c6d30  [crypto returns 0]
100043                   D       crypto_ 0xfffffe00540c6d80  [crypto returns 1]
   14     0     0     0  DL      seqstat 0xfffffe00570f5488  [sequencer 00]
   13     0     0     0  DL      (threaded)                  [geom]
100035                   D       -       0xffffffff836ca5e0  [g_event]
100036                   D       -       0xffffffff836ca600  [g_up]
100037                   D       -       0xffffffff836ca620  [g_down]
    2     0     0     0  WL      (threaded)                  [clock]
100029                   I                                   [clock (0)]
100030                   I                                   [clock (1)]
   12     0     0     0  WL      (threaded)                  [intr]
100012                   I                                   [swi6: task queue]
100013                   I                                   [swi6: Giant taskq]
100015                   I                                   [swi5: fast taskq]
100031                   I                                   [swi1: netisr 0]
100032                   I                                   [swi1: hpts]
100033                   I                                   [swi1: hpts]
100046                   I                                   [irq24: virtio_pci0]
100047                   I                                   [irq25: virtio_pci0]
100048                   I                                   [irq26: virtio_pci0]
100049                   I                                   [irq27: virtio_pci0]
100050                   I                                   [irq28: virtio_pci1]
100051                   I                                   [irq29: virtio_pci1]
100052                   I                                   [irq30: virtio_pci1]
100053                   I                                   [irq31: virtio_pci1]
100054                   I                                   [irq32: virtio_pci1]
100059                   I                                   [irq33: virtio_pci2]
100060                   I                                   [irq34: virtio_pci2]
100061                   I                                   [irq35: virtio_pci2]
100063                   I                                   [irq1: atkbd0]
100064                   I                                   [irq12: psm0]
100065                   I                                   [swi0: uart uart++]
100069                   I                                   [swi1: pf send]
   11     0     0     0  RL      (threaded)                  [idle]
100003                   CanRun                              [idle: cpu0]
100004                   CanRun                              [idle: cpu1]
    1     0     1     0  SLs     wait    0xfffffe005422b040  [init]
   10     0     0     0  DL      audit_w 0xffffffff838946a0  [audit]
    0     0     0     0  DLs     (threaded)                  [kernel]
100000                   D       swapin  0xffffffff836cafa0  [swapper]
100005                   D       -       0xfffffe00540da700  [softirq_0]
100006                   D       -       0xfffffe00540da600  [softirq_1]
100007                   D       -       0xfffffe00540da500  [if_io_tqg_0]
100008                   D       -       0xfffffe00540da400  [if_io_tqg_1]
100009                   D       -       0xfffffe00540da300  [if_config_tqg_0]
100010                   D       -       0xfffffe00079eee00  [pci_hp taskq]
100011                   D       -       0xfffffe00079eec00  [kqueue_ctx taskq]
100014                   D       -       0xfffffe00079ee600  [thread taskq]
100016                   D       -       0xfffffe00079ee200  [aiod_kick taskq]
100017                   D       -       0xfffffe00079ee000  [deferred_unmount ta]
100018                   D       -       0xfffffe00079edd00  [inm_free taskq]
100019                   D       -       0xfffffe00079edb00  [in6m_free taskq]
100020                   D       -       0xfffffe00079ed900  [linuxkpi_irq_wq]
100021                   D       -       0xfffffe00079ed700  [linuxkpi_short_wq_0]
100022                   D       -       0xfffffe00079ed700  [linuxkpi_short_wq_1]
100023                   D       -       0xfffffe00079ed700  [linuxkpi_short_wq_2]
100024                   D       -       0xfffffe00079ed700  [linuxkpi_short_wq_3]
100025                   D       -       0xfffffe00079ed200  [linuxkpi_long_wq_0]
100026                   D       -       0xfffffe00079ed200  [linuxkpi_long_wq_1]
100027                   D       -       0xfffffe00079ed200  [linuxkpi_long_wq_2]
100028                   D       -       0xfffffe00079ed200  [linuxkpi_long_wq_3]
100034                   D       -       0xfffffe00079ec600  [firmware taskq]
100039                   D       -       0xfffffe0054368900  [crypto_0]
100040                   D       -       0xfffffe0054368900  [crypto_1]
100055                   D       -       0xfffffe0057232500  [vtnet0 rxq 0]
100056                   D       -       0xfffffe0057232400  [vtnet0 txq 0]
100057                   D       -       0xfffffe0057232300  [vtnet0 rxq 1]
100058                   D       -       0xfffffe0057232200  [vtnet0 txq 1]
100062                   D       vtbslp  0xfffffe005756f000  [virtio_balloon]
100066                   D       -       0xffffffff826e5c01  [deadlkres]
100070                   D       -       0xfffffe00079ec000  [acpi_task_0]
100071                   D       -       0xfffffe00079ec000  [acpi_task_1]
100072                   D       -       0xfffffe00079ec000  [acpi_task_2]
100074                   D       -       0xfffffe00079efa00  [mca taskq]
100075                   D       -       0xfffffe0054366c00  [CAM taskq]
db> show all locks
Process 773 (syz-executor1834333) thread 0xfffffe0057561020 (100086)
exclusive sleep mutex udphash (udphash) r = 0 (0xfffffe0054089e28) locked @ /syzkaller/managers/main/kernel/sys/netinet/udp_usrreq.c:1252
exclusive rw udpinp (udpinp) r = 0 (0xfffffe0058aa7aa0) locked @ /syzkaller/managers/main/kernel/sys/netinet/udp_usrreq.c:1096
Process 769 (sshd) thread 0xfffffe0058af23a0 (100110)
exclusive sleep mutex process lock (process lock) r = 0 (0xfffffe0058b2f6e8) locked @ /syzkaller/managers/main/kernel/sys/kern/subr_trap.c:103
db> show malloc
              Type        InUse        MemUse     Requests
           pf_hash            5        11524K            5
          tcp_hpts            7         4801K            7
            devbuf         4192         4324K         4217
         sysctloid        34926         2058K        34997
             vtbuf           24         1968K           46
              kobj          326         1304K          488
            newblk          832         1232K          844
          vfscache            3         1025K            3
               pcb           23          669K           42
          inodedep           49          530K           71
         ufs_quota            1          512K            1
          vfs_hash            1          512K            1
           callout            2          512K            2
              intr            4          472K            4
         vnet_data            2          224K            2
          acpitask            1          224K            1
            acpica         1674          184K        60310
           subproc           96          181K          830
           tidhash            3          141K            3
              vmem            3          134K            4
           pagedep           14          132K           18
            linker          352          130K          385
        tfo_ccache            1          128K            1
          IP reass            1          128K            1
               sem            4          106K            4
            DEVFS1          105          105K          114
        gtaskqueue           18           98K           18
               bus          985           81K         5155
          mtx_pool            2           72K            2
          syncache            1           68K            1
     NFSD srvcache            3           68K            3
            module          512           64K          512
       ddb_capture            1           64K            1
              temp           18           37K         1566
         hostcache            1           32K            1
               shm            1           32K            1
            DEVFS3          124           31K          134
           kdtrace          152           31K          886
              umtx          242           31K          242
               msg            4           30K            4
            kbdmux            6           28K            6
        DEVFS_RULE           56           20K           56
               BPF           10           18K           10
         ufs_mount            4           17K            5
              proc            3           17K            3
               tty           16           16K           16
           ithread           97           16K           97
            bus-sc           34           15K         1687
      eventhandler          161           14K          161
            KTRACE          100           13K          100
              kenv           95           12K           95
            ifaddr           30           12K           32
              rman           88           11K          431
              GEOM           61           11K          481
          routetbl           50           11K          176
         CAM queue            5           11K         1528
         bmsafemap            4            9K           41
               rpc            4            9K            4
           devstat            4            9K            4
              UART           12            9K           12
              ksem            1            8K            1
             shmfd            1            8K            1
       pfs_vncache            1            8K            1
     audit_evclass          238            8K          300
         taskqueue           63            7K           63
            sglist            6            7K            6
           CAM DEV            3            6K          510
              cred           23            6K          274
         pfs_nodes           20            5K           20
             hhook           15            5K           17
       ufs_dirhash           24            5K           24
               UMA          268            5K          268
            dirrem           17            5K           28
            plimit           17            5K          322
             ifnet            3            5K            3
                vt           11            5K           11
           memdesc            1            4K            1
               MCA           32            4K           32
          filedesc            1            4K            1
             evdev            4            4K            4
           acpisem           28            4K           28
       ether_multi           40            4K           50
            diradd           25            4K           36
           lltable           11            4K           11
          pf_ifnet            5            3K            6
         in6_multi           25            3K           25
          terminal           11            3K           11
           session           20            3K           31
            kqueue           40            3K          776
           pwddesc           40            3K          774
             clone            9            3K            9
           uidinfo            3            3K            8
         proc-args           62            3K         1696
        local_apic            1            2K            1
           io_apic            1            2K            1
         ipsec-saq            2            2K            2
            Unitno           27            2K           41
           CAM XPT           22            2K          543
             lockf           15            2K           22
               msi           12            2K           12
         toponodes            6            2K            6
       ipsecpolicy            2            2K            2
             selfd           20            2K        12886
           acpidev           20            2K           20
           softdep            1            1K            1
            sahead            1            1K            1
          secasvar            1            1K            1
       vnodemarker            2            1K            8
      NFSD session            1            1K            1
            select            7            1K           29
        CAM periph            4            1K          271
             ipsec            3            1K            3
          indirdep            3            1K            3
            CC Mem            3            1K            7
             nhops            6            1K            6
              pfil            6            1K            6
            isadev            6            1K            6
             mount           16            1K           89
          pci_link           10            1K           10
          sctp_ifa            5            1K            6
            crypto            4            1K            4
            ip6ndp            4            1K            5
 encap_export_host           12            1K           12
         newdirblk            4            1K            8
             mkdir            4            1K           16
          in_multi            2            1K            4
              cdev            2            1K            2
               osd            8            1K           20
    chacha20random            1            1K            1
            biobuf            1            1K            1
       inpcbpolicy           11            1K          140
          sctp_ifn            2            1K            6
               mld            2            1K            2
              igmp            2            1K            2
            vnodes            1            1K            1
      NFSD lckfile            1            1K            1
     NFSD V4client            1            1K            1
            DEVFSP            4            1K            9
             DEVFS            9            1K           10
           CAM SIM            2            1K            2
            feeder            7            1K            7
           tcpfunc            3            1K            3
        loginclass            3            1K            7
            prison            6            1K            6
       lkpikmalloc            5            1K            6
            soname            5            1K         3404
         cryptodev            2            1K           49
          nexusdev            8            1K            8
            apmdev            1            1K            1
          atkbddev            2            1K            2
           netlink            1            1K            1
          procdesc            1            1K            6
          pmchooks            1            1K            1
          CAM path            4            1K         1034
     CAM dev queue            2            1K            2
 CAM I/O Scheduler            1            1K            1
          filecaps            4            1K           66
               tun            3            1K            3
          sctp_vrf            1            1K            1
              vnet            1            1K            1
               pmc            1            1K            1
           entropy            2            1K           35
          acpiintr            1            1K            1
              cpus            2            1K            2
    vnet_data_free            1            1K            1
           Per-cpu            1            1K            1
          freework            1            1K           26
          p1003.1b            1            1K            1
          pf_table            0            0K            0
           pf_rule            0            0K            0
           pf_altq            0            0K            0
           pf_osfp            0            0K            0
     pf_krule_item            0            0K            0
           pf_temp            0            0K            0
            mqdata            0            0K            0
        sctp_mcore            0            0K            0
        sctp_socko            0            0K            0
         sctp_iter            0            0K            4
         sctp_mvrf            0            0K            0
         sctp_timw            0            0K            0
         sctp_cpal            0            0K            0
         sctp_cmsg            0            0K            0
         sctp_stre            0            0K            0
         sctp_athi            0            0K            0
         sctp_athm            0            0K            0
         sctp_atky            0            0K            0
         sctp_atcl            0            0K            0
         sctp_a_it            0            0K            4
         sctp_aadr            0            0K            0
         sctp_stro            0            0K            0
         sctp_stri            0            0K            0
          sctp_map            0            0K            0
           filemon            0            0K            0
            tcp_do            0            0K            0
           tcp_fsb            0            0K            0
            ipcomp            0            0K            0
               esp            0            0K            0
                ah            0            0K            0
        madt_table            0            0K            2
          smartpqi            0            0K            0
               ixl            0            0K            0
        ice-resmgr            0            0K            0
         ice-osdep            0            0K            0
               ice            0            0K            0
              iavf            0            0K            0
             axgbe            0            0K            0
       fpukern_ctx            0            0K            0
          xen_intr            0            0K            0
           xen_hvm            0            0K            0
         legacydrv            0            0K            0
            bounce            0            0K            0
            busdma            0            0K            0
            qpidrv            0            0K            0
      dmar_idpgtbl            0            0K            0
          dmar_dom            0            0K            0
          dmar_ctx            0            0K            0
              isci            0            0K            0
      iommu_dmamap            0            0K            0
     hyperv_socket            0            0K            0
           bxe_ilt            0            0K            0
        aesni_data            0            0K            0
            xenbus            0            0K            0
     vm_fictitious            0            0K            0
           UMAHash            0            0K            0
         vm_pgdata            0            0K            0
           jblocks            0            0K            0
          savedino            0            0K           13
          sentinel            0            0K            0
            jfsync            0            0K            0
            jtrunc            0            0K            0
             sbdep            0            0K            2
           jsegdep            0            0K            0
              jseg            0            0K            0
         jfreefrag            0            0K            0
          jfreeblk            0            0K            0
           jnewblk            0            0K            0
            jmvref            0            0K            0
           jremref            0            0K            0
           jaddref            0            0K            0
           freedep            0            0K            0
          freefile            0            0K            9
          freeblks            0            0K           25
          freefrag            0            0K            1
        allocindir            0            0K            0
       allocdirect            0            0K            0
          ufs_trim            0            0K            0
           mactemp            0            0K            0
     audit_trigger            0            0K            0
 audit_pipe_presel            0            0K            0
     audit_pipeent            0            0K            0
        audit_pipe            0            0K            0
      audit_evname            0            0K            0
         audit_bsm            0            0K            0
      audit_gidset            0            0K            0
        audit_text            0            0K            0
        audit_path            0            0K            0
        audit_data            0            0K            0
        audit_cred            0            0K            0
          ktls_ocf            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
      MLX5E_TLS_RX            0            0K            0
        MLX5EEPROM            0            0K            0
         MLX5E_TLS            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
            MLX5EN            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
          MLX5DUMP            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
       simple_attr            0            0K            0
          seq_file            0            0K            0
           lkpiskb            0            0K            0
             radix            0            0K            0
               idr            0            0K            0
          lkpindev            0            0K            0
           lkpimhi            0            0K            0
            lkpifw            0            0K            0
         lkpi80211            0            0K            0
               NLM            0            0K            0
    ipsec-spdcache            0            0K            0
         ipsec-reg            0            0K            0
        ipsec-misc            0            0K            0
      ipsecrequest            0            0K            0
            ip6opt            0            0K            3
       ip6_msource            0            0K            0
      ip6_moptions            0            0K            0
       in6_mfilter            0            0K            0
             frag6            0            0K            0
            tcplog            0            0K            0
        tcp_hwpace            0            0K            0
               LRO            0            0K            0
        ip_msource            0            0K            0
       ip_moptions            0            0K            0
        in_mfilter            0            0K            0
              ipid            0            0K            0
         80211scan            0            0K            0
      80211ratectl            0            0K            0
        80211power            0            0K            0
       80211nodeie            0            0K            0
         80211node            0            0K            0
      80211mesh_gt            0            0K            0
      80211mesh_rt            0            0K            0
         80211perr            0            0K            0
         80211prep            0            0K            0
         80211preq            0            0K            0
          80211dfs            0            0K            0
       80211crypto            0            0K            0
          80211vap            0            0K            0
             iflib            0            0K            0
              vlan            0            0K            0
               gif            0            0K            0
           ifdescr            0            0K            0
              zlib            0            0K            0
           fadvise            0            0K            0
           VN POLL            0            0K            0
            statfs            0            0K          195
     namei_tracker            0            0K            0
       export_host            0            0K            0
        cl_savebuf            0            0K           10
               aio            0            0K            0
               lio            0            0K            0
               acl            0            0K            0
          mbuf_tag            0            0K            0
              ktls            0            0K            0
              accf            0            0K            0
               pts            0            0K            0
           timerfd            0            0K            0
               iov            0            0K        13557
          ioctlops            0            0K           86
           eventfd            0            0K            0
           Witness            0            0K            0
             stack            0            0K            0
              sbuf            0            0K          288
          firmware            0            0K            0
        compressor            0            0K            0
              SWAP            0            0K            0
         sysctltmp            0            0K          649
            sysctl            0            0K            3
              ekcd            0            0K            0
            dumper            0            0K            0
          sendfile            0            0K            0
              rctl            0            0K            0
             cache            0            0K            0
          kcovinfo            0            0K            0
      prison_racct            0            0K            0
       Fail Points            0            0K            0
             sigio            0            0K            1
filedesc_to_leader            0            0K            0
               pwd            0            0K            0
       tty console            0            0K            0
         boottrace            0            0K            0
        isofs_node            0            0K            0
       isofs_mount            0            0K            0
     tr_raid5_data            0            0K            0
    tr_raid1e_data            0            0K            0
     tr_raid1_data            0            0K            0
     tr_raid0_data            0            0K            0
    tr_concat_data            0            0K            0
       md_sii_data            0            0K            0
   md_promise_data            0            0K            0
    md_nvidia_data            0            0K            0
   md_jmicron_data            0            0K            0
     md_intel_data            0            0K            0
       md_ddf_data            0            0K            0
         raid_data            0            0K           72
     geom_flashmap            0            0K            0
         tmpfs dir            0            0K            0
        tmpfs name            0            0K            0
       tmpfs mount            0            0K            0
     tmpfs extattr            0            0K            0
           NFS FHA            0            0K            0
         newnfsmnt            0            0K            0
  newnfsclient_req            0            0K            0
   NFSCL layrecall            0            0K            0
     NFSCL session            0            0K            0
     NFSCL sockreq            0            0K            0
     NFSCL devinfo            0            0K            0
     NFSCL flayout            0            0K            0
      NFSCL layout            0            0K            0
     NFSD rollback            0            0K            0
      NFSCL diroff            0            0K            0
       NEWdirectio            0            0K            0
        NEWNFSnode            0            0K            0
         NFSCL lck            0            0K            0
      NFSCL lckown            0            0K            0
      NFSCL client            0            0K            0
       NFSCL deleg            0            0K            0
        NFSCL open            0            0K            0
       NFSCL owner            0            0K            0
            NFS fh            0            0K            0
           NFS req            0            0K            0
     NFSD usrgroup            0            0K            0
       NFSD string            0            0K            0
       NFSD V4lock            0            0K            0
      NFSD V4state            0            0K            0
       msdosfs_fat            0            0K            0
     msdosfs_mount            0            0K            0
      msdosfs_node            0            0K            0
            DEVFS4            0            0K            0
            DEVFS2            0            0K            0
            gntdev            0            0K            0
       privcmd_dev            0            0K            0
        evtchn_dev            0            0K            0
          xenstore            0            0K            0
               xnb            0            0K            0
          xen_acpi            0            0K            0
              xbbd            0            0K            0
               xbd            0            0K            0
           Balloon            0            0K            0
          sysmouse            0            0K            0
            vtfont            0            0K            0
            pvscsi            0            0K            0
            USBdev            0            0K            0
               USB            0            0K            0
            twsbuf            0            0K            0
       tcp_log_dev            0            0K            0
      midi buffers            0            0K            0
             mixer            0            0K            0
              ac97            0            0K            0
             hdacc            0            0K            0
              hdac            0            0K            0
              hdaa            0            0K            0
       SIIS driver            0            0K            0
               PUC            0            0K            0
          ppbusdev            0            0K            0
            sr_iov            0            0K            0
               OCS            0            0K            0
               OCS            0            0K            0
              nvme            0            0K            0
               nvd            0            0K            0
            netmap            0            0K            0
            mwldev            0            0K            0
        MVS driver            0            0K            0
          mrsasbuf            0            0K            0
          mpt_user            0            0K            0
          mps_user            0            0K            0
            MPSSAS            0            0K            0
               mps            0            0K            0
          mpr_user            0            0K            0
            MPRSAS            0            0K            0
               mpr            0            0K            0
            mfibuf            0            0K            0
        md_sectors            0            0K            0
           md_disk            0            0K            0
           malodev            0            0K            0
               LED            0            0K            0
          ix_sriov            0            0K            0
                ix            0            0K            0
            ipsbuf            0            0K            0
         ciss_data            0            0K            0
         BACKLIGHT            0            0K            0
           ath_hal            0            0K            0
            athdev            0            0K            0
           ata_pci            0            0K            0
           ata_dma            0            0K            0
       ata_generic            0            0K            0
       AHCI driver            0            0K            0
               agp            0            0K            0
           acpipwr            0            0K            0
         acpi_perf            0            0K            0
         acpicmbat            0            0K            0
        aacraidcam            0            0K            0
       aacraid_buf            0            0K            0
            aaccam            0            0K            0
            aacbuf            0            0K            0
              zstd            0            0K            0
            XZ_DEC            0            0K            0
            nvlist            0            0K            0
          SCSI ENC            0            0K            0
           SCSI sa            0            0K            0
         scsi_pass            0            0K            0
           scsi_da            0            0K           69
            ata_da            0            0K            0
           scsi_ch            0            0K            0
           scsi_cd            0            0K            0
           nvme_da            0            0K            0
           CAM CCB            0            0K          523
     CAM ccb queue            0            0K            0
db> show uma
              Zone   Size    Used    Free    Requests  Sleeps  Bucket  Total Mem    XFree
   mbuf_jumbo_page   4096    8320    1078       15715       0     254   38494208        0
              mbuf    256    8578    1084       19334       0     254    2473472        0
          BUF TRIE    144     190   11626         546       0      62    1701504        0
        malloc-384    384    4173      27        4519       0      30    1612800        0
        malloc-128    128   11486     108       11509       0     126    1484032        0
       malloc-4096   4096     326       4         488       0       2    1351680        0
       UMA Slabs 0    112   10582      32       10582       0     126    1188768        0
      mbuf_cluster   2048     508       0         508       0     254    1040384        0
         vmem btag     56   15384     135       15384       0     254     869064        0
         FFS inode   1160     499      19         509       0       8     600880        0
          lkpicurr    168       2    3118           2       0      62     524160        0
            lkpimm    168       1    3095           1       0      62     520128        0
              pbuf   2624       0     198           0       0       2     519552        0
        RADIX NODE    144    3252     243       23368       0      62     503280        0
            socket    960      19     489        1315       0     254     487680        0
      malloc-65536  65536       5       2         161       0       1     458752        0
        malloc-256    256    1222      83        2140       0      62     334080        0
         malloc-64     64    4055     292        4839       0     254     278208        0
        256 Bucket   2048     115      13         977       0       8     262144        0
         VM OBJECT    264     924      66       14120       0      30     261360        0
             VNODE    448     529      47         541       0      30     258048        0
       malloc-2048   2048       7     113         514       0       8     245760        0
         malloc-16     16   14456     294       14537       0     254     236000        0
            DEVCTL   1024       0     220         123       0       0     225280        0
            THREAD   1824     111      10         111       0       8     220704        0
       malloc-4096   4096      42       4         776       0       2     188416        0
         UMA Zones    768     240       4         240       0      16     187392        0
         malloc-32     32    5326     344        6593       0     254     181440        0
        malloc-128    128    1192     203       28156       0     126     178560        0
       malloc-1024   1024     121      39        1702       0      16     163840        0
       FFS2 dinode    256     499      71         508       0      62     145920        0
      malloc-65536  65536       2       0           2       0       1     131072        0
      malloc-65536  65536       1       1           9       0       1     131072        0
             unpcb    256       7     503        1158       0     254     130560        0
       mbuf_packet    256       0     508         117       0     254     130048        0
       S VFS Cache    104     966     204        1006       0     126     121680        0
         MAP ENTRY     96     893     367       40274       0     126     120960        0
          ksiginfo    112      34    1010          49       0     126     116928        0
        malloc-128    128     675     224        1660       0     126     115072        0
     FPU_save_area    832     113      22         125       0      16     112320        0
        malloc-128    128     540     235        3896       0     126      99200        0
      malloc-32768  32768       3       0           3       0       1      98304        0
      malloc-32768  32768       3       0           3       0       1      98304        0
          UMA Kegs    384     227       6         227       0      30      89472        0
        128 Bucket   1024      44      39         243       0      16      84992        0
      malloc-16384  16384       4       1         164       0       1      81920        0
              PROC   1376      39      16         773       0       8      75680        0
             g_bio    408       0     180        4507       0      30      73440        0
         malloc-64     64     558     513        2405       0     254      68544        0
      malloc-32768  32768       2       0           2       0       1      65536        0
       malloc-4096   4096      14       2         220       0       2      65536        0
         filedesc0   1072      40      16         774       0       8      60032        0
       malloc-8192   8192       5       2         132       0       1      57344        0
         64 Bucket    512      67      37        1139       0      30      53248        0
         malloc-64     64     553     266       14904       0     254      52416        0
        malloc-128    128     159     244         436       0     126      51584        0
        malloc-256    256      89     106         703       0      62      49920        0
        malloc-256    256      43     152         394       0      62      49920        0
         32 Bucket    256      58     137         456       0      62      49920        0
           DIRHASH   1024      35      13          35       0      16      49152        0
             NAMEI   1024       0      48       12073       0      16      49152        0
       malloc-8192   8192       6       0           6       0       1      49152        0
       malloc-2048   2048       1      23         524       0       8      49152        0
          syncache    168       0     264           5       0     254      44352        0
       malloc-8192   8192       5       0           5       0       1      40960        0
       malloc-4096   4096       8       2          12       0       2      40960        0
              pipe    728       7      48         282       0      16      40040        0
         udp_inpcb    424       7      83         129       0      30      38160        0
            da_ccb    544       0      70        1258       0      16      38080        0
            pcpu-8      8    4273     335        4301       0     254      36864        0
         malloc-64     64      34     533       13552       0     254      36288        0
         malloc-64     64     160     407         160       0     254      36288        0
         malloc-64     64      15     552          20       0     254      36288        0
         malloc-64     64       2     565          19       0     254      36288        0
        malloc-128    128      87     192          98       0     126      35712        0
        malloc-128    128       1     278         158       0     126      35712        0
        malloc-128    128      11     268          11       0     126      35712        0
     routing nhops    256      10     125          17       0      62      34560        0
           ttyoutq    256      72      63         160       0      62      34560        0
        malloc-384    384      55      35          79       0      30      34560        0
        malloc-384    384      57      33          57       0      30      34560        0
        malloc-256    256       4     131         399       0      62      34560        0
        malloc-256    256      16     119          19       0      62      34560        0
        malloc-256    256       7     128          13       0      62      34560        0
        malloc-256    256      25     110         328       0      62      34560        0
        malloc-256    256      19     116          24       0      62      34560        0
      malloc-32768  32768       0       1         120       0       1      32768        0
       malloc-8192   8192       3       1           5       0       1      32768        0
       malloc-4096   4096       5       3         559       0       2      32768        0
       malloc-2048   2048       7       9          16       0       8      32768        0
       malloc-2048   2048       4      12          90       0       8      32768        0
       malloc-2048   2048       0      16           2       0       8      32768        0
       malloc-2048   2048       5      11         196       0       8      32768        0
       malloc-1024   1024       2      30          13       0      16      32768        0
       malloc-1024   1024      16      16          16       0      16      32768        0
       malloc-1024   1024      14      18          14       0      16      32768        0
        malloc-512    512       1      63          11       0      30      32768        0
        malloc-512    512       3      61         179       0      30      32768        0
        malloc-512    512       9      55           9       0      30      32768        0
           pcpu-64     64     487      25         487       0     254      32768        0
            ttyinq    160     135      65         300       0      62      32000        0
              PGRP    120      20     244          31       0     126      31680        0
            clpbuf   2624       0      12          30       0       4      31488        0
           VMSPACE    616      23      25         758       0      16      29568        0
        sctp_laddr     48       0     588           4       0     254      28224        0
         malloc-32     32     185     697        1525       0     254      28224        0
         malloc-32     32     306     576         381       0     254      28224        0
         16 Bucket    144      45     151         247       0      62      28224        0
          4 Bucket     48       5     583           8       0     254      28224        0
         TURNSTILE    136     122      67         122       0      62      25704        0
            cpuset    200       7     121           7       0      62      25600        0
             ripcb    392       1      62           4       0      30      24696        0
       malloc-4096   4096       6       0           6       0       2      24576        0
    ertt_txseginfo     40       0     606         293       0     254      24240        0
          rl_entry     40      27     579          27       0     254      24240        0
               PWD     40      10     596          99       0     254      24240        0
           rtentry    168      13     131          17       0      62      24192        0
             Files     80      72     228        6514       0     126      24000        0
          8 Bucket     80      52     248         257       0     126      24000        0
         tcp_inpcb   1304       3      15           7       0       8      23472        0
        malloc-384    384       1      59          22       0      30      23040        0
        malloc-384    384      11      49          11       0      30      23040        0
        malloc-384    384      28      32          29       0      30      23040        0
        SLEEPQUEUE     88     122     134         122       0     126      22528        0
         hostcache     64       1     314           1       0     254      20160        0
   udp_inpcb ports     32       3     627          40       0     254      20160        0
              ertt     72       3     277           7       0     126      20160        0
         malloc-64     64       2     313           2       0     254      20160        0
         malloc-32     32      54     576         199       0     254      20160        0
         malloc-32     32       6     624          20       0     254      20160        0
         malloc-32     32      23     607        2951       0     254      20160        0
         malloc-32     32       6     624          19       0     254      20160        0
         malloc-32     32       2     628           5       0     254      20160        0
          2 Bucket     32      41     589         282       0     254      20160        0
 epoch_record pcpu    256       4      60           4       0      62      16384        0
      malloc-16384  16384       1       0           1       0       1      16384        0
      malloc-16384  16384       1       0           1       0       1      16384        0
      malloc-16384  16384       1       0           1       0       1      16384        0
       malloc-8192   8192       2       0           2       0       1      16384        0
       malloc-4096   4096       1       3           2       0       2      16384        0
       malloc-2048   2048       4       4           5       0       8      16384        0
       malloc-2048   2048       2       6           2       0       8      16384        0
       malloc-1024   1024       5      11           5       0      16      16384        0
       malloc-1024   1024       8       8           8       0      16      16384        0
       malloc-1024   1024       1      15           1       0      16      16384        0
       malloc-1024   1024       2      14           2       0      16      16384        0
        malloc-512    512       2      30           2       0      30      16384        0
        malloc-512    512       0      32           1       0      30      16384        0
        malloc-512    512       2      30           8       0      30      16384        0
        malloc-512    512       1      31           1       0      30      16384        0
        malloc-512    512       2      30           2       0      30      16384        0
           SMR CPU     32       7     504           7       0     254      16352        0
         malloc-16     16     508     492        3543       0     254      16000        0
              kenv    258      17      43        1069       0      30      15480        0
            mqnode    416       3      33           3       0      30      14976        0
              vmem   1856       1       7           1       0       8      14848        0
        SMR SHARED     24       7     504           7       0     254      12264        0
   tcp_inpcb ports     32       1     377           1       0     254      12096        0
             KNOTE    160       0      75           8       0      62      12000        0
         malloc-16     16      33     717        1459       0     254      12000        0
         malloc-16     16      11     739          14       0     254      12000        0
         malloc-16     16      30     720       27516       0     254      12000        0
         malloc-16     16       2     748         114       0     254      12000        0
        malloc-384    384       1      29           1       0      30      11520        0
        malloc-384    384      13      17          13       0      30      11520        0
       Mountpoints   2816       2       2           2       0       4      11264        0
       malloc-8192   8192       1       0           1       0       1       8192        0
       malloc-8192   8192       1       0           1       0       1       8192        0
       malloc-4096   4096       0       2           2       0       2       8192        0
      vtnet_tx_hdr     24       0     334        2653       0     254       8016        0
         malloc-16     16       1     499           1       0     254       8000        0
         malloc-16     16       3     497           5       0     254       8000        0
           pcpu-16     16       4     252           4       0     254       4096        0
       UMA Slabs 1    176       8      14           8       0      62       3872        0
        KMAP ENTRY     96      12      27          14       0       0       3744        0
       FFS1 dinode    128       0       0           0       0     126          0        0
           ada_ccb    272       0       0           0       0      30          0        0
             swblk    136       0       0           0       0      62          0        0
          swpctrie    144       0       0           0       0      62          0        0
   cdg_qdiffsample     16       0       0           0       0     254          0        0
   pf state scrubs     40       0       0           0       0     254          0        0
   pf frag entries     40       0       0           0       0     254          0        0
          pf frags    248       0       0           0       0      62          0        0
  pf table entries    160       0       0           0       0     254          0        0
pf table entry counters     64       0       0           0       0     254          0        0
   pf source nodes    152       0       0           0       0     254          0        0
     pf state keys     88       0       0           0       0     126          0        0
         pf states    352       0       0           0       0     254          0        0
           pf tags    104       0       0           0       0     126          0        0
          pf mtags    184       0       0           0       0      62          0        0
       tcp_bbr_pcb    832       0       0           0       0      16          0        0
       tcp_bbr_map    128       0       0           0       0     126          0        0
      tcp_rack_pcb   1024       0       0           0       0      16          0        0
      tcp_rack_map    128       0       0           0       0     126          0        0
tfo_ccache_entries     80       0       0           0       0     126          0        0
               tfo      4       0       0           0       0     254          0        0
          sackhole     32       0       0           0       0     254          0        0
               ipq     56       0       0           0       0     254          0        0
   sctp_asconf_ack     48       0       0           0       0     254          0        0
       sctp_asconf     40       0       0           0       0     254          0        0
sctp_stream_msg_out    112       0       0           0       0     254          0        0
        sctp_readq    152       0       0           0       0     254          0        0
        sctp_chunk    152       0       0           0       0     254          0        0
        sctp_raddr    736       0       0           0       0     254          0        0
         sctp_asoc   2256       0       0           0       0     254          0        0
           sctp_ep   1176       0       0           0       0     254          0        0
   tcp_log_id_node    120       0       0           0       0     126          0        0
 tcp_log_id_bucket    176       0       0           0       0      62          0        0
           tcp_log    416       0       0           0       0     254          0        0
          tcpreass     48       0       0           0       0     254          0        0
udplite_inpcb ports     32       0       0           0       0     254          0        0
     udplite_inpcb    424       0       0           0       0      30          0        0
       ripcb ports     32       0       0           0       0     254          0        0
    IPsec SA lft_c     16       0       0           0       0     254          0        0
           netlink   2048       0       0           0       0       8          0        0
            itimer    352       0       0           0       0      30          0        0
            AIOLIO    272       0       0           0       0      30          0        0
             AIOCB    552       0       0           0       0      16          0        0
               AIO    208       0       0           0       0      62          0        0
        mqnotifier    216       0       0           0       0      62          0        0
            mvdata     64       0       0           0       0     254          0        0
            mqueue    248       0       0           0       0      62          0        0
        TMPFS node    232       0       0           0       0      62          0        0
           NCLNODE    608       0       0           0       0      16          0        0
     LTS VFS Cache    360       0       0           0       0      30          0        0
       L VFS Cache    320       0       0           0       0      30          0        0
     STS VFS Cache    144       0       0           0       0      62          0        0
           cryptop    280       0       0           0       0      30          0        0
  linux_dma_object     32       0       0           0       0     254          0        0
  linux_dma_pctrie    144       0       0           0       0      62          0        0
   IOMMU_MAP_ENTRY    104       0       0           0       0     126          0        0
    mbuf_jumbo_16k  16384       0       0           0       0     254          0        0
     mbuf_jumbo_9k   9216       0       0           0       0     254          0        0
      audit_record   1280       0       0           0       0       8          0        0
         domainset     40       0       0           0       0     254          0        0
        MAC labels     40       0       0           0       0     254          0        0
            vnpbuf   2624       0       0           0       0      16          0        0
           nfspbuf   2624       0       0           0       0       4          0        0
            swwbuf   2624       0       0           0       0       2          0        0
            swrbuf   2624       0       0           0       0       4          0        0
          umtx_shm     88       0       0           0       0     126          0        0
           umtx pi     96       0       0           0       0     126          0        0
rangeset pctrie nodes    144       0       0           0       0      62          0        0
      malloc-65536  65536       0       0           0       0       1          0        0
      malloc-65536  65536       0       0           0       0       1          0        0
      malloc-65536  65536       0       0           0       0       1          0        0
      malloc-65536  65536       0       0           0       0       1          0        0
      malloc-65536  65536       0       0           0       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
      malloc-16384  16384       0       0           0       0       1          0        0
      malloc-16384  16384       0       0           0       0       1          0        0
      malloc-16384  16384       0       0           0       0       1          0        0
      malloc-16384  16384       0       0           0       0       1          0        0
       malloc-8192   8192       0       0           0       0       1          0        0
           pcpu-32     32       0       0           0       0     254          0        0
            pcpu-4      4       0       0           0       0     254          0        0
            fakepg    104       0       0           0       0     126          0        0
          UMA Hash    256       0       0           0       0      62          0        0

Crashes (94):
Time	Kernel	Commit	Syzkaller	Log	Report	Syz repro	C repro	Manager	Title
2023/10/04 15:25	freebsd-src	74c2461386ea	b7d7ff54	console log	report	syz	C	ci-freebsd-main	panic: in_pcblookup_hash_locked: invalid local address
2023/06/24 06:49	freebsd-src	b1c66bc44af0	ee50e71c	console log	report	syz	C	ci-freebsd-main	panic: in_pcblookup_hash_locked: invalid local address
2023/10/04 15:07	freebsd-src	74c2461386ea	b7d7ff54	console log	report			ci-freebsd-main	panic: in_pcblookup_hash_locked: invalid local address
2023/09/28 09:39	freebsd-src	f6d37c9ca13f	c2ab1e5d	console log	report			ci-freebsd-main	panic: in_pcblookup_hash_locked: invalid local address
2023/09/10 08:25	freebsd-src	3482f57f0fdf	6654cf89	console log	report			ci-freebsd-main	panic: in_pcblookup_hash_locked: invalid local address
2023/09/07 10:55	freebsd-src	03a7c36ddbc0	72324844	console log	report			ci-freebsd-main	panic: in_pcblookup_hash_locked: invalid local address
2023/09/03 14:02	freebsd-src	525bc87f54f2	696ea0d2	console log	report			ci-freebsd-main	panic: in_pcblookup_hash_locked: invalid local address
2023/08/31 22:32	freebsd-src	09ec5e67a7a6	4ad3538b	console log	report			ci-freebsd-main	panic: in_pcblookup_hash_locked: invalid local address
2023/09/10 15:56	freebsd-src	3482f57f0fdf	6654cf89	console log	report			ci-freebsd-i386	panic: in_pcblookup_hash_locked: invalid local address
2023/09/08 02:46	freebsd-src	c9315099f69e	72324844	console log	report			ci-freebsd-i386	panic: in_pcblookup_hash_locked: invalid local address
2023/08/31 13:45	freebsd-src	09ec5e67a7a6	4ad3538b	console log	report			ci-freebsd-i386	panic: in_pcblookup_hash_locked: invalid local address
2023/08/23 18:53	freebsd-src	0834f13da9e3	4d7ae7ab	console log	report			ci-freebsd-main	panic: in_pcblookup_hash_locked: invalid local address
2023/08/19 18:30	freebsd-src	0d30f3afa62b	d216d8a0	console log	report			ci-freebsd-main	panic: in_pcblookup_hash_locked: invalid local address
2023/08/17 08:47	freebsd-src	d1d7a273707a	74b106b6	console log	report			ci-freebsd-main	panic: in_pcblookup_hash_locked: invalid local address
2023/08/12 11:20	freebsd-src	5f11a33ceeb3	39990d51	console log	report			ci-freebsd-main	panic: in_pcblookup_hash_locked: invalid local address
2023/08/06 09:57	freebsd-src	1a6238d1ea2a	4ffcc9ef	console log	report			ci-freebsd-main	panic: in_pcblookup_hash_locked: invalid local address
2023/07/21 20:42	freebsd-src	9f23cbd6cae8	e2c3b400	console log	report			ci-freebsd-main	panic: in_pcblookup_hash_locked: invalid local address
2023/07/06 01:35	freebsd-src	544deacc90f4	ee50e71c	console log	report			ci-freebsd-main	panic: in_pcblookup_hash_locked: invalid local address
2023/07/03 11:33	freebsd-src	2176c9ab71c8	ee50e71c	console log	report			ci-freebsd-main	panic: in_pcblookup_hash_locked: invalid local address
2023/06/24 06:32	freebsd-src	b1c66bc44af0	ee50e71c	console log	report			ci-freebsd-main	panic: in_pcblookup_hash_locked: invalid local address
2023/06/15 18:54	freebsd-src	e27c618e20cd	ee50e71c	console log	report			ci-freebsd-main	panic: in_pcblookup_hash_locked: invalid local address
2023/06/12 23:05	freebsd-src	34eeabff5a86	ee50e71c	console log	report			ci-freebsd-main	panic: in_pcblookup_hash_locked: invalid local address
2023/06/10 06:35	freebsd-src	553022aba541	ee50e71c	console log	report			ci-freebsd-main	panic: in_pcblookup_hash_locked: invalid local address
2023/06/09 00:11	freebsd-src	2178e8c27aad	ee50e71c	console log	report			ci-freebsd-main	panic: in_pcblookup_hash_locked: invalid local address
2023/06/06 05:00	freebsd-src	d66540e829ec	ee50e71c	console log	report			ci-freebsd-main	panic: in_pcblookup_hash_locked: invalid local address
2023/05/13 10:14	freebsd-src	46f35bf28d0a	ee50e71c	console log	report			ci-freebsd-main	panic: in_pcblookup_hash_locked: invalid local address
2023/05/08 18:57	freebsd-src	f76df4718d27	ee50e71c	console log	report			ci-freebsd-main	panic: in_pcblookup_hash_locked: invalid local address
2023/05/08 14:38	freebsd-src	356e698011b2	ee50e71c	console log	report			ci-freebsd-main	panic: in_pcblookup_hash_locked: invalid local address
2023/05/03 07:11	freebsd-src	ec1e83782d9d	ee50e71c	console log	report			ci-freebsd-main	panic: in_pcblookup_hash_locked: invalid local address
2023/03/17 21:27	freebsd-src	b754d7faafd3	ee50e71c	console log	report			ci-freebsd-main	panic: in_pcblookup_hash_locked: invalid local address
2023/03/13 16:44	freebsd-src	15e7fa83ef3c	ee50e71c	console log	report			ci-freebsd-main	panic: in_pcblookup_hash_locked: invalid local address
2023/03/10 22:01	freebsd-src	3916fdd2f2c8	ee50e71c	console log	report			ci-freebsd-main	panic: in_pcblookup_hash_locked: invalid local address
2023/03/08 09:47	freebsd-src	52f9710412ee	ee50e71c	console log	report			ci-freebsd-main	panic: in_pcblookup_hash_locked: invalid local address
2023/03/07 23:31	freebsd-src	d71a00e9f5db	ee50e71c	console log	report			ci-freebsd-main	panic: in_pcblookup_hash_locked: invalid local address
2023/08/26 06:37	freebsd-src	8ed0ecf8024d	7ba13a15	console log	report			ci-freebsd-i386	panic: in_pcblookup_hash_locked: invalid local address
2023/08/14 22:00	freebsd-src	d29b95ecc0d0	39990d51	console log	report			ci-freebsd-i386	panic: in_pcblookup_hash_locked: invalid local address
2023/08/11 10:52	freebsd-src	580cadd6a5f0	39990d51	console log	report			ci-freebsd-i386	panic: in_pcblookup_hash_locked: invalid local address
2023/07/24 07:28	freebsd-src	e64fe029e9d3	b03242d7	console log	report			ci-freebsd-i386	panic: in_pcblookup_hash_locked: invalid local address
2023/07/10 20:08	freebsd-src	8ab2da68283b	ee50e71c	console log	report			ci-freebsd-i386	panic: in_pcblookup_hash_locked: invalid local address
2023/07/08 21:12	freebsd-src	5fee12e18967	ee50e71c	console log	report			ci-freebsd-i386	panic: in_pcblookup_hash_locked: invalid local address
2023/07/06 13:38	freebsd-src	4631191c8a5f	ee50e71c	console log	report			ci-freebsd-i386	panic: in_pcblookup_hash_locked: invalid local address
2023/07/02 07:47	freebsd-src	f03a7e52769e	ee50e71c	console log	report			ci-freebsd-i386	panic: in_pcblookup_hash_locked: invalid local address
2023/06/14 06:27	freebsd-src	246aec9a3ce3	ee50e71c	console log	report			ci-freebsd-i386	panic: in_pcblookup_hash_locked: invalid local address
2023/06/13 11:30	freebsd-src	740d76544ad8	ee50e71c	console log	report			ci-freebsd-i386	panic: in_pcblookup_hash_locked: invalid local address
2023/06/11 04:07	freebsd-src	51117ed11640	ee50e71c	console log	report			ci-freebsd-i386	panic: in_pcblookup_hash_locked: invalid local address
2023/06/02 15:20	freebsd-src	c1839039b193	ee50e71c	console log	report			ci-freebsd-i386	panic: in_pcblookup_hash_locked: invalid local address
2023/05/30 19:23	freebsd-src	7a52b570e758	ee50e71c	console log	report			ci-freebsd-i386	panic: in_pcblookup_hash_locked: invalid local address
2023/05/30 17:06	freebsd-src	d464a7698de8	ee50e71c	console log	report			ci-freebsd-i386	panic: in_pcblookup_hash_locked: invalid local address
2023/05/29 02:53	freebsd-src	b796bfce4869	ee50e71c	console log	report			ci-freebsd-i386	panic: in_pcblookup_hash_locked: invalid local address
2023/05/28 11:00	freebsd-src	27234ad6999b	ee50e71c	console log	report			ci-freebsd-i386	panic: in_pcblookup_hash_locked: invalid local address
2023/05/23 17:49	freebsd-src	5a9c724847f9	ee50e71c	console log	report			ci-freebsd-i386	panic: in_pcblookup_hash_locked: invalid local address
2023/05/15 12:18	freebsd-src	d957343f8713	ee50e71c	console log	report			ci-freebsd-i386	panic: in_pcblookup_hash_locked: invalid local address
2023/03/20 03:36	freebsd-src	ea6d16926666	ee50e71c	console log	report			ci-freebsd-i386	panic: in_pcblookup_hash_locked: invalid local address
2023/03/09 18:58	freebsd-src	b2654064c2d1	ee50e71c	console log	report			ci-freebsd-i386	panic: in_pcblookup_hash_locked: invalid local address

* ~~Struck through~~ repros no longer work on HEAD.