syzbot


panic: Most recently used by ip6opt (2)

Status: fixed on 2020/03/20 00:05
Reported-by: syzbot+52eb0fd4ddc119787f9d@syzkaller.appspotmail.com
Fix commit: e02582d1ae44 Fix synchronization in the IPV6_2292PKTOPTIONS set handler.
First crash: 1547d, last: 1502d
Duplicate bugs (1)
duplicates (1):
Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
Fatal trap 12: page fault in pmap_kextract 1 1502d 1502d 0/2 closed as dup on 2020/03/19 16:44
Similar bugs (1)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
freebsd panic: Most recently used by ip6opt 3 1787d 1817d 0/2 auto-closed as invalid on 2019/10/25 08:44

Sample crash report:
panic: Most recently used by ip6opt

cpuid = 1
time = 1584355722
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x47/frame 0xfffffe0024adae50
vpanic() at vpanic+0x1c7/frame 0xfffffe0024adaeb0
panic() at panic+0x43/frame 0xfffffe0024adaf10
mtrash_ctor() at mtrash_ctor+0xe5/frame 0xfffffe0024adaf50
item_ctor() at item_ctor+0x47f/frame 0xfffffe0024adafb0
malloc() at malloc+0xd9/frame 0xfffffe0024adb010
ip6_ctloutput() at ip6_ctloutput+0x184d/frame 0xfffffe0024adb910
tcp_ctloutput() at tcp_ctloutput+0xe2/frame 0xfffffe0024adb990
sosetopt() at sosetopt+0x101/frame 0xfffffe0024adba10
kern_setsockopt() at kern_setsockopt+0x158/frame 0xfffffe0024adba90
sys_setsockopt() at sys_setsockopt+0x33/frame 0xfffffe0024adbac0
amd64_syscall() at amd64_syscall+0x2f4/frame 0xfffffe0024adbbf0
fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0024adbbf0
--- syscall (198, FreeBSD ELF64, nosys), rip = 0x41332a, rsp = 0x7fffdffdcf38, rbp = 0x5 ---
KDB: enter: panic
[ thread pid 985 tid 100360 ]
Stopped at      kdb_enter+0x67: movq    $0,0x146d276(%rip)
db> 
db> set $lines = 0
db> set $maxwidth = 0
db> show registers
cs                        0x20
ds                        0x3b  ll+0x1a
es                        0x3b  ll+0x1a
fs                        0x13
gs                        0x1b
ss                        0x28  ll+0x7
rax                       0x12
rcx                       0x80  ll+0x5f
rdx         0xffffffff818939c2
rbx                          0
rsp         0xfffffe0024adae30
rbp         0xfffffe0024adae50
rsi                        0x1
rdi                          0
r8                           0
r9                  0xffffffff
r10                       0x32  ll+0x11
r11         0xfffffe002498ca10
r12         0xffffffff82068e30  ddb_dbbe
r13                          0
r14         0xffffffff81932be6
r15         0xffffffff81932be6
rip         0xffffffff810a9fc7  kdb_enter+0x67
rflags                    0x86  ll+0x65
kdb_enter+0x67: movq    $0,0x146d276(%rip)
db> show proc
Process 985 (syz-executor.1) at 0xfffff8000c491530:
 state: NORMAL
 uid: 0  gids: 0, 0, 5
 parent: pid 777 at 0xfffff8000c55b530
 ABI: FreeBSD ELF64
 arguments: /root/syz-executor.1
 reaper: 0xfffff80003311000 reapsubtree: 1
 sigparent: 20
 vmspace: 0xfffffe0024987000
   (map 0xfffffe0024987000)
   (map.pmap 0xfffffe00249870c0)
   (pmap 0xfffffe0024987120)
 threads: 4
100114                   Run     CPU 0                       syz-executor.1
100350                   S       select  0xfffff800035738c0  syz-executor.1
100360                   Run     CPU 1                       syz-executor.1
100362                   RunQ                                syz-executor.1
db> ps
  pid  ppid  pgrp   uid  state   wmesg   wchan               cmd
  988   774   774     0  R       (threaded)                  syz-executor.0
100085                   RunQ                                syz-executor.0
100357                   S       select  0xfffff80003573440  syz-executor.0
  987   778   778     0  R       (threaded)                  syz-executor.3
100075                   RunQ                                syz-executor.3
100354                   S       select  0xfffff80003a7d0c0  syz-executor.3
  985   777   777     0  R       (threaded)                  syz-executor.1
100114                   Run     CPU 0                       syz-executor.1
100350                   S       select  0xfffff800035738c0  syz-executor.1
100360                   Run     CPU 1                       syz-executor.1
100362                   RunQ                                syz-executor.1
  975   969   975     0  Ss      select  0xfffff80003a7d140  dhclient
  972     1   972     0  Ss      select  0xfffff80003573340  dhclient
  969   962   422    65  S       select  0xfffff8000355cbc0  dhclient
  962   422   422     0  S       wait    0xfffff8000c55ba60  sh
  778   772   778     0  Rs                                  syz-executor.3
  777   772   777     0  Rs                                  syz-executor.1
  775   772   775     0  Rs                                  syz-executor.2
  774   772   774     0  Ds      proctre 0xffffffff82002580  syz-executor.0
  772   770   770     0  S       (threaded)                  syz-execprog
100098                   S       uwait   0xfffff80003a66280  syz-execprog
100099                   S       uwait   0xfffff80003a66380  syz-execprog
100100                   S       uwait   0xfffff80003a67380  syz-execprog
100101                   S       uwait   0xfffff80003820b80  syz-execprog
100102                   S       uwait   0xfffff80003a67780  syz-execprog
100103                   S       uwait   0xfffff80003479680  syz-execprog
100104                   S       uwait   0xfffff80003479780  syz-execprog
100105                   S       uwait   0xfffff80003479c00  syz-execprog
100106                   S       uwait   0xfffff80003479d00  syz-execprog
100107                   S       kqread  0xfffff80003843000  syz-execprog
100108                   S       uwait   0xfffff80003a67700  syz-execprog
  770   768   770     0  Ss      pause   0xfffff800033f15d8  csh
  768   680   768     0  Ss      select  0xfffff8000355ce40  sshd
  746     1   746     0  Ss+     ttyin   0xfffff800033ea8b0  getty
  745     1   745     0  Ss+     ttyin   0xfffff80003b3b0b0  getty
  744     1   744     0  Ss+     ttyin   0xfffff80003b3b4b0  getty
  743     1   743     0  Ss+     ttyin   0xfffff80003b3b8b0  getty
  742     1   742     0  Ss+     ttyin   0xfffff80003b3bcb0  getty
  741     1   741     0  Ss+     ttyin   0xfffff80003b3a0b0  getty
  740     1   740     0  Ss+     ttyin   0xfffff80003b3a4b0  getty
  739     1   739     0  Ss+     ttyin   0xfffff80003b3a8b0  getty
  738     1   738     0  Ss+     ttyin   0xfffff80003b3acb0  getty
  684     1   684     0  Ss      nanslp  0xffffffff824ffe40  cron
  680     1   680     0  Ss      select  0xfffff8000355f140  sshd
  493     1   493     0  Ss      select  0xfffff80003a7ddc0  syslogd
  422     1   422     0  Ss      wait    0xfffff80003d33a60  devd
  421     1   421    65  Ss      select  0xfffff80003a7da40  dhclient
  336     1   336     0  Ss      select  0xfffff8000355f240  dhclient
  333     1   333     0  Ss      select  0xfffff80003a7db40  dhclient
   21     0     0     0  DL      vlruwt  0xfffff800033f1a60  [vnlru]
   20     0     0     0  DL      syncer  0xffffffff825d62d8  [syncer]
   19     0     0     0  DL      (threaded)                  [bufdaemon]
100065                   D       qsleep  0xffffffff825d57d8  [bufdaemon]
100066                   D       -       0xffffffff8200aa00  [bufspacedaemon-0]
100081                   D       sdflush 0xfffff8000341ace8  [/ worker]
   18     0     0     0  DL      psleep  0xffffffff825f1248  [vmdaemon]
   17     0     0     0  DL      (threaded)                  [pagedaemon]
100063                   D       psleep  0xffffffff8261d158  [dom0]
100069                   D       launds  0xffffffff8261d164  [laundry: dom0]
100070                   D       umarcl  0xffffffff81536af0  [uma]
   16     0     0     0  DL      -       0xffffffff8235a6b0  [rand_harvestq]
   15     0     0     0  DL      waiting 0xffffffff82662720  [sctp_iterator]
    9     0     0     0  DL      -       0xffffffff825d51dc  [soaiod4]
    8     0     0     0  DL      -       0xffffffff825d51dc  [soaiod3]
    7     0     0     0  DL      -       0xffffffff825d51dc  [soaiod2]
    6     0     0     0  DL      -       0xffffffff825d51dc  [soaiod1]
    5     0     0     0  DL      (threaded)                  [cam]
100031                   D       -       0xffffffff82235ac0  [doneq0]
100062                   D       -       0xffffffff82235988  [scanner]
    4     0     0     0  DL      crypto_ 0xfffff8000321b190  [crypto returns 1]
    3     0     0     0  DL      crypto_ 0xfffff8000321b130  [crypto returns 0]
    2     0     0     0  DL      crypto_ 0xffffffff825eb2b8  [crypto]
   14     0     0     0  DL      seqstat 0xfffff80003369888  [sequencer 00]
   13     0     0     0  DL      (threaded)                  [geom]
100022                   D       -       0xffffffff8261b788  [g_event]
100023                   D       -       0xffffffff8261b798  [g_up]
100024                   D       -       0xffffffff8261b790  [g_down]
   12     0     0     0  WL      (threaded)                  [intr]
100005                   I                                   [swi6: Giant taskq]
100007                   I                                   [swi5: fast taskq]
100011                   I                                   [swi6: task queue]
100017                   I                                   [swi1: netisr 0]
100018                   I                                   [swi3: vm]
100019                   I                                   [swi4: clock (0)]
100020                   I                                   [swi4: clock (1)]
100032                   I                                   [irq24: virtio_pci0]
100033                   I                                   [irq25: virtio_pci0]
100034                   I                                   [irq26: virtio_pci0]
100035                   I                                   [irq27: virtio_pci0]
100036                   I                                   [irq28: virtio_pci1]
100037                   I                                   [irq29: virtio_pci1]
100038                   I                                   [irq30: virtio_pci1]
100039                   I                                   [irq31: virtio_pci1]
100040                   I                                   [irq32: virtio_pci1]
100045                   I                                   [irq10: virtio_pci2]
100047                   I                                   [irq1: atkbd0]
100048                   I                                   [irq12: psm0]
100049                   I                                   [swi0: uart uart++]
   11     0     0     0  RL      (threaded)                  [idle]
100003                   CanRun                              [idle: cpu0]
100004                   CanRun                              [idle: cpu1]
    1     0     1     0  SLs     wait    0xfffff80003311000  [init]
   10     0     0     0  DL      audit_w 0xffffffff826633b0  [audit]
    0     0     0     0  DLs     (threaded)                  [kernel]
100000                   D       swapin  0xffffffff8260adc8  [swapper]
100006                   D       -       0xfffff80003338000  [thread taskq]
100008                   D       -       0xfffff80003205d00  [config_0]
100009                   D       -       0xfffff80003339d00  [kqueue_ctx taskq]
100010                   D       -       0xfffff80003339c00  [aiod_kick taskq]
100012                   D       -       0xfffff80003205c00  [if_config_tqg_0]
100013                   D       -       0xfffff80003205b00  [if_io_tqg_0]
100014                   D       -       0xfffff80003205a00  [if_io_tqg_1]
100015                   D       -       0xfffff80003205900  [softirq_0]
100016                   D       -       0xfffff80003205800  [softirq_1]
100021                   D       -       0xfffff80003339a00  [firmware taskq]
100026                   D       -       0xfffff80003339800  [crypto_0]
100027                   D       -       0xfffff80003339800  [crypto_1]
100041                   D       -       0xfffff80003334a00  [vtnet0 rxq 0]
100042                   D       -       0xfffff80003334900  [vtnet0 txq 0]
100043                   D       -       0xfffff80003334800  [vtnet0 rxq 1]
100044                   D       -       0xfffff80003334700  [vtnet0 txq 1]
100046                   D       vtbslp  0xfffff80003572d80  [virtio_balloon]
100050                   D       -       0xfffff80003845000  [mca taskq]
100055                   D       -       0xffffffff81cd5e80  [deadlkres]
100058                   D       -       0xfffff80003b36500  [acpi_task_0]
100059                   D       -       0xfffff80003b36500  [acpi_task_1]
100060                   D       -       0xfffff80003b36500  [acpi_task_2]
100061                   D       -       0xfffff80003339600  [CAM taskq]
db> show all locks
Process 985 (syz-executor.1) thread 0xfffffe0024967700 (100114)
exclusive sleep mutex umtxql (umtxql) r = 0 (0xffffffff8250f6a0) locked @ /syzkaller/managers/main/kernel/sys/kern/kern_umtx.c:512
Process 985 (syz-executor.1) thread 0xfffffe002498c500 (100360)
exclusive rw tcpinp (tcpinp) r = 0 (0xfffff8000c330b90) locked @ /syzkaller/managers/main/kernel/sys/netinet6/ip6_output.c:2049
db> show malloc
              Type        InUse        MemUse     Requests
            devbuf         4213         4851K         4241
             vtbuf           24         1968K           46
         sysctloid        26033         1517K        26097
              kobj          332         1328K          488
            newblk           43         1035K          530
          vfscache            4         1025K            4
               pcb           30          546K          412
          inodedep           37          530K          172
         ufs_quota            1          512K            1
          vfs_hash            1          512K            1
           callout            2          512K            2
              intr            4          388K            4
           subproc          120          246K         1056
            acpica         1674          185K        52709
         vnet_data            1          168K            1
          filedesc           20          137K          226
           pagedep           15          132K          111
        tfo_ccache            1          128K            1
               sem            4          106K            4
            DEVFS1          105          105K          122
            linker          222           89K          253
               bus          988           79K         3374
          mtx_pool            2           72K            2
          syncache            1           68K            1
          acpitask            1           64K            1
       ddb_capture            1           64K            1
            module          494           62K          494
              umtx          288           36K          288
               BPF           22           36K           22
           kdtrace          175           34K         2282
        gtaskqueue           22           34K           22
         hostcache            1           32K            1
               shm            1           32K            1
            DEVFS3          124           31K          134
               msg            4           30K            4
        DEVFS_RULE           56           27K           56
            ifaddr           71           24K           73
              vmem            3           22K            4
            kbdmux            6           22K            6
           lltable           47           18K           47
              temp           34           17K         1942
         ufs_mount            3           17K            4
              proc            3           17K            3
               tty           16           16K           16
           tidhash            1           16K            1
           ithread           89           15K           89
       ether_multi          172           14K          177
            bus-sc           30           14K         1431
            KTRACE          100           13K          100
             ifnet            7           13K            7
              kenv           95           12K           99
         in6_multi           89           11K           89
      eventhandler          122           11K          122
         pfs_nodes           20           10K           20
              GEOM           60           10K          487
              rman           82           10K          423
         bmsafemap            2            9K          142
              UART           12            9K           12
           devstat            4            9K            4
               rpc            2            8K            2
             shmfd            1            8K            1
       pfs_vncache            1            8K            1
          routetbl           58            8K           62
     audit_evclass          232            8K          290
           CAM DEV            3            6K          510
            select           48            6K           48
            kqueue           55            6K          995
                vt           11            6K           11
            plimit           21            6K          366
              cred           21            6K          243
            sglist            5            6K            5
         CAM queue            5            6K         1528
       ufs_dirhash           24            5K           24
         taskqueue           42            5K           42
           memdesc            1            4K            1
               MCA           32            4K           32
             evdev            4            4K            4
               UMA          236            4K          236
            dirrem           13            4K          106
            diradd           26            4K          140
             hhook           13            4K           13
           session           25            4K           40
              pgrp           25            4K           40
           acpisem           22            3K           22
          terminal           11            3K           11
         proc-args           44            3K          582
           uidinfo            3            3K            8
             mkdir           17            3K          196
          sctp_ifa           17            3K           17
        local_apic            1            2K            1
           io_apic            1            2K            1
          indirdep            8            2K           10
         ipsec-saq            2            2K            2
         sctp_atcl            4            2K          162
             lockf           19            2K           29
            ip6ndp           12            2K           21
          freefile           13            2K          104
            Unitno           28            2K           45
           CAM XPT           22            2K          543
         newdirblk           12            2K           98
          in_multi            6            2K            7
            crypto            2            2K            2
           acpidev           20            2K           20
               msi            9            2K            9
               tun            7            2K            7
          freework            5            2K          104
           softdep            1            1K            1
          freeblks            4            1K          103
       ipsecpolicy            1            1K            1
            sahead            1            1K            1
          secasvar            1            1K            1
             clone            8            1K            8
       vnodemarker            2            1K           14
      NFSD session            1            1K            1
        CAM periph            4            1K          271
       inpcbpolicy           25            1K          678
               mld            6            1K            6
          sctp_ifn            6            1K            6
              igmp            6            1K            6
         toponodes            6            1K            6
            isadev            6            1K            6
             mount           16            1K           86
          pci_link           10            1K           10
              pfil            4            1K            4
    chacha20random            1            1K            1
           CAM SIM            2            1K            2
             epoch            4            1K            4
              cdev            2            1K            2
            DEVFSP            8            1K            8
 encap_export_host            8            1K            8
            ip6opt            5            1K          331
               osd            3            1K            9
            vnodes            1            1K            1
      NFSD lckfile            1            1K            1
     NFSD V4client            1            1K            1
             DEVFS            9            1K           10
            feeder            7            1K            7
        loginclass            3            1K            7
     CAM dev queue            2            1K            2
 CAM I/O Scheduler            1            1K            1
            apmdev            1            1K            1
          atkbddev            2            1K            2
          CAM path            4            1K         1034
         sctp_atky            4            1K          162
          pmchooks            1            1K            1
            prison            4            1K            4
            soname            4            1K         5768
          nexusdev            5            1K            5
           entropy            2            1K           42
           tcpfunc            1            1K            1
          sctp_vrf            1            1K            1
         sctp_athm            4            1K          162
              vnet            1            1K            1
          acpiintr            1            1K            1
               pmc            1            1K            1
              cpus            2            1K            2
    vnet_data_free            1            1K            1
           Per-cpu            1            1K            1
          filecaps            2            1K           90
          p1003.1b            1            1K            1
           ath_hal            0            0K            0
            athdev            0            0K            0
        madt_table            0            0K            2
           ata_pci            0            0K            0
           ata_dma            0            0K            0
       ata_generic            0            0K            0
               amr            0            0K            0
           scsi_da            0            0K           69
            ata_da            0            0K            0
           scsi_ch            0            0K            0
            pvscsi            0            0K            0
          smartpqi            0            0K            0
           scsi_cd            0            0K            0
            USBdev            0            0K            0
               USB            0            0K            0
       AHCI driver            0            0K            0
               agp            0            0K            0
           nvme_da            0            0K            0
              iavf            0            0K            0
               ixl            0            0K            0
           acpipwr            0            0K            0
            twsbuf            0            0K            0
      twe_commands            0            0K            0
      twa_commands            0            0K            0
       tcp_log_dev            0            0K            0
      midi buffers            0            0K            0
             mixer            0            0K            0
       fpukern_ctx            0            0K            0
          xen_intr            0            0K            0
              ac97            0            0K            0
             hdacc            0            0K            0
           xen_hvm            0            0K            0
         legacydrv            0            0K            0
            qpidrv            0            0K            0
              hdac            0            0K            0
              hdaa            0            0K            0
      dmar_idpgtbl            0            0K            0
          dmar_dom            0            0K            0
          dmar_ctx            0            0K            0
       dmar_dmamap            0            0K            0
         acpi_perf            0            0K            0
         acpicmbat            0            0K            0
       SIIS driver            0            0K            0
              isci            0            0K            0
           bxe_ilt            0            0K            0
            xenbus            0            0K            0
           CAM CCB            0            0K         1887
     vm_fictitious            0            0K            0
               PUC            0            0K            0
          ppbusdev            0            0K            0
agtiapi_MemAlloc malloc            0            0K            0
    osti_cacheable            0            0K            0
          tempbuff            0            0K            0
          tempbuff            0            0K            0
ag_tgt_map_t malloc            0            0K            0
           UMAHash            0            0K            0
ag_slr_map_t malloc            0            0K            0
lDevFlags * malloc            0            0K            0
         vm_pgdata            0            0K            0
           jblocks            0            0K            0
          savedino            0            0K           33
          sentinel            0            0K            0
            jfsync            0            0K            0
            jtrunc            0            0K            0
             sbdep            0            0K            5
           jsegdep            0            0K            0
              jseg            0            0K            0
         jfreefrag            0            0K            0
          jfreeblk            0            0K            0
           jnewblk            0            0K            0
            jmvref            0            0K            0
           jremref            0            0K            0
           jaddref            0            0K            0
           freedep            0            0K            0
          freefrag            0            0K            5
        allocindir            0            0K            0
       allocdirect            0            0K            0
          ufs_trim            0            0K            0
           mactemp            0            0K            0
     audit_trigger            0            0K            0
 audit_pipe_presel            0            0K            0
     audit_pipeent            0            0K            0
        audit_pipe            0            0K            0
      audit_evname            0            0K            0
         audit_bsm            0            0K            0
      audit_gidset            0            0K            0
        audit_text            0            0K            0
        audit_path            0            0K            0
        audit_data            0            0K            0
        audit_cred            0            0K            0
             xform            0            0K            0
               NLM            0            0K            0
 nfsclient_nlminfo            0            0K            0
    nfsclient_lock            0            0K            0
           NFS FHA            0            0K            0
    ipsec-spdcache            0            0K            0
         ipsec-reg            0            0K            0
        ipsec-misc            0            0K            0
      ipsecrequest            0            0K            0
       ip6_msource            0            0K            0
      ip6_moptions            0            0K            0
       in6_mfilter            0            0K            0
             frag6            0            0K            0
            tcplog            0            0K            0
               LRO            0            0K            0
        sctp_mcore            0            0K            0
        sctp_socko            0            0K            0
         sctp_iter            0            0K            7
         sctp_mvrf            0            0K            0
         sctp_timw            0            0K            0
         sctp_cpal            0            0K            0
         sctp_cmsg            0            0K            0
         sctp_stre            0            0K            0
         sctp_athi            0            0K            0
         sctp_a_it            0            0K            7
         sctp_aadr            0            0K            0
         sctp_stro            0            0K            0
         sctp_stri            0            0K            0
          sctp_map            0            0K            0
      newreno data            0            0K            0
        ip_msource            0            0K            0
       ip_moptions            0            0K            0
        in_mfilter            0            0K            0
              ipid            0            0K            0
         80211scan            0            0K            0
      80211ratectl            0            0K            0
        80211power            0            0K            0
       80211nodeie            0            0K            0
         80211node            0            0K            0
      80211mesh_gt            0            0K            0
      80211mesh_rt            0            0K            0
         80211perr            0            0K            0
         80211prep            0            0K            0
         80211preq            0            0K            0
          80211dfs            0            0K            0
       80211crypto            0            0K            0
          80211vap            0            0K            0
             iflib            0            0K            0
              vlan            0            0K            0
               gif            0            0K            0
           ifdescr            0            0K            0
              zlib            0            0K            0
           fadvise            0            0K            0
tiDeviceHandle_t * malloc            0            0K            0
            statfs            0            0K          282
       export_host            0            0K            0
        cl_savebuf            0            0K            2
ag_portal_data_t malloc            0            0K            0
ag_device_t malloc            0            0K            0
     STLock malloc            0            0K            0
          CCB List            0            0K            0
            sr_iov            0            0K            0
               OCS            0            0K            0
               OCS            0            0K            0
              nvme            0            0K            0
               nvd            0            0K            0
            netmap            0            0K            0
            mwldev            0            0K            0
        MVS driver            0            0K            0
     CAM ccb queue            0            0K            0
          mrsasbuf            0            0K            0
          mpt_user            0            0K            0
          mps_user            0            0K            0
            biobuf            0            0K            0
              aios            0            0K            0
               lio            0            0K            0
               acl            0            0K            0
            MPSSAS            0            0K            0
          mbuf_tag            0            0K          111
              accf            0            0K            0
               pts            0            0K            0
               iov            0            0K        14120
          ioctlops            0            0K          105
           Witness            0            0K            0
             stack            0            0K            0
               mps            0            0K            0
          mpr_user            0            0K            0
            MPRSAS            0            0K            0
               mpr            0            0K            0
            mfibuf            0            0K            0
        md_sectors            0            0K            0
              sbuf            0            0K          288
           md_disk            0            0K            0
        compressor            0            0K            0
           malodev            0            0K            0
              SWAP            0            0K            0
               LED            0            0K            0
         sysctltmp            0            0K          593
            sysctl            0            0K            1
              ekcd            0            0K            0
            dumper            0            0K            0
              rctl            0            0K            0
          ix_sriov            0            0K            0
        aacraidcam            0            0K            0
                ix            0            0K            0
            ipsbuf            0            0K            0
            iirbuf            0            0K            0
             cache            0            0K            0
       aacraid_buf            0            0K            0
          kcovinfo            0            0K            0
      prison_racct            0            0K            0
       Fail Points            0            0K            0
             sigio            0            0K            1
filedesc_to_leader            0            0K            0
               pwd            0            0K            0
       tty console            0            0K            0
            aaccam            0            0K            0
            aacbuf            0            0K            0
              zstd            0            0K            0
            nvlist            0            0K            0
          SCSI ENC            0            0K            0
           SCSI sa            0            0K            0
        isofs_node            0            0K            0
       isofs_mount            0            0K            0
     tr_raid5_data            0            0K            0
    tr_raid1e_data            0            0K            0
     tr_raid1_data            0            0K            0
     tr_raid0_data            0            0K            0
    tr_concat_data            0            0K            0
       md_sii_data            0            0K            0
   md_promise_data            0            0K            0
    md_nvidia_data            0            0K            0
   md_jmicron_data            0            0K            0
     md_intel_data            0            0K            0
       md_ddf_data            0            0K            0
         raid_data            0            0K           72
     geom_flashmap            0            0K            0
         newnfsmnt            0            0K            0
  newnfsclient_req            0            0K            0
   NFSCL layrecall            0            0K            0
     NFSCL session            0            0K            0
     NFSCL sockreq            0            0K            0
     NFSCL devinfo            0            0K            0
     NFSCL flayout            0            0K            0
      NFSCL layout            0            0K            0
     NFSD rollback            0            0K            0
NFSCL diroffdiroff            0            0K            0
       NEWdirectio            0            0K            0
        NEWNFSnode            0            0K            0
         NFSCL lck            0            0K            0
      NFSCL lckown            0            0K            0
      NFSCL client            0            0K            0
       NFSCL deleg            0            0K            0
        NFSCL open            0            0K            0
       NFSCL owner            0            0K            0
            NFS fh            0            0K            0
           NFS req            0            0K            0
     NFSD usrgroup            0            0K            0
       NFSD string            0            0K            0
       NFSD V4lock            0            0K            0
      NFSD V4state            0            0K            0
     NFSD srvcache            0            0K            0
       msdosfs_fat            0            0K            0
     msdosfs_mount            0            0K            0
      msdosfs_node            0            0K            0
            DEVFS4            0            0K            0
            DEVFS2            0            0K            0
            gntdev            0            0K            0
       privcmd_dev            0            0K            0
        evtchn_dev            0            0K            0
          xenstore            0            0K            0
         scsi_pass            0            0K            0
         ciss_data            0            0K            0
               xnb            0            0K            0
              xbbd            0            0K            0
               xbd            0            0K            0
           Balloon            0            0K            0
          sysmouse            0            0K            0
            vtfont            0            0K            0
db> show ktr
No such command; use "help" to list available commands

Crashes (4):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2020/03/16 10:57 freebsd 937b338ad2d3 749688d2 console log report syz ci-freebsd-main
2020/03/05 17:05 freebsd 4f81afdc2bd0 b655d91b console log report ci-freebsd-main
2020/02/07 09:21 freebsd ee8362f6f3b7 06150bf1 console log report ci-freebsd-main
2020/01/31 01:40 freebsd 12c568d4591f 5ed23f9a console log report ci-freebsd-main
* Struck through repros no longer work on HEAD.