syzbot


panic: Warning: Last msg marked incomplete, yet nothing left? (2)

Status: fixed on 2022/05/29 00:41
Reported-by: syzbot+e26628a755f78bacff16@syzkaller.appspotmail.com
Fix commit: 2646cd085850 sctp: use a consistent view of the send parameters
First crash: 262d, last: 254d
similar bugs (1):
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
freebsd panic: Warning: Last msg marked incomplete, yet nothing left? C 34 376d 629d 0/2 closed as invalid on 2022/04/17 12:46

Sample crash report:
login: panic: Warning: Last msg marked incomplete, yet nothing left?
cpuid = 0
time = 1652992909
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0xc7/frame 0xfffffe00541a0070
kdb_backtrace() at kdb_backtrace+0xd3/frame 0xfffffe00541a01d0
vpanic() at vpanic+0x2b8/frame 0xfffffe00541a02b0
panic() at panic+0xb5/frame 0xfffffe00541a0370
sctp_lower_sosend() at sctp_lower_sosend+0x58e3/frame 0xfffffe00541a0740
sctp_sosend() at sctp_sosend+0x72c/frame 0xfffffe00541a09e0
sosend() at sosend+0xfc/frame 0xfffffe00541a0a50
kern_sendit() at kern_sendit+0x58a/frame 0xfffffe00541a0bb0
sendit() at sendit+0x2bf/frame 0xfffffe00541a0c10
sys_sendto() at sys_sendto+0x182/frame 0xfffffe00541a0d30
amd64_syscall() at amd64_syscall+0x410/frame 0xfffffe00541a0f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00541a0f30
--- syscall (0, FreeBSD ELF64, nosys), rip = 0x2b441a, rsp = 0x82b2eff78, rbp = 0x82b2effb0 ---
KDB: enter: panic
[ thread pid 4353 tid 107251 ]
Stopped at      kdb_enter+0x6b: movq    $0,0x275a80a(%rip)
db> 
db> set $lines = 0
db> set $maxwidth = 0
db> show registers
cs                        0x20
ds                        0x3b
es                        0x3b
fs                        0x13
gs                        0x1b
ss                        0x28
rax                       0x12
rcx         0xfffffe00033eee30
rdx         0xdffff7c000000000
rbx                          0
rsp         0xfffffe00541a01b0
rbp         0xfffffe00541a01d0
rsi                        0x1
rdi                          0
r8                         0x3
r9                  0xffffffff
r10                          0
r11         0xfffffe009f44f510
r12         0xfffffe009f44f000
r13         0xfffffe00541a0201
r14         0xffffffff82b4fde0  .str.26
r15         0xffffffff82b4fde0  .str.26
rip         0xffffffff8171988b  kdb_enter+0x6b
rflags                    0x46
kdb_enter+0x6b: movq    $0,0x275a80a(%rip)
db> show proc
Process 4353 (syz-executor6332198) at 0xfffffe009efed000:
 state: NORMAL
 uid: 0  gids: 0, 0, 5
 parent: pid 779 at 0xfffffe0056f9ea90
 ABI: FreeBSD ELF64
 flag: 0x10000080  flag2: 0
 arguments: ./syz-executor633219804
 reaper: 0xfffffe0053de1000 reapsubtree: 1
 sigparent: 20
 vmspace: 0xfffffe0053dee000
   (map 0xfffffe0053dee000)
   (map.pmap 0xfffffe0053dee0c0)
   (pmap 0xfffffe0053dee128)
 threads: 3
100111                   RunQ                                syz-executor6332198
107251                   Run     CPU 0                       syz-executor6332198
107252                   S       uwait   0xfffffe0057889080  syz-executor6332198
db> ps
  pid  ppid  pgrp   uid  state   wmesg   wchan               cmd
 4353   779   777     0  R       (threaded)                  syz-executor6332198
100111                   RunQ                                syz-executor6332198
107251                   Run     CPU 0                       syz-executor6332198
107252                   S       uwait   0xfffffe0057889080  syz-executor6332198
  779   777   777     0  S       nanslp  0xffffffff83e41701  syz-executor6332198
  777   775   777     0  Ss      pause   0xfffffe009efed5f8  csh
  775   688   775     0  Ss      select  0xfffffe0056f6a4c0  sshd
  754     1   754     0  Ss+     ttyin   0xfffffe00574764b0  getty
  753     1   753     0  Ss+     ttyin   0xfffffe00574728b0  getty
  752     1   752     0  Ss+     ttyin   0xfffffe0057472cb0  getty
  751     1   751     0  Ss+     ttyin   0xfffffe00579c60b0  getty
  750     1   750     0  Ss+     ttyin   0xfffffe00579c64b0  getty
  749     1   749     0  Ss+     ttyin   0xfffffe00579c68b0  getty
  748     1   748     0  Ss+     ttyin   0xfffffe00579c6cb0  getty
  747     1   747     0  Ss+     ttyin   0xfffffe00579c70b0  getty
  746     1   746     0  Ss+     ttyin   0xfffffe00579c74b0  getty
  744     1    18     0  S+      piperd  0xfffffe0058be2000  logger
  743   742    18     0  S+      nanslp  0xffffffff83e41700  sleep
  742     1    18     0  S+      wait    0xfffffe0053de1a90  sh
  692     1   692     0  Ss      nanslp  0xffffffff83e41700  cron
  688     1   688     0  Ss      select  0xfffffe0056f6ab40  sshd
  501     1   501     0  Ss      select  0xfffffe0056f6b4c0  syslogd
  430     1   430     0  Ss      select  0xfffffe0056f6b040  devd
  429     1   429    65  Ss      select  0xfffffe0056f6ae40  dhclient
  344     1   344     0  Ss      select  0xfffffe0056f6af40  dhclient
  341     1   341     0  Ss      select  0xfffffe0056f6b1c0  dhclient
   17     0     0     0  DL      syncer  0xffffffff83f66f60  [syncer]
   16     0     0     0  DL      vlruwt  0xfffffe0056fa0a90  [vnlru]
   15     0     0     0  DL      (threaded)                  [bufdaemon]
100079                   D       psleep  0xffffffff83f65560  [bufdaemon]
100082                   D       -       0xffffffff83211f80  [bufspacedaemon-0]
100094                   D       sdflush 0xfffffe00574724e8  [/ worker]
    9     0     0     0  DL      psleep  0xffffffff83f99000  [vmdaemon]
    8     0     0     0  DL      (threaded)                  [pagedaemon]
100077                   D       psleep  0xffffffff83f8ceb8  [dom0]
100083                   D       launds  0xffffffff83f8cec4  [laundry: dom0]
100084                   D       umarcl  0xffffffff81e46fe0  [uma]
    7     0     0     0  DL      -       0xffffffff83bfdd28  [rand_harvestq]
    6     0     0     0  DL      pftm    0xffffffff845b2550  [pf purge]
    5     0     0     0  DL      waiting 0xffffffff848ed4a0  [sctp_iterator]
    4     0     0     0  DL      (threaded)                  [cam]
100044                   D       -       0xffffffff83aa0cc0  [doneq0]
100045                   D       -       0xffffffff83aa0c40  [async]
100076                   D       -       0xffffffff83aa0ac0  [scanner]
   14     0     0     0  DL      seqstat 0xfffffe0053fd7488  [sequencer 00]
    3     0     0     0  DL      (threaded)                  [crypto]
100040                   D       crypto_ 0xffffffff83f886e0  [crypto]
100041                   D       crypto_ 0xfffffe0053ecd830  [crypto returns 0]
100042                   D       crypto_ 0xfffffe0053ecd880  [crypto returns 1]
   13     0     0     0  DL      (threaded)                  [geom]
100035                   D       -       0xffffffff83e16d00  [g_event]
100036                   D       -       0xffffffff83e16d20  [g_up]
100037                   D       -       0xffffffff83e16d40  [g_down]
    2     0     0     0  WL      (threaded)                  [clock]
100029                   I                                   [clock (0)]
100030                   I                                   [clock (1)]
   12     0     0     0  WL      (threaded)                  [intr]
100015                   I                                   [swi5: fast taskq]
100018                   I                                   [swi6: task queue]
100019                   I                                   [swi6: Giant taskq]
100031                   I                                   [swi1: netisr 0]
100032                   I                                   [swi1: hpts]
100033                   I                                   [swi1: hpts]
100046                   I                                   [irq24: virtio_pci0]
100047                   I                                   [irq25: virtio_pci0]
100048                   I                                   [irq26: virtio_pci0]
100049                   I                                   [irq27: virtio_pci0]
100050                   I                                   [irq28: virtio_pci1]
100051                   I                                   [irq29: virtio_pci1]
100052                   I                                   [irq30: virtio_pci1]
100053                   I                                   [irq31: virtio_pci1]
100054                   I                                   [irq32: virtio_pci1]
100059                   I                                   [irq33: virtio_pci2]
100060                   I                                   [irq34: virtio_pci2]
100061                   I                                   [irq35: virtio_pci2]
100063                   I                                   [irq1: atkbd0]
100064                   I                                   [irq12: psm0]
100065                   I                                   [swi0: uart uart++]
100069                   I                                   [swi1: pf send]
   11     0     0     0  RL      (threaded)                  [idle]
100003                   CanRun                              [idle: cpu0]
100004                   Run     CPU 1                       [idle: cpu1]
    1     0     1     0  SLs     wait    0xfffffe0053de1000  [init]
   10     0     0     0  DL      audit_w 0xffffffff83f891c0  [audit]
    0     0     0     0  DLs     (threaded)                  [kernel]
100000                   D       swapin  0xffffffff83e17700  [swapper]
100005                   D       -       0xfffffe0053e84100  [if_config_tqg_0]
100006                   D       -       0xfffffe0053e84000  [softirq_0]
100007                   D       -       0xfffffe0053e83e00  [softirq_1]
100008                   D       -       0xfffffe0053e83d00  [if_io_tqg_0]
100009                   D       -       0xfffffe0053e83c00  [if_io_tqg_1]
100010                   D       -       0xfffffe000795a100  [inm_free taskq]
100011                   D       -       0xfffffe000795a000  [linuxkpi_irq_wq]
100012                   D       -       0xfffffe0007959e00  [in6m_free taskq]
100013                   D       -       0xfffffe0007959d00  [deferred_unmount ta]
100014                   D       -       0xfffffe0007959c00  [thread taskq]
100016                   D       -       0xfffffe0007959a00  [kqueue_ctx taskq]
100017                   D       -       0xfffffe0007959900  [pci_hp taskq]
100020                   D       -       0xfffffe0007959600  [aiod_kick taskq]
100021                   D       -       0xfffffe0007959500  [linuxkpi_short_wq_0]
100022                   D       -       0xfffffe0007959500  [linuxkpi_short_wq_1]
100023                   D       -       0xfffffe0007959500  [linuxkpi_short_wq_2]
100024                   D       -       0xfffffe0007959500  [linuxkpi_short_wq_3]
100025                   D       -       0xfffffe0007959400  [linuxkpi_long_wq_0]
100026                   D       -       0xfffffe0007959400  [linuxkpi_long_wq_1]
100027                   D       -       0xfffffe0007959400  [linuxkpi_long_wq_2]
100028                   D       -       0xfffffe0007959400  [linuxkpi_long_wq_3]
100034                   D       -       0xfffffe0007959300  [firmware taskq]
100038                   D       -       0xfffffe0007959200  [crypto_0]
100039                   D       -       0xfffffe0007959200  [crypto_1]
100055                   D       -       0xfffffe0007959000  [vtnet0 rxq 0]
100056                   D       -       0xfffffe0007958e00  [vtnet0 txq 0]
100057                   D       -       0xfffffe0007958d00  [vtnet0 rxq 1]
100058                   D       -       0xfffffe0007958c00  [vtnet0 txq 1]
100062                   D       vtbslp  0xfffffe0056f6c000  [virtio_balloon]
100066                   D       -       0xffffffff82b55c60  [deadlkres]
100070                   D       -       0xfffffe000795a200  [mca taskq]
100071                   D       -       0xfffffe00585ef600  [acpi_task_0]
100072                   D       -       0xfffffe00585ef600  [acpi_task_1]
100073                   D       -       0xfffffe00585ef600  [acpi_task_2]
100075                   D       -       0xfffffe0007959100  [CAM taskq]
db> show all locks
Process 4353 (syz-executor6332198) thread 0xfffffe009f44f000 (107251)
exclusive sleep mutex sctp-tcb (tcb) r = 0 (0xfffffe00a104ca50) locked @ /syzkaller/managers/main/kernel/sys/netinet/sctp_output.c:12556
db> show malloc
              Type        InUse        MemUse     Requests
           pf_hash            5        11524K            5
               pcb         7167         8578K         7186
          tcp_hpts            7         4801K            7
            devbuf         4217         4323K         4242
         sctp_stro         3574         3574K         3574
         sctp_atcl         7148         2681K         7148
         sysctloid        35322         2081K        35393
             vtbuf           24         1968K           46
              kobj          328         1312K          490
            newblk          564         1165K          591
          vfscache            3         1025K            3
          inodedep           26          522K           71
         ufs_quota            1          512K            1
          vfs_hash            1          512K            1
           callout            2          512K            2
              intr            4          472K            4
         sctp_atky        10722          447K        10722
              vmem            3          274K            5
           subproc           99          186K         4412
            acpica         1674          184K        57552
         vnet_data            1          168K            1
           tidhash            3          141K            3
            linker          358          134K          386
           pagedep            8          130K           18
        tfo_ccache            1          128K            1
         sctp_athm         7148          112K         7148
          sctp_map         7148          112K         7148
               sem            4          106K            4
            DEVFS1          105          105K          114
               bus          995           81K         5208
          mtx_pool            2           72K            2
          syncache            1           68K            1
            module          514           65K          514
          acpitask            1           64K            1
       ddb_capture            1           64K            1
              umtx          286           36K          286
              temp           17           33K         1606
         hostcache            1           32K            1
               shm            1           32K            1
           kdtrace          155           32K        11607
            DEVFS3          124           31K          134
               msg            4           30K            4
        gtaskqueue           18           26K           18
            kbdmux            6           22K            6
        DEVFS_RULE           56           20K           56
               BPF           10           18K           10
         ufs_mount            4           17K            5
              proc            3           17K            3
               tty           16           16K           16
           ithread           97           16K           97
            bus-sc           34           15K         1681
            KTRACE          100           13K          100
              kenv           95           12K           95
      eventhandler          134           12K          134
            ifaddr           30           12K           32
              rman           88           11K          431
              GEOM           61           11K          490
          routetbl           50           11K          176
         CAM queue            5           11K         1528
              UART           12            9K           12
           devstat            4            9K            4
              ksem            1            8K            1
               rpc            2            8K            2
         bmsafemap            1            8K           40
             shmfd            1            8K            1
       pfs_vncache            1            8K            1
         pfs_nodes           20            8K           20
     audit_evclass          237            8K          296
              cred           29            8K          234
         taskqueue           63            7K           63
            sglist            5            7K            5
           CAM DEV            3            6K          510
       ufs_dirhash           24            5K           24
               UMA          272            5K          272
            plimit           17            5K          322
                vt           11            5K           11
             ifnet            3            5K            3
           memdesc            1            4K            1
               MCA           32            4K           32
          filedesc            1            4K            1
             evdev            4            4K            4
           acpisem           28            4K           28
             hhook           15            4K           17
       ether_multi           40            4K           50
           lltable           11            4K           11
          pf_ifnet            5            3K            6
         in6_multi           25            3K           25
          terminal           11            3K           11
            kqueue           41            3K         4356
           pwddesc           41            3K         4354
           session           20            3K           31
           uidinfo            3            3K            8
         proc-args           63            3K         5294
        local_apic            1            2K            1
           io_apic            1            2K            1
       fpukern_ctx            2            2K            2
         ipsec-saq            2            2K            2
             selfd           27            2K        55483
          freefile           13            2K           22
            Unitno           27            2K           39
           CAM XPT           22            2K          543
             lockf           15            2K           22
               msi           12            2K           12
       ipsecpolicy            2            2K            2
           acpidev           20            2K           20
             clone            9            2K            9
           softdep            1            1K            1
            dirrem            4            1K           28
            sahead            1            1K            1
          secasvar            1            1K            1
       vnodemarker            2            1K           10
      NFSD session            1            1K            1
            diradd            7            1K           36
        CAM periph            4            1K          271
            select            7            1K           29
             ipsec            3            1K            3
          indirdep            3            1K            3
             nhops            6            1K            6
         toponodes            6            1K            6
            isadev            6            1K            6
             mount           16            1K           89
          pci_link           10            1K           10
          sctp_ifa            5            1K            6
            crypto            4            1K            4
            ip6ndp            4            1K            5
 encap_export_host           12            1K           12
         newdirblk            4            1K            8
             mkdir            4            1K           16
          in_multi            2            1K            4
              pfil            4            1K            4
              cdev            2            1K            2
    chacha20random            1            1K            1
               osd            7            1K           18
       inpcbpolicy           10            1K          139
          sctp_ifn            2            1K            6
      NFSD lckfile            1            1K            1
     NFSD V4client            1            1K            1
            DEVFSP            4            1K            9
             DEVFS            9            1K           10
          freework            1            1K           26
               mld            2            1K            2
              igmp            2            1K            2
            vnodes            1            1K            1
           CAM SIM            2            1K            2
            feeder            7            1K            7
           tcpfunc            3            1K            3
            CC Mem            3            1K            7
        loginclass            3            1K            7
            prison            6            1K            6
       lkpikmalloc            5            1K            6
        aesni_data            2            1K            2
         cryptodev            2            1K           49
          nexusdev            8            1K            8
            apmdev            1            1K            1
          atkbddev            2            1K            2
     CAM dev queue            2            1K            2
 CAM I/O Scheduler            1            1K            1
          CAM path            4            1K         1034
          procdesc            1            1K            6
          pmchooks            1            1K            1
            soname            4            1K         7045
          filecaps            4            1K           66
               tun            3            1K            3
          sctp_vrf            1            1K            1
              vnet            1            1K            1
           entropy            2            1K           35
               pmc            1            1K            1
          acpiintr            1            1K            1
              cpus            2            1K            2
    vnet_data_free            1            1K            1
           Per-cpu            1            1K            1
          p1003.1b            1            1K            1
            tcp_do            0            0K            0
           tcp_fsb            0            0K            0
            ipcomp            0            0K            0
               esp            0            0K            0
                ah            0            0K            0
        sctp_mcore            0            0K            0
        sctp_socko            0            0K         7148
         sctp_iter            0            0K            4
         sctp_mvrf            0            0K            0
         sctp_timw            0            0K            0
         sctp_cpal            0            0K            0
         sctp_cmsg            0            0K            0
         sctp_stre            0            0K            0
         sctp_athi            0            0K            0
         sctp_a_it            0            0K            4
         sctp_aadr            0            0K            0
         sctp_stri            0            0K            0
           filemon            0            0K            0
          pf_table            0            0K            0
           pf_rule            0            0K            0
           pf_altq            0            0K            0
           pf_osfp            0            0K            0
           pf_temp            0            0K            0
            mqdata            0            0K            0
   NFSCL layrecall            0            0K            0
     NFSCL session            0            0K            0
        madt_table            0            0K            2
          smartpqi            0            0K            0
     NFSCL sockreq            0            0K            0
     NFSCL devinfo            0            0K            0
     NFSCL flayout            0            0K            0
               ixl            0            0K            0
      NFSCL layout            0            0K            0
     NFSD rollback            0            0K            0
      NFSCL diroff            0            0K            0
       NEWdirectio            0            0K            0
        NEWNFSnode            0            0K            0
         NFSCL lck            0            0K            0
      NFSCL lckown            0            0K            0
        ice-resmgr            0            0K            0
         ice-osdep            0            0K            0
               ice            0            0K            0
              iavf            0            0K            0
             axgbe            0            0K            0
      NFSCL client            0            0K            0
       NFSCL deleg            0            0K            0
        NFSCL open            0            0K            0
       NFSCL owner            0            0K            0
            NFS fh            0            0K            0
           NFS req            0            0K            0
     NFSD usrgroup            0            0K            0
       NFSD string            0            0K            0
       NFSD V4lock            0            0K            0
          xen_intr            0            0K            0
      NFSD V4state            0            0K            0
           xen_hvm            0            0K            0
         legacydrv            0            0K            0
            bounce            0            0K            0
            busdma            0            0K            0
            qpidrv            0            0K            0
     NFSD srvcache            0            0K            0
       msdosfs_fat            0            0K            0
      dmar_idpgtbl            0            0K            0
          dmar_dom            0            0K            0
          dmar_ctx            0            0K            0
     msdosfs_mount            0            0K            0
      msdosfs_node            0            0K            0
              isci            0            0K            0
      iommu_dmamap            0            0K            0
     hyperv_socket            0            0K            0
           bxe_ilt            0            0K            0
            xenbus            0            0K            0
            DEVFS4            0            0K            0
     vm_fictitious            0            0K            0
            DEVFS2            0            0K            0
            gntdev            0            0K            0
       privcmd_dev            0            0K            0
        evtchn_dev            0            0K            0
          xenstore            0            0K            0
         scsi_pass            0            0K            0
         ciss_data            0            0K            0
               xnb            0            0K            0
          xen_acpi            0            0K            0
              xbbd            0            0K            0
               xbd            0            0K            0
           UMAHash            0            0K            0
           Balloon            0            0K            0
          sysmouse            0            0K            0
         vm_pgdata            0            0K            0
           jblocks            0            0K            0
          savedino            0            0K           18
          sentinel            0            0K            0
            jfsync            0            0K            0
            jtrunc            0            0K            0
             sbdep            0            0K            3
           jsegdep            0            0K            0
              jseg            0            0K            0
         jfreefrag            0            0K            0
          jfreeblk            0            0K            0
           jnewblk            0            0K            0
            jmvref            0            0K            0
           jremref            0            0K            0
           jaddref            0            0K            0
           freedep            0            0K            0
          freeblks            0            0K           25
          freefrag            0            0K            1
        allocindir            0            0K            0
       allocdirect            0            0K            0
          ufs_trim            0            0K            0
           mactemp            0            0K            0
     audit_trigger            0            0K            0
 audit_pipe_presel            0            0K            0
     audit_pipeent            0            0K            0
        audit_pipe            0            0K            0
      audit_evname            0            0K            0
         audit_bsm            0            0K            0
      audit_gidset            0            0K            0
        audit_text            0            0K            0
        audit_path            0            0K            0
        audit_data            0            0K            0
        audit_cred            0            0K            0
            vtfont            0            0K            0
         BACKLIGHT            0            0K            0
           ath_hal            0            0K            0
            athdev            0            0K            0
           ata_pci            0            0K            0
           ata_dma            0            0K            0
       ata_generic            0            0K            0
            pvscsi            0            0K            0
           scsi_da            0            0K           69
            ata_da            0            0K            0
           scsi_ch            0            0K            0
           scsi_cd            0            0K            0
          ktls_ocf            0            0K            0
       AHCI driver            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
      MLX5E_TLS_RX            0            0K            0
        MLX5EEPROM            0            0K            0
         MLX5E_TLS            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
            MLX5EN            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
          MLX5DUMP            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
          seq_file            0            0K            0
           lkpiskb            0            0K            0
             radix            0            0K            0
               idr            0            0K            0
          lkpindev            0            0K            0
            lkpifw            0            0K            0
         lkpi80211            0            0K            0
               NLM            0            0K            0
    ipsec-spdcache            0            0K            0
         ipsec-reg            0            0K            0
        ipsec-misc            0            0K            0
      ipsecrequest            0            0K            0
            ip6opt            0            0K            3
       ip6_msource            0            0K            0
      ip6_moptions            0            0K            0
       in6_mfilter            0            0K            0
             frag6            0            0K            0
            tcplog            0            0K            0
        tcp_hwpace            0            0K            0
            USBdev            0            0K            0
               USB            0            0K            0
               LRO            0            0K            0
        ip_msource            0            0K            0
       ip_moptions            0            0K            0
        in_mfilter            0            0K            0
              ipid            0            0K            0
         80211scan            0            0K            0
      80211ratectl            0            0K            0
        80211power            0            0K            0
       80211nodeie            0            0K            0
         80211node            0            0K            0
      80211mesh_gt            0            0K            0
      80211mesh_rt            0            0K            0
         80211perr            0            0K            0
         80211prep            0            0K            0
         80211preq            0            0K            0
          80211dfs            0            0K            0
       80211crypto            0            0K            0
          80211vap            0            0K            0
             iflib            0            0K            0
              vlan            0            0K            0
               gif            0            0K            0
           ifdescr            0            0K            0
              zlib            0            0K            0
           fadvise            0            0K            0
           VN POLL            0            0K            0
               agp            0            0K            0
            statfs            0            0K          196
     namei_tracker            0            0K            0
       export_host            0            0K            0
        cl_savebuf            0            0K            4
           nvme_da            0            0K            0
           acpipwr            0            0K            0
         acpi_perf            0            0K            0
            twsbuf            0            0K            0
      twe_commands            0            0K            0
       tcp_log_dev            0            0K            0
      midi buffers            0            0K            0
             mixer            0            0K            0
              ac97            0            0K            0
             hdacc            0            0K            0
              hdac            0            0K            0
              hdaa            0            0K            0
         acpicmbat            0            0K            0
       SIIS driver            0            0K            0
           CAM CCB            0            0K          523
            biobuf            0            0K            0
              aios            0            0K            0
               lio            0            0K            0
               acl            0            0K            0
          mbuf_tag            0            0K           27
              ktls            0            0K            0
               PUC            0            0K            0
          ppbusdev            0            0K            0
agtiapi_MemAlloc malloc            0            0K            0
    osti_cacheable            0            0K            0
          tempbuff            0            0K            0
          tempbuff            0            0K            0
ag_tgt_map_t malloc            0            0K            0
ag_slr_map_t malloc            0            0K            0
lDevFlags * malloc            0            0K            0
tiDeviceHandle_t * malloc            0            0K            0
ag_portal_data_t malloc            0            0K            0
ag_device_t malloc            0            0K            0
     STLock malloc            0            0K            0
          CCB List            0            0K            0
            sr_iov            0            0K            0
               OCS            0            0K            0
               OCS            0            0K            0
              nvme            0            0K            0
               nvd            0            0K            0
            netmap            0            0K            0
            mwldev            0            0K            0
        MVS driver            0            0K            0
     CAM ccb queue            0            0K            0
              accf            0            0K            0
               pts            0            0K            0
               iov            0            0K        24222
          ioctlops            0            0K           86
           eventfd            0            0K            0
           Witness            0            0K            0
             stack            0            0K            0
          mrsasbuf            0            0K            0
          mpt_user            0            0K            0
          mps_user            0            0K            0
            MPSSAS            0            0K            0
               mps            0            0K            0
              sbuf            0            0K          288
          mpr_user            0            0K            0
          firmware            0            0K            0
        compressor            0            0K            0
            MPRSAS            0            0K            0
              SWAP            0            0K            0
               mpr            0            0K            0
            mfibuf            0            0K            0
         sysctltmp            0            0K          658
            sysctl            0            0K            3
        md_sectors            0            0K            0
              ekcd            0            0K            0
            dumper            0            0K            0
          sendfile            0            0K            0
              rctl            0            0K            0
           md_disk            0            0K            0
           malodev            0            0K            0
               LED            0            0K            0
          ix_sriov            0            0K            0
             cache            0            0K            0
        aacraidcam            0            0K            0
          kcovinfo            0            0K            0
      prison_racct            0            0K            0
       Fail Points            0            0K            0
             sigio            0            0K            1
filedesc_to_leader            0            0K            0
               pwd            0            0K            0
       tty console            0            0K            0
                ix            0            0K            0
            ipsbuf            0            0K            0
       aacraid_buf            0            0K            0
            aaccam            0            0K            0
         boottrace            0            0K            0
            aacbuf            0            0K            0
              zstd            0            0K            0
            XZ_DEC            0            0K            0
            nvlist            0            0K            0
          SCSI ENC            0            0K            0
           SCSI sa            0            0K            0
        isofs_node            0            0K            0
       isofs_mount            0            0K            0
     tr_raid5_data            0            0K            0
    tr_raid1e_data            0            0K            0
     tr_raid1_data            0            0K            0
     tr_raid0_data            0            0K            0
    tr_concat_data            0            0K            0
       md_sii_data            0            0K            0
   md_promise_data            0            0K            0
    md_nvidia_data            0            0K            0
   md_jmicron_data            0            0K            0
     md_intel_data            0            0K            0
       md_ddf_data            0            0K            0
         raid_data            0            0K           72
     geom_flashmap            0            0K            0
         tmpfs dir            0            0K            0
        tmpfs name            0            0K            0
       tmpfs mount            0            0K            0
           NFS FHA            0            0K            0
         newnfsmnt            0            0K            0
  newnfsclient_req            0            0K            0
db> show uma
              Zone   Size    Used    Free    Requests  Sleeps  Bucket  Total Mem    XFree
   mbuf_jumbo_page   4096    8320    1078       15102       0     254   38494208        0
         sctp_asoc   2256    3574     236        3574       0     254    8595360        0
       malloc-2048   2048    3578       6        3769       0       8    7340032        0
           sctp_ep   1208    3574     236        3574       0     254    4602480        0
              mbuf    256   15724     283       31753       0     254    4097792        0
       malloc-1024   1024    3581      19        3581       0      16    3686400        0
        sctp_raddr    736    3574     243        3574       0     254    2809312        0
        malloc-384    384    7150      50        7150       0      30    2764800        0
              pbuf   2624       0     989           0       0       2    2595136        0
          BUF TRIE    144     171   11617         454       0      62    1697472        0
        malloc-384    384    4169      31        4509       0      30    1612800        0
        malloc-128    128   11629      89       11681       0     126    1499904        0
       UMA Slabs 0    112   13242       0       13242       0     126    1483104        0
       malloc-4096   4096     328       2         493       0       2    1351680        0
         vmem btag     56   22715      76       22715       0     254    1276296        0
      mbuf_cluster   2048     508       0         508       0     254    1040384        0
        malloc-256    256    3594      66        3600       0      62     936960        0
sctp_stream_msg_out    112    7069      59        7069       0     254     798336        0
            socket    960      19     745        4909       0     254     733440        0
         FFS inode   1160     486      32         508       0       8     600880        0
        RADIX NODE    144    3846     209       66914       0      62     583920        0
             tcpcb   1104       3     508           7       0     254     564144        0
         VM OBJECT    264    1426     104       92325       0      30     403920        0
            lkpimm    168       1    2327           1       0      62     391104        0
          lkpicurr    168       2    2326           2       0      62     391104        0
        256 Bucket   2048     145      17        1474       0       8     331776        0
      malloc-65536  65536       4       1         140       0       1     327680        0
         malloc-64     64    4114     485        9008       0     254     294336        0
         malloc-64     64    4094     253        5188       0     254     278208        0
            THREAD   1808     113      30        7252       0       8     258544        0
             VNODE    448     516      60         540       0      30     258048        0
         malloc-32     32    7413     273       10240       0     254     245952        0
         malloc-16     16   14655     345       14729       0     254     240000        0
            DEVCTL   1024       0     220         126       0       0     225280        0
        malloc-256    256     801      69        1191       0      62     222720        0
       malloc-4096   4096      47       3        4360       0       2     204800        0
         MAP ENTRY     96    1585     431      177206       0     126     193536        0
         malloc-32     32    5361     561        5876       0     254     189504        0
         UMA Zones    768     244       0         244       0      16     187392        0
        malloc-128    128    1203     192       26870       0     126     178560        0
       malloc-1024   1024     117      27         325       0      16     147456        0
       FFS2 dinode    256     486      84         508       0      62     145920        0
     FPU_save_area    832     115      47        7267       0      16     134784        0
      malloc-65536  65536       2       0           2       0       1     131072        0
      malloc-65536  65536       0       2          54       0       1     131072        0
             unpcb    256       7     503        1179       0     254     130560        0
       mbuf_packet    256       0     508          77       0     254     130048        0
       S VFS Cache    104     966     204        1005       0     126     121680        0
         malloc-16     16    7182     318       33400       0     254     120000        0
         malloc-16     16    7159     341        7207       0     254     120000        0
          ksiginfo    112      34    1010          50       0     126     116928        0
       malloc-2048   2048       5      51        1061       0       8     114688        0
        128 Bucket   1024      49      50         709       0      16     101376        0
        malloc-128    128     525     250        3836       0     126      99200        0
          UMA Kegs    384     230       3         230       0      30      89472        0
           VMSPACE   2552      24       9        4338       0       4      84216        0
      malloc-16384  16384       4       1         164       0       1      81920        0
        malloc-256    256     160     155        7312       0      62      80640        0
              PROC   1352      40      17        4353       0       8      77064        0
         filedesc0   1072      41      29        4354       0       8      75040        0
             g_bio    408       0     180        4644       0      30      73440        0
         64 Bucket    512      67      69        3408       0      30      69632        0
        malloc-128    128     343     184         493       0     126      67456        0
        malloc-128    128     310     217        1084       0     126      67456        0
           DIRHASH   1024      35      29          35       0      16      65536        0
      malloc-65536  65536       1       0           1       0       1      65536        0
      malloc-65536  65536       1       0           1       0       1      65536        0
      malloc-65536  65536       1       0           1       0       1      65536        0
      malloc-32768  32768       0       2         120       0       1      65536        0
       malloc-8192   8192       6       2         135       0       1      65536        0
       malloc-4096   4096      13       3          27       0       2      65536        0
        malloc-128    128     151     252         638       0     126      51584        0
        malloc-128    128     137     266         189       0     126      51584        0
        malloc-256    256      60     135         798       0      62      49920        0
         32 Bucket    256      60     135        3219       0      62      49920        0
             NAMEI   1024       0      48       12233       0      16      49152        0
       malloc-8192   8192       6       0           6       0       1      49152        0
       malloc-2048   2048       9      15          10       0       8      49152        0
       malloc-1024   1024      27      21          38       0      16      49152        0
       malloc-1024   1024       6      42         530       0      16      49152        0
          syncache    168       0     264           5       0     254      44352        0
            clpbuf   2624       0      16          20       0      16      41984        0
       malloc-8192   8192       4       1           6       0       1      40960        0
       malloc-8192   8192       5       0           5       0       1      40960        0
       Mountpoints   2752       2      12           2       0       4      38528        0
         udp_inpcb    424       6      84         128       0      30      38160        0
            pcpu-8      8    4223     385        4251       0     254      36864        0
         malloc-64     64       0     567       13178       0     254      36288        0
         malloc-64     64     135     432         154       0     254      36288        0
         malloc-64     64     504      63         740       0     254      36288        0
         malloc-64     64      91     476       59916       0     254      36288        0
         malloc-64     64      62     505        4627       0     254      36288        0
         malloc-64     64      13     554          31       0     254      36288        0
        malloc-128    128      35     244         111       0     126      35712        0
     routing nhops    256      10     125          17       0      62      34560        0
           ttyoutq    256      72      63         160       0      62      34560        0
        malloc-384    384      38      52         112       0      30      34560        0
        malloc-384    384      58      32          59       0      30      34560        0
        malloc-256    256       2     133         287       0      62      34560        0
        malloc-256    256      18     117          24       0      62      34560        0
        malloc-256    256      50      85         655       0      62      34560        0
        malloc-256    256      10     125         565       0      62      34560        0
         TURNSTILE    136     144     108         144       0      62      34272        0
        SLEEPQUEUE     88     144     240         144       0     126      33792        0
      malloc-32768  32768       1       0           1       0       1      32768        0
      malloc-32768  32768       1       0           1       0       1      32768        0
      malloc-32768  32768       1       0           1       0       1      32768        0
      malloc-16384  16384       2       0          17       0       1      32768        0
       malloc-4096   4096       4       4         630       0       2      32768        0
       malloc-4096   4096       6       2           6       0       2      32768        0
       malloc-2048   2048       3      13          65       0       8      32768        0
       malloc-2048   2048       4      12          13       0       8      32768        0
       malloc-1024   1024       6      26         874       0      16      32768        0
        malloc-512    512      11      53          19       0      30      32768        0
        malloc-512    512       3      61         170       0      30      32768        0
        malloc-512    512       2      62          12       0      30      32768        0
           pcpu-64     64     493      19         493       0     254      32768        0
    ertt_txseginfo     40       0     808        3780       0     254      32320        0
            ttyinq    160     135      65         300       0      62      32000        0
             Files     80      72     328       10155       0     126      32000        0
          8 Bucket     80      43     357        1570       0     126      32000        0
            cpuset    104       7     272           7       0     126      29016        0
         16 Bucket    144      51     145        1024       0      62      28224        0
          4 Bucket     48       6     582         467       0     254      28224        0
         tcp_inpcb    424       3      60           7       0      30      26712        0
             ripcb    424       1      62           4       0      30      26712        0
            da_ccb    544       0      49        1274       0      16      26656        0
              pipe    744       7      28         284       0      16      26040        0
           rtentry    176      13     125          17       0      62      24288        0
              PGRP     88      20     256          31       0     126      24288        0
          rl_entry     40      26     580          26       0     254      24240        0
        malloc-384    384      27      33          29       0      30      23040        0
        malloc-384    384      30      30          30       0      30      23040        0
         hostcache     64       1     314           1       0     254      20160        0
             udpcb     32       6     624         128       0     254      20160        0
   udp_inpcb ports     32       3     627          40       0     254      20160        0
              ertt     72       3     277           7       0     126      20160        0
               PWD     32      10     620         100       0     254      20160        0
         malloc-32     32       5     625        7161       0     254      20160        0
         malloc-32     32     116     514         297       0     254      20160        0
         malloc-32     32      33     597          35       0     254      20160        0
         malloc-32     32      56     574        3807       0     254      20160        0
         malloc-32     32      23     607        1072       0     254      20160        0
          2 Bucket     32      46     584         285       0     254      20160        0
 epoch_record pcpu    256       4      60           4       0      62      16384        0
      malloc-16384  16384       1       0           1       0       1      16384        0
      malloc-16384  16384       1       0           1       0       1      16384        0
       malloc-8192   8192       2       0           2       0       1      16384        0
       malloc-4096   4096       1       3         197       0       2      16384        0
       malloc-4096   4096       3       1           3       0       2      16384        0
       malloc-2048   2048       3       5           3       0       8      16384        0
       malloc-2048   2048       1       7           1       0       8      16384        0
       malloc-2048   2048       2       6           2       0       8      16384        0
       malloc-1024   1024       4      12           4       0      16      16384        0
       malloc-1024   1024       1      15           1       0      16      16384        0
        malloc-512    512       0      32           1       0      30      16384        0
        malloc-512    512       2      30           2       0      30      16384        0
           SMR CPU     32       7     504           7       0     254      16352        0
        sctp_laddr     48       0     336           4       0     254      16128        0
      vtnet_tx_hdr     24       0     668        5056       0     254      16032        0
         malloc-16     16     478     522        3438       0     254      16000        0
              kenv    258      15      45        1037       0      30      15480        0
            mqnode    416       3      33           3       0      30      14976        0
              vmem   1856       1       7           1       0       8      14848        0
        SMR SHARED     24       7     504           7       0     254      12264        0
   tcp_inpcb ports     32       1     377           1       0     254      12096        0
         malloc-32     32      81     297         892       0     254      12096        0
             KNOTE    160       0      75           8       0      62      12000        0
         malloc-16     16       9     741       14490       0     254      12000        0
         malloc-16     16      18     732         131       0     254      12000        0
         malloc-16     16      16     734          56       0     254      12000        0
         malloc-16     16      23     727        1251       0     254      12000        0
        malloc-384    384       0      30           1       0      30      11520        0
        malloc-384    384       1      29           1       0      30      11520        0
       malloc-8192   8192       1       0           1       0       1       8192        0
       malloc-8192   8192       1       0           1       0       1       8192        0
           pcpu-16     16      14     498          14       0     254       8192        0
       UMA Slabs 1    176       9      13           9       0      62       3872        0
        KMAP ENTRY     96      12      27          14       0       0       3744        0
            pcpu-4      4       1     511           1       0     254       2048        0
       FFS1 dinode    128       0       0           0       0     126          0        0
           ada_ccb    272       0       0           0       0      30          0        0
             swblk    136       0       0           0       0      62          0        0
          swpctrie    144       0       0           0       0      62          0        0
   cdg_qdiffsample     16       0       0           0       0     254          0        0
   pf state scrubs     40       0       0           0       0     254          0        0
   pf frag entries     40       0       0           0       0     254          0        0
          pf frags    248       0       0           0       0      62          0        0
  pf table entries    160       0       0           0       0     254          0        0
pf table entry counters     64       0       0           0       0     254          0        0
   pf source nodes    136       0       0           0       0     254          0        0
     pf state keys     88       0       0           0       0     126          0        0
         pf states    312       0       0           0       0     254          0        0
           pf tags    104       0       0           0       0     126          0        0
          pf mtags    184       0       0           0       0      62          0        0
      tcp_rack_pcb    896       0       0           0       0      16          0        0
      tcp_rack_map    120       0       0           0       0     126          0        0
       tcp_bbr_pcb    832       0       0           0       0      16          0        0
       tcp_bbr_map    128       0       0           0       0     126          0        0
tfo_ccache_entries     80       0       0           0       0     126          0        0
               tfo      4       0       0           0       0     254          0        0
          sackhole     32       0       0           0       0     254          0        0
             tcptw     72       0       0           0       0     254          0        0
               ipq     56       0       0           0       0     254          0        0
   sctp_asconf_ack     48       0       0           0       0     254          0 

Crashes (3):
Manager Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets Title
ci-freebsd-main 2022/05/19 20:43 freebsd-src f9ca52bab510 cb1ac2e7 console log report syz C panic: Warning: Last msg marked incomplete, yet nothing left?
ci-freebsd-main 2022/05/28 06:16 freebsd-src 076002f24d35 a46af346 console log report panic: Warning: Last msg marked incomplete, yet nothing left?
ci-freebsd-main 2022/05/19 20:20 freebsd-src f9ca52bab510 cb1ac2e7 console log report panic: Warning: Last msg marked incomplete, yet nothing left?
* Struck through repros no longer work on HEAD.