syzbot


panic: sbflush_internal: residual data (3)

Status: fixed on 2023/09/13 03:54
Reported-by: syzbot+d4e1d30d578891245f59@syzkaller.appspotmail.com
Fix commit: 81c5f0fac91d sctp: improve shutting down the read side of a socket
First crash: 895d, last: 528d
Similar bugs (2)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
freebsd panic: sbflush_internal: residual data (2) C 263 907d 1170d 2/2 fixed on 2022/05/30 04:02
freebsd panic: sbflush_internal: residual data C 374 1172d 1744d 0/2 closed as dup on 2021/09/07 21:31

Sample crash report:
panic: sbflush_internal: ccc 0 mb 0 mbcnt 1280
cpuid = 0
time = 1678688323
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0xc7/frame 0xfffffe0007cf5850
kdb_backtrace() at kdb_backtrace+0xd1/frame 0xfffffe0007cf59b0
vpanic() at vpanic+0x254/frame 0xfffffe0007cf5a90
panic() at panic+0xb5/frame 0xfffffe0007cf5b60
sbrelease_internal() at sbrelease_internal+0x20e/frame 0xfffffe0007cf5bc0
sbrelease() at sbrelease+0x70/frame 0xfffffe0007cf5bf0
sorflush() at sorflush+0xcc/frame 0xfffffe0007cf5c20
soshutdown() at soshutdown+0x289/frame 0xfffffe0007cf5c70
kern_shutdown() at kern_shutdown+0x139/frame 0xfffffe0007cf5d30
amd64_syscall() at amd64_syscall+0x410/frame 0xfffffe0007cf5f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0007cf5f30
--- syscall (0, FreeBSD ELF64, syscall), rip = 0x2b3f7a, rsp = 0x82106be08, rbp = 0x82106be50 ---
KDB: enter: panic
[ thread pid 3589 tid 100104 ]
Stopped at      kdb_enter+0x6b: movq    $0,0x25789ba(%rip)
db> 
db> set $lines = 0
db> set $maxwidth = 0
db> show registers
cs                        0x20
ds                        0x3b
es                        0x3b
fs                        0x13
gs                        0x1b
ss                        0x28
rax                       0x12
rcx         0xfffffe00033eee30
rdx         0xdffff7c000000000
rbx                          0
rsp         0xfffffe0007cf5990
rbp         0xfffffe0007cf59b0
rsi                        0x1
rdi                          0
r8                         0x3
r9                  0xffffffff
r10                          0
r11         0xfffffe005787b1a0
r12                          0
r13         0xfffffe005787ac80
r14         0xffffffff82af8e80  .str.26
r15         0xffffffff82af8e80  .str.26
rip         0xffffffff817180db  kdb_enter+0x6b
rflags                    0x46
kdb_enter+0x6b: movq    $0,0x25789ba(%rip)
db> show proc
Process 3589 (syz-executor3468367) at 0xfffffe00926bf008:
 state: NORMAL
 uid: 0  gids: 0, 0, 5
 parent: pid 782 at 0xfffffe005797eab0
 ABI: FreeBSD ELF64
 flag: 0x10000000  flag2: 0
 arguments: ./syz-executor3468367
 reaper: 0xfffffe00541da010 reapsubtree: 1
 sigparent: 20
 vmspace: 0xfffffe0092654a00
   (map 0xfffffe0092654a00)
   (map.pmap 0xfffffe0092654ac0)
   (pmap 0xfffffe0092654b30)
 threads: 1
100104                   Run     CPU 0                       syz-executor3468367
db> ps
  pid  ppid  pgrp   uid  state   wmesg   wchan               cmd
 3598   781   778     0  S       connec  0xfffffe008fc3985a  syz-executor3468367
 3597   785   778     0  S       connec  0xfffffe008fc3785a  syz-executor3468367
 3596   784   778     0  S       connec  0xfffffe008fc380da  syz-executor3468367
 3589   782   778     0  R       CPU 0                       syz-executor3468367
  785   780   778     0  S       nanslp  0xffffffff83c5e200  syz-executor3468367
  784   780   778     0  S       nanslp  0xffffffff83c5e200  syz-executor3468367
  782   780   778     0  S       nanslp  0xffffffff83c5e200  syz-executor3468367
  781   780   778     0  S       nanslp  0xffffffff83c5e200  syz-executor3468367
  780   778   778     0  S       nanslp  0xffffffff83c5e201  syz-executor3468367
  778   776   778     0  Ss      pause   0xfffffe0056f8d618  csh
  776   688   776     0  Ss      select  0xfffffe0007874240  sshd
  754     1   754     0  Ss+     ttyin   0xfffffe005746fcb0  getty
  753     1   753     0  Ss+     ttyin   0xfffffe00586d50b0  getty
  752     1   752     0  Ss+     ttyin   0xfffffe00586d58b0  getty
  751     1   751     0  Ss+     ttyin   0xfffffe005747a8b0  getty
  750     1   750     0  Ss+     ttyin   0xfffffe0007b4d0b0  getty
  749     1   749     0  Ss+     ttyin   0xfffffe0007b4d8b0  getty
  748     1   748     0  Ss+     ttyin   0xfffffe0007b4e0b0  getty
  747     1   747     0  Ss+     ttyin   0xfffffe0007b4e8b0  getty
  746     1   746     0  Ss+     ttyin   0xfffffe0007b500b0  getty
  692     1   692     0  Ss      nanslp  0xffffffff83c5e201  cron
  688     1   688     0  Ss      select  0xfffffe008fe4fe40  sshd
  501     1   501     0  Ss      select  0xfffffe00078746c0  syslogd
  430     1   430     0  Ss      select  0xfffffe0007874a40  devd
  429     1   429    65  Ss      select  0xfffffe00078748c0  dhclient
  344     1   344     0  Ss      select  0xfffffe008fe50140  dhclient
  341     1   341     0  Ss      select  0xfffffe008fe500c0  dhclient
   17     0     0     0  DL      syncer  0xffffffff83d836a0  [syncer]
   16     0     0     0  DL      vlruwt  0xfffffe0056f8b000  [vnlru]
   15     0     0     0  DL      (threaded)                  [bufdaemon]
100079                   D       psleep  0xffffffff83d81cc0  [bufdaemon]
100082                   D       -       0xffffffff83012180  [bufspacedaemon-0]
100095                   D       sdflush 0xfffffe0058ad74e8  [/ worker]
    9     0     0     0  DL      psleep  0xffffffff83db9400  [vmdaemon]
    8     0     0     0  DL      (threaded)                  [pagedaemon]
100077                   D       psleep  0xffffffff83dad2b8  [dom0]
100080                   D       launds  0xffffffff83dad2c4  [laundry: dom0]
100081                   D       umarcl  0xffffffff81e7d120  [uma]
    7     0     0     0  DL      -       0xffffffff83a2be48  [rand_harvestq]
    6     0     0     0  DL      pftm    0xffffffff8491d270  [pf purge]
    5     0     0     0  DL      waiting 0xffffffff847631c0  [sctp_iterator]
    4     0     0     0  DL      (threaded)                  [cam]
100044                   D       -       0xffffffff838ce340  [doneq0]
100045                   D       -       0xffffffff838ce2c0  [async]
100076                   D       -       0xffffffff838ce140  [scanner]
   14     0     0     0  DL      seqstat 0xfffffe0007baa088  [sequencer 00]
    3     0     0     0  DL      (threaded)                  [crypto]
100040                   D       crypto_ 0xffffffff83da8b60  [crypto]
100041                   D       crypto_ 0xfffffe0054096430  [crypto returns 0]
100042                   D       crypto_ 0xfffffe0054096480  [crypto returns 1]
   13     0     0     0  DL      (threaded)                  [geom]
100035                   D       -       0xffffffff83c33640  [g_event]
100036                   D       -       0xffffffff83c33660  [g_up]
100037                   D       -       0xffffffff83c33680  [g_down]
    2     0     0     0  WL      (threaded)                  [clock]
100030                   I                                   [clock (0)]
100031                   I                                   [clock (1)]
   12     0     0     0  RL      (threaded)                  [intr]
100010                   I                                   [swi5: fast taskq]
100013                   I                                   [swi6: task queue]
100018                   I                                   [swi6: Giant taskq]
100029                   Run     CPU 1                       [swi1: netisr 0]
100032                   I                                   [swi1: hpts]
100033                   I                                   [swi1: hpts]
100046                   I                                   [irq24: virtio_pci0]
100047                   I                                   [irq25: virtio_pci0]
100048                   I                                   [irq26: virtio_pci0]
100049                   I                                   [irq27: virtio_pci0]
100050                   I                                   [irq28: virtio_pci1]
100051                   I                                   [irq29: virtio_pci1]
100052                   I                                   [irq30: virtio_pci1]
100053                   I                                   [irq31: virtio_pci1]
100054                   I                                   [irq32: virtio_pci1]
100059                   I                                   [irq33: virtio_pci2]
100060                   I                                   [irq34: virtio_pci2]
100061                   I                                   [irq35: virtio_pci2]
100063                   I                                   [irq1: atkbd0]
100064                   I                                   [irq12: psm0]
100065                   I                                   [swi0: uart uart++]
100069                   I                                   [swi1: pf send]
   11     0     0     0  RL      (threaded)                  [idle]
100003                   CanRun                              [idle: cpu0]
100004                   CanRun                              [idle: cpu1]
    1     0     1     0  SLs     wait    0xfffffe00541da010  [init]
   10     0     0     0  DL      audit_w 0xffffffff83da95a0  [audit]
    0     0     0     0  DLs     (threaded)                  [kernel]
100000                   D       swapin  0xffffffff83c34060  [swapper]
100005                   D       -       0xfffffe0007a09700  [if_config_tqg_0]
100006                   D       -       0xfffffe0007a09600  [softirq_0]
100007                   D       -       0xfffffe0007a09500  [softirq_1]
100008                   D       -       0xfffffe0007a09400  [if_io_tqg_0]
100009                   D       -       0xfffffe0007a09300  [if_io_tqg_1]
100011                   D       -       0xfffffe00085f3c00  [kqueue_ctx taskq]
100012                   D       -       0xfffffe00085f3b00  [pci_hp taskq]
100014                   D       -       0xfffffe00085f3900  [inm_free taskq]
100015                   D       -       0xfffffe00085f3800  [aiod_kick taskq]
100016                   D       -       0xfffffe00085f3700  [in6m_free taskq]
100017                   D       -       0xfffffe00085f3600  [deferred_unmount ta]
100019                   D       -       0xfffffe00085f3400  [thread taskq]
100020                   D       -       0xfffffe00085f3300  [linuxkpi_irq_wq]
100021                   D       -       0xfffffe00085f3200  [linuxkpi_short_wq_0]
100022                   D       -       0xfffffe00085f3200  [linuxkpi_short_wq_1]
100023                   D       -       0xfffffe00085f3200  [linuxkpi_short_wq_2]
100024                   D       -       0xfffffe00085f3200  [linuxkpi_short_wq_3]
100025                   D       -       0xfffffe00085f3100  [linuxkpi_long_wq_0]
100026                   D       -       0xfffffe00085f3100  [linuxkpi_long_wq_1]
100027                   D       -       0xfffffe00085f3100  [linuxkpi_long_wq_2]
100028                   D       -       0xfffffe00085f3100  [linuxkpi_long_wq_3]
100034                   D       -       0xfffffe00085f3000  [firmware taskq]
100038                   D       -       0xfffffe00085f2e00  [crypto_0]
100039                   D       -       0xfffffe00085f2e00  [crypto_1]
100055                   D       -       0xfffffe00085f2900  [vtnet0 rxq 0]
100056                   D       -       0xfffffe00085f2800  [vtnet0 txq 0]
100057                   D       -       0xfffffe00085f2700  [vtnet0 rxq 1]
100058                   D       -       0xfffffe00085f2600  [vtnet0 txq 1]
100062                   D       vtbslp  0xfffffe0056f5c180  [virtio_balloon]
100066                   D       -       0xffffffff82afddc1  [deadlkres]
100070                   D       -       0xfffffe00085f4100  [mca taskq]
100071                   D       -       0xfffffe00579b4000  [acpi_task_0]
100072                   D       -       0xfffffe00579b4000  [acpi_task_1]
100073                   D       -       0xfffffe00579b4000  [acpi_task_2]
100075                   D       -       0xfffffe00085f2b00  [CAM taskq]
db> show all locks
Process 3589 (syz-executor3468367) thread 0xfffffe005787ac80 (100104)
exclusive sleep mutex so_rcv (so_rcv) r = 0 (0xfffffe008fc3a1a0) locked @ /syzkaller/managers/main/kernel/sys/kern/uipc_sockbuf.c:780
exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xfffffe008fc3a180) locked @ /syzkaller/managers/main/kernel/sys/kern/uipc_socket.c:4006
Process 12 (intr) thread 0xfffffe0007a9c3a0 (100029)
exclusive sleep mutex sctp-tcb (tcb) r = 0 (0xfffffe0092e8ea68) locked @ /syzkaller/managers/main/kernel/sys/netinet/sctp_pcb.c:2138
db> show malloc
              Type        InUse        MemUse     Requests
           pf_hash            5        11524K            5
          tcp_hpts            7         4801K            7
            devbuf         4216         4323K         4244
         sysctloid        34725         2046K        34796
             vtbuf           24         1968K           46
              kobj          330         1320K          493
            newblk          130         1057K          818
          vfscache            3         1025K            3
               pcb           33          552K         5666
          inodedep            2          513K           72
         ufs_quota            1          512K            1
          vfs_hash            1          512K            1
           callout            2          512K            2
              intr            4          472K            4
              vmem            3          274K            6
           subproc          101          201K         3655
            acpica         1674          184K        58126
           tidhash            3          141K            3
           pagedep            2          129K           19
        tfo_ccache            1          128K            1
          IP reass            1          128K            1
            linker          324          127K          353
         vnet_data            1          112K            1
               sem            4          106K            4
            DEVFS1          105          105K          114
               bus         1000           82K         5215
          mtx_pool            2           72K            2
     NFSD srvcache            3           68K            3
          syncache            1           68K            1
            module          513           65K          513
          acpitask            1           64K            1
       ddb_capture            1           64K            1
              temp           19           53K         1612
         sctp_timw          206           52K          206
         hostcache            1           32K            1
               shm            1           32K            1
           kdtrace          159           32K         3713
            DEVFS3          124           31K          134
              umtx          242           31K          242
               msg            4           30K            4
            kbdmux            6           28K            6
        gtaskqueue           18           26K           18
        DEVFS_RULE           56           20K           56
               BPF           10           18K           10
         ufs_mount            4           17K            5
              proc            3           17K            3
               tty           16           16K           16
           ithread           97           16K           97
            bus-sc           34           15K         1682
      eventhandler          154           13K          154
            KTRACE          100           13K          100
              kenv           95           12K           95
            ifaddr           30           12K           32
              rman           88           11K          431
              GEOM           61           11K          481
          routetbl           50           11K          176
         CAM queue            5           11K         1528
              cred           35            9K          234
         bmsafemap            3            9K           42
               rpc            4            9K            4
              UART           12            9K           12
           devstat            4            9K            4
              ksem            1            8K            1
             shmfd            1            8K            1
       pfs_vncache            1            8K            1
         pfs_nodes           20            8K           20
     audit_evclass          237            8K          296
         sctp_stro            7            7K         2814
         sctp_atcl           18            7K         6012
         taskqueue           63            7K           63
            sglist            5            7K            5
           CAM DEV            3            6K          510
       ufs_dirhash           24            5K           24
               UMA          267            5K          267
                vt           11            5K           11
             ifnet            3            5K            3
           memdesc            1            4K            1
               MCA           32            4K           32
            plimit           16            4K          323
          filedesc            1            4K            1
             evdev            4            4K            4
           acpisem           28            4K           28
             hhook           15            4K           17
       ether_multi           40            4K           50
           lltable           11            4K           11
          pf_ifnet            5            3K            6
         in6_multi           25            3K           25
            kqueue           45            3K         3601
           pwddesc           45            3K         3599
          terminal           11            3K           11
           session           19            3K           31
             clone            9            3K            9
           uidinfo            3            3K            8
         proc-args           64            3K         4545
         sctp_stri            4            2K          768
        local_apic            1            2K            1
           io_apic            1            2K            1
       fpukern_ctx            2            2K            2
         ipsec-saq            2            2K            2
             selfd           27            2K        48055
            Unitno           27            2K           41
           CAM XPT           22            2K          543
             lockf           15            2K           22
               msi           12            2K           12
       ipsecpolicy            2            2K            2
           acpidev           20            2K           20
         sctp_atky           25            2K         9210
      NFSD session            1            1K            1
           softdep            1            1K            1
            sahead            1            1K            1
          secasvar            1            1K            1
       vnodemarker            2            1K           20
        CAM periph            4            1K          271
            select            7            1K           29
             ipsec            3            1K            3
             nhops            6            1K            6
         toponodes            6            1K            6
            isadev            6            1K            6
             mount           16            1K           89
          pci_link           10            1K           10
          sctp_ifa            5            1K            6
            crypto            4            1K            4
            ip6ndp            4            1K            5
 encap_export_host           12            1K           12
          in_multi            2            1K            4
              pfil            4            1K            4
              cdev            2            1K            2
               osd            7            1K           19
            CC Mem            3            1K            7
    chacha20random            1            1K            1
       inpcbpolicy           10            1K          139
         sctp_athm           18            1K         6396
          sctp_ifn            2            1K            6
      NFSD lckfile            1            1K            1
     NFSD V4client            1            1K            1
            DEVFSP            4            1K            9
             DEVFS            9            1K           10
          indirdep            1            1K            3
               mld            2            1K            2
              igmp            2            1K            2
            vnodes            1            1K            1
           CAM SIM            2            1K            2
          sctp_map           14            1K         5628
            feeder            7            1K            7
            soname            7            1K         9051
           tcpfunc            3            1K            3
        loginclass            3            1K            7
            prison            6            1K            6
       lkpikmalloc            5            1K            6
        aesni_data            2            1K            2
         cryptodev            2            1K           49
          nexusdev            8            1K            8
            apmdev            1            1K            1
          atkbddev            2            1K            2
            diradd            1            1K           36
     CAM dev queue            2            1K            2
           netlink            1            1K            1
 CAM I/O Scheduler            1            1K            1
          CAM path            4            1K         1034
          procdesc            1            1K            6
          pmchooks            1            1K            1
               tun            3            1K            3
          sctp_vrf            1            1K            1
              vnet            1            1K            1
           entropy            2            1K           35
               pmc            1            1K            1
          acpiintr            1            1K            1
              cpus            2            1K            2
          freework            1            1K           26
    vnet_data_free            1            1K            1
           Per-cpu            1            1K            1
          p1003.1b            1            1K            1
          filecaps            1            1K           66
          pf_table            0            0K            0
           pf_rule            0            0K            0
           pf_altq            0            0K            0
           pf_osfp            0            0K            0
           pf_temp            0            0K            0
        sctp_mcore            0            0K            0
        sctp_socko            0            0K         2811
         sctp_iter            0            0K            4
         sctp_mvrf            0            0K            0
         sctp_cpal            0            0K            0
         sctp_cmsg            0            0K            0
         sctp_stre            0            0K            0
         sctp_athi            0            0K            0
         sctp_a_it            0            0K            4
         sctp_aadr            0            0K            0
            tcp_do            0            0K            0
           tcp_fsb            0            0K            0
            ipcomp            0            0K            0
               esp            0            0K            0
                ah            0            0K            0
            mqdata            0            0K            0
           filemon            0            0K            0
  newnfsclient_req            0            0K            0
        madt_table            0            0K            2
          smartpqi            0            0K            0
   NFSCL layrecall            0            0K            0
     NFSCL session            0            0K            0
     NFSCL sockreq            0            0K            0
               ixl            0            0K            0
     NFSCL devinfo            0            0K            0
     NFSCL flayout            0            0K            0
      NFSCL layout            0            0K            0
     NFSD rollback            0            0K            0
      NFSCL diroff            0            0K            0
       NEWdirectio            0            0K            0
        NEWNFSnode            0            0K            0
        ice-resmgr            0            0K            0
         ice-osdep            0            0K            0
               ice            0            0K            0
              iavf            0            0K            0
             axgbe            0            0K            0
         NFSCL lck            0            0K            0
      NFSCL lckown            0            0K            0
      NFSCL client            0            0K            0
       NFSCL deleg            0            0K            0
        NFSCL open            0            0K            0
       NFSCL owner            0            0K            0
            NFS fh            0            0K            0
           NFS req            0            0K            0
     NFSD usrgroup            0            0K            0
       NFSD string            0            0K            0
          xen_intr            0            0K            0
       NFSD V4lock            0            0K            0
           xen_hvm            0            0K            0
         legacydrv            0            0K            0
            bounce            0            0K            0
            busdma            0            0K            0
            qpidrv            0            0K            0
      NFSD V4state            0            0K            0
      dmar_idpgtbl            0            0K            0
          dmar_dom            0            0K            0
          dmar_ctx            0            0K            0
       msdosfs_fat            0            0K            0
     msdosfs_mount            0            0K            0
              isci            0            0K            0
      iommu_dmamap            0            0K            0
      msdosfs_node            0            0K            0
     hyperv_socket            0            0K            0
           bxe_ilt            0            0K            0
            xenbus            0            0K            0
            DEVFS4            0            0K            0
     vm_fictitious            0            0K            0
            DEVFS2            0            0K            0
            gntdev            0            0K            0
       privcmd_dev            0            0K            0
        evtchn_dev            0            0K            0
          xenstore            0            0K            0
         scsi_pass            0            0K            0
         ciss_data            0            0K            0
               xnb            0            0K            0
          xen_acpi            0            0K            0
           UMAHash            0            0K            0
              xbbd            0            0K            0
               xbd            0            0K            0
         vm_pgdata            0            0K            0
           jblocks            0            0K            0
          savedino            0            0K           17
          sentinel            0            0K            0
            jfsync            0            0K            0
            jtrunc            0            0K            0
             sbdep            0            0K            6
           jsegdep            0            0K            0
              jseg            0            0K            0
         jfreefrag            0            0K            0
          jfreeblk            0            0K            0
           jnewblk            0            0K            0
            jmvref            0            0K            0
           jremref            0            0K            0
           jaddref            0            0K            0
           freedep            0            0K            0
         newdirblk            0            0K            8
            dirrem            0            0K           28
             mkdir            0            0K           16
          freefile            0            0K           26
          freeblks            0            0K           25
          freefrag            0            0K            2
        allocindir            0            0K            0
       allocdirect            0            0K            0
          ufs_trim            0            0K            0
           mactemp            0            0K            0
     audit_trigger            0            0K            0
 audit_pipe_presel            0            0K            0
     audit_pipeent            0            0K            0
        audit_pipe            0            0K            0
      audit_evname            0            0K            0
         audit_bsm            0            0K            0
      audit_gidset            0            0K            0
        audit_text            0            0K            0
        audit_path            0            0K            0
        audit_data            0            0K            0
        audit_cred            0            0K            0
           Balloon            0            0K            0
          sysmouse            0            0K            0
            vtfont            0            0K            0
         BACKLIGHT            0            0K            0
           ath_hal            0            0K            0
            athdev            0            0K            0
           ata_pci            0            0K            0
           ata_dma            0            0K            0
       ata_generic            0            0K            0
            pvscsi            0            0K            0
           scsi_da            0            0K           69
            ata_da            0            0K            0
           scsi_ch            0            0K            0
          ktls_ocf            0            0K            0
           scsi_cd            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
      MLX5E_TLS_RX            0            0K            0
        MLX5EEPROM            0            0K            0
         MLX5E_TLS            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
            MLX5EN            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
          MLX5DUMP            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
       simple_attr            0            0K            0
          seq_file            0            0K            0
           lkpiskb            0            0K            0
             radix            0            0K            0
               idr            0            0K            0
          lkpindev            0            0K            0
            lkpifw            0            0K            0
         lkpi80211            0            0K            0
               NLM            0            0K            0
    ipsec-spdcache            0            0K            0
         ipsec-reg            0            0K            0
        ipsec-misc            0            0K            0
      ipsecrequest            0            0K            0
            ip6opt            0            0K            3
       ip6_msource            0            0K            0
      ip6_moptions            0            0K            0
       in6_mfilter            0            0K            0
             frag6            0            0K            0
            tcplog            0            0K            0
        tcp_hwpace            0            0K            0
       AHCI driver            0            0K            0
            USBdev            0            0K            0
               LRO            0            0K            0
        ip_msource            0            0K            0
       ip_moptions            0            0K            0
        in_mfilter            0            0K            0
              ipid            0            0K            0
         80211scan            0            0K            0
      80211ratectl            0            0K            0
        80211power            0            0K            0
       80211nodeie            0            0K            0
         80211node            0            0K            0
      80211mesh_gt            0            0K            0
      80211mesh_rt            0            0K            0
         80211perr            0            0K            0
         80211prep            0            0K            0
         80211preq            0            0K            0
          80211dfs            0            0K            0
       80211crypto            0            0K            0
          80211vap            0            0K            0
             iflib            0            0K            0
              vlan            0            0K            0
               gif            0            0K            0
           ifdescr            0            0K            0
              zlib            0            0K            0
           fadvise            0            0K            0
           VN POLL            0            0K            0
               USB            0            0K            0
            statfs            0            0K          198
     namei_tracker            0            0K            0
       export_host            0            0K            0
        cl_savebuf            0            0K            3
               agp            0            0K            0
           nvme_da            0            0K            0
           acpipwr            0            0K            0
         acpi_perf            0            0K            0
            twsbuf            0            0K            0
      twe_commands            0            0K            0
       tcp_log_dev            0            0K            0
      midi buffers            0            0K            0
             mixer            0            0K            0
              ac97            0            0K            0
             hdacc            0            0K            0
              hdac            0            0K            0
              hdaa            0            0K            0
         acpicmbat            0            0K            0
       SIIS driver            0            0K            0
           CAM CCB            0            0K          523
            biobuf            0            0K            0
               aio            0            0K            0
               lio            0            0K            0
               acl            0            0K            0
          mbuf_tag            0            0K            0
              ktls            0            0K            0
               PUC            0            0K            0
          ppbusdev            0            0K            0
agtiapi_MemAlloc malloc            0            0K            0
    osti_cacheable            0            0K            0
          tempbuff            0            0K            0
          tempbuff            0            0K            0
ag_tgt_map_t malloc            0            0K            0
ag_slr_map_t malloc            0            0K            0
lDevFlags * malloc            0            0K            0
tiDeviceHandle_t * malloc            0            0K            0
ag_portal_data_t malloc            0            0K            0
ag_device_t malloc            0            0K            0
     STLock malloc            0            0K            0
          CCB List            0            0K            0
            sr_iov            0            0K            0
               OCS            0            0K            0
               OCS            0            0K            0
              nvme            0            0K            0
               nvd            0            0K            0
            netmap            0            0K            0
            mwldev            0            0K            0
        MVS driver            0            0K            0
     CAM ccb queue            0            0K            0
              accf            0            0K            0
               pts            0            0K            0
               iov            0            0K        13765
          ioctlops            0            0K           86
           eventfd            0            0K            0
           Witness            0            0K            0
             stack            0            0K            0
          mrsasbuf            0            0K            0
          mpt_user            0            0K            0
          mps_user            0            0K            0
            MPSSAS            0            0K            0
               mps            0            0K            0
              sbuf            0            0K          288
          mpr_user            0            0K            0
          firmware            0            0K            0
        compressor            0            0K            0
            MPRSAS            0            0K            0
              SWAP            0            0K            0
               mpr            0            0K            0
            mfibuf            0            0K            0
         sysctltmp            0            0K          650
            sysctl            0            0K            3
        md_sectors            0            0K            0
              ekcd            0            0K            0
            dumper            0            0K            0
          sendfile            0            0K            0
              rctl            0            0K            0
           md_disk            0            0K            0
           malodev            0            0K            0
               LED            0            0K            0
          ix_sriov            0            0K            0
             cache            0            0K            0
        aacraidcam            0            0K            0
          kcovinfo            0            0K            0
      prison_racct            0            0K            0
       Fail Points            0            0K            0
             sigio            0            0K            1
filedesc_to_leader            0            0K            0
               pwd            0            0K            0
       tty console            0            0K            0
                ix            0            0K            0
            ipsbuf            0            0K            0
       aacraid_buf            0            0K            0
            aaccam            0            0K            0
         boottrace            0            0K            0
            aacbuf            0            0K            0
              zstd            0            0K            0
            XZ_DEC            0            0K            0
            nvlist            0            0K            0
          SCSI ENC            0            0K            0
           SCSI sa            0            0K            0
        isofs_node            0            0K            0
       isofs_mount            0            0K            0
     tr_raid5_data            0            0K            0
    tr_raid1e_data            0            0K            0
     tr_raid1_data            0            0K            0
     tr_raid0_data            0            0K            0
    tr_concat_data            0            0K            0
       md_sii_data            0            0K            0
   md_promise_data            0            0K            0
    md_nvidia_data            0            0K            0
   md_jmicron_data            0            0K            0
     md_intel_data            0            0K            0
       md_ddf_data            0            0K            0
         raid_data            0            0K           72
     geom_flashmap            0            0K            0
         tmpfs dir            0            0K            0
        tmpfs name            0            0K            0
       tmpfs mount            0            0K            0
     tmpfs extattr            0            0K            0
           NFS FHA            0            0K            0
         newnfsmnt            0            0K            0
db> show uma
              Zone   Size    Used    Free    Requests  Sleeps  Bucket  Total Mem    XFree
   mbuf_jumbo_page   4096   10140    1036      191404       0     254   45776896        0
              mbuf    256   13088     894      480472       0     254    3579392        0
              pbuf   2624       0     778           0       0       2    2041472        0
          BUF TRIE    144     187   11601         595       0      62    1697472        0
        malloc-384    384    4180      80       10175       0      30    1635840        0
        malloc-128    128   11418     176       11491       0     126    1484032        0
       malloc-4096   4096     348       2        1145       0       2    1433600        0
       UMA Slabs 0    112   12389      25       12389       0     126    1390368        0
         sctp_asoc   2264       7     503        2814       0     254    1154640        0
         vmem btag     56   18642     117       18642       0     254    1050504        0
      mbuf_cluster   2048     508       0         508       0     254    1040384        0
         FFS inode   1160     483      35         509       0       8     600880        0
           sctp_ep   1176       7     503        2814       0     254     599760        0
        RADIX NODE    144    3513     234       46746       0      62     539568        0
            socket    960      22     486        4133       0     254     487680        0
         VM OBJECT    264    1355     145       47004       0      30     396000        0
      malloc-65536  65536       6       0           6       0       1     393216        0
            lkpimm    168       1    2327           1       0      62     391104        0
          lkpicurr    168       2    2326           2       0      62     391104        0
        sctp_raddr    736       7     510        2814       0     254     380512        0
        256 Bucket   2048     148      30        2442       0       8     364544        0
         malloc-64     64    3786     309        3803       0     254     262080        0
             VNODE    448     513      63         541       0      30     258048        0
         malloc-16     16   14367     383       14464       0     254     236000        0
            DEVCTL   1024       0     220         124       0       0     225280        0
            THREAD   1824     113       8         113       0       8     220704        0
       malloc-4096   4096      45       5        3599       0       2     204800        0
      malloc-65536  65536       1       2         137       0       1     196608        0
      malloc-65536  65536       2       1          10       0       1     196608        0
        malloc-128    128    1311     208       27589       0     126     194432        0
         MAP ENTRY     96    1595     421      144625       0     126     193536        0
        malloc-256    256     130     620         835       0      62     192000        0
         UMA Zones    768     239       0         239       0      16     183552        0
         malloc-32     32    5228     442        5259       0     254     181440        0
       malloc-1024   1024     142      34        2975       0      16     180224        0
       FFS2 dinode    256     483      87         509       0      62     145920        0
      malloc-65536  65536       0       2          46       0       1     131072        0
      malloc-32768  32768       4       0           4       0       1     131072        0
             unpcb    256       7     503        1163       0     254     130560        0
       mbuf_packet    256       7     501        4831       0     254     130048        0
       S VFS Cache    104     970     200        1009       0     126     121680        0
          ksiginfo    112      36    1008          56       0     126     116928        0
     FPU_save_area    832     115      20         132       0      16     112320        0
        128 Bucket   1024      47      52         510       0      16     101376        0
        malloc-128    128     605     170        1336       0     126      99200        0
       malloc-2048   2048       7      41         547       0       8      98304        0
           VMSPACE   2560      28       8        3583       0       4      92160        0
       malloc-8192   8192       9       2          12       0       1      90112        0
          UMA Kegs    384     225       8         225       0      30      89472        0
            clpbuf   2624       0      32          27       0      16      83968        0
        malloc-256    256     262      53         626       0      62      80640        0
        sctp_readq    152       4     516         331       0     254      79040        0
        sctp_chunk    152      95     425        9307       0     254      79040        0
              PROC   1368      44      11        3598       0       8      75240        0
         filedesc0   1072      45      25        3599       0       8      75040        0
         64 Bucket    512      74      62        2248       0      30      69632        0
         malloc-64     64     471     600         902       0     254      68544        0
         malloc-64     64     626     445       15138       0     254      68544        0
        malloc-128    128     274     253         337       0     126      67456        0
        malloc-128    128     293     234         430       0     126      67456        0
      malloc-32768  32768       0       2         120       0       1      65536        0
      malloc-16384  16384       4       0          14       0       1      65536        0
       malloc-2048   2048       8      24         532       0       8      65536        0
        malloc-256    256     162      93         863       0      62      65280        0
             g_bio    408       0     150        4958       0      30      61200        0
sctp_stream_msg_out    112       4     536         384       0     254      60480        0
        malloc-384    384      58      92         128       0      30      57600        0
         malloc-64     64     285     534       51927       0     254      52416        0
        malloc-256    256      70     125         708       0      62      49920        0
        malloc-256    256     122      73         186       0      62      49920        0
        malloc-256    256      75     120         198       0      62      49920        0
         32 Bucket    256      67     128        5632       0      62      49920        0
           DIRHASH   1024      35      13          35       0      16      49152        0
             NAMEI   1024       0      48       12225       0      16      49152        0
      malloc-16384  16384       3       0           3       0       1      49152        0
       malloc-2048   2048       8      16        2817       0       8      49152        0
       malloc-1024   1024       8      40        1398       0      16      49152        0
        malloc-512    512       6      90         770       0      30      49152        0
          syncache    168       0     264           5       0     254      44352        0
         udp_inpcb    448       6      84         128       0      30      40320        0
            da_ccb    544       0      70        1373       0      16      38080        0
            pcpu-8      8    4211     397        4239       0     254      36864        0
         malloc-64     64      14     553          14       0     254      36288        0
         malloc-64     64      59     508         694       0     254      36288        0
         malloc-64     64     146     421       10813       0     254      36288        0
         malloc-64     64      23     544          45       0     254      36288        0
        malloc-128    128       9     270          14       0     126      35712        0
        malloc-128    128     124     155        3408       0     126      35712        0
        malloc-128    128      23     256         281       0     126      35712        0
     routing nhops    256      10     125          17       0      62      34560        0
           ttyoutq    256      72      63         160       0      62      34560        0
        malloc-384    384      63      27          63       0      30      34560        0
        malloc-256    256      51      84         174       0      62      34560        0
        malloc-256    256      27     108        3396       0      62      34560        0
      malloc-32768  32768       1       0           1       0       1      32768        0
      malloc-16384  16384       2       0           2       0       1      32768        0
      malloc-16384  16384       0       2         160       0       1      32768        0
       malloc-8192   8192       4       0           4       0       1      32768        0
       malloc-8192   8192       4       0           4       0       1      32768        0
       malloc-4096   4096       8       0           9       0       2      32768        0
       malloc-4096   4096       4       4         202       0       2      32768        0
       malloc-2048   2048       1      15          13       0       8      32768        0
       malloc-2048   2048       3      13           3       0       8      32768        0
       malloc-2048   2048       0      16          50       0       8      32768        0
       malloc-2048   2048       3      13         194       0       8      32768        0
       malloc-1024   1024       2      30          42       0      16      32768        0
       malloc-1024   1024       7      25          11       0      16      32768        0
       malloc-1024   1024      10      22         168       0      16      32768        0
        malloc-512    512       3      61         139       0      30      32768        0
        malloc-512    512       1      63          11       0      30      32768        0
        malloc-512    512       9      55           9       0      30      32768        0
        malloc-512    512       4      60          53       0      30      32768        0
           pcpu-64     64     497      15         497       0     254      32768        0
    ertt_txseginfo     40       1     807        3019       0     254      32320        0
            ttyinq    160     135      65         300       0      62      32000        0
            cpuset    104       7     272           7       0     126      29016        0
        sctp_laddr     48       0     588           4       0     254      28224        0
         malloc-32     32     250     632        5942       0     254      28224        0
         16 Bucket    144      47     149         262       0      62      28224        0
          4 Bucket     48       5     583          92       0     254      28224        0
         TURNSTILE    136     122      67         122       0      62      25704        0
       malloc-8192   8192       2       1          28       0       1      24576        0
       malloc-8192   8192       1       2         102       0       1      24576        0
       malloc-8192   8192       3       0           3       0       1      24576        0
              PGRP     88      19     257          31       0     126      24288        0
          rl_entry     40      26     580          26       0     254      24240        0
           rtentry    168      13     131          17       0      62      24192        0
              pipe    728       6      27         284       0      16      24024        0
             Files     80      71     229        9395       0     126      24000        0
          8 Bucket     80      50     250         384       0     126      24000        0
         tcp_inpcb   1288       3      15           7       0       8      23184        0
        malloc-384    384       2      58          13       0      30      23040        0
        malloc-384    384       1      59          20       0      30      23040        0
        malloc-384    384       0      60         345       0      30      23040        0
        malloc-384    384       8      52          11       0      30      23040        0
        SLEEPQUEUE     88     122     134         122       0     126      22528        0
         hostcache     64       1     314           1       0     254      20160        0
   udp_inpcb ports     32       3     627          40       0     254      20160        0
              ertt     72       3     277           7       0     126      20160        0
               PWD     32      10     620         100       0     254      20160        0
         malloc-32     32      70     560        1608       0     254      20160        0
         malloc-32     32      72     558        5821       0     254      20160        0
         malloc-32     32      64     566        3751       0     254      20160        0
         malloc-32     32      60     570        2857       0     254      20160        0
         malloc-32     32      48     582         209       0     254      20160        0
          2 Bucket     32      49     581         303       0     254      20160        0
 epoch_record pcpu    256       4      60           4       0      62      16384        0
       malloc-8192   8192       2       0           2       0       1      16384        0
       malloc-4096   4096       2       2           5       0       2      16384        0
       malloc-4096   4096       3       1           3       0       2      16384        0
       malloc-4096   4096       0       4           3       0       2      16384        0
       malloc-2048   2048       5       3           5       0       8      16384        0
       malloc-1024   1024       6      10           6       0      16      16384        0
        malloc-512    512       0      32           1       0      30      16384        0
           SMR CPU     32       7     504           7       0     254      16352        0
      vtnet_tx_hdr     24       0     668        4992       0     254      16032        0
         malloc-16     16      62     938       14905       0     254      16000        0
              kenv    258      15      45        1038       0      30      15480        0
             ripcb    416       1      35           4       0      30      14976        0
            mqnode    416       3      33           3       0      30      14976        0
              vmem   1856       1       7           1       0       8      14848        0
        SMR SHARED     24       7     504           7       0     254      12264        0
   tcp_inpcb ports     32       1     377           1       0     254      12096        0
         malloc-32     32      80     298          80       0     254      12096        0
             KNOTE    160       0      75           8       0      62      12000        0
         malloc-16     16      18     732          19       0     254      12000        0
         malloc-16     16     293     457         494       0     254      12000        0
         malloc-16     16      10     740         168       0     254      12000        0
         malloc-16     16     211     539        4353       0     254      12000        0
         malloc-16     16      24     726       26517       0     254      12000        0
         malloc-16     16      22     728          25       0     254      12000        0
       Mountpoints   2816       2       2           2       0       4      11264        0
       malloc-8192   8192       1       0           1       0       1       8192        0
           pcpu-16     16       4     252           4       0     254       4096        0
       UMA Slabs 1    176       8      14           8       0      62       3872        0
        KMAP ENTRY     96      12      27          14       0       0       3744        0
       FFS1 dinode    128       0       0           0       0     126          0        0
           ada_ccb    272       0       0           0       0      30          0        0
             swblk    136       0       0           0       0      62          0        0
          swpctrie    144       0       0           0       0      62          0        0
   pf state scrubs     40       0       0           0       0     254          0        0
   pf frag entries     40       0       0           0       0     254          0        0
          pf frags    248       0       0           0       0      62          0        0
  pf table entries    160       0       0           0       0     254          0        0
pf table entry counters     64       0       0           0       0     254          0        0
   pf source nodes    136       0       0           0       0     254          0        0
     pf state keys     88       0       0           0       0     126          0        0
         pf states    312       0       0           0       0     254          0        0
           pf tags    104       0       0           0       0     126          0        0
          pf mtags    184       0       0           0       0      62          0        0
      tcp_rack_pcb    896       0       0           0       0      16          0        0
      tcp_rack_map    120       0       0           0       0     126          0        0
       tcp_bbr_pcb    832       0       0           0       0      16          0        0
       tcp_bbr_map    128       0       0           0       0     126          0        0
tfo_ccache_entries     80       0       0           0       0     126          0        0
               tfo      4       0       0           0       0     254          0        0
          sackhole     32       0       0           0       0     254          0        0
               ipq     56       0       0           0       0     254          0        0
   tcp_log_id_node    120       0       0           0       0     126          0        0
 tcp_log_id_bucket    176       0       0           0       0      62          0        0
           tcp_log    416       0       0           0       0     254          0        0
          tcpreass     48       0       0           0       0     254          0        0
   sctp_asconf_ack     48       0       0           0       0     254          0        0
       sctp_asconf     40       0       0           0       0     254          0        0
       ripcb ports     32       0       0           0       0     254          0        0
udplite_inpcb ports     32       0       0           0       0     254          0        0
     udplite_inpcb    448       0       0           0       0      30          0        0
    IPsec SA lft_c     16       0       0           0       0     254          0        0
            itimer    352       0       0           0       0      30          0        0
            AIOLIO    272       0       0           0       0      30          0        0
             AIOCB    552       0       0           0       0      16          0        0
               AIO    208       0       0           0       0      62          0        0
        TMPFS node    232       0       0           0       0      62          0        0
        mqnotifier    216       0       0           0       0      62          0        0
            mvdata     64       0       0           0       0     254          0        0
            mqueue    248       0       0           0       0      62          0        0
           NCLNODE    608       0       0           0       0      16          0        0
     LTS VFS Cache    360       0       0           0       0      30          0        0
       L VFS Cache    320       0       0           0       0      30          0        0
     STS VFS Cache    144       0       0           0       0      62          0        0
           cryptop    280       0       0           0       0      30          0        0
  linux_dma_object     32       0       0           0       0     254          0        0
  linux_dma_pctrie    144       0       0           0       0      62          0        0
   IOMMU_MAP_ENTRY    104       0       0           0       0     126          0        0
    mbuf_jumbo_16k  16384       0       0           0       0     254          0        0
     mbuf_jumbo_9k   9216       0       0           0       0     254          0        0
      audit_record   1280       0       0           0       0       8          0        0
         domainset     40       0       0           0       0     254          0        0
        MAC labels     40       0       0           0       0     254          0        0
            vnpbuf   2624       0       0           0       0      64          0        0
            mdpbuf   2624       0       0           0       0       3          0        0
           nfspbuf   2624       0       0           0       0      16          0        0
            swwbuf   2624       0       0           0       0       8          0        0
            swrbuf   2624       0       0           0       0      16          0        0
          umtx_shm     88       0       0           0       0     126          0        0
           umtx pi     96       0       0           0       0     126          0        0
rangeset pctrie nodes    144       0       0           0       0      62          0        0
      malloc-65536  65536       0       0           0       0       1          0        0
      malloc-65536  65536       0       0           0       0       1          0        0
      malloc-65536  65536       0       0           0       0       1          0        0
      malloc-65536  65536       0       0           0       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
      malloc-16384  16384       0       0           0       0       1          0        0
      malloc-16384  16384       0       0           0       0       1          0        0
      malloc-16384  16384       0       0           0       0       1          0        0
      malloc-16384  16384       0       0           0       0       1          0        0
       malloc-4096   4096       0       0           0       0       2          0        0
       malloc-1024   1024       0       0           0       0      16          0        0
       malloc-1024   1024       0       0           0       0      16          0        0
        malloc-512    512       0       0           0       0      30          0        0
        malloc-512    512       0       0           0       0      30          0        0
        malloc-384    384       0       0           0       0      30          0        0
           pcpu-32     32       0       0           0       0     254          0        0
            pcpu-4      4       0       0           0       0     254          0        0
            fakepg    104       0       0           0       0     126          0        0
          UMA Hash    256       0       0           0       0      62          0        0

Crashes (33):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2023/03/13 06:20 freebsd-src 15e7fa83ef3c ee50e71c console log report syz C ci-freebsd-main panic: sbflush_internal: residual data
2022/10/17 01:28 freebsd-src e6901a29bc43 67cb024c console log report syz C ci-freebsd-main panic: sbflush_internal: residual data
2022/06/11 10:55 freebsd-src 36447829aee5 0d5abf15 console log report syz C ci-freebsd-main panic: sbflush_internal: residual data
2023/06/07 06:04 freebsd-src e82a62943529 ee50e71c console log report ci-freebsd-main panic: sbflush_internal: residual data
2023/05/27 21:33 freebsd-src 537cd766435c ee50e71c console log report ci-freebsd-main panic: sbflush_internal: residual data
2023/05/18 01:57 freebsd-src 743516d51fa7 ee50e71c console log report ci-freebsd-main panic: sbflush_internal: residual data
2023/05/16 09:03 freebsd-src 816129210ad4 ee50e71c console log report ci-freebsd-main panic: sbflush_internal: residual data
2023/03/20 22:45 freebsd-src e4e139b828a2 ee50e71c console log report ci-freebsd-main panic: sbflush_internal: residual data
2023/03/13 04:27 freebsd-src 15e7fa83ef3c ee50e71c console log report ci-freebsd-main panic: sbflush_internal: residual data
2022/11/06 17:27 freebsd-src d56c7ac87f9f 6d752409 console log report ci-freebsd-main panic: sbflush_internal: residual data
2022/10/16 22:36 freebsd-src e6901a29bc43 67cb024c console log report ci-freebsd-main panic: sbflush_internal: residual data
2022/08/28 22:07 freebsd-src 31937f7e843d 07177916 console log report ci-freebsd-main panic: sbflush_internal: residual data
2022/08/27 04:22 freebsd-src a28f83353243 07177916 console log report ci-freebsd-main panic: sbflush_internal: residual data
2022/08/24 14:22 freebsd-src 4b8feb5d61ac 514514f6 console log report ci-freebsd-main panic: sbflush_internal: residual data
2022/08/15 14:52 freebsd-src 35b587464afc 8dfcaa3d console log report ci-freebsd-main panic: sbflush_internal: residual data
2022/08/11 11:20 freebsd-src 64f923959a8a 787ed7e0 console log report ci-freebsd-main panic: sbflush_internal: residual data
2022/08/07 20:00 freebsd-src 75f8dcc831bf 88e3a122 console log report ci-freebsd-main panic: sbflush_internal: residual data
2022/07/15 07:03 freebsd-src 60052a11db8e 5d921b08 console log report ci-freebsd-main panic: sbflush_internal: residual data
2022/07/09 22:16 freebsd-src 8f9972075cb3 b5765a15 console log report ci-freebsd-main panic: sbflush_internal: residual data
2022/07/05 04:25 freebsd-src ec32fc2af525 bff65f44 console log report ci-freebsd-main panic: sbflush_internal: residual data
2022/06/21 08:13 freebsd-src 0586a1290446 0fc5c330 console log report ci-freebsd-main panic: sbflush_internal: residual data
2022/06/11 10:37 freebsd-src 36447829aee5 0d5abf15 console log report ci-freebsd-main panic: sbflush_internal: residual data
2023/06/12 20:16 freebsd-src 1dd6f95bb90d ee50e71c console log report ci-freebsd-i386 panic: sbflush_internal: residual data
2023/05/13 23:37 freebsd-src d489b2a39d51 ee50e71c console log report ci-freebsd-i386 panic: sbflush_internal: residual data
2023/03/24 05:33 freebsd-src 40924005c222 ee50e71c console log report ci-freebsd-i386 panic: sbflush_internal: residual data
2022/10/27 05:52 freebsd-src 5daf88ea5efe 86777b7f console log report ci-freebsd-i386 panic: sbflush_internal: residual data
2022/08/21 09:32 freebsd-src 3454a7caa053 26a13b38 console log report ci-freebsd-i386 panic: sbflush_internal: residual data
2022/08/15 21:35 freebsd-src da36b5d24441 8dfcaa3d console log report ci-freebsd-i386 panic: sbflush_internal: residual data
2022/08/04 23:20 freebsd-src 369ea0520a30 1c9013ac console log report ci-freebsd-i386 panic: sbflush_internal: residual data
2022/08/02 13:44 freebsd-src 1abc27dd52e5 1c9013ac console log report ci-freebsd-i386 panic: sbflush_internal: residual data
2022/07/23 05:00 freebsd-src 151abc80cde7 22343af4 console log report ci-freebsd-i386 panic: sbflush_internal: residual data
2022/06/26 14:26 freebsd-src fdfeaa66b58a a371c43c console log report ci-freebsd-i386 panic: sbflush_internal: residual data
2022/06/25 14:06 freebsd-src 61c74fb66f1b a371c43c console log report ci-freebsd-i386 panic: sbflush_internal: residual data
* Struck through repros no longer work on HEAD.