syzbot


panic: td ADDR is not suspended

Status: fixed on 2022/06/14 07:46
Reported-by: syzbot+9db4640d67478a0ced08@syzkaller.appspotmail.com
Fix commit: 1575804961d2 reap_kill_proc(): avoid singlethreading any other process if we are exiting
First crash: 284d, last: 239d

Sample crash report:
login: panic: td 0xfffffe0058ce4000 is not suspended
cpuid = 0
time = 1651991379
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0xc7/frame 0xfffffe009c1b1750
kdb_backtrace() at kdb_backtrace+0xd3/frame 0xfffffe009c1b18b0
vpanic() at vpanic+0x2b8/frame 0xfffffe009c1b1990
panic() at panic+0xb5/frame 0xfffffe009c1b1a60
thread_single() at thread_single+0xca4/frame 0xfffffe009c1b1b10
fork1() at fork1+0x693/frame 0xfffffe009c1b1c10
sys_rfork() at sys_rfork+0x1c2/frame 0xfffffe009c1b1d30
amd64_syscall() at amd64_syscall+0x40c/frame 0xfffffe009c1b1f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe009c1b1f30
--- syscall (0, FreeBSD ELF64, nosys), rip = 0x2b440a, rsp = 0x8296adf78, rbp = 0x8296adfb0 ---
KDB: enter: panic
[ thread pid 787 tid 100118 ]
Stopped at      kdb_enter+0x6b: movq    $0,0x26ff52a(%rip)
db> 
db> set $lines = 0
db> set $maxwidth = 0
db> show registers
cs                        0x20
ds                        0x3b
es                        0x3b
fs                        0x13
gs                        0x1b
ss                        0x28
rax                       0x12
rcx         0x7ce9170a665c7452
rdx         0xdffff7c000000000
rbx                          0
rsp         0xfffffe009c1b1890
rbp         0xfffffe009c1b18b0
rsi                        0x1
rdi                          0
r8                         0x3
r9                  0xffffffff
r10                          0
r11         0xfffffe0058ce68b0
r12         0xfffffe0058ce63a0
r13         0xfffffe009c1b1901
r14         0xffffffff82bc6e40  .str.26
r15         0xffffffff82bc6e40  .str.26
rip         0xffffffff8177516b  kdb_enter+0x6b
rflags                    0x46
kdb_enter+0x6b: movq    $0,0x26ff52a(%rip)
db> show proc
Process 787 (syz-executor3894954) at 0xfffffe0058dc8548:
 state: NORMAL
 uid: 0  gids: 0, 0, 5
 parent: pid 784 at 0xfffffe0056fa4a90
 ABI: FreeBSD ELF64
 flag: 0x10480080  flag2: 0
 arguments: ./syz-executor3894954413
 reaper: 0xfffffe0053dd8000 reapsubtree: 1
 sigparent: 20
 vmspace: 0xfffffe009ec539f8
   (map 0xfffffe009ec539f8)
   (map.pmap 0xfffffe009ec53ab8)
   (pmap 0xfffffe009ec53b20)
 threads: 2
100096                   RunQ                                syz-executor3894954
100118                   Run     CPU 0                       syz-executor3894954
db> ps
  pid  ppid  pgrp   uid  state   wmesg   wchan               cmd
  787   784   777     0  T       (threaded)                  syz-executor3894954
100096                   RunQ                                syz-executor3894954
100118                   Run     CPU 0                       syz-executor3894954
  786   783   777     0  R       (threaded)                  syz-executor3894954
100115                   Run     CPU 1                       syz-executor3894954
100119                   RunQ                                syz-executor3894954
  785   781   777     0  R       (threaded)                  syz-executor3894954
100114                   RunQ                                syz-executor3894954
100117                   S       uwait   0xfffffe0053f72300  syz-executor3894954
  784   779   777     0  S       nanslp  0xffffffff83e41d00  syz-executor3894954
  783   779   777     0  S       nanslp  0xffffffff83e41d00  syz-executor3894954
  782   780   777     0  R       (threaded)                  syz-executor3894954
100113                   RunQ                                syz-executor3894954
100116                   s                                   syz-executor3894954
  781   779   777     0  S       nanslp  0xffffffff83e41d00  syz-executor3894954
  780   779   777     0  TL                                  syz-executor3894954
  779   777   777     0  S       nanslp  0xffffffff83e41d00  syz-executor3894954
  777   775   777     0  Ss      pause   0xfffffe0058c12b40  csh
  775   688   775     0  Ss      select  0xfffffe0058bebcc0  sshd
  754     1   754     0  Ss+     ttyin   0xfffffe0056fde8b0  getty
  753     1   753     0  Ss+     ttyin   0xfffffe00586c28b0  getty
  752     1   752     0  Ss+     ttyin   0xfffffe00586c30b0  getty
  751     1   751     0  Ss+     ttyin   0xfffffe00586c38b0  getty
  750     1   750     0  Ss+     ttyin   0xfffffe0053f330b0  getty
  749     1   749     0  Ss+     ttyin   0xfffffe0053f338b0  getty
  748     1   748     0  Ss+     ttyin   0xfffffe0053f340b0  getty
  747     1   747     0  Ss+     ttyin   0xfffffe0053f348b0  getty
  746     1   746     0  Ss+     ttyin   0xfffffe0053f350b0  getty
  744     1    18     0  S+      piperd  0xfffffe0058c288b8  logger
  743   742    18     0  S+      nanslp  0xffffffff83e41d00  sleep
  742     1    18     0  S+      wait    0xfffffe0058c14a90  sh
  692     1   692     0  Ss      nanslp  0xffffffff83e41d01  cron
  688     1   688     0  Ss      select  0xfffffe0058bec440  sshd
  501     1   501     0  Ss      select  0xfffffe0058bec4c0  syslogd
  430     1   430     0  Ss      select  0xfffffe0058bec640  devd
  429     1   429    65  Ss      select  0xfffffe0058becd40  dhclient
  344     1   344     0  Ss      select  0xfffffe0058bec6c0  dhclient
  341     1   341     0  Ss      select  0xfffffe0058bec7c0  dhclient
   17     0     0     0  DL      vlruwt  0xfffffe0056fa6548  [vnlru]
   16     0     0     0  DL      syncer  0xffffffff83f67560  [syncer]
   15     0     0     0  DL      (threaded)                  [bufdaemon]
100079                   D       psleep  0xffffffff83f65b60  [bufdaemon]
100082                   D       -       0xffffffff83211f80  [bufspacedaemon-0]
100093                   D       sdflush 0xfffffe0056fad4e8  [/ worker]
    9     0     0     0  DL      psleep  0xffffffff83f99600  [vmdaemon]
    8     0     0     0  DL      (threaded)                  [pagedaemon]
100077                   D       psleep  0xffffffff83f8d4b8  [dom0]
100083                   D       launds  0xffffffff83f8d4c4  [laundry: dom0]
100084                   D       umarcl  0xffffffff81eb17b0  [uma]
    7     0     0     0  DL      -       0xffffffff83bfe328  [rand_harvestq]
    6     0     0     0  RL                                  [pf purge]
    5     0     0     0  DL      waiting 0xffffffff84a3e4a0  [sctp_iterator]
    4     0     0     0  DL      (threaded)                  [cam]
100044                   D       -       0xffffffff83aa12c0  [doneq0]
100045                   D       -       0xffffffff83aa1240  [async]
100076                   D       -       0xffffffff83aa10c0  [scanner]
   14     0     0     0  DL      seqstat 0xfffffe0053fafc88  [sequencer 00]
    3     0     0     0  DL      (threaded)                  [crypto]
100040                   D       crypto_ 0xffffffff83f88ce0  [crypto]
100041                   D       crypto_ 0xfffffe0053f6c030  [crypto returns 0]
100042                   D       crypto_ 0xfffffe0053f6c080  [crypto returns 1]
   13     0     0     0  DL      (threaded)                  [geom]
100035                   D       -       0xffffffff83e17300  [g_event]
100036                   D       -       0xffffffff83e17320  [g_up]
100037                   D       -       0xffffffff83e17340  [g_down]
    2     0     0     0  WL      (threaded)                  [clock]
100029                   I                                   [clock (0)]
100030                   I                                   [clock (1)]
   12     0     0     0  WL      (threaded)                  [intr]
100015                   I                                   [swi5: fast taskq]
100018                   I                                   [swi6: task queue]
100019                   I                                   [swi6: Giant taskq]
100031                   I                                   [swi1: netisr 0]
100032                   I                                   [swi1: hpts]
100033                   I                                   [swi1: hpts]
100046                   I                                   [irq24: virtio_pci0]
100047                   I                                   [irq25: virtio_pci0]
100048                   I                                   [irq26: virtio_pci0]
100049                   I                                   [irq27: virtio_pci0]
100050                   I                                   [irq28: virtio_pci1]
100051                   I                                   [irq29: virtio_pci1]
100052                   I                                   [irq30: virtio_pci1]
100053                   I                                   [irq31: virtio_pci1]
100054                   I                                   [irq32: virtio_pci1]
100059                   I                                   [irq33: virtio_pci2]
100060                   I                                   [irq34: virtio_pci2]
100061                   I                                   [irq35: virtio_pci2]
100063                   I                                   [irq1: atkbd0]
100064                   I                                   [irq12: psm0]
100065                   I                                   [swi0: uart uart++]
100069                   I                                   [swi1: pf send]
   11     0     0     0  RL      (threaded)                  [idle]
100003                   CanRun                              [idle: cpu0]
100004                   CanRun                              [idle: cpu1]
    1     0     1     0  SLs     wait    0xfffffe0053dd8000  [init]
   10     0     0     0  DL      audit_w 0xffffffff83f897c0  [audit]
    0     0     0     0  DLs     (threaded)                  [kernel]
100000                   D       swapin  0xffffffff83e17d00  [swapper]
100005                   D       -       0xfffffe00081f8e00  [if_config_tqg_0]
100006                   D       -       0xfffffe00081f8d00  [softirq_0]
100007                   D       -       0xfffffe00081f8c00  [softirq_1]
100008                   D       -       0xfffffe00081f8b00  [if_io_tqg_0]
100009                   D       -       0xfffffe00081f8a00  [if_io_tqg_1]
100010                   D       -       0xfffffe0007972600  [inm_free taskq]
100011                   D       -       0xfffffe0007972400  [linuxkpi_irq_wq]
100012                   D       -       0xfffffe0007972200  [in6m_free taskq]
100013                   D       -       0xfffffe0007972000  [deferred_unmount ta]
100014                   D       -       0xfffffe0007971d00  [thread taskq]
100016                   D       -       0xfffffe0007971900  [kqueue_ctx taskq]
100017                   D       -       0xfffffe0007971700  [pci_hp taskq]
100020                   D       -       0xfffffe0007971100  [aiod_kick taskq]
100021                   D       -       0xfffffe0007970e00  [linuxkpi_short_wq_0]
100022                   D       -       0xfffffe0007970e00  [linuxkpi_short_wq_1]
100023                   D       -       0xfffffe0007970e00  [linuxkpi_short_wq_2]
100024                   D       -       0xfffffe0007970e00  [linuxkpi_short_wq_3]
100025                   D       -       0xfffffe0007970900  [linuxkpi_long_wq_0]
100026                   D       -       0xfffffe0007970900  [linuxkpi_long_wq_1]
100027                   D       -       0xfffffe0007970900  [linuxkpi_long_wq_2]
100028                   D       -       0xfffffe0007970900  [linuxkpi_long_wq_3]
100034                   D       -       0xfffffe0053ee7300  [firmware taskq]
100038                   D       -       0xfffffe0053ee6d00  [crypto_0]
100039                   D       -       0xfffffe0053ee6d00  [crypto_1]
100055                   D       -       0xfffffe0053ee5b00  [vtnet0 rxq 0]
100056                   D       -       0xfffffe0053ee5a00  [vtnet0 txq 0]
100057                   D       -       0xfffffe0053ee5900  [vtnet0 rxq 1]
100058                   D       -       0xfffffe0053ee5800  [vtnet0 txq 1]
100062                   D       vtbslp  0xfffffe0056f7c280  [virtio_balloon]
100066                   D       -       0xffffffff82bcccc0  [deadlkres]
100070                   D       -       0xfffffe0007973200  [mca taskq]
100072                   D       -       0xfffffe005789a600  [acpi_task_0]
100073                   D       -       0xfffffe005789a600  [acpi_task_1]
100074                   D       -       0xfffffe005789a600  [acpi_task_2]
100075                   D       -       0xfffffe0053ee6600  [CAM taskq]
db> show all locks
Process 787 (syz-executor3894954) thread 0xfffffe0058ce63a0 (100118)
exclusive sleep mutex process lock (process lock) r = 0 (0xfffffe0058dc8670) locked @ /syzkaller/managers/main/kernel/sys/kern/kern_fork.c:324
Process 786 (syz-executor3894954) thread 0xfffffe009e9293a0 (100115)
exclusive sleep mutex umtxql (umtxql) r = 0 (0xffffffff83e63450) locked @ /syzkaller/managers/main/kernel/sys/kern/kern_umtx.c:1267
Process 782 (syz-executor3894954) thread 0xfffffe0058ce6ac0 (100116)
exclusive sx sapblk (sapblk) r = 0 (0xffffffff83e300a0) locked @ /syzkaller/managers/main/kernel/sys/kern/kern_proc.c:3405
db> show malloc
              Type        InUse        MemUse     Requests
           pf_hash            5        11524K            5
          tcp_hpts            7         4801K            7
            devbuf         4217         4323K         4242
         sysctloid        35322         2081K        35393
             vtbuf           24         1968K           46
              kobj          328         1312K          489
            newblk          552         1162K          591
          vfscache            3         1025K            3
               pcb           27          546K           50
          inodedep           26          522K           71
         ufs_quota            1          512K            1
          vfs_hash            1          512K            1
           callout            2          512K            2
              intr            4          472K            4
           subproc          106          214K          846
            acpica         1674          184K        57552
         vnet_data            1          168K            1
              vmem            3          146K            4
           tidhash            3          141K            3
            linker          358          134K          386
           pagedep            8          130K           18
        tfo_ccache            1          128K            1
               sem            4          106K            4
            DEVFS1          105          105K          114
               bus          994           81K         5207
          mtx_pool            2           72K            2
          syncache            1           68K            1
            module          513           65K          513
          acpitask            1           64K            1
       ddb_capture            1           64K            1
           kdtrace          168           33K          908
              temp           18           33K         1607
         hostcache            1           32K            1
               shm            1           32K            1
            DEVFS3          124           31K          134
              umtx          242           31K          242
               msg            4           30K            4
        gtaskqueue           18           26K           18
            kbdmux            6           22K            6
        DEVFS_RULE           56           20K           56
               BPF           10           18K           10
         ufs_mount            4           17K            5
              proc            3           17K            3
               tty           16           16K           16
           ithread           97           16K           97
            bus-sc           34           15K         1681
            KTRACE          100           13K          100
              kenv           95           12K           95
      eventhandler          134           12K          134
            ifaddr           30           12K           32
              rman           88           11K          431
              GEOM           61           11K          490
          routetbl           50           11K          176
         CAM queue            5           11K         1528
              UART           12            9K           12
           devstat            4            9K            4
           filemon            1            8K            2
              ksem            1            8K            1
               rpc            2            8K            2
         bmsafemap            1            8K           40
             shmfd            1            8K            1
       pfs_vncache            1            8K            1
              cred           30            8K          234
         pfs_nodes           20            8K           20
     audit_evclass          237            8K          296
         taskqueue           63            7K           63
            sglist            5            7K            5
           CAM DEV            3            6K          510
       ufs_dirhash           24            5K           24
               UMA          272            5K          272
            plimit           17            5K          322
                vt           11            5K           11
             ifnet            3            5K            3
           memdesc            1            4K            1
               MCA           32            4K           32
          filedesc            1            4K            1
             evdev            4            4K            4
           acpisem           28            4K           28
             hhook           15            4K           17
       ether_multi           40            4K           50
           lltable           11            4K           11
          pf_ifnet            5            3K            6
            kqueue           48            3K          790
           pwddesc           48            3K          789
         in6_multi           25            3K           25
          terminal           11            3K           11
           session           20            3K           31
         proc-args           70            3K         1728
           uidinfo            3            3K            8
        local_apic            1            2K            1
           io_apic            1            2K            1
       fpukern_ctx            2            2K            2
         ipsec-saq            2            2K            2
            Unitno           36            2K           55
             selfd           27            2K         9098
          freefile           13            2K           22
           CAM XPT           22            2K          543
             lockf           15            2K           22
         sctp_atcl            4            2K            6
               msi           12            2K           12
       ipsecpolicy            2            2K            2
           acpidev           20            2K           20
             clone            9            2K            9
           softdep            1            1K            1
            dirrem            4            1K           28
            sahead            1            1K            1
          secasvar            1            1K            1
       vnodemarker            2            1K           10
      NFSD session            1            1K            1
            diradd            7            1K           36
        CAM periph            4            1K          271
            select            7            1K           29
             ipsec            3            1K            3
          indirdep            3            1K            3
             nhops            6            1K            6
         toponodes            6            1K            6
            isadev            6            1K            6
             mount           16            1K           89
          pci_link           10            1K           10
          sctp_ifa            5            1K            6
            crypto            4            1K            4
            ip6ndp            4            1K            5
 encap_export_host           12            1K           12
         newdirblk            4            1K            8
             mkdir            4            1K           16
          in_multi            2            1K            4
              pfil            4            1K            4
              cdev            2            1K            2
    chacha20random            1            1K            1
               osd            7            1K           18
            DEVFSP            5            1K           11
       inpcbpolicy           10            1K          139
          sctp_ifn            2            1K            6
      NFSD lckfile            1            1K            1
     NFSD V4client            1            1K            1
             DEVFS            9            1K           10
          freework            1            1K           26
               mld            2            1K            2
              igmp            2            1K            2
            vnodes            1            1K            1
           CAM SIM            2            1K            2
            feeder            7            1K            7
           tcpfunc            3            1K            3
            CC Mem            3            1K            7
        loginclass            3            1K            7
            prison            6            1K            6
       lkpikmalloc            5            1K            6
        aesni_data            2            1K            2
         cryptodev            2            1K           49
         sctp_atky            4            1K            6
          nexusdev            8            1K            8
            apmdev            1            1K            1
          atkbddev            2            1K            2
     CAM dev queue            2            1K            2
 CAM I/O Scheduler            1            1K            1
          CAM path            4            1K         1034
          procdesc            1            1K            6
          pmchooks            1            1K            1
            soname            4            1K         3471
          filecaps            4            1K           66
               tun            3            1K            3
          sctp_vrf            1            1K            1
         sctp_athm            4            1K            6
              vnet            1            1K            1
           entropy            2            1K           35
               pmc            1            1K            1
          acpiintr            1            1K            1
              cpus            2            1K            2
    vnet_data_free            1            1K            1
           Per-cpu            1            1K            1
          p1003.1b            1            1K            1
            tcp_do            0            0K            0
           tcp_fsb            0            0K            0
        sctp_mcore            0            0K            0
        sctp_socko            0            0K            0
         sctp_iter            0            0K            4
         sctp_mvrf            0            0K            0
         sctp_timw            0            0K            0
         sctp_cpal            0            0K            0
         sctp_cmsg            0            0K            0
         sctp_stre            0            0K            0
         sctp_athi            0            0K            0
         sctp_a_it            0            0K            4
         sctp_aadr            0            0K            0
         sctp_stro            0            0K            0
         sctp_stri            0            0K            0
          sctp_map            0            0K            0
          pf_table            0            0K            0
           pf_rule            0            0K            0
           pf_altq            0            0K            0
           pf_osfp            0            0K            0
           pf_temp            0            0K            0
            mqdata            0            0K            0
            ipcomp            0            0K            0
               esp            0            0K            0
                ah            0            0K            0
   NFSCL layrecall            0            0K            0
     NFSCL session            0            0K            0
        madt_table            0            0K            2
          smartpqi            0            0K            0
     NFSCL sockreq            0            0K            0
     NFSCL devinfo            0            0K            0
     NFSCL flayout            0            0K            0
               ixl            0            0K            0
      NFSCL layout            0            0K            0
     NFSD rollback            0            0K            0
      NFSCL diroff            0            0K            0
       NEWdirectio            0            0K            0
        NEWNFSnode            0            0K            0
         NFSCL lck            0            0K            0
      NFSCL lckown            0            0K            0
        ice-resmgr            0            0K            0
         ice-osdep            0            0K            0
               ice            0            0K            0
              iavf            0            0K            0
             axgbe            0            0K            0
      NFSCL client            0            0K            0
       NFSCL deleg            0            0K            0
        NFSCL open            0            0K            0
       NFSCL owner            0            0K            0
            NFS fh            0            0K            0
           NFS req            0            0K            0
     NFSD usrgroup            0            0K            0
       NFSD string            0            0K            0
       NFSD V4lock            0            0K            0
          xen_intr            0            0K            0
      NFSD V4state            0            0K            0
           xen_hvm            0            0K            0
         legacydrv            0            0K            0
            bounce            0            0K            0
            busdma            0            0K            0
            qpidrv            0            0K            0
     NFSD srvcache            0            0K            0
       msdosfs_fat            0            0K            0
      dmar_idpgtbl            0            0K            0
          dmar_dom            0            0K            0
          dmar_ctx            0            0K            0
     msdosfs_mount            0            0K            0
      msdosfs_node            0            0K            0
              isci            0            0K            0
      iommu_dmamap            0            0K            0
     hyperv_socket            0            0K            0
           bxe_ilt            0            0K            0
            xenbus            0            0K            0
            DEVFS4            0            0K            0
     vm_fictitious            0            0K            0
            DEVFS2            0            0K            0
            gntdev            0            0K            0
       privcmd_dev            0            0K            0
        evtchn_dev            0            0K            0
          xenstore            0            0K            0
         scsi_pass            0            0K            0
         ciss_data            0            0K            0
               xnb            0            0K            0
          xen_acpi            0            0K            0
              xbbd            0            0K            0
               xbd            0            0K            0
           UMAHash            0            0K            0
           Balloon            0            0K            0
          sysmouse            0            0K            0
         vm_pgdata            0            0K            0
           jblocks            0            0K            0
          savedino            0            0K           18
          sentinel            0            0K            0
            jfsync            0            0K            0
            jtrunc            0            0K            0
             sbdep            0            0K            3
           jsegdep            0            0K            0
              jseg            0            0K            0
         jfreefrag            0            0K            0
          jfreeblk            0            0K            0
           jnewblk            0            0K            0
            jmvref            0            0K            0
           jremref            0            0K            0
           jaddref            0            0K            0
           freedep            0            0K            0
          freeblks            0            0K           25
          freefrag            0            0K            1
        allocindir            0            0K            0
       allocdirect            0            0K            0
          ufs_trim            0            0K            0
           mactemp            0            0K            0
     audit_trigger            0            0K            0
 audit_pipe_presel            0            0K            0
     audit_pipeent            0            0K            0
        audit_pipe            0            0K            0
      audit_evname            0            0K            0
         audit_bsm            0            0K            0
      audit_gidset            0            0K            0
        audit_text            0            0K            0
        audit_path            0            0K            0
        audit_data            0            0K            0
        audit_cred            0            0K            0
            vtfont            0            0K            0
         BACKLIGHT            0            0K            0
           ath_hal            0            0K            0
            athdev            0            0K            0
           ata_pci            0            0K            0
           ata_dma            0            0K            0
       ata_generic            0            0K            0
            pvscsi            0            0K            0
           scsi_da            0            0K           69
            ata_da            0            0K            0
           scsi_ch            0            0K            0
           scsi_cd            0            0K            0
          ktls_ocf            0            0K            0
       AHCI driver            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
      MLX5E_TLS_RX            0            0K            0
        MLX5EEPROM            0            0K            0
         MLX5E_TLS            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
            MLX5EN            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
          MLX5DUMP            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
          seq_file            0            0K            0
           lkpiskb            0            0K            0
             radix            0            0K            0
               idr            0            0K            0
          lkpindev            0            0K            0
            lkpifw            0            0K            0
         lkpi80211            0            0K            0
               NLM            0            0K            0
    ipsec-spdcache            0            0K            0
         ipsec-reg            0            0K            0
        ipsec-misc            0            0K            0
      ipsecrequest            0            0K            0
            ip6opt            0            0K            3
       ip6_msource            0            0K            0
      ip6_moptions            0            0K            0
       in6_mfilter            0            0K            0
             frag6            0            0K            0
            tcplog            0            0K            0
        tcp_hwpace            0            0K            0
            USBdev            0            0K            0
               USB            0            0K            0
               LRO            0            0K            0
        ip_msource            0            0K            0
       ip_moptions            0            0K            0
        in_mfilter            0            0K            0
              ipid            0            0K            0
         80211scan            0            0K            0
      80211ratectl            0            0K            0
        80211power            0            0K            0
       80211nodeie            0            0K            0
         80211node            0            0K            0
      80211mesh_gt            0            0K            0
      80211mesh_rt            0            0K            0
         80211perr            0            0K            0
         80211prep            0            0K            0
         80211preq            0            0K            0
          80211dfs            0            0K            0
       80211crypto            0            0K            0
          80211vap            0            0K            0
             iflib            0            0K            0
              vlan            0            0K            0
               gif            0            0K            0
           ifdescr            0            0K            0
              zlib            0            0K            0
           fadvise            0            0K            0
           VN POLL            0            0K            0
               agp            0            0K            0
            statfs            0            0K          196
     namei_tracker            0            0K            0
       export_host            0            0K            0
        cl_savebuf            0            0K            4
           nvme_da            0            0K            0
           acpipwr            0            0K            0
         acpi_perf            0            0K            0
            twsbuf            0            0K            0
      twe_commands            0            0K            0
       tcp_log_dev            0            0K            0
      midi buffers            0            0K            0
             mixer            0            0K            0
              ac97            0            0K            0
             hdacc            0            0K            0
              hdac            0            0K            0
              hdaa            0            0K            0
         acpicmbat            0            0K            0
       SIIS driver            0            0K            0
           CAM CCB            0            0K          523
            biobuf            0            0K            0
              aios            0            0K            0
               lio            0            0K            0
               acl            0            0K            0
          mbuf_tag            0            0K           27
              ktls            0            0K            0
               PUC            0            0K            0
          ppbusdev            0            0K            0
agtiapi_MemAlloc malloc            0            0K            0
    osti_cacheable            0            0K            0
          tempbuff            0            0K            0
          tempbuff            0            0K            0
ag_tgt_map_t malloc            0            0K            0
ag_slr_map_t malloc            0            0K            0
lDevFlags * malloc            0            0K            0
tiDeviceHandle_t * malloc            0            0K            0
ag_portal_data_t malloc            0            0K            0
ag_device_t malloc            0            0K            0
     STLock malloc            0            0K            0
          CCB List            0            0K            0
            sr_iov            0            0K            0
               OCS            0            0K            0
               OCS            0            0K            0
              nvme            0            0K            0
               nvd            0            0K            0
            netmap            0            0K            0
            mwldev            0            0K            0
        MVS driver            0            0K            0
     CAM ccb queue            0            0K            0
              accf            0            0K            0
               pts            0            0K            0
               iov            0            0K        13498
          ioctlops            0            0K           86
           eventfd            0            0K            0
           Witness            0            0K            0
             stack            0            0K            0
          mrsasbuf            0            0K            0
          mpt_user            0            0K            0
          mps_user            0            0K            0
            MPSSAS            0            0K            0
               mps            0            0K            0
              sbuf            0            0K          288
          mpr_user            0            0K            0
          firmware            0            0K            0
        compressor            0            0K            0
            MPRSAS            0            0K            0
              SWAP            0            0K            0
               mpr            0            0K            0
            mfibuf            0            0K            0
         sysctltmp            0            0K          658
            sysctl            0            0K            3
        md_sectors            0            0K            0
              ekcd            0            0K            0
            dumper            0            0K            0
          sendfile            0            0K            0
              rctl            0            0K            0
           md_disk            0            0K            0
           malodev            0            0K            0
               LED            0            0K            0
          ix_sriov            0            0K            0
             cache            0            0K            0
        aacraidcam            0            0K            0
          kcovinfo            0            0K            0
      prison_racct            0            0K            0
       Fail Points            0            0K            0
             sigio            0            0K            1
filedesc_to_leader            0            0K            0
               pwd            0            0K            0
       tty console            0            0K            0
                ix            0            0K            0
            ipsbuf            0            0K            0
       aacraid_buf            0            0K            0
            aaccam            0            0K            0
         boottrace            0            0K            0
            aacbuf            0            0K            0
              zstd            0            0K            0
            XZ_DEC            0            0K            0
            nvlist            0            0K            0
          SCSI ENC            0            0K            0
           SCSI sa            0            0K            0
        isofs_node            0            0K            0
       isofs_mount            0            0K            0
     tr_raid5_data            0            0K            0
    tr_raid1e_data            0            0K            0
     tr_raid1_data            0            0K            0
     tr_raid0_data            0            0K            0
    tr_concat_data            0            0K            0
       md_sii_data            0            0K            0
   md_promise_data            0            0K            0
    md_nvidia_data            0            0K            0
   md_jmicron_data            0            0K            0
     md_intel_data            0            0K            0
       md_ddf_data            0            0K            0
         raid_data            0            0K           72
     geom_flashmap            0            0K            0
         tmpfs dir            0            0K            0
        tmpfs name            0            0K            0
       tmpfs mount            0            0K            0
           NFS FHA            0            0K            0
         newnfsmnt            0            0K            0
  newnfsclient_req            0            0K            0
db> show uma
              Zone   Size    Used    Free    Requests  Sleeps  Bucket  Total Mem    XFree
   mbuf_jumbo_page   4096    8320    1078       13389       0     254   38494208        0
              pbuf   2624       0     989           0       0       2    2595136        0
              mbuf    256    8577    1085       15814       0     254    2473472        0
          BUF TRIE    144     171   11617         458       0      62    1697472        0
        malloc-384    384    4199      31        4199       0      30    1624320        0
       malloc-4096   4096     382       2        1906       0       2    1572864        0
        malloc-128    128   11711     162       15056       0     126    1519744        0
       UMA Slabs 0    112   10591      23       10591       0     126    1188768        0
      mbuf_cluster   2048     508       0         508       0     254    1040384        0
         vmem btag     56   16596      75       16596       0     254     933576        0
           sctp_ep   1208       4     506           6       0     254     616080        0
         FFS inode   1160     486      32         509       0       8     600880        0
             tcpcb   1104       3     508           7       0     254     564144        0
        RADIX NODE    144    3297     142       19934       0      62     495216        0
            socket    960      22     486        1341       0     254     487680        0
      malloc-65536  65536       7       0           7       0       1     458752        0
         VM OBJECT    264    1499      31       24522       0      30     403920        0
            lkpimm    168       1    2327           1       0      62     391104        0
          lkpicurr    168       2    2326           2       0      62     391104        0
        256 Bucket   2048     130      16        1012       0       8     299008        0
         malloc-64     64    3906     441        5298       0     254     278208        0
             VNODE    448     517      59         542       0      30     258048        0
         malloc-16     16   14615     385       14854       0     254     240000        0
            DEVCTL   1024       0     220         126       0       0     225280        0
            THREAD   1808     119       2         119       0       8     218768        0
        malloc-128    128    1279     240       27293       0     126     194432        0
         MAP ENTRY     96    1736     280       84491       0     126     193536        0
         malloc-32     32    5310     612        5780       0     254     189504        0
         UMA Zones    768     244       0         244       0      16     187392        0
       malloc-2048   2048       9      79        1074       0       8     180224        0
       malloc-1024   1024     132      28         142       0      16     163840        0
        malloc-256    256     553      77         615       0      62     161280        0
       FFS2 dinode    256     486      84         508       0      62     145920        0
      malloc-65536  65536       0       2          54       0       1     131072        0
      malloc-65536  65536       0       2         136       0       1     131072        0
      malloc-65536  65536       2       0           2       0       1     131072        0
             unpcb    256       7     503        1179       0     254     130560        0
       mbuf_packet    256       0     508          77       0     254     130048        0
       S VFS Cache    104     966     204        1007       0     126     121680        0
          ksiginfo    112      39    1005          61       0     126     116928        0
        malloc-128    128     615     284        1580       0     126     115072        0
     FPU_save_area    832     121      14         134       0      16     112320        0
          UMA Kegs    384     230       3         230       0      30      89472        0
             g_bio    408       0     210        4656       0      30      85680        0
        128 Bucket   1024      43      40         477       0      16      84992        0
           VMSPACE   2552      31       2         772       0       4      84216        0
       malloc-8192   8192       9       1          11       0       1      81920        0
        malloc-256    256     303      12         337       0      62      80640        0
              PROC   1352      47      10         787       0       8      77064        0
       malloc-4096   4096      14       4          28       0       2      73728        0
         64 Bucket    512      60      76        1667       0      30      69632        0
         malloc-64     64     607     464       14870       0     254      68544        0
        malloc-128    128     288     239         327       0     126      67456        0
        malloc-128    128     290     237         367       0     126      67456        0
      malloc-32768  32768       0       2         120       0       1      65536        0
      malloc-16384  16384       3       1          18       0       1      65536        0
      malloc-16384  16384       4       0           4       0       1      65536        0
         filedesc0   1072      48       8         789       0       8      60032        0
         malloc-64     64     353     466        1884       0     254      52416        0
         malloc-64     64     453     366         653       0     254      52416        0
        malloc-256    256      75     120         277       0      62      49920        0
         32 Bucket    256      63     132        2340       0      62      49920        0
           DIRHASH   1024      35      13          35       0      16      49152        0
             NAMEI   1024       0      48       12235       0      16      49152        0
       malloc-1024   1024       5      43         533       0      16      49152        0
          syncache    168       0     264           5       0     254      44352        0
            clpbuf   2624       0      16          21       0      16      41984        0
       malloc-8192   8192       5       0           6       0       1      40960        0
       Mountpoints   2752       2      12           2       0       4      38528        0
         udp_inpcb    424       6      84         128       0      30      38160        0
            da_ccb    544       0      70        1277       0      16      38080        0
            pcpu-8      8    4223     385        4251       0     254      36864        0
         malloc-64     64      39     528        9134       0     254      36288        0
         malloc-64     64      57     510         120       0     254      36288        0
         malloc-64     64      40     527         273       0     254      36288        0
        malloc-128    128      20     259          75       0     126      35712        0
        malloc-128    128      18     261          23       0     126      35712        0
        malloc-128    128      67     212         136       0     126      35712        0
     routing nhops    256      10     125          17       0      62      34560        0
           ttyoutq    256      72      63         160       0      62      34560        0
        malloc-384    384      25      65          70       0      30      34560        0
        malloc-384    384      58      32         398       0      30      34560        0
        malloc-256    256      49      86         181       0      62      34560        0
        malloc-256    256      48      87         634       0      62      34560        0
        malloc-256    256       4     131         736       0      62      34560        0
        malloc-256    256      18     117         304       0      62      34560        0
        malloc-256    256      70      65         645       0      62      34560        0
      malloc-32768  32768       1       0           1       0       1      32768        0
      malloc-32768  32768       1       0           1       0       1      32768        0
      malloc-32768  32768       1       0           1       0       1      32768        0
      malloc-16384  16384       0       2         160       0       1      32768        0
       malloc-8192   8192       2       2          30       0       1      32768        0
       malloc-8192   8192       2       2         103       0       1      32768        0
       malloc-8192   8192       4       0           4       0       1      32768        0
       malloc-4096   4096       8       0          12       0       2      32768        0
       malloc-2048   2048       4      12          16       0       8      32768        0
       malloc-2048   2048       6      10           7       0       8      32768        0
       malloc-2048   2048       0      16          50       0       8      32768        0
       malloc-2048   2048       3      13         194       0       8      32768        0
       malloc-2048   2048       5      11           7       0       8      32768        0
       malloc-1024   1024       2      30          42       0      16      32768        0
       malloc-1024   1024       3      29           6       0      16      32768        0
       malloc-1024   1024       7      25         880       0      16      32768        0
       malloc-1024   1024      10      22         167       0      16      32768        0
        malloc-512    512       1      63         119       0      30      32768        0
        malloc-512    512       2      62          10       0      30      32768        0
        malloc-512    512       9      55          20       0      30      32768        0
        malloc-512    512       4      60          53       0      30      32768        0
           pcpu-64     64     493      19         493       0     254      32768        0
            ttyinq    160     135      65         300       0      62      32000        0
            cpuset    104       7     272           7       0     126      29016        0
        sctp_laddr     48       0     588           4       0     254      28224        0
         malloc-32     32     293     589        3231       0     254      28224        0
          4 Bucket     48       6     582          54       0     254      28224        0
         tcp_inpcb    424       3      60           7       0      30      26712        0
             ripcb    424       1      62           4       0      30      26712        0
              pipe    744       7      28         284       0      16      26040        0
         TURNSTILE    136     122      67         122       0      62      25704        0
       malloc-4096   4096       2       4         198       0       2      24576        0
           rtentry    176      13     125          17       0      62      24288        0
              PGRP     88      20     256          31       0     126      24288        0
    ertt_txseginfo     40       0     606         216       0     254      24240        0
          rl_entry     40      28     578          28       0     254      24240        0
             Files     80      76     224        6589       0     126      24000        0
          8 Bucket     80      43     257         284       0     126      24000        0
        malloc-384    384      11      49          11       0      30      23040        0
        malloc-384    384       2      58          13       0      30      23040        0
        malloc-384    384       5      55          26       0      30      23040        0
        malloc-384    384       9      51          12       0      30      23040        0
        SLEEPQUEUE     88     122     134         122       0     126      22528        0
         hostcache     64       1     314           1       0     254      20160        0
             udpcb     32       6     624         128       0     254      20160        0
   udp_inpcb ports     32       3     627          40       0     254      20160        0
              ertt     72       3     277           7       0     126      20160        0
               PWD     32      10     620         100       0     254      20160        0
         malloc-64     64       5     310          16       0     254      20160        0
         malloc-32     32      82     548          84       0     254      20160        0
         malloc-32     32      91     539        1194       0     254      20160        0
         malloc-32     32      82     548         159       0     254      20160        0
         malloc-32     32      34     596         781       0     254      20160        0
         malloc-32     32      62     568         221       0     254      20160        0
         16 Bucket    144      45      95         247       0      62      20160        0
          2 Bucket     32      43     587         293       0     254      20160        0
 epoch_record pcpu    256       4      60           4       0      62      16384        0
      malloc-16384  16384       1       0           1       0       1      16384        0
       malloc-8192   8192       2       0           2       0       1      16384        0
       malloc-4096   4096       2       2           2       0       2      16384        0
       malloc-2048   2048       8       0           8       0       8      16384        0
       malloc-1024   1024       3      13           3       0      16      16384        0
       malloc-1024   1024       6      10           6       0      16      16384        0
        malloc-512    512       1      31           1       0      30      16384        0
        malloc-512    512       1      31           1       0      30      16384        0
           SMR CPU     32       7     504           7       0     254      16352        0
              kenv    258      15      45        1037       0      30      15480        0
            mqnode    416       3      33           3       0      30      14976        0
              vmem   1856       1       7           1       0       8      14848        0
        SMR SHARED     24       7     504           7       0     254      12264        0
   tcp_inpcb ports     32       1     377           1       0     254      12096        0
         malloc-32     32       7     371          30       0     254      12096        0
             KNOTE    160       0      75           8       0      62      12000        0
         malloc-16     16      15     735          54       0     254      12000        0
         malloc-16     16      28     722          67       0     254      12000        0
         malloc-16     16     286     464         447       0     254      12000        0
         malloc-16     16      56     694          81       0     254      12000        0
         malloc-16     16     191     559        3110       0     254      12000        0
         malloc-16     16      19     731       26250       0     254      12000        0
         malloc-16     16      38     712        1253       0     254      12000        0
        malloc-384    384      20      10          20       0      30      11520        0
       malloc-8192   8192       1       0           1       0       1       8192        0
       malloc-8192   8192       1       0           1       0       1       8192        0
       malloc-4096   4096       0       2           2       0       2       8192        0
       malloc-4096   4096       1       1           1       0       2       8192        0
           pcpu-16     16      14     498          14       0     254       8192        0
      vtnet_tx_hdr     24       0     334        1542       0     254       8016        0
       UMA Slabs 1    176       9      13           9       0      62       3872        0
        KMAP ENTRY     96      12      27          14       0       0       3744        0
            pcpu-4      4       1     511           1       0     254       2048        0
       FFS1 dinode    128       0       0           0       0     126          0        0
           ada_ccb    272       0       0           0       0      30          0        0
             swblk    136       0       0           0       0      62          0        0
          swpctrie    144       0       0           0       0      62          0        0
   cdg_qdiffsample     16       0       0           0       0     254          0        0
   pf state scrubs     40       0       0           0       0     254          0        0
   pf frag entries     40       0       0           0       0     254          0        0
          pf frags    248       0       0           0       0      62          0        0
  pf table entries    160       0       0           0       0     254          0        0
pf table entry counters     64       0       0           0       0     254          0        0
   pf source nodes    136       0       0           0       0     254          0        0
     pf state keys     88       0       0           0       0     126          0        0
         pf states    312       0       0           0       0     254          0        0
           pf tags    104       0       0           0       0     126          0        0
          pf mtags     56       0       0           0       0     254          0        0
       tcp_bbr_pcb    832       0       0           0       0      16          0        0
       tcp_bbr_map    128       0       0           0       0     126          0        0
      tcp_rack_pcb    896       0       0           0       0      16          0        0
      tcp_rack_map    120       0       0           0       0     126          0        0
tfo_ccache_entries     80       0       0           0       0     126          0        0
               tfo      4       0       0           0       0     254          0        0
          sackhole     32       0       0           0       0     254          0        0
             tcptw     72       0       0           0       0     254          0        0
               ipq     56       0       0           0       0     254          0        0
   sctp_asconf_ack     48       0       0           0       0     254          0        0
       sctp_asconf     40       0       0           0       0     254          0        0
sctp_stream_msg_out    112       0       0           0       0     254          0        0
        sctp_readq    152       0       0           0       0     254          0        0
        sctp_chunk    152       0       0           0       0     254          0        0
        sctp_raddr    736       0       0           0       0     254          0        0
         sctp_asoc   2256       0       0           0       0     254          0        0
   tcp_log_id_node    120       0       0           0       0     126          0        0
 tcp_log_id_bucket    176       0       0           0       0      62          0        0
           tcp_log    416       0       0           0       0     254          0        0
          tcpreass     48       0       0           0       0     254          0        0
       ripcb ports     32       0       0           0       0     254          0        0
udplite_inpcb ports     32       0       0           0       0     254          0        0
     udplite_inpcb    424       0       0           0       0      30          0        0
    IPsec SA lft_c     16       0       0           0       0     254          0        0
            itimer    352       0       0           0       0      30          0        0
            AIOLIO    272       0       0           0       0      30          0        0
             AIOCB    552       0       0           0       0      16          0        0
              AIOP     32       0       0           0       0     254          0        0
               AIO    208       0       0           0       0      62          0        0
        TMPFS node    224       0       0           0       0      62          0        0
           NCLNODE    608       0       0           0       0      16          0        0
        mqnotifier    216       0       0           0       0      62          0        0
            mvdata     64       0       0           0       0     254          0        0
            mqueue    248       0       0           0       0      62          0        0
     LTS VFS Cache    360       0       0           0       0      30          0        0
       L VFS Cache    320       0       0           0       0      30          0        0
     STS VFS Cache    144       0       0           0       0      62          0        0
           cryptop    280       0       0           0       0      30          0        0
  linux_dma_object     32       0       0           0       0     254          0        0
  linux_dma_pctrie    144       0       0           0       0      62          0        0
   IOMMU_MAP_ENTRY    120       0       0           0       0     126          0        0
    mbuf_jumbo_16k  16384       0       0           0       0     254          0        0
     mbuf_jumbo_9k   9216       0       0           0       0     254          0        0
      audit_record   1280       0       0           0       0       8          0        0
         domainset     40       0       0           0       0     254          0        0
        MAC labels     40       0       0           0       0     254          0        0
            vnpbuf   2624       0       0           0       0      64          0        0
            mdpbuf   2624       0       0           0       0       3          0        0
           nfspbuf   2624       0       0           0       0      16          0        0
            swwbuf   2624       0       0           0       0       8          0        0
            swrbuf   2624       0       0           0       0      16          0        0
          umtx_shm     88       0       0           0       0     126          0        0
           umtx pi     96       0       0           0       0     126          0        0
rangeset pctrie nodes    144       0       0           0       0      62          0        0
      malloc-65536  65536       0       0           0       0       1          0        0
      malloc-65536  65536       0       0           0       0       1          0        0
      malloc-65536  65536       0       0           0       0       1          0        0
      malloc-65536  65536       0       0           0       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
      malloc-16384  16384       0       0           0       0       1          0        0
      malloc-16384  16384       0       0           0       0       1          0        0
      malloc-16384  16384       0       0           0       0       1          0        0
      malloc-16384  16384       0       0           0       0       1          0        0
       malloc-4096   4096       0       0           0       0       2          0        0
       malloc-2048   2048       0       0           0       0       8          0        0
        malloc-512    512       0       0           0       0      30          0        0
        malloc-512    512       0       0           0       0      30          0        0
           pcpu-32     32       0       0           0       0     254          0        0
            fakepg    104       0       0           0       0     126          0        0
          UMA Hash    256       0       0           0       0      62          0        0

Crashes (11):
Manager Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets Title
ci-freebsd-main 2022/05/08 06:31 freebsd-src cbbce42345c5 e60b1103 console log report syz C panic: td ADDR is not suspended
ci-freebsd-main 2022/06/12 20:57 freebsd-src 987d26ee3f7a 0d5abf15 console log report panic: td ADDR is not suspended
ci-freebsd-main 2022/05/28 06:44 freebsd-src 076002f24d35 a46af346 console log report panic: td ADDR is not suspended
ci-freebsd-main 2022/05/23 23:41 freebsd-src f16e38162c75 e7f9308d console log report panic: td ADDR is not suspended
ci-freebsd-main 2022/05/23 11:33 freebsd-src b387a075d9db 4c7657cb console log report panic: td ADDR is not suspended
ci-freebsd-main 2022/05/15 12:46 freebsd-src 9b2a35b3a96b 744a39e2 console log report panic: td ADDR is not suspended
ci-freebsd-main 2022/05/10 02:29 freebsd-src 10f44229dcd9 8b277b8e console log report panic: td ADDR is not suspended
ci-freebsd-main 2022/05/08 03:54 freebsd-src cbbce42345c5 e60b1103 console log report panic: td ADDR is not suspended
ci-freebsd-main 2022/05/07 00:34 freebsd-src 90161e72eecd e60b1103 console log report panic: td ADDR is not suspended
ci-freebsd-main 2022/04/30 09:43 freebsd-src 00614c9c2ddc 2df221f6 console log report panic: td ADDR is not suspended
ci-freebsd-main 2022/04/28 14:10 freebsd-src 25768526bbed 7c337266 console log report panic: td ADDR is not suspended
* Struck through repros no longer work on HEAD.