syzbot


panic: _mtx_lock_sleep: recursed on non-recursive mutex sctp-tcb @ /syzkaller/managers/i386/kernel/sys/netinet/sctp_pcb. (3)

Status: auto-obsoleted due to no activity on 2023/09/26 23:02
Reported-by: syzbot+30113743a960f51dcb40@syzkaller.appspotmail.com
First crash: 309d, last: 309d
Similar bugs (2)
Kernel Title Repro Cause bisect Fix bisect Count Last Reported Patched Status
freebsd panic: _mtx_lock_sleep: recursed on non-recursive mutex sctp-tcb @ /syzkaller/managers/i386/kernel/sys/netinet/sctp_pcb. syz 3 1084d 1288d 0/2 closed as dup on 2021/09/07 22:01
freebsd panic: _mtx_lock_sleep: recursed on non-recursive mutex sctp-tcb @ /syzkaller/managers/i386/kernel/sys/netinet/sctp_pcb. (2) 1 677d 677d 0/2 auto-obsoleted due to no activity on 2022/09/23 23:19

Sample crash report:
panic: _mtx_lock_sleep: recursed on non-recursive mutex sctp-tcb @ /syzkaller/managers/i386/kernel/sys/netinet/sctp_pcb.c:3374

cpuid = 1
time = 1687993319
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0xc6/frame 0xfffffe0053fb9c70
kdb_backtrace() at kdb_backtrace+0xd0/frame 0xfffffe0053fb9dd0
vpanic() at vpanic+0x252/frame 0xfffffe0053fb9eb0
panic() at panic+0xb5/frame 0xfffffe0053fb9f70
__mtx_lock_sleep() at __mtx_lock_sleep+0xa04/frame 0xfffffe0053fba0b0
__mtx_lock_flags() at __mtx_lock_flags+0x23d/frame 0xfffffe0053fba1a0
sctp_inpcb_free() at sctp_inpcb_free+0x6da/frame 0xfffffe0053fba230
sctp_free_assoc() at sctp_free_assoc+0x428e/frame 0xfffffe0053fba390
sctp_load_addresses_from_init() at sctp_load_addresses_from_init+0x1d66/frame 0xfffffe0053fbb180
sctp_handle_init_ack() at sctp_handle_init_ack+0x51a/frame 0xfffffe0053fbb2b0
sctp_process_control() at sctp_process_control+0x319d/frame 0xfffffe0053fbb7c0
sctp_common_input_processing() at sctp_common_input_processing+0xe01/frame 0xfffffe0053fbba20
sctp_input_with_port() at sctp_input_with_port+0x5ab/frame 0xfffffe0053fbbbb0
sctp_input() at sctp_input+0x31/frame 0xfffffe0053fbbbd0
ip_input() at ip_input+0xac9/frame 0xfffffe0053fbbcf0
swi_net() at swi_net+0x2f3/frame 0xfffffe0053fbbd90
ithread_loop() at ithread_loop+0x4eb/frame 0xfffffe0053fbbef0
fork_exit() at fork_exit+0xd1/frame 0xfffffe0053fbbf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0053fbbf30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
KDB: enter: panic
[ thread pid 12 tid 100031 ]
Stopped at      kdb_enter+0x6e: movq    $0,0x2133c87(%rip)
db> 
db> set $lines = 0
db> set $maxwidth = 0
db> show registers
cs                        0x20
ds                        0x3b
es                        0x3b
fs                        0x13
gs                        0x1b
ss                           0
rax                       0x12
rcx         0xffffffff815cd525  printf+0xf5
rdx                        0x1
rbx         0xffffffff826ba6e0  .str.26
rsp         0xfffffe0053fb9db0
rbp         0xfffffe0053fb9dd0
rsi                          0
rdi         0xffffffff815cd586  printf+0x156
r8                           0
r9                  0xffffffff
r10                          0
r11                        0x2
r12         0xfffffe005428a560
r13         0xfffffffffffffffd
r14         0xffffffff826ba6e0  .str.26
r15                          0
rip         0xffffffff815bd40e  kdb_enter+0x6e
rflags                    0x46
kdb_enter+0x6e: movq    $0,0x2133c87(%rip)
db> show proc
Process 12 (intr) at 0xfffffe00541de580:
 state: NORMAL
 uid: 0  gids: 0
 parent: pid 0 at 0xffffffff836a9060
 ABI: null
 flag: 0x10000284  flag2: 0
 reaper: 0xffffffff836a9060 reapsubtree: 12
 sigparent: 20
 vmspace: 0xffffffff836aa000
   (map 0xffffffff836aa000)
   (map.pmap 0xffffffff836aa0c0)
   (pmap 0xffffffff836aa130)
 threads: 22
100016                   I                                   [swi5: fast taskq]
100019                   I                                   [swi6: task queue]
100020                   I                                   [swi6: Giant taskq]
100031                   Run     CPU 1                       [swi1: netisr 0]
100032                   I                                   [swi1: hpts]
100033                   I                                   [swi1: hpts]
100046                   I                                   [irq24: virtio_pci0]
100047                   I                                   [irq25: virtio_pci0]
100048                   I                                   [irq26: virtio_pci0]
100049                   I                                   [irq27: virtio_pci0]
100050                   I                                   [irq28: virtio_pci1]
100051                   I                                   [irq29: virtio_pci1]
100052                   I                                   [irq30: virtio_pci1]
100053                   I                                   [irq31: virtio_pci1]
100054                   I                                   [irq32: virtio_pci1]
100059                   I                                   [irq33: virtio_pci2]
100060                   I                                   [irq34: virtio_pci2]
100061                   I                                   [irq35: virtio_pci2]
100063                   I                                   [irq1: atkbd0]
100064                   I                                   [irq12: psm0]
100065                   I                                   [swi0: uart uart++]
100069                   I                                   [swi1: pf send]
db> ps
  pid  ppid  pgrp   uid  state   wmesg   wchan               cmd
30619   776   776     0  R       (threaded)                  syz-executor.0
142811                   Run     CPU 0                       syz-executor.0
144454                   RunQ                                syz-executor.0
30618   779   779     0  R       (threaded)                  syz-executor.2
144389                   RunQ                                syz-executor.2
144451                   RunQ                                syz-executor.2
144452                   S       uwait   0xfffffe00793d6b00  syz-executor.2
144453                   S       uwait   0xfffffe00793d7980  syz-executor.2
30613   794   794     0  R       (threaded)                  syz-executor.3
144075                   RunQ                                syz-executor.3
144439                   S       connec  0xfffffe007949f0da  syz-executor.3
144441                   S       connec  0xfffffe00794c5c1a  syz-executor.3
144442                   S       uwait   0xfffffe00793d7280  syz-executor.3
30552     1 30549     0  SV      uwait   0xfffffe00793d6c00  syz-executor.3
30528     1   776     0  T       uwait   0xfffffe00793d8400  syz-executor.0
30213     1   777     0  S       uwait   0xfffffe00785eac80  syz-executor.1
29930     1   777     0  S       umtxn   0xfffffe00785ec380  syz-executor.1
29766     1   777     0  S       uwait   0xfffffe00793d8900  syz-executor.1
29700     0     0     0  DL      mdwait  0xfffffe00776e2000  [md19]
29693     0     0     0  DL      mdwait  0xfffffe007ba59000  [md18]
29688     0     0     0  DL      mdwait  0xfffffe007ba4d000  [md17]
29686     0     0     0  DL      mdwait  0xfffffe007ba5a000  [md16]
28619     1   776     0  S       uwait   0xfffffe00793da800  syz-executor.0
28612     1   776     0  S       uwait   0xfffffe00785eab80  syz-executor.0
28606     1   776     0  S       umtxn   0xfffffe00785ea880  syz-executor.0
28600     1   776     0  S       umtxn   0xfffffe00793d8e80  syz-executor.0
28422     1   777     0  S       uwait   0xfffffe00793d8600  syz-executor.1
28399     1   779     0  S       uwait   0xfffffe00793da000  syz-executor.2
28372     1 28368     0  S       uwait   0xfffffe00793d7880  syz-executor.0
28067     1   779     0  S       uwait   0xfffffe00793d8300  syz-executor.2
27999     1   776     0  S       uwait   0xfffffe007ab33680  syz-executor.0
27992     1   779     0  S       uwait   0xfffffe00793dad00  syz-executor.2
27985     1   776     0  S       uwait   0xfffffe00785ebc00  syz-executor.0
27977     1   779     0  S       umtxn   0xfffffe00793da100  syz-executor.2
27968     1   776     0  S       umtxn   0xfffffe00785ec000  syz-executor.0
27963     1   779     0  S       uwait   0xfffffe00793da900  syz-executor.2
27954     1   779     0  S       umtxn   0xfffffe00785eb200  syz-executor.2
27752     1   779     0  S       uwait   0xfffffe00793d8700  syz-executor.2
27748     1   779     0  S       uwait   0xfffffe007aee7280  syz-executor.2
27746     1   779     0  S       uwait   0xfffffe00785ebb00  syz-executor.2
27742     1   779     0  S       uwait   0xfffffe00785ebe80  syz-executor.2
27626     1   779     0  S       uwait   0xfffffe007aee7500  syz-executor.2
27624     1   779     0  S       umtxn   0xfffffe00793d8800  syz-executor.2
27614     1   779     0  S       uwait   0xfffffe0077fb0d00  syz-executor.2
27612     1   779     0  S       uwait   0xfffffe00785eb500  syz-executor.2
27426     0     0     0  DL      mdwait  0xfffffe007982a000  [md15]
27422     0     0     0  DL      mdwait  0xfffffe007ad89000  [md14]
27418     0     0     0  DL      mdwait  0xfffffe007982b000  [md13]
27416     0     0     0  DL      mdwait  0xfffffe007ad79000  [md12]
27315     1   794     0  S       uwait   0xfffffe007aee8100  syz-executor.3
27313     1   777     0  S       uwait   0xfffffe007aee7580  syz-executor.1
27303     1   794     0  S       uwait   0xfffffe00785ecd00  syz-executor.3
27301     1   777     0  S       uwait   0xfffffe007aee8b00  syz-executor.1
27295     1   794     0  S       uwait   0xfffffe007aee8600  syz-executor.3
27292     1   777     0  S       uwait   0xfffffe00785ecc00  syz-executor.1
27284     1 27282     0  S       uwait   0xfffffe00785eba00  syz-executor.2
27280     1   794     0  S       uwait   0xfffffe0077fb0e00  syz-executor.3
27135     1   777     0  S       uwait   0xfffffe00785eb400  syz-executor.1
27134     1   794     0  S       uwait   0xfffffe007aee7b80  syz-executor.3
27130     1   777     0  S       uwait   0xfffffe007ab31780  syz-executor.1
27129     1   794     0  S       uwait   0xfffffe007aee8400  syz-executor.3
27122     1   794     0  S       uwait   0xfffffe00785ec580  syz-executor.3
27121     1   777     0  S       uwait   0xfffffe007aee7480  syz-executor.1
27117     1   794     0  S       uwait   0xfffffe00785eb700  syz-executor.3
26937     1   776     0  S       uwait   0xfffffe00785ec280  syz-executor.0
26900     1 26893     0  S       umtxn   0xfffffe007aee8900  syz-executor.3
26891     1 26886     0  S       uwait   0xfffffe00785ec480  syz-executor.3
26878     1 26874     0  S       uwait   0xfffffe00793dae00  syz-executor.3
26867     1 26865     0  S       uwait   0xfffffe00785ebe00  syz-executor.3
26569     1   776     0  S       uwait   0xfffffe00785ec980  syz-executor.0
26568     1   777     0  S       uwait   0xfffffe0077fb0b00  syz-executor.1
26561     1   777     0  S       uwait   0xfffffe007aee7c80  syz-executor.1
26560     1   776     0  S       umtxn   0xfffffe00785ec680  syz-executor.0
26551     1   776     0  S       uwait   0xfffffe007aee7380  syz-executor.0
26550     1   777     0  S       uwait   0xfffffe0077fb0c00  syz-executor.1
26542     1   777     0  S       uwait   0xfffffe00793dac00  syz-executor.1
26411     1   794     0  S       umtxn   0xfffffe00785ec780  syz-executor.3
26408     1   776     0  S       uwait   0xfffffe00785eca80  syz-executor.0
26406     1   794     0  S       uwait   0xfffffe007ab32480  syz-executor.3
26404     1   776     0  S       uwait   0xfffffe007ab34c00  syz-executor.0
26401     1   794     0  S       uwait   0xfffffe007aee9c80  syz-executor.3
26399     1   776     0  S       uwait   0xfffffe0077fb0f00  syz-executor.0
26395     1   794     0  S       uwait   0xfffffe007aee7880  syz-executor.3
26391     1   794     0  S       umtxn   0xfffffe007aee7080  syz-executor.3
26387     1   794     0  S       uwait   0xfffffe007aee8300  syz-executor.3
26383     1   794     0  S       uwait   0xfffffe007ab31900  syz-executor.3
26276     1   776     0  S       uwait   0xfffffe007aee9980  syz-executor.0
26191     1   776     0  S       uwait   0xfffffe007aee7980  syz-executor.0
26176     1   779     0  S       uwait   0xfffffe007ab34900  syz-executor.2
26174     1   779     0  T       umtxn   0xfffffe007ab34f00  syz-executor.2
26170     1   776     0  S       uwait   0xfffffe007aee8d00  syz-executor.0
26169     1   776     0  T       uwait   0xfffffe007ab31280  syz-executor.0
26164     1   779     0  S       uwait   0xfffffe007ab34e00  syz-executor.2
26162     1   779     0  T       umtxn   0xfffffe007aee7d80  syz-executor.2
26161     1   776     0  S       uwait   0xfffffe007aee7a80  syz-executor.0
26158     1   776     0  T       uwait   0xfffffe007aee7780  syz-executor.0
26153     1   779     0  S       uwait   0xfffffe007aee7680  syz-executor.2
26152     1   779     0  T       umtxn   0xfffffe0077fad780  syz-executor.2
26150     1   776     0  S       uwait   0xfffffe007ab32380  syz-executor.0
26147     1   776     0  T       uwait   0xfffffe007aee7180  syz-executor.0
26135     1   776     0  S       uwait   0xfffffe007aee8a00  syz-executor.0
26134     1   776     0  T       uwait   0xfffffe00785ec880  syz-executor.0
25788     1   794     0  S       uwait   0xfffffe007aee8700  syz-executor.3
25630     1   779     0  S       uwait   0xfffffe007aeea180  syz-executor.2
25629     1   794     0  S       uwait   0xfffffe007aee8800  syz-executor.3
25626     1   779     0  S       uwait   0xfffffe007ab31880  syz-executor.2
25625     1   794     0  S       uwait   0xfffffe007ab32880  syz-executor.3
25618     1   779     0  S       uwait   0xfffffe007aee9d80  syz-executor.2
25617     1   794     0  S       uwait   0xfffffe007aee9080  syz-executor.3
25611     1   777     0  S       uwait   0xfffffe0077fae480  syz-executor.1
25607     1   777     0  S       uwait   0xfffffe007ab31080  syz-executor.1
25605     1   777     0  S       uwait   0xfffffe007aee8200  syz-executor.1
25602     1   777     0  S       uwait   0xfffffe007aee7e80  syz-executor.1
25598     1   777     0  S       uwait   0xfffffe007ab31180  syz-executor.1
25596     1   777     0  S       uwait   0xfffffe007aee8c00  syz-executor.1
25591     1   777     0  S       uwait   0xfffffe007aee8000  syz-executor.1
25112     1   794     0  S       uwait   0xfffffe007aeea000  syz-executor.3
25108     1   794     0  S       uwait   0xfffffe007ab31480  syz-executor.3
25102     1   794     0  S       uwait   0xfffffe007aeeac00  syz-executor.3
25098     1   794     0  S       uwait   0xfffffe007ab31580  syz-executor.3
24839     1   776     0  S       uwait   0xfffffe007ab31680  syz-executor.0
24704     1   776     0  S       uwait   0xfffffe007ab32a80  syz-executor.0
24700     1   794     0  S       uwait   0xfffffe007aee9780  syz-executor.3
24698     1   776     0  S       uwait   0xfffffe007ab33880  syz-executor.0
24695     1   776     0  S       uwait   0xfffffe007ab32980  syz-executor.0
24693     1   776     0  S       uwait   0xfffffe007aee9380  syz-executor.0
24676     1   776     0  S       uwait   0xfffffe007ab31380  syz-executor.0
24666     1   779     0  S       uwait   0xfffffe007aee9180  syz-executor.2
24665     1   776     0  S       uwait   0xfffffe007aee9280  syz-executor.0
24661     1   779     0  S       uwait   0xfffffe007aeea200  syz-executor.2
24655     1   776     0  S       uwait   0xfffffe007aee9880  syz-executor.0
24654     1   779     0  S       umtxn   0xfffffe007aeea400  syz-executor.2
24645     1   776     0  S       uwait   0xfffffe007aee9480  syz-executor.0
24458     1   794     0  S       uwait   0xfffffe007aeea100  syz-executor.3
24457     1   794     0  S       umtxn   0xfffffe007aee8e00  syz-executor.3
24455     1   776     0  S       uwait   0xfffffe007ab32b80  syz-executor.0
24454     1   779     0  S       uwait   0xfffffe007aee9e80  syz-executor.2
24453     1   776     0  S       uwait   0xfffffe007ab32c80  syz-executor.0
24452     1   779     0  S       uwait   0xfffffe0077fad000  syz-executor.2
24449     1   794     0  S       uwait   0xfffffe007ab32280  syz-executor.3
24448     1   794     0  S       uwait   0xfffffe007aeea300  syz-executor.3
24447     1   776     0  S       uwait   0xfffffe007aee8f00  syz-executor.0
24445     1   776     0  S       uwait   0xfffffe007ab31d00  syz-executor.0
24444     1   779     0  S       uwait   0xfffffe007ab32180  syz-executor.2
24442     1   779     0  S       umtxn   0xfffffe007ab33000  syz-executor.2
24439     1   794     0  S       uwait   0xfffffe007ab31c00  syz-executor.3
24438     1   776     0  S       uwait   0xfffffe0074dcee80  syz-executor.0
24437     1   794     0  S       uwait   0xfffffe007ab32e80  syz-executor.3
24436     1   779     0  S       uwait   0xfffffe0077fadc80  syz-executor.2
24435     1   776     0  S       uwait   0xfffffe007aee9b80  syz-executor.0
24434     1   779     0  S       uwait   0xfffffe007ab31f00  syz-executor.2
24427     1   779     0  S       umtxn   0xfffffe0077fad980  syz-executor.2
24426     1   779     0  S       uwait   0xfffffe0078f20b80  syz-executor.2
24149     1   777     0  S       uwait   0xfffffe007aee9680  syz-executor.1
24001     1   794     0  S       uwait   0xfffffe007ab32080  syz-executor.3
23997     1   779     0  S       uwait   0xfffffe007aeea500  syz-executor.2
23991     1   794     0  S       uwait   0xfffffe007ab31e00  syz-executor.3
23987     1   779     0  S       uwait   0xfffffe007ab32580  syz-executor.2
23983     1   794     0  S       uwait   0xfffffe007ab33200  syz-executor.3
23978     1   779     0  S       uwait   0xfffffe007aeea800  syz-executor.2
23969     1   779     0  S       uwait   0xfffffe007aee9a80  syz-executor.2
23847     1 23845     0  S       uwait   0xfffffe007ab33b80  syz-executor.1
23846     1 23845     0  S       uwait   0xfffffe0077fad100  syz-executor.1
23574     1   794     0  S       uwait   0xfffffe0077fad300  syz-executor.3
23572     1   794     0  S       uwait   0xfffffe0077fada80  syz-executor.3
23570     1   794     0  S       uwait   0xfffffe007ab33d80  syz-executor.3
23565     1   794     0  S       uwait   0xfffffe007aeea700  syz-executor.3
23341     1   776     0  SV      uwait   0xfffffe0077fad200  syz-executor.0
23134     1   777     0  S       uwait   0xfffffe007aeea600  syz-executor.1
22999     1   777     0  S       uwait   0xfffffe007aeeaa00  syz-executor.1
22997     1   794     0  S       uwait   0xfffffe007ab34000  syz-executor.3
22995     1   779     0  S       uwait   0xfffffe007ab32680  syz-executor.2
22992     1   777     0  S       uwait   0xfffffe007ab32780  syz-executor.1
22990     1   794     0  S       uwait   0xfffffe007aeea900  syz-executor.3
22989     1   779     0  S       uwait   0xfffffe007aeeab00  syz-executor.2
22984     1   777     0  S       uwait   0xfffffe0077fad880  syz-executor.1
22983     1   779     0  S       umtxn   0xfffffe0077fadf00  syz-executor.2
22982     1   794     0  S       uwait   0xfffffe00762c1f00  syz-executor.3
22970     1   779     0  S       uwait   0xfffffe007ab33580  syz-executor.2
22578     1   776     0  S       uwait   0xfffffe0078f20a00  syz-executor.0
22576     1   794     0  S       uwait   0xfffffe0078f20e80  syz-executor.3
22567     1   776     0  S       uwait   0xfffffe007ab32d80  syz-executor.0
22566     1   794     0  S       uwait   0xfffffe0077fadb80  syz-executor.3
22559     1   776     0  S       uwait   0xfffffe0077fadd80  syz-executor.0
22558     1   794     0  S       uwait   0xfffffe0077faed00  syz-executor.3
22550     1   794     0  S       uwait   0xfffffe007ab33100  syz-executor.3
22529     1   794     0  SV      uwait   0xfffffe0078f20d80  syz-executor.3
22528     1   776     0  SV      uwait   0xfffffe007ab34500  syz-executor.0
22519     1   794     0  SV      uwait   0xfffffe007ab34100  syz-executor.3
22518     1   776     0  SV      uwait   0xfffffe0078f1d580  syz-executor.0
22512     1   776     0  SV      uwait   0xfffffe0077fad500  syz-executor.0
22510     1   794     0  SV      uwait   0xfffffe007ab33980  syz-executor.3
22496     1   794     0  SV      uwait   0xfffffe0077fade80  syz-executor.3
22349     1 22341     0  S       uwait   0xfffffe007ab33780  syz-executor.2
22338     1 22336     0  S       umtxn   0xfffffe0077fad400  syz-executor.2
22337     1 22329     0  S       uwait   0xfffffe0077fae900  syz-executor.0
22327     1 22325     0  S       uwait   0xfffffe0078f1ee00  syz-executor.2
22326     1 22321     0  S       uwait   0xfffffe0078f1e100  syz-executor.0
22317     1 22315     0  S       uwait   0xfffffe0078f20c80  syz-executor.0
22308     1 22306     0  S       uwait   0xfffffe007ab34800  syz-executor.0
22054     1   777     0  S       uwait   0xfffffe007ab34b00  syz-executor.1
22051     1   777     0  S       uwait   0xfffffe0077fad680  syz-executor.1
22050     1   779     0  S       uwait   0xfffffe0077fae180  syz-executor.2
22045     1   777     0  S       uwait   0xfffffe007ab34600  syz-executor.1
22043     1   779     0  S       umtxn   0xfffffe00762c1c00  syz-executor.2
22041     1   779     0  S       uwait   0xfffffe007ab34400  syz-executor.2
22039     1   779     0  S       uwait   0xfffffe0078f1ef00  syz-executor.2
21863     0     0     0  DL      mdwait  0xfffffe007ad8a000  [md11]
21861     0     0     0  DL      mdwait  0xfffffe007ad7a000  [md10]
21857     0     0     0  DL      mdwait  0xfffffe007ad64000  [md9]
21856     0     0     0  DL      mdwait  0xfffffe007ad65000  [md8]
21853     0     0     0  DL      mdwait  0xfffffe0078090000  [md7]
21852     0     0     0  DL      mdwait  0xfffffe0078091000  [md6]
21847     0     0     0  DL      mdwait  0xfffffe0078b6a000  [md5]
21846     0     0     0  DL      mdwait  0xfffffe0078b6b000  [md4]
21792     1   776     0  S       uwait   0xfffffe007ab33c80  syz-executor.0
21788     1   776     0  S       uwait   0xfffffe00762c1e00  syz-executor.0
21785     1   776     0  S       uwait   0xfffffe0077fae880  syz-executor.0
21779     1   776     0  S       uwait   0xfffffe007ab33a80  syz-executor.0
21671     1   779     0  S       umtxn   0xfffffe0078f1f180  syz-executor.2
21670     1   794     0  S       uwait   0xfffffe0078f1f480  syz-executor.3
21669     1   777     0  S       uwait   0xfffffe0078f1e900  syz-executor.1
21668     1   776     0  S       uwait   0xfffffe0077fae580  syz-executor.0
21667     1   779     0  S       uwait   0xfffffe0073a99e00  syz-executor.2
21665     1   777     0  S       uwait   0xfffffe0078f1d380  syz-executor.1
21663     1   794     0  S       uwait   0xfffffe00762c1b00  syz-executor.3
21662     1   776     0  S       uwait   0xfffffe0077fae080  syz-executor.0
21659     1   779     0  S       uwait   0xfffffe007ab34a00  syz-executor.2
21658     1   777     0  S       uwait   0xfffffe00762be900  syz-executor.1
21657     1   776     0  S       uwait   0xfffffe0077fafd00  syz-executor.0
21656     1   779     0  S       uwait   0xfffffe0078f1e700  syz-executor.2
21655     1   794     0  S       umtxn   0xfffffe0077fb0a80  syz-executor.3
21653     1   777     0  S       uwait   0xfffffe0073a99a00  syz-executor.1
21651     1   776     0  S       uwait   0xfffffe0078f1d800  syz-executor.0
21649     1   794     0  S       uwait   0xfffffe0078f1d280  syz-executor.3
21647     1   777     0  S       uwait   0xfffffe007ab34b80  syz-executor.1
21646     1   776     0  S       uwait   0xfffffe0078f1df00  syz-executor.0
21645     1   779     0  S       uwait   0xfffffe00762bf600  syz-executor.2
21644     1   794     0  S       uwait   0xfffffe0078f1f880  syz-executor.3
21643     1   777     0  S       uwait   0xfffffe0077fb0780  syz-executor.1
21641     1   794     0  S       umtxn   0xfffffe0078f1eb00  syz-executor.3
21638     1   776     0  S       uwait   0xfffffe00762bf300  syz-executor.0
21637     1   779     0  S       uwait   0xfffffe0077fae680  syz-executor.2
21632     1   776     0  S       uwait   0xfffffe0078f1e300  syz-executor.0
21631     1   776     0  S       uwait   0xfffffe00762c1a80  syz-executor.0
21582     1   794     0  S       uwait   0xfffffe00762c1d00  syz-executor.3
21577     1   794     0  S       uwait   0xfffffe0078f1d900  syz-executor.3
21575     1   794     0  S       uwait   0xfffffe0078f1e400  syz-executor.3
21570     1   794     0  S       uwait   0xfffffe0077fae280  syz-executor.3
20707     1   777     0  S       uwait   0xfffffe0077fb0980  syz-executor.1
20706     1   776     0  S       uwait   0xfffffe0078f1ed80  syz-executor.0
20704     1   776     0  S       uwait   0xfffffe0078f1ec80  syz-executor.0
20700     1   777     0  S       uwait   0xfffffe0078f1ea00  syz-executor.1
20699     1   776     0  S       uwait   0xfffffe0078f1dc00  syz-executor.0
20696     1   777     0  S       uwait   0xfffffe0078f1e600  syz-executor.1
20688     1   777     0  S       uwait   0xfffffe0073a99d00  syz-executor.1
20677     1   776     0  S       uwait   0xfffffe0077faf080  syz-executor.0
20676     1   777     0  S       umtxn   0xfffffe0078f1e500  syz-executor.1
20672     1   776     0  S       uwait   0xfffffe0077faef00  syz-executor.0
20669     1   777     0  S       uwait   0xfffffe0078f1d080  syz-executor.1
20666     1   776     0  S       uwait   0xfffffe0078f1de00  syz-executor.0
20662     1   776     0  T       uwait   0xfffffe0078f1fc00  syz-executor.0
20659     1   777     0  S       umtxn   0xfffffe0077fb0680  syz-executor.1
20652     1   777     0  S       uwait   0xfffffe0077fae780  syz-executor.1
20040     1   779     0  S       uwait   0xfffffe0078f1db00  syz-executor.2
20039     1   779     0  S       uwait   0xfffffe0077fafe00  syz-executor.2
20037     1   779     0  S       uwait   0xfffffe0078f20480  syz-executor.2
20036     1   779     0  S       uwait   0xfffffe0078f1e080  syz-executor.2
20032     1   779     0  S       uwait   0xfffffe0077faea00  syz-executor.2
20031     1   779     0  S       uwait   0xfffffe0078f1dd00  syz-executor.2
20028     1   779     0  S       uwait   0xfffffe0078f20180  syz-executor.2
20026     1   779     0  S       uwait   0xfffffe0078f1da00  syz-executor.2
19148     1   777     0  S       uwait   0xfffffe0074dcb380  syz-executor.1
19145     1   777     0  S       uwait   0xfffffe0077fafa00  syz-executor.1
19142     1   777     0  S       uwait   0xfffffe00762bf000  syz-executor.1
19138     1   777     0  S       uwait   0xfffffe0078f1e800  syz-executor.1
19135     1   777     0  S       uwait   0xfffffe0077fb0580  syz-executor.1
19128     1   777     0  S       uwait   0xfffffe0073a99b00  syz-executor.1
19122     1   777     0  S       uwait   0xfffffe0077fb0100  syz-executor.1
18867     1 18866     0  S       uwait   0xfffffe0077faf380  syz-executor.2
18671     1   776     0  S       uwait   0xfffffe0078f20880  syz-executor.0
18665     1   779     0  S       uwait   0xfffffe0077faf900  syz-executor.2
18661     1   779     0  S       uwait   0xfffffe0074dcb180  syz-executor.2
18658     1   776     0  S       uwait   0xfffffe0077fafc00  syz-executor.0
18653     1   779     0  S       uwait   0xfffffe0077fb0280  syz-executor.2
18651     1   776     0  S       uwait   0xfffffe0078f1f080  syz-executor.0
18648     1   776     0  S       uwait   0xfffffe00762bea00  syz-executor.0
18644     1   776     0  S       uwait   0xfffffe0077faec00  syz-executor.0
18641     1   776     0  S       uwait   0xfffffe00762beb80  syz-executor.0
18636     1   776     0  S       uwait   0xfffffe0077faeb00  syz-executor.0
18340     0     0     0  DL      mdwait  0xfffffe006d18f000  [md3]
18336     0     0     0  DL      mdwait  0xfffffe006d16d000  [md2]
18332     0     0     0  DL      mdwait  0xfffffe006d190000  [md1]
18328     0     0     0  DL      mdwait  0xfffffe00541fb000  [md0]
18257     1   794     0  S       uwait   0xfffffe0077faf680  syz-executor.3
18255     1   794     0  S       uwait   0xfffffe0077faf180  syz-executor.3
18250     1   794     0  S       uwait   0xfffffe0077faee00  syz-executor.3
18244     1   794     0  S       umtxn   0xfffffe0077faf480  syz-executor.3
17891     1   777     0  S       uwait   0xfffffe0077faff00  syz-executor.1
17887     1   779     0  S       uwait   0xfffffe0078f20780  syz-executor.2
17882     1   777     0  S       uwait   0xfffffe0073a99780  syz-executor.1
17880     1   779     0  S       uwait   0xfffffe0078f20380  syz-executor.2
17876     1   776     0  S       uwait   0xfffffe0074dce880  syz-executor.0
17873     1   794     0  S       uwait   0xfffffe0077faf800  syz-executor.3
17871     1   779     0  S       uwait   0xfffffe0077fb0080  syz-executor.2
17870     1   776     0  S       uwait   0xfffffe0077fb0380  syz-executor.0
17869     1   777     0  S       uwait   0xfffffe0074dcb080  syz-executor.1
17864     1   794     0  S       uwait   0xfffffe0077faf280  syz-executor.3
17861     1   776     0  S       uwait   0xfffffe0078f1fb00  syz-executor.0
17859     1   794     0  S       uwait   0xfffffe0077fb0480  syz-executor.3
17853     1   794     0  S       uwait   0xfffffe0077faf580  syz-executor.3
16550     1   777     0  S       uwait   0xfffffe0073a99900  syz-executor.1
16361     1   794     0  S       uwait   0xfffffe0074dcec80  syz-executor.3
16355     1   794     0  S       uwait   0xfffffe0078f20580  syz-executor.3
16347     1   779     0  S       uwait   0xfffffe0074dcb280  syz-executor.2
16345     1   777     0  S       uwait   0xfffffe0078f1fd00  syz-executor.1
16344     1   794     0  S       uwait   0xfffffe0074dcc180  syz-executor.3
16336     1   779     0  S       uwait   0xfffffe0073a99f00  syz-executor.2
16334     1   777     0  S       uwait   0xfffffe0058f3d680  syz-executor.1
16330     1   779     0  S       uwait   0xfffffe0077fb0880  syz-executor.2
16329     1   777     0  S       uwait   0xfffffe0077fafb00  syz-executor.1
16321     1   777     0  S       uwait   0xfffffe00762c1880  syz-executor.1
15887     1 15886     0  S       uwait   0xfffffe0073a99c00  syz-executor.0
15885     1 15884     0  S       uwait   0xfffffe0074dceb80  syz-executor.0
15883     1 15881     0  S       uwait   0xfffffe00762be400  syz-executor.0
15878     1 15877     0  S       uwait   0xfffffe0078f1ff00  syz-executor.0
14186     1   779     0  S       uwait   0xfffffe0078f1fa00  syz-executor.2
14183     1   779     0  S       uwait   0xfffffe0077fb0180  syz-executor.2
14181     1   776     0  S       uwait   0xfffffe0074dcb800  syz-executor.0
14176     1   779     0  S       uwait   0xfffffe0078f20080  syz-executor.2
14175     1   776     0  S       uwait   0xfffffe00762be300  syz-executor.0
14172     1   776     0  S       uwait   0xfffffe0074dcea80  syz-executor.0
14169     1   776     0  S       uwait   0xfffffe00762c1680  syz-executor.0
13821     1   776     0  S       umtxn   0xfffffe00762bf100  syz-executor.0
12711     1   794     0  S       uwait   0xfffffe00762bf400  syz-executor.3
12294     1   776     0  S       umtxn   0xfffffe0078f1fe00  syz-executor.0
12291     1   779     0  S       uwait   0xfffffe00762c1380  syz-executor.2
12284     1   776     0  S       umtxn   0xfffffe0074dce980  syz-executor.0
12283     1   779     0  S       uwait   0xfffffe0074dcbb00  syz-executor.2
12274     1   776     0  S       uwait   0xfffffe0078f20980  syz-executor.0
12273     1   779     0  S       umtxn   0xfffffe0074dcba00  syz-executor.2
12264     1   779     0  S       uwait   0xfffffe0078f20280  syz-executor.2
12113     1   776     0  S       uwait   0xfffffe00762be800  syz-executor.0
12108     1   776     0  S       uwait   0xfffffe0074dcb900  syz-executor.0
12103     1   776     0  S       uwait   0xfffffe0078f20680  syz-executor.0
12098     1   776     0  S       uwait   0xfffffe0074dcbf00  syz-executor.0
11229     1   794     0  S       uwait   0xfffffe00762be100  syz-executor.3
11227     1   776     0  S       uwait   0xfffffe00762bfe00  syz-executor.0
11226     1   779     0  S       uwait   0xfffffe00762c0180  syz-executor.2
11224     1   777     0  S       uwait   0xfffffe00762be000  syz-executor.1
11221     1   794     0  S       umtxn   0xfffffe00762be500  syz-executor.3
11219     1   779     0  S       umtxn   0xfffffe00762bed80  syz-executor.2
11217     1   794     0  S       uwait   0xfffffe00762bf780  syz-executor.3
11216     1   777     0  S       uwait   0xfffffe0074dced80  syz-executor.1
11214     1   776     0  S       uwait   0xfffffe0074dcb700  syz-executor.0
11211     1   779     0  S       uwait   0xfffffe0074dcb500  syz-executor.2
11209     1   777     0  S       umtxn   0xfffffe00762c1480  syz-executor.1
11207     1   776     0  S       umtxn   0xfffffe00762c0080  syz-executor.0
11203     1   776     0  S       uwait   0xfffffe00762bf500  syz-executor.0
11200     1   776     0  S       umtxn   0xfffffe0074dcbd00  syz-executor.0
11197     1   776     0  S       uwait   0xfffffe00762be600  syz-executor.0
11194     1   776     0  S       uwait   0xfffffe00762bf200  syz-executor.0
11053     1   779     0  S       uwait   0xfffffe00762be700  syz-executor.2
 9854     1   777     0  S       uwait   0xfffffe00762bee80  syz-executor.1
 9848     1   794     0  S       umtxn   0xfffffe00762bea80  syz-executor.3
 9844     1   777     0  S       umtxn   0xfffffe00762c0380  syz-executor.1
 9838     1   794     0  S       umtxn   0xfffffe0074dcd200  syz-executor.3
 9833     1   777     0  S       uwait   0xfffffe00762bfa00  syz-executor.1
 9829     1   794     0  S       uwait   0xfffffe0074dcbc00  syz-executor.3
 9818     1   794     0  S       uwait   0xfffffe00762bfd00  syz-executor.3
 9635     1   779     0  S       uwait   0xfffffe0074dcc680  syz-executor.2
 9633     1   776     0  S       uwait   0xfffffe0074dcbe00  syz-executor.0
 9632     1   794     0  S       uwait   0xfffffe00762bf680  syz-executor.3
 9629     1   777     0  S       uwait   0xfffffe0074dcca80  syz-executor.1
 9627     1   779     0  S       uwait   0xfffffe00762bf900  syz-executor.2
 9625     1   776     0  S       uwait   0xfffffe0074dccb80  syz-executor.0
 9623     1   794     0  S       uwait   0xfffffe0074dcc280  syz-executor.3
 9621     1   777     0  S       uwait   0xfffffe0073a97280  syz-executor.1
 9619     1   779     0  S       uwait   0xfffffe00762bec80  syz-executor.2
 9617     1   776     0  S       uwait   0xfffffe00762c0d80  syz-executor.0
 9616     1   794     0  S       uwait   0xfffffe0073a96700  syz-executor.3
 9611     1   777     0  S       uwait   0xfffffe00762c0480  syz-executor.1
 9604     1   777     0  S       uwait   0xfffffe0074dcb600  syz-executor.1
 9058     1   776     0  SV      uwait   0xfffffe00762c0a80  syz-executor.0
 9049     1   776     0  SV      uwait   0xfffffe00762bfc00  syz-executor.0
 9033     1   776     0  SV      uwait   0xfffffe0074dcc380  syz-executor.0
 9031     1   794     0  SV      uwait   0xfffffe0074dcc080  syz-executor.3
 9029     1   779     0  SV      uwait   0xfffffe00762c0880  syz-executor.2
 9027     1   777     0  SV      uwait   0xfffffe00762bfb00  syz-executor.1
 9025     1   776     0  SV      uwait   0xfffffe00762c0780  syz-executor.0
 9023     1   794     0  SV      uwait   0xfffffe00762c1080  syz-executor.3
 9021     1   779     0  SV      uwait   0xfffffe0073a96300  syz-executor.2
 9019     1   777     0  SV      uwait   0xfffffe0073a96600  syz-executor.1
 9017     1   776     0  SV      uwait   0xfffffe0074dcda00  syz-executor.0
 9015     1   794     0  SV      uwait   0xfffffe00762c0280  syz-executor.3
 9013     1   779     0  SV      uwait   0xfffffe0074dcc580  syz-executor.2
 9011     1   777     0  SV      uwait   0xfffffe00762c0680  syz-executor.1
 9009     1   776     0  SV      uwait   0xfffffe00762bff00  syz-executor.0
 8992     1   776     0  SV      uwait   0xfffffe00762c1180  syz-executor.0
 8100     1   779     0  S       umtxn   0xfffffe0058f3da80  syz-executor.2
 8097     1   794     0  S       uwait   0xfffffe00762c0f00  syz-executor.3
 8091     1   779     0  S       uwait   0xfffffe00762c1780  syz-executor.2
 8088     1   794     0  S       umtxn   0xfffffe00762c0b80  syz-executor.3
 8082     1   779     0  S       uwait   0xfffffe00762c0e80  syz-executor.2
 8078     1   794     0  S       uwait   0xfffffe0074dcc480  syz-executor.3
 8067     1   794     0  S       umtxn   0xfffffe00762c0980  syz-executor.3
 8027     1   777     0  SV      uwait   0xfffffe00762c0c80  syz-executor.1
 7994     1   776     0  S       umtxn   0xfffffe0074dcd100  syz-executor.0
 7993     1   776     0  S       uwait   0xfffffe00762c1580  syz-executor.0
 7988     1   776     0  S       uwait   0xfffffe0073a96f00  syz-executor.0
 7987     1   776     0  S       umtxn   0xfffffe0074dcc780  syz-executor.0
 7983     1   776     0  S       uwait   0xfffffe0074dccc80  syz-executor.0
 7982     1   776     0  S       umtxn   0xfffffe0074dccd80  syz-executor.0
 7973     1   776     0  S       uwait   0xfffffe0074dcc980  syz-executor.0
 7972     1   776     0  S       uwait   0xfffffe0074dcce80  syz-executor.0
 7933     1   794     0  T                                   syz-executor.3
 7446     1   776     0  S       uwait   0xfffffe0058f3db80  syz-executor.0
 7444     1   776     0  S       uwait   0xfffffe0058f3b780  syz-executor.0
 7442     1   776     0  S       uwait   0xfffffe0074dcd000  syz-executor.0
 7440     1   776     0  S       uwait   0xfffffe0074dcde00  syz-executor.0
 7393     1   777     0  S       uwait   0xfffffe0073a96800  syz-executor.1
 7392     1   776     0  S       umtxn   0xfffffe0074dcd600  syz-executor.0
 7390     1   794     0  S       uwait   0xfffffe00762c1280  syz-executor.3
 7389     1   779     0  S       uwait   0xfffffe0073a96500  syz-executor.2
 7385     1   794     0  S       uwait   0xfffffe0074dcc880  syz-executor.3
 7384     1   777     0  S       uwait   0xfffffe0058f3d780  syz-executor.1
 7383     1   776     0  S       uwait   0xfffffe0074dcdf00  syz-executor.0
 7380     1   779     0  S       uwait   0xfffffe0058f3d880  syz-executor.2
 7377     1   777     0  S       uwait   0xfffffe0073a96400  syz-executor.1
 7376     1   794     0  S       uwait   0xfffffe0074dcdd00  syz-executor.3
 7375     1   776     0  S       uwait   0xfffffe0058f3b100  syz-executor.0
 7374     1   779     0  S       uwait   0xfffffe0074dcd500  syz-executor.2
 7366     1   776     0  S       uwait   0xfffffe0074dce780  syz-executor.0
 7162     1   779     0  SV      uwait   0xfffffe0074dce180  syz-executor.2
 7159     1   794     0  SV      uwait   0xfffffe0057a56a80  syz-executor.3
 7151     1   779     0  SV      uwait   0xfffffe0058f3de80  syz-executor.2
 7150     1   794     0  SV      uwait   0xfffffe0057a56980  syz-executor.3
 7142     1   779     0  SV      uwait   0xfffffe0073a97780  syz-executor.2
 7141     1   794     0  SV      uwait   0xfffffe0074dce680  syz-executor.3
 7128     1   794     0  SV      uwait   0xfffffe0074dce480  syz-executor.3
 7049     1   779     0  S       uwait   0xfffffe0074dcd700  syz-executor.2
 7045     1   779     0  S       uwait   0xfffffe0074dcdb00  syz-executor.2
 7043     1   779     0  S       uwait   0xfffffe0058f3dd80  syz-executor.2
 7041     1   779     0  S       umtxn   0xfffffe0074dce580  syz-executor.2
 6528     1   779     0  S       uwait   0xfffffe0074dcd300  syz-executor.2
 6519     1   779     0  S       uwait   0xfffffe0057a56b80  syz-executor.2
 6510     1   779     0  S       uwait   0xfffffe0058f3a400  syz-executor.2
 6505     1   779     0  S       uwait   0xfffffe0074dcd900  syz-executor.2
 6304     1   776     0  S       uwait   0xfffffe0073a96e00  syz-executor.0
 6298     1   794     0  S       uwait   0xfffffe0074dcd800  syz-executor.3
 6297     1   776     0  S       uwait   0xfffffe0073a96200  syz-executor.0
 6295     1   779     0  S       uwait   0xfffffe0074dcdc00  syz-executor.2
 6293     1   776     0  S       uwait   0xfffffe0073a96000  syz-executor.0
 6292     1   794     0  S       uwait   0xfffffe0074dcd400  syz-executor.3
 6289     1   779     0  S       uwait   0xfffffe0057a56c80  syz-executor.2
 6288     1   794     0  S       uwait   0xfffffe0058f3d980  syz-executor.3
 6283     1   779     0  S       uwait   0xfffffe0073a96100  syz-executor.2
 6279     1   779     0  S       umtxn   0xfffffe0058f3b980  syz-executor.2
 5920     1   777     0  SV      uwait   0xfffffe0058f3dc80  syz-executor.1
 4584     1   779     0  S       uwait   0xfffffe0073a97580  syz-executor.2
 4582     1   779     0  S       uwait   0xfffffe0074dce280  syz-executor.2
 4578     1   779     0  S       uwait   0xfffffe0074dce080  syz-executor.2
 4577     1   779     0  S       uwait   0xfffffe0073a96c00  syz-executor.2
 4572     1   794     0  S       umtxn   0xfffffe0073a96a00  syz-executor.3
 4571     1   794     0  S       uwait   0xfffffe0073a96900  syz-executor.3
 4567     1   779     0  S       uwait   0xfffffe0073a97e00  syz-executor.2
 4564     1   777     0  S       uwait   0xfffffe0073a97080  syz-executor.1
 4563     1   794     0  S       uwait   0xfffffe0057a56680  syz-executor.3
 4562     1   779     0  S       uwait   0xfffffe0073a99400  syz-executor.2
 4561     1   777     0  S       uwait   0xfffffe0057a54d00  syz-executor.1
 4559     1   794     0  S       uwait   0xfffffe0058f3b580  syz-executor.3
 4558     1   776     0  S       uwait   0xfffffe0057a56580  syz-executor.0
 4557     1   777     0  S       uwait   0xfffffe0057141900  syz-executor.1
 4556     1   777     0  S       uwait   0xfffffe0058f3b480  syz-executor.1
 4555     1   776     0  S       uwait   0xfffffe0057a56880  syz-executor.0
 4550     1   776     0  S       uwait   0xfffffe0073a97d00  syz-executor.0
 4548     1   794     0  S       uwait   0xfffffe0073a97480  syz-executor.3
 4547     1   794     0  S       uwait   0xfffffe0058f3b680  syz-executor.3
 4546     1   776     0  S       uwait   0xfffffe0073a97680  syz-executor.0
 4545     1   777     0  S       uwait   0xfffffe0073a97180  syz-executor.1
 4544     1   777     0  S       uwait   0xfffffe0058f3bc80  syz-executor.1
 4540     1   776     0  S       uwait   0xfffffe0074dce380  syz-executor.0
 4539     1   776     0  S       uwait   0xfffffe0058f3c380  syz-executor.0
 4532     1   776     0  S       uwait   0xfffffe00543e6580  syz-executor.0
 4531     1   776     0  S       uwait   0xfffffe0073a97380  syz-executor.0
 4192     1   776     0  S       uwait   0xfffffe0057a53b00  syz-executor.0
 4179     1   776     0  S       uwait   0xfffffe0058f3b380  syz-executor.0
 4170     1   776     0  S       uwait   0xfffffe0057a56780  syz-executor.0
 4160     1   776     0  S       uwait   0xfffffe00543e6380  syz-executor.0
 4123     1  4123    65  Ss      select  0xfffffe00571a0bc0  dhclient
 3941     0     0     0  DL      -       0xffffffff836aa460  [accounting]
 3870     0     0     0  DL      (threaded)                  [zfskern]
104198                   D       t->zthr 0xfffffe0073f64848  [arc_evict]
104265                   D       t->zthr 0xfffffe0073f77748  [arc_reap]
104266                   D       -       0xfffffe00741ff200  [dbu_evict]
104267                   D       dbuf_ev 0xffffffff8540e060  [dbuf_evict_thread]
104268                   D       -       0xfffffe0074397500  [z_vdev_file_0]
104269                   D       -       0xfffffe0074397500  [z_vdev_file_1]
104270                   D       -       0xfffffe0074397500  [z_vdev_file_2]
104271                   D       -       0xfffffe0074397500  [z_vdev_file_3]
104272                   D       -       0xfffffe0074397500  [z_vdev_file_4]
104273                   D       -       0xfffffe0074397500  [z_vdev_file_5]
104274                   D       -       0xfffffe0074397500  [z_vdev_file_6]
104275                   D       -       0xfffffe0074397500  [z_vdev_file_7]
104276                   D       -       0xfffffe0074397500  [z_vdev_file_8]
104277                   D       -       0xfffffe0074397500  [z_vdev_file_9]
104278                   D       -       0xfffffe0074397500  [z_vdev_file_10]
104279                   D       -       0xfffffe0074397500  [z_vdev_file_11]
104280                   D       -       0xfffffe0074397500  [z_vdev_file_12]
104281                   D       -       0xfffffe0074397500  [z_vdev_file_13]
104282                   D       -       0xfffffe0074397500  [z_vdev_file_14]
104283                   D       -       0xfffffe0074397500  [z_vdev_file_15]
104284                   D       l2arc_f 0xffffffff8540cfa0  [l2arc_feed_thread]
104285                   D       -       0xfffffe0073e09000  [zfsvfs]
104286                   S       zevent_ 0xffffffff8540ed00  [sysevent]
 3771     1   794     0  S       umtxn   0xfffffe0073a98b00  syz-executor.3
 3759     1   794     0  S       uwait   0xfffffe005713f780  syz-executor.3
 3750     1   794     0  S       uwait   0xfffffe0057141600  syz-executor.3
 3739     1   794     0  S       uwait   0xfffffe0057141400  syz-executor.3
 3648     1   777     0  S       uwait   0xfffffe00543e6c80  syz-executor.1
 3640     1   777     0  S       uwait   0xfffffe0058f3ba80  syz-executor.1
 3632     1   777     0  S       uwait   0xfffffe0073a98380  syz-executor.1
 3624     1   777     0  S       uwait   0xfffffe0073a99080  syz-executor.1
 3578     1   777     0  S       uwait   0xfffffe0073a97f00  syz-executor.1
 3569     1   777     0  S       uwait   0xfffffe0073a98480  syz-executor.1
 3562     1   777     0  S       uwait   0xfffffe0073a98f00  syz-executor.1
 3559     1   776     0  S       umtxn   0xfffffe0057a53680  syz-executor.0
 3558     1   794     0  S       uwait   0xfffffe0073a98180  syz-executor.3
 3557     1   777     0  S       uwait   0xfffffe0073a97c00  syz-executor.1
 3552     1   794     0  S       umtxn   0xfffffe0073a99380  syz-executor.3
 3550     1   776     0  S       uwait   0xfffffe0058f3b880  syz-executor.0
 3549     1   777     0  S       umtxn   0xfffffe0058f3c000  syz-executor.1
 3546     1   777     0  S       umtxn   0xfffffe005713e900  syz-executor.1
 3544     1   777     0  S       umtxn   0xfffffe005713fc00  syz-executor.1
 3542     1   777     0  S       uwait   0xfffffe005713f880  syz-executor.1
 3539     1   777     0  S       uwait   0xfffffe0057141800  syz-executor.1
 3537     1   794     0  SV      uwait   0xfffffe0058f3c500  syz-executor.3
 3536     1   776     0  SV      uwait   0xfffffe0057141a80  syz-executor.0
 3535     1   794     0  S       uwait   0xfffffe0058f3c400  syz-executor.3
 3533     1   776     0  S       uwait   0xfffffe0057a54780  syz-executor.0
 3532     1   777     0  S       uwait   0xfffffe0057141500  syz-executor.1
 3528     1   777     0  S       uwait   0xfffffe0073a99180  syz-executor.1
 3524     1   777     0  S       uwait   0xfffffe0057a54b00  syz-executor.1
 3514     1   777     0  SV      uwait   0xfffffe0057141c80  syz-executor.1
 3511     1   777     0  S       umtxn   0xfffffe0058f3cb00  syz-executor.1
 3214     1  3214     0  Ss      select  0xfffffe00571c3dc0  dhclient
 3211     1  3211     0  Ss      select  0xfffffe00571c3e40  dhclient
 3188     1  3188    65  Ss      select  0xfffffe00571c50c0  dhclient
 2925     1   777     0  S       uwait   0xfffffe0057141b00  syz-executor.1
 2422     1  2422     0  Ss      select  0xfffffe00571c52c0  dhclient
 2419     1  2419     0  Ss      select  0xfffffe0057a6d240  dhclient
 2381     1  2381    65  Ss      select  0xfffffe0057a6d840  dhclient
 1713     1  1713     0  Ss      select  0xfffffe0057a6d6c0  dhclient
 1710     1  1710     0  Ss      select  0xfffffe0057a6d4c0  dhclient
 1687     1  1687    65  Ss      select  0xfffffe0057a6d640  dhclient
 1078     1  1078     0  Ss      select  0xfffffe0057a6d940  dhclient
 1072     1  1072     0  Ss      select  0xfffffe00571c56c0  dhclient
  879     0     0     0  DL      -       0xffffffff837cf480  [soaiod4]
  878     0     0     0  DL      -       0xffffffff837cf480  [soaiod3]
  877     0     0     0  DL      -       0xffffffff837cf480  [soaiod2]
  876     0     0     0  DL      -       0xffffffff837cf480  [soaiod1]
  875     0     0     0  DL      aiordy  0xfffffe006d170020  [aiod4]
  874     0     0     0  DL      aiordy  0xfffffe006d170580  [aiod3]
  873     0     0     0  DL      aiordy  0xfffffe006cd60000  [aiod2]
  872     0     0     0  DL      aiordy  0xfffffe006cd61580  [aiod1]
  794   774   794     0  Rs                                  syz-executor.3
  779   774   779     0  Rs                                  syz-executor.2
  777   774   777     0  Rs                                  syz-executor.1
  776   774   776     0  Rs                                  syz-executor.0
  774   772   772     0  R       (threaded)                  syz-fuzzer
100113                   S       uwait   0xfffffe0057a55080  syz-fuzzer
100116                   RunQ                                syz-fuzzer
100117                   S       uwait   0xfffffe0057a53e00  syz-fuzzer
100118                   S       uwait   0xfffffe0057a53f00  syz-fuzzer
100119                   S       uwait   0xfffffe0057a54080  syz-fuzzer
100120                   S       wait    0xfffffe006cca85c0  syz-fuzzer
100121                   S       uwait   0xfffffe00543e6d80  syz-fuzzer
100123                   S       wait    0xfffffe006cca85c0  syz-fuzzer
100125                   S       wait    0xfffffe006cca85c0  syz-fuzzer
100129                   S       wait    0xfffffe006cca85c0  syz-fuzzer
100134                   S       kqread  0xfffffe0058f38b00  syz-fuzzer
100139                   S       uwait   0xfffffe005713e100  syz-fuzzer
110358                   RunQ                                syz-fuzzer
  772   770   772     0  Ss      pause   0xfffffe006cca7bb0  csh
  770   688   770     0  Ss      select  0xfffffe00571c5bc0  sshd
  754     1   754     0  Ss+     ttyin   0xfffffe0057106cb0  getty
  753     1   753     0  Ss+     ttyin   0xfffffe0007c8f8b0  getty
  752     1   752     0  Ss+     ttyin   0xfffffe0007c8fcb0  getty
  751     1   751     0  Ss+     ttyin   0xfffffe00571058b0  getty
  750     1   750     0  Ss+     ttyin   0xfffffe0007c900b0  getty
  749     1   749     0  Ss+     ttyin   0xfffffe0057105cb0  getty
  748     1   748     0  Ss+     ttyin   0xfffffe0007c904b0  getty
  747     1   747     0  Ss+     ttyin   0xfffffe0007c908b0  getty
  746     1   746     0  Ss+     ttyin   0xfffffe0007c90cb0  getty
  692     1   692     0  Ss      nanslp  0xffffffff836d2841  cron
  688     1   688     0  Ss      select  0xfffffe005719bcc0  sshd
  501     1   501     0  Rs                                  syslogd
  430     1   430     0  Ss      select  0xfffffe00571a0140  devd
  429     1   429    65  Ss      select  0xfffffe0057a6da40  dhclient
  344     1   344     0  Ss      select  0xfffffe005719bec0  dhclient
  341     1   341     0  Ss      select  0xfffffe0057a6dac0  dhclient
   17     0     0     0  DL      vlruwt  0xfffffe005715fae0  [vnlru]
   16     0     0     0  DL      syncer  0xffffffff837d4d20  [syncer]
   15     0     0     0  DL      (threaded)                  [bufdaemon]
100079                   D       psleep  0xffffffff837d3340  [bufdaemon]
100082                   D       -       0xffffffff82c0a140  [bufspacedaemon-0]
100094                   D       sdflush 0xfffffe0058b6c8e8  [/ worker]
    9     0     0     0  DL      psleep  0xffffffff8380ac00  [vmdaemon]
    8     0     0     0  DL      (threaded)                  [pagedaemon]
100077                   D       psleep  0xffffffff837feab8  [dom0]
100080                   D       launds  0xffffffff837feac4  [laundry: dom0]
100081                   D       umarcl  0xffffffff81d3da40  [uma]
    7     0     0     0  DL      -       0xffffffff83496e48  [rand_harvestq]
    6     0     0     0  DL      pftm    0xffffffff842243d0  [pf purge]
    5     0     0     0  DL      waiting 0xffffffff8457a1c0  [sctp_iterator]
    4     0     0     0  DL      (threaded)                  [cam]
100044                   D       -       0xffffffff83479340  [doneq0]
100045                   D       -       0xffffffff834792c0  [async]
100076                   D       -       0xffffffff83479140  [scanner]
   14     0     0     0  DL      seqstat 0xfffffe000795d488  [sequencer 00]
    3     0     0     0  DL      (threaded)                  [crypto]
100040                   D       crypto_ 0xffffffff837fa360  [crypto]
100041                   D       crypto_ 0xfffffe00542c4830  [crypto returns 0]
100042                   D       crypto_ 0xfffffe00542c4880  [crypto returns 1]
   13     0     0     0  DL      (threaded)                  [geom]
100035                   D       -       0xffffffff836a8640  [g_event]
100036                   D       -       0xffffffff836a8660  [g_up]
100037                   D       -       0xffffffff836a8680  [g_down]
    2     0     0     0  WL      (threaded)                  [clock]
100029                   I                                   [clock (0)]
100030                   I                                   [clock (1)]
   12     0     0     0  RL      (threaded)                  [intr]
100016                   I                                   [swi5: fast taskq]
100019                   I                                   [swi6: task queue]
100020                   I                                   [swi6: Giant taskq]
100031                   Run     CPU 1                       [swi1: netisr 0]
100032                   I                                   [swi1: hpts]
100033                   I                                   [swi1: hpts]
100046                   I                                   [irq24: virtio_pci0]
100047                   I                                   [irq25: virtio_pci0]
100048                   I                                   [irq26: virtio_pci0]
100049                   I                                   [irq27: virtio_pci0]
100050                   I                                   [irq28: virtio_pci1]
100051                   I                                   [irq29: virtio_pci1]
100052                   I                                   [irq30: virtio_pci1]
100053                   I                                   [irq31: virtio_pci1]
100054                   I                                   [irq32: virtio_pci1]
100059                   I                                   [irq33: virtio_pci2]
100060                   I                                   [irq34: virtio_pci2]
100061                   I                                   [irq35: virtio_pci2]
100063                   I                                   [irq1: atkbd0]
100064                   I                                   [irq12: psm0]
100065                   I                                   [swi0: uart uart++]
100069                   I                                   [swi1: pf send]
   11     0     0     0  RL      (threaded)                  [idle]
100003                   CanRun                              [idle: cpu0]
100004                   CanRun                              [idle: cpu1]
    1     0     1     0  SLs     wait    0xfffffe00541df040  [init]
   10     0     0     0  DL      audit_w 0xffffffff837fada0  [audit]
    0     0     0     0  DLs     (threaded)                  [kernel]
100000                   D       swapin  0xffffffff836a9060  [swapper]
100005                   D       -       0xfffffe005408c000  [if_io_tqg_0]
100006                   D       -       0xfffffe005408be00  [if_io_tqg_1]
100007                   D       -       0xfffffe005408bd00  [if_config_tqg_0]
100008                   D       -       0xfffffe005408bc00  [softirq_0]
100009                   D       -       0xfffffe005408bb00  [softirq_1]
100010                   D       -       0xfffffe0007966500  [linuxkpi_irq_wq]
100011                   D       -       0xfffffe0007966400  [thread taskq]
100012                   D       -       0xfffffe0007966300  [inm_free taskq]
100013                   D       -       0xfffffe0007966200  [aiod_kick taskq]
100014                   D       -       0xfffffe0007966100  [deferred_unmount ta]
100015                   D       -       0xfffffe0007966000  [in6m_free taskq]
100017                   D       -       0xfffffe0007965d00  [kqueue_ctx taskq]
100018                   D       -       0xfffffe0007965c00  [pci_hp taskq]
100021                   D       -       0xfffffe0007965900  [linuxkpi_short_wq_0]
100022                   D       -       0xfffffe0007965900  [linuxkpi_short_wq_1]
100023                   D       -       0xfffffe0007965900  [linuxkpi_short_wq_2]
100024                   D       -       0xfffffe0007965900  [linuxkpi_short_wq_3]
100025                   D       -       0xfffffe0007965800  [linuxkpi_long_wq_0]
100026                   D       -       0xfffffe0007965800  [linuxkpi_long_wq_1]
100027                   D       -       0xfffffe0007965800  [linuxkpi_long_wq_2]
100028                   D       -       0xfffffe0007965800  [linuxkpi_long_wq_3]
100034                   D       -       0xfffffe0007965700  [firmware taskq]
100038                   D       -       0xfffffe0007965500  [crypto_0]
100039                   D       -       0xfffffe0007965500  [crypto_1]
100055                   D       -       0xfffffe00571cc700  [vtnet0 rxq 0]
100056                   D       -       0xfffffe00571cc600  [vtnet0 txq 0]
100057                   D       -       0xfffffe00571cc500  [vtnet0 rxq 1]
100058                   D       -       0xfffffe00571cc400  [vtnet0 txq 1]
100062                   D       vtbslp  0xfffffe00571a0380  [virtio_balloon]
100066                   D       -       0xffffffff826bf620  [deadlkres]
100070                   D       -       0xfffffe0007c8c200  [acpi_task_0]
100071                   D       -       0xfffffe0007c8c200  [acpi_task_1]
100072                   D       -       0xfffffe0007c8c200  [acpi_task_2]
100073                   D       -       0xfffffe0007966b00  [mca taskq]
100075                   D       -       0xfffffe0007965300  [CAM taskq]
104260                   D       -       0xfffffe0075332900  [system_taskq_0]
104261                   D       -       0xfffffe0075332900  [system_taskq_1]
104262                   D       -       0xfffffe00741fda00  [system_delay_taskq_]
104263                   D       -       0xfffffe00741fda00  [system_delay_taskq_]
104264                   D       -       0xfffffe0075332800  [arc_prune]
30612   777   777     0  Z                                   syz-executor.1
db> show all locks
Process 501 (syslogd) thread 0xfffffe0058c9cc80 (100092)
exclusive lockmgr ufs (ufs) r = 0 (0xfffffe006ccdc3f0) locked @ /syzkaller/managers/i386/kernel/sys/kern/vfs_syscalls.c:3551
Process 12 (intr) thread 0xfffffe005428a560 (100031)
exclusive sleep mutex sctp-inp (inp) r = 0 (0xfffffe0078a6ff90) locked @ /syzkaller/managers/i386/kernel/sys/netinet/sctp_pcb.c:3341
exclusive rw sctp-info (sctp-info) r = 0 (0xfffffe00079e4440) locked @ /syzkaller/managers/i386/kernel/sys/netinet/sctp_pcb.c:3340
exclusive sleep mutex sctp-create (inp_create) r = 0 (0xfffffe0078a6ffb0) locked @ /syzkaller/managers/i386/kernel/sys/netinet/sctp_pcb.c:3339
exclusive sleep mutex sctp-tcb (tcb) r = 0 (0xfffffe0073aee190) locked @ /syzkaller/managers/i386/kernel/sys/netinet/sctp_pcb.c:1473
db> show malloc
              Type        InUse        MemUse     Requests
         sctp_stro          363        11943K        18805
           pf_hash            5        11524K            5
            linker          347         9249K          787
          filedesc          928         7431K        58877
          tcp_hpts            7         4801K            7
            devbuf         4218         4324K         4267
               pcb         2166         3068K       100089
           solaris          136         3066K          227
         sysctloid        48793         2870K        48899
           subproc         1169         2520K        31363
             vtbuf           24         1968K           46
           filemon          166         1328K          886
              kobj          326         1304K          668
            newblk           11         1027K       131436
          vfscache            3         1025K            3
           tcp_fsb          340          702K         8420
          inodedep          105          551K        36038
         sctp_atcl         1457          547K        72271
         ufs_quota            1          512K            1
          vfs_hash            1          512K            1
           callout            2          512K            2
              intr            4          472K            4
              vmem            3          280K            9
           kdtrace         1275          212K        75079
            acpica         1674          184K        57877
              umtx         1452          182K         1452
           tidhash            3          141K            3
           pagedep           11          131K        29707
            DEVFS1          130          130K          147
        tfo_ccache            1          128K            1
          IP reass            1          128K            1
               shm           47          124K          453
         vnet_data            1          112K            1
               sem            4          106K            4
               BPF           46           88K         1960
            CC Mem          332           83K        17360
               bus          988           81K         5135
           md_disk           32           81K           36
          mtx_pool            2           72K            2
         sctp_atky         1827           70K        96105
     NFSD srvcache            3           68K            3
          syncache            1           68K            1
            module          512           64K          512
          acpitask            1           64K            1
       ddb_capture            1           64K            1
              temp           38           55K        10815
        md_sectors           12           48K           12
            kqueue          580           39K        31079
            DEVFS3          149           38K          159
           pwddesc          573           36K        31056
         hostcache            1           32K            1
              GEOM          201           31K         1173
               msg            4           30K            4
            kbdmux            6           28K            6
        gtaskqueue           18           26K           18
            dirrem           94           24K        33291
         sctp_athm         1457           23K        75773
            ifaddr           71           21K           73
           devstat           10           21K           10
        DEVFS_RULE           56           20K           56
          routetbl          144           19K         2996
        kstat_data           18           18K           18
           lltable           56           18K          965
            DEVFSP          274           18K         5873
         sctp_timw           67           17K           67
         ufs_mount            4           17K            5
              proc            3           17K            3
               tty           16           16K           16
           ithread           97           16K           97
           pf_osfp          125           15K          125
            bus-sc           34           15K         1648
         sctp_stri           28           14K         7470
              ksem           35           14K          779
      eventhandler          160           14K          160
       inpcbpolicy          401           13K        19681
            KTRACE          101           13K     18190945
       ether_multi          157           13K          259
             ifnet            7           13K            7
          freefile           92           12K        32609
              kenv           95           12K           95
          sctp_map          726           12K        38760
         proc-args          578           12K        32203
         sctp_aadr          171           11K          482
              rman           88           11K          431
         CAM queue            5           11K         1528
             mount           32           10K          214
         in6_multi           71            9K           72
         taskqueue           81            9K          114
         bmsafemap            2            9K        36008
               rpc            4            9K            4
              UART           12            9K           12
       pfs_vncache            1            8K            1
             shmfd            1            8K          185
     audit_evclass          237            8K          297
               UMA          375            8K          375
              cred           28            7K          783
           session           54            7K          264
               osd          360            7K        17304
            sglist            5            7K            5
           CAM DEV            3            6K          510
            plimit           24            6K          654
          pf_ifnet           16            6K          618
            ip6opt           33            6K          721
         pfs_nodes           20            5K           20
       ufs_dirhash           24            5K           24
             lockf           40            5K         1002
                vt           11            5K           11
          pf_table            2            4K          642
           memdesc            1            4K            1
               MCA           32            4K           32
             evdev            4            4K            4
           acpisem           28            4K           28
             hhook           15            4K           17
          kcovinfo           52            4K           52
             selfd           50            4K      1603789
          terminal           11            3K           11
         cryptodev           42            3K         5212
            select           19            3K          553
             clone            9            3K           16
           uidinfo            3            3K          187
        local_apic            1            2K            1
           io_apic            1            2K            1
       fpukern_ctx            2            2K            2
         ipsec-saq            2            2K            2
            ip6ndp           12            2K           15
          sctp_ifa           14            2K           15
            Unitno           28            2K          577
           CAM XPT           22            2K          543
          freework            7            2K        71297
               msi           12            2K           12
          freeblks            6            2K        33898
          in_multi            6            2K           26
       vnodemarker            3            2K         2965
       ipsecpolicy            2            2K            2
           acpidev           20            2K           20
               tun            7            2K            7
      NFSD session            1            1K            1
           softdep            1            1K            1
             mkdir            8            1K        58018
            sahead            1            1K            1
          secasvar            1            1K            1
             nhops            6            1K            8
           eventfd            8            1K          168
        ip_msource           14            1K           82
        CAM periph            4            1K          271
             sigio           14            1K           47
          sctp_ifn            6            1K           15
             ipsec            3            1K            3
         newdirblk            6            1K        29009
               mld            6            1K            6
              igmp            6            1K            6
              pfil            6            1K            6
         toponodes            6            1K            6
            isadev            6            1K            6
          pci_link           10            1K           10
           pf_rule            5            1K          459
            crypto            4            1K         1395
 encap_export_host           12            1K           12
          procdesc            5            1K           18
filedesc_to_leader            9            1K           35
            diradd            4            1K        33336
              cdev            2            1K            2
           netlink            2            1K            3
    chacha20random            1            1K            1
            biobuf            1            1K            1
      NFSD lckfile            1            1K            1
     NFSD V4client            1            1K            1
             DEVFS            9            1K           10
            vnodes            1            1K           50
           CAM SIM            2            1K            2
            prison            8            1K            8
            feeder            7            1K            7
             taskq            2            1K            2
           tcpfunc            3            1K            3
        loginclass            3            1K           12
       lkpikmalloc            5            1K            6
            soname            6            1K        67148
        aesni_data            2            1K            2
          nexusdev            8            1K            8
            apmdev            1            1K            1
          atkbddev            2            1K            2
     CAM dev queue            2            1K            2
 CAM I/O Scheduler            1            1K            1
               aio            4            1K           22
          CAM path            4            1K         1034
          pmchooks            1            1K            1
          filecaps            5            1K          151
          sctp_vrf            1            1K            1
              vnet            1            1K            1
           entropy            2            1K           52
               pmc            1            1K            1
          acpiintr            1            1K            1
              cpus            2            1K            2
    vnet_data_free            1            1K            1
           Per-cpu            1            1K            1
          p1003.1b            1            1K            1
         sfs_nodes            0            0K            0
        zones_data            0            0K            0
        sctp_mcore            0            0K            0
        sctp_socko            0            0K        25442
         sctp_iter            0            0K           86
         sctp_mvrf            0            0K            0
         sctp_cpal            0            0K           76
         sctp_cmsg            0            0K            0
         sctp_stre            0            0K            0
         sctp_athi            0            0K            0
         sctp_a_it            0            0K           21
            mqdata            0            0K            0
           pf_altq            0            0K            0
     pf_krule_item            0            0K            0
           pf_temp            0            0K            0
            ipcomp            0            0K            0
               esp            0            0K            0
                ah            0            0K            0
            tcp_do            0            0K            0
     md_intel_data            0            0K            0
       md_ddf_data            0            0K            0
        madt_table            0            0K            2
          smartpqi            0            0K            0
         raid_data            0            0K          192
     geom_flashmap            0            0K            0
               ixl            0            0K            0
         tmpfs dir            0            0K            0
        tmpfs name            0            0K            0
       tmpfs mount            0            0K            0
     tmpfs extattr            0            0K            0
           NFS FHA            0            0K            0
        ice-resmgr            0            0K            0
         ice-osdep            0            0K            0
               ice            0            0K            0
              iavf            0            0K            0
             axgbe            0            0K            0
         newnfsmnt            0            0K            0
  newnfsclient_req            0            0K            0
   NFSCL layrecall            0            0K            0
     NFSCL session            0            0K            0
     NFSCL sockreq            0            0K            0
     NFSCL devinfo            0            0K            0
     NFSCL flayout            0            0K            0
      NFSCL layout            0            0K            0
     NFSD rollback            0            0K            0
          xen_intr            0            0K            0
      NFSCL diroff            0            0K            0
       NEWdirectio            0            0K            0
           xen_hvm            0            0K            0
         legacydrv            0            0K            0
            bounce            0            0K            0
            busdma            0            0K            0
            qpidrv            0            0K            0
        NEWNFSnode            0            0K            0
         NFSCL lck            0            0K            0
      dmar_idpgtbl            0            0K            0
          dmar_dom            0            0K            0
          dmar_ctx            0            0K            0
      NFSCL lckown            0            0K            0
      NFSCL client            0            0K            0
       NFSCL deleg            0            0K            0
              isci            0            0K            0
      iommu_dmamap            0            0K            0
        NFSCL open            0            0K            0
     hyperv_socket            0            0K            0
           bxe_ilt            0            0K            0
       NFSCL owner            0            0K            0
            xenbus            0            0K            0
            NFS fh            0            0K            0
           NFS req            0            0K            0
     NFSD usrgroup            0            0K            0
     vm_fictitious            0            0K            0
       NFSD string            0            0K            0
       NFSD V4lock            0            0K            0
      NFSD V4state            0            0K            0
       msdosfs_fat            0            0K            0
     msdosfs_mount            0            0K            0
      msdosfs_node            0            0K            0
           UMAHash            0            0K            0
            DEVFS4            0            0K            0
         vm_pgdata            0            0K            0
           jblocks            0            0K            0
          savedino            0            0K        44623
          sentinel            0            0K            0
            jfsync            0            0K            0
            jtrunc            0            0K            0
             sbdep            0            0K         1495
           jsegdep            0            0K            0
              jseg            0            0K            0
         jfreefrag            0            0K            0
          jfreeblk            0            0K            0
           jnewblk            0            0K            0
            jmvref            0            0K            0
           jremref            0            0K            0
           jaddref            0            0K            0
           freedep            0            0K            0
          freefrag            0            0K         1015
        allocindir            0            0K            0
          indirdep            0            0K        55939
       allocdirect            0            0K            0
          ufs_trim            0            0K            0
           mactemp            0            0K            0
     audit_trigger            0            0K            0
 audit_pipe_presel            0            0K            0
     audit_pipeent            0            0K            0
        audit_pipe            0            0K            0
      audit_evname            0            0K            0
         audit_bsm            0            0K            0
      audit_gidset            0            0K            0
        audit_text            0            0K            0
        audit_path            0            0K            0
        audit_data            0            0K            0
        audit_cred            0            0K            0
            DEVFS2            0            0K            0
            gntdev            0            0K            0
       privcmd_dev            0            0K            0
        evtchn_dev            0            0K            0
          xenstore            0            0K            0
         scsi_pass            0            0K            0
         ciss_data            0            0K            0
               xnb            0            0K            0
          xen_acpi            0            0K            0
              xbbd            0            0K            0
               xbd            0            0K            0
           Balloon            0            0K            0
          sysmouse            0            0K            0
            vtfont            0            0K            0
          ktls_ocf            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
      MLX5E_TLS_RX            0            0K            0
        MLX5EEPROM            0            0K            0
         MLX5E_TLS            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
            MLX5EN            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
          MLX5DUMP            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
        MLX5EEPROM            0            0K            0
       simple_attr            0            0K            0
          seq_file            0            0K            0
           lkpiskb            0            0K            0
             radix            0            0K            0
               idr            0            0K            0
          lkpindev            0            0K            0
           lkpimhi            0            0K            0
            lkpifw            0            0K            0
         lkpi80211            0            0K            0
               NLM            0            0K            0
    ipsec-spdcache            0            0K            0
         ipsec-reg            0            0K            0
        ipsec-misc            0            0K            0
      ipsecrequest            0            0K            0
       ip6_msource            0            0K            0
      ip6_moptions            0            0K           16
       in6_mfilter            0            0K            1
             frag6            0            0K           77
            tcplog            0            0K            0
        tcp_hwpace            0            0K            0
         BACKLIGHT            0            0K            0
               LRO            0            0K            0
       ip_moptions            0            0K           89
        in_mfilter            0            0K          184
              ipid            0            0K            0
         80211scan            0            0K            0
      80211ratectl            0            0K            0
        80211power            0            0K            0
       80211nodeie            0            0K            0
         80211node            0            0K            0
      80211mesh_gt            0            0K            0
      80211mesh_rt            0            0K            0
         80211perr            0            0K            0
         80211prep            0            0K            0
         80211preq            0            0K            0
          80211dfs            0            0K            0
       80211crypto            0            0K            0
          80211vap            0            0K            0
             iflib            0            0K            0
              vlan            0            0K            0
               gif            0            0K            0
           ifdescr            0            0K            0
              zlib            0            0K            0
           fadvise            0            0K            0
           VN POLL            0            0K           11
           ath_hal            0            0K            0
            statfs            0            0K        29670
     namei_tracker            0            0K           78
       export_host            0            0K            0
        cl_savebuf            0            0K          237
            athdev            0            0K            0
           ata_pci            0            0K            0
           ata_dma            0            0K            0
       ata_generic            0            0K            0
            pvscsi            0            0K            0
           scsi_da            0            0K           69
            ata_da            0            0K            0
           scsi_ch            0            0K            0
           scsi_cd            0            0K            0
       AHCI driver            0            0K            0
            USBdev            0            0K            0
               USB            0            0K            0
               agp            0            0K            0
           nvme_da            0            0K            0
           acpipwr            0            0K            0
         acpi_perf            0            0K            0
            twsbuf            0            0K            0
       tcp_log_dev            0            0K         1052
               lio            0            0K          122
               acl            0            0K            0
      midi buffers            0            0K            0
          mbuf_tag            0            0K            0
              ktls            0            0K            0
             mixer            0            0K            0
              ac97            0            0K            0
             hdacc            0            0K            0
              hdac            0            0K            0
              hdaa            0            0K            0
         acpicmbat            0            0K            0
       SIIS driver            0            0K            0
           CAM CCB            0            0K          523
               PUC            0            0K            0
          ppbusdev            0            0K            0
            sr_iov            0            0K            0
               OCS            0            0K            0
               OCS            0            0K            0
              nvme            0            0K            0
               nvd            0            0K            0
            netmap            0            0K            0
            mwldev            0            0K            0
        MVS driver            0            0K            0
     CAM ccb queue            0            0K            0
              accf            0            0K            0
               pts            0            0K            0
               iov            0            0K        38322
          ioctlops            0            0K         2294
           Witness            0            0K            0
             stack            0            0K            0
          mrsasbuf            0            0K            0
          mpt_user            0            0K            0
          mps_user            0            0K            0
            MPSSAS            0            0K            0
               mps            0            0K            0
              sbuf            0            0K          564
          mpr_user            0            0K            0
          firmware            0            0K            0
        compressor            0            0K            0
            MPRSAS            0            0K            0
              SWAP            0            0K            0
               mpr            0            0K            0
            mfibuf            0            0K            0
         sysctltmp            0            0K         1399
            sysctl            0            0K            3
              ekcd            0            0K            0
            dumper            0            0K            0
          sendfile            0            0K           28
              rctl            0            0K            0
           malodev            0            0K            0
               LED            0            0K            0
          ix_sriov            0            0K            0
             cache            0            0K            0
        aacraidcam            0            0K            0
      prison_racct            0            0K            0
       Fail Points            0            0K            0
               pwd            0            0K            0
       tty console            0            0K            0
                ix            0            0K            0
            ipsbuf            0            0K            0
       aacraid_buf            0            0K            0
            aaccam            0            0K            0
         boottrace            0            0K            0
            aacbuf            0            0K            0
              zstd            0            0K            0
            XZ_DEC            0            0K            0
            nvlist            0            0K            0
          SCSI ENC            0            0K            0
           SCSI sa            0            0K            0
        isofs_node            0            0K            0
       isofs_mount            0            0K            0
     tr_raid5_data            0            0K            0
    tr_raid1e_data            0            0K            0
     tr_raid1_data            0            0K            0
     tr_raid0_data            0            0K            0
    tr_concat_data            0            0K            0
       md_sii_data            0            0K            0
   md_promise_data            0            0K            0
    md_nvidia_data            0            0K            0
   md_jmicron_data            0            0K            0
db> show uma
              Zone   Size    Used    Free    Requests  Sleeps  Bucket  Total Mem    XFree
   mbuf_jumbo_page   4096    8782    4680      784475       0     254   55140352        0
              mbuf    256   14498   39866    22018294       0     254   13917184        0
      malloc-16384  16384     465       4       29448       0       1    7684096        0
         malloc-64     64     988  106742     1635887       0     254    6894720        0
        RADIX NODE    144   25831     736      813621       0      63    3825648        0
      mbuf_cluster   2048    1016     508        1022       0     254    3121152        0
       malloc-4096   4096     592       4       31175       0       2    2441216        0
           tcp_log    416     522    5328      192670       0     254    2433600        0
       malloc-2048   2048    1074      30       49952       0       8    2260992        0
        256 Bucket   2048     926      92       91703       0      10    2084864        0
       malloc-4096   4096     498       8        5022       0       2    2072576        0
        malloc-128    128   15958     193       16508       0     126    2067328        0
       UMA Slabs 0    112   17912      10       17912       0     126    2007264        0
        malloc-384    384    4850     190       42090       0      30    1935360        0
         vmem btag     56   33633     102       33698       0     254    1889160        0
         VM OBJECT    264    6917      43      362882       0      30    1837440        0
           sctp_ep   1176    1066     464       49695       0     254    1799280        0
         sctp_asoc   2264     363     402       18417       0     254    1731960        0
          BUF TRIE    144     654   11162      103341       0      62    1701504        0
            socket    960    1200     324       72618       0     254    1463040        0
        sctp_chunk    152    1032    8380     1030023       0     254    1430624        0
         MAP ENTRY     96   14534     334     1101859       0     126    1427328        0
       malloc-8192   8192     170       4         890       0       1    1425408        0
         FFS inode   1160    1138      24       33818       0       8    1347920        0
    ertt_txseginfo     40       0   33330    12280448       0     254    1333200        0
            THREAD   1824     700      26       44454       0       8    1324224        0
zio_buf_comb_1048576 1048576       0       1          15       0       1    1048576        0
              PROC   1376     573      21       30623       0       8     817344        0
        sctp_raddr    736     507     516       24317       0     254     752928        0
         filedesc0   1072     573      22       31056       0       8     637840        0
     FPU_save_area    832     702      36       49824       0      16     614016        0
        malloc-384    384    1459      71       72647       0      30     587520        0
             VNODE    448    1179     117       33861       0      30     580608        0
       tcp_bbr_map    128      68    3714      621232       0     126     484096        0
         tcp_inpcb   1304     332      28       17259       0       8     469440        0
      malloc-65536  65536       2       5        1457       0       1     458752        0
              pbuf   2624       0     166           0       0       2     435584        0
       malloc-1024   1024     359      41       18143       0      16     409600        0
      malloc-65536  65536       4       2          52       0       1     393216        0
            lkpimm    168       1    2327           1       0      62     391104        0
          lkpicurr    168       2    2326           2       0      62     391104        0
         malloc-64     64    5249     358        5325       0     254     358848        0
        malloc-256    256    1258     107       53787       0      62     349440        0
         malloc-16     16   20006     494       20194       0     254     328000        0
       FFS2 dinode    256    1138      47       33817       0      62     303360        0
        malloc-256    256     831     354      226567       0      62     303360        0
           VMSPACE    520     526      44       30542       0      16     296400        0
         UMA Zones    768     347       2         347       0      16     268032        0
      malloc-32768  32768       0       8       52848       0       1     262144        0
        malloc-128    128    1838     208        6236       0     126     261888        0
       mbuf_packet    256     189     827      276559       0     254     260096        0
         malloc-32     32    7678     260        7715       0     254     254016        0
            DEVCTL   1024       0     220         194       0       0     225280        0
        malloc-256    256     640     230       54220       0      62     222720        0
      tcp_rack_pcb   1024     170      38        4210       0      16     212992        0
        malloc-128    128    1555      88       34905       0     126     210304        0
      malloc-65536  65536       2       1          10       0       1     196608        0
       malloc-2048   2048       6      90        1678       0       8     196608        0
             Files     80    1958     192      137548       0     126     172000        0
       malloc-1024   1024     143      17         519       0      16     163840        0
       S VFS Cache    104    1104     417       35661       0     126     158184        0
        128 Bucket   1024     107      40       10155       0      16     150528        0
          UMA Kegs    384     334       9         334       0      30     131712        0
zio_buf_comb_131072 131072       0       1           1       0       1     131072        0
      malloc-65536  65536       0       2         126       0       1     131072        0
      malloc-32768  32768       2       2         122       0       1     131072        0
        malloc-128    128     699     324      124511       0     126     130944        0
             unpcb    256      68     442        3050       0     254     130560        0
          ksiginfo    112     577     467        7240       0     126     116928        0
         malloc-64     64    1344     483       35559       0     254     116928        0
         malloc-64     64    1225     602     7199342       0     254     116928        0
       malloc-8192   8192       7       7         142       0       1     114688        0
       malloc-2048   2048      46      10         486       0       8     114688        0
         TURNSTILE    136     727      92         727       0      62     111384        0
       malloc-4096   4096      24       2         398       0       2     106496        0
       malloc-4096   4096      22       4          24       0       2     106496        0
      malloc-32768  32768       1       2          20       0       1      98304        0
      malloc-16384  16384       0       6          61       0       1      98304        0
        malloc-256    256     130     245       73088       0      62      96000        0
       malloc-8192   8192       9       2          21       0       1      90112        0
          syncache    168       0     528          19       0     254      88704        0
              pipe    728      73      48        2756       0      16      88088        0
         64 Bucket    512      91      77       58533       0      30      86016        0
             g_bio    408       0     210      840892       0      30      85680        0
         malloc-64     64     728     595       57806       0     254      84672        0
            vnpbuf   2624       0      32          13       0      16      83968        0
      malloc-16384  16384       5       0           5       0       1      81920        0
      malloc-16384  16384       0       5          13       0       1      81920        0
        sctp_readq    152       0     520       36797       0     254      79040        0
        SLEEPQUEUE     88     727      41         727       0     126      67584        0
        malloc-128    128     223     304       34478       0     126      67456        0
       tcp_bbr_pcb    832      34      47        8916       0      16      67392        0
      malloc-65536  65536       1       0           1       0       1      65536        0
      malloc-65536  65536       0       1           1       0       1      65536        0
      malloc-65536  65536       1       0           1       0       1      65536        0
      malloc-32768  32768       0       2          21       0       1      65536        0
      malloc-32768  32768       2       0           2       0       1      65536        0
       malloc-4096   4096      12       4          28       0       2      65536        0
       malloc-2048   2048      14      18         114       0       8      65536        0
       malloc-1024   1024      25      39         742       0      16      65536        0
       malloc-1024   1024      38      26        2332       0      16      65536        0
        malloc-256    256      54     201       66641       0      62      65280        0
         32 Bucket    256     112     143       13647       0      62      65280        0
sctp_stream_msg_out    112     236     304        6077       0     254      60480        0
         malloc-32     32    1550     340     1289056       0     254      60480        0
       malloc-4096   4096      12       2          21       0       2      57344        0
         udp_inpcb    424      19     107         831       0      30      53424        0
            pcpu-8      8    6003     653       34900       0     254      53248        0
               PWD     40     453     860       28869       0     254      52520        0
      tcp_rack_map    128     262     141       13560       0     126      51584        0
        malloc-256    256       6     189       36989       0      62      49920        0
             ripcb    392      34      92        1149       0      30      49392        0
              md10    512      68      28          68       0      30      49152        0
               md8    512      68      28          68       0      30      49152        0
               md6    512      68      28          68       0      30      49152        0
               md4    512      68      28          68       0      30      49152        0
zio_data_buf_16384  16384       0       3           9       0       1      49152        0
           DIRHASH   1024      35      13          35       0      16      49152        0
             NAMEI   1024       0      48      163105       0      16      49152        0
      malloc-16384  16384       1       2         161       0       1      49152        0
       malloc-8192   8192       1       5         160       0       1      49152        0
       malloc-8192   8192       4       2          10       0       1      49152        0
       malloc-2048   2048       2      22        2322       0       8      49152        0
        malloc-512    512      12      84        2974       0      30      49152        0
        malloc-512    512      28      68        7470       0      30      49152        0
        malloc-512    512      11      85        1893       0      30      49152        0
           pcpu-64     64     491     277         491       0     254      49152        0
        malloc-384    384      63      57          63       0      30      46080        0
        malloc-384    384      56      64        2541       0      30      46080        0
          rl_entry     40     560     551         561       0     254      44440        0
       malloc-8192   8192       2       3          44       0       1      40960        0
        sctp_laddr     48     254     586       13920       0     254      40320        0
     udplite_inpcb    424      16      74         442       0      30      38160        0
            da_ccb    544       0      70      210295       0      16      38080        0
         hostcache     64       3     564           3       0     254      36288        0
   tcp_inpcb ports     32      16    1118       10840       0     254      36288        0
              ertt     72     332     172       17259       0     126      36288        0
         malloc-64     64      44     523          75       0     254      36288        0
         malloc-64     64       0     567          98       0     254      36288        0
         16 Bucket    144     121     131       10838       0      62      36288        0
          8 Bucket     80      59     391        8898       0     126      36000        0
        malloc-128    128      90     189        1838       0     126      35712        0
        malloc-128    128      81     198         427       0     126      35712        0
        malloc-128    128      18     261          22       0     126      35712        0
            itimer    352       0      99         346       0      30      34848        0
     routing nhops    256      27     108          37       0      62      34560        0
           ttyoutq    256      72      63         160       0      62      34560        0
        malloc-256    256      15     120         391       0      62      34560        0
        malloc-256    256      29     106         449       0      62      34560        0
     zio_buf_16384  16384       0       2          10       0       1      32768        0
       malloc-4096   4096       0       8       29676       0       2      32768        0
       malloc-2048   2048       4      12          50       0       8      32768        0
       malloc-2048   2048       9       7         167       0       8      32768        0
       malloc-1024   1024       3      29         134       0      16      32768        0
       malloc-1024   1024       4      28           8       0      16      32768        0
       malloc-1024   1024       4      28           4       0      16      32768        0
        malloc-512    512       2      62         233       0      30      32768        0
        malloc-512    512       5      59          68       0      30      32768        0
        malloc-512    512       0      64         713       0      30      32768        0
        malloc-512    512       2      62          89       0      30      32768        0
               ipq     56       0     576           2       0     254      32256        0
             KNOTE    160      28     172      269871       0      62      32000        0
            ttyinq    160     135      65         300       0      62      32000        0
         malloc-16     16    1311     689       78105       0     254      32000        0
         malloc-16     16    1461     539       75780       0     254      32000        0
   tcp_log_id_node    120       0     264          22       0     126      31680        0
            clpbuf   2624       0      12        1706       0       4      31488        0
       L VFS Cache    320       0      96          79       0      30      30720        0
            cpuset    104      66     213        1475       0     126      29016        0
   sctp_asconf_ack     48       0     588          36       0     254      28224        0
          tcpreass     48       0     588          70       0     254      28224        0
         malloc-32     32     278     604        2374       0     254      28224        0
         malloc-32     32     412     470       20251       0     254      28224        0
         malloc-32     32     312     570       33859       0     254      28224        0
         malloc-32     32     576     306       31410       0     254      28224        0
          4 Bucket     48       7     581          93       0     254      28224        0
          2 Bucket     32      99     783       12624       0     254      28224        0
               AIO    208       0     133         582       0      62      27664        0
             AIOCB    552       0      49         618       0      16      27048        0
       malloc-8192   8192       3       0           3       0       1      24576        0
 tcp_log_id_bucket    176       0     138          11       0      62      24288        0
              PGRP     88      55     221         326       0     126      24288        0
           rtentry    168      31     113          37       0      62      24192        0
        malloc-384    384       0      60         195       0      30      23040        0
         domainset     40       0     567        1153       0     254      22680        0
       Mountpoints   2816       2       6           3       0       4      22528        0
tfo_ccache_entries     80       8     248           8       0     126      20480        0
udplite_inpcb ports     32       0     630          29       0     254      20160        0
   udp_inpcb ports     32       3     627         171       0     254      20160        0
         malloc-32     32      17     613        1294       0     254      20160        0
         malloc-16     16     415     835     9850724       0     254      20000        0
           cryptop    280       0      70         276       0      30      19600        0
            AIOLIO    272       0      70          61       0      30      19040        0
 epoch_record pcpu    256       4      60           4       0      62      16384        0
      malloc-16384  16384       1       0           1       0       1      16384        0
      malloc-16384  16384       1       0           1       0       1      16384        0
       malloc-1024   1024       0      16           1       0      16      16384        0
        malloc-512    512       1      31           6       0      30      16384        0
           SMR CPU     32       7     504           7       0     254      16352        0
      vtnet_tx_hdr     24       0     668     2435731       0     254      16032        0
         malloc-16     16     545     455       36625       0     254      16000        0
              kenv    258      15      45        1055       0      30      15480        0
            mqnode    416       3      33           3       0      30      14976        0
              vmem   1856       1       7           1       0       8      14848        0
        SMR SHARED     24       7     504           7       0     254      12264        0
         malloc-32     32       7     371           7       0     254      12096        0
         malloc-16     16      15     735          17       0     254      12000        0
         malloc-16     16      42     708       20822       0     254      12000        0
        malloc-384    384       1      29           1       0      30      11520        0
        malloc-384    384       0      30           1       0      30      11520        0
arc_buf_hdr_t_full    344       4      29           4       0      30      11352        0
       malloc-8192   8192       0       1           1       0       1       8192        0
           pcpu-16     16       8     504           8       0     254       8192        0
         malloc-16     16       0     500           1       0     254       8000        0
       UMA Slabs 1    176      12      10          12       0      62       3872        0
        KMAP ENTRY     96      15      24          23       0       0       3744        0
              md15      4       0       0           0       0     254          0        0
              md14      4       0       0           0       0     254          0        0
              md13      4       0       0           0       0     254          0        0
              md12      4       0       0           0       0     254          0        0
               md3      4       0       0           0       0     254          0        0
               md2      4       0       0           0       0     254          0        0
               md1      4       0       0           0       0     254          0        0
               md0      4       0       0           0       0     254          0        0
   zfs_znode_cache    464       0       0           0       0      30          0        0
       sio_cache_2    168       0       0           0       0      62          0        0
       sio_cache_1    152       0       0           0       0      62          0        0
       sio_cache_0    136       0       0           0       0      62          0        0
     zil_zcw_cache     80       0       0           0       0     126          0        0
     zil_lwb_cache    376       0       0           0       0      30          0        0
    dmu_buf_impl_t    408       0       0           0       0      30          0        0
         arc_buf_t     32       0       0           0       0     254          0        0
arc_buf_hdr_t_l2only     96       0       0           0       0     126          0        0
arc_buf_hdr_t_full_crypt    408       0       0           0       0      30          0        0
           dnode_t   1016       0       0           0       0      16          0        0
          sa_cache    296       0       0           0       0      30          0        0
         abd_chunk   4096       0       0           0       0       2          0        0
zio_buf_comb_16777216 16777216       0       0           0       0       1          0        0
zio_buf_comb_14680064 14680064       0       0           0       0       1          0        0
zio_buf_comb_12582912 12582912       0       0           0       0       1          0        0
zio_buf_comb_10485760 10485760       0       0           0       0       1          0        0
zio_buf_comb_8388608 8388608       0       0           0       0       1          0        0
zio_buf_comb_7340032 7340032       0       0           0       0       1          0        0
zio_buf_comb_6291456 6291456       0       0           0       0       1          0        0
zio_buf_comb_5242880 5242880       0       0           0       0       1          0        0
zio_buf_comb_4194304 4194304       0       0           0       0       1          0        0
zio_buf_comb_3670016 3670016       0       0           0       0       1          0        0
zio_buf_comb_3145728 3145728       0       0           0       0       1          0        0
zio_buf_comb_2621440 2621440       0       0           0       0       1          0        0
zio_buf_comb_2097152 2097152       0       0           0       0       1          0        0
zio_buf_comb_1835008 1835008       0       0           0       0       1          0        0
zio_buf_comb_1572864 1572864       0       0           0       0       1          0        0
zio_buf_comb_1310720 1310720       0       0           0       0       1          0        0
zio_buf_comb_917504 917504       0       0           0       0       1          0        0
zio_buf_comb_786432 786432       0       0           0       0       1          0        0
zio_buf_comb_655360 655360       0       0           0       0       1          0        0
zio_buf_comb_524288 524288       0       0           0       0       1          0        0
zio_buf_comb_458752 458752       0       0           0       0       1          0        0
zio_buf_comb_393216 393216       0       0           0       0       1          0        0
zio_buf_comb_327680 327680       0       0           0       0       1          0        0
zio_buf_comb_262144 262144       0       0           0       0       1          0        0
zio_buf_comb_229376 229376       0       0           0       0       1          0        0
zio_buf_comb_196608 196608       0       0           0       0       1          0        0
zio_buf_comb_163840 163840       0       0           0       0       1          0        0
zio_buf_comb_114688 114688       0       0           0       0       1          0        0
zio_buf_comb_98304  98304       0       0           0       0       1          0        0
zio_buf_comb_81920  81920       0       0           0       0       1          0        0
zio_buf_comb_65536  65536       0       0           0       0       1          0        0
zio_buf_comb_57344  57344       0       0           0       0       1          0        0
zio_buf_comb_49152  49152       0       0           0       0       1          0        0
zio_buf_comb_40960  40960       0       0           0       0       1          0        0
zio_buf_comb_32768  32768       0       0           0       0       1          0        0
zio_buf_comb_28672  28672       0       0           0       0       1          0        0
zio_buf_comb_24576  24576       0       0           0       0       1          0        0
zio_buf_comb_20480  20480       0       0           0       0       1          0        0
zio_data_buf_14336  14336       0       0           0       0       1          0        0
     zio_buf_14336  14336       0       0           0       0       1          0        0
zio_data_buf_12288  12288       0       0           0       0       1          0        0
     zio_buf_12288  12288       0       0           0       0       1          0        0
zio_data_buf_10240  10240       0       0           0       0       1          0        0
     zio_buf_10240  10240       0       0           0       0       1          0        0
 zio_data_buf_8192   8192       0       0           0       0       1          0        0
      zio_buf_8192   8192       0       0           0       0       1          0        0
 zio_data_buf_7168   7168       0       0           0       0       1          0        0
      zio_buf_7168   7168       0       0           0       0       1          0        0
 zio_data_buf_6144   6144       0       0           0       0       1          0        0
      zio_buf_6144   6144       0       0           0       0       1          0        0
 zio_data_buf_5120   5120       0       0           0       0       1          0        0
      zio_buf_5120   5120       0       0           0       0       1          0        0
 zio_data_buf_4096   4096       0       0           0       0       2          0        0
      zio_buf_4096   4096       0       0           0       0       2          0        0
 zio_data_buf_3584   3584       0       0           0       0       2          0        0
      zio_buf_3584   3584       0       0           0       0       2          0        0
 zio_data_buf_3072   3072       0       0           0       0       4          0        0
      zio_buf_3072   3072       0       0           0       0       4          0        0
 zio_data_buf_2560   2560       0       0           0       0       4          0        0
      zio_buf_2560   2560       0       0           0       0       4          0        0
 zio_data_buf_2048   2048       0       0           0       0       8          0        0
      zio_buf_2048   2048       0       0           0       0       8          0        0
 zio_data_buf_1536   1536       0       0           0       0       8          0        0
      zio_buf_1536   1536       0       0           0       0       8          0        0
 zio_data_buf_1024   1024       0       0           0       0      16          0        0
      zio_buf_1024   1024       0       0           0       0      16          0        0
  zio_data_buf_512    512       0       0           0       0      30          0        0
       zio_buf_512    512       0       0           0       0      30          0        0
    zio_link_cache     48       0       0           0       0     254          0        0
         zio_cache   1216       0       0           0       0       8          0        0
   ddt_entry_cache    392       0       0           0       0      30          0        0
         ddt_cache  24824       0       0           0       0       1          0        0
brt_pending_entry_cache    160       0       0           0       0      62          0        0
   brt_entry_cache     40       0       0           0       0     254          0        0
metaslab_alloc_trace_cache     72       0       0           0       0     126          0        0
zfs_btree_leaf_cache   4096       0       0           0       0       2          0        0
   reference_cache     48       0       0           0       0     254          0        0
        taskq_zone    192       0       0           0       0      62          0        0
       FFS1 dinode    128       0       0           0       0     126          0        0
           ada_ccb    272       0       0           0       0      30          0        0
             swblk    136       0       0           0       0      62          0        0
          swpctrie    144       0       0           0       0      62          0        0
   pf state scrubs     40       0       0           0       0     254          0        0
   pf frag entries     40       0       0           0       0     254          0        0
          pf frags    248       0       0           0       0      62          0        0
  pf table entries    160       0       0           0       0     254          0        0
pf table entry counters     64       0       0           0       0     254          0        0
   pf source nodes    152       0       0           0       0     254          0        0
     pf state keys     88       0       0           0       0     126          0        0
         pf states    344       0       0           0       0       0          0        0
           pf tags    104       0       0           0       0     126          0        0
          pf mtags    184       0       0           0       0      62          0        0
               tfo      4       0       0           0       0     254          0        0
          sackhole     32       0       0           0       0     254          0        0
       sctp_asconf     40       0       0           0       0     254          0        0
       ripcb ports     32       0       0           0       0     254          0        0
    IPsec SA lft_c     16       0       0           0       0     254          0        0
           netlink   2048       0       0           0       0       8          0        0
           NCLNODE    608       0       0           0       0      16          0        0
        TMPFS node    232       0       0           0       0      62          0        0
        mqnotifier    216       0       0           0       0      62          0        0
            mvdata     64       0       0           0       0     254          0        0
            mqueue    248       0       0           0       0      62          0        0
     LTS VFS Cache    360       0       0           0       0      30          0        0
     STS VFS Cache    144       0       0           0       0      62          0        0
  linux_dma_object     32       0       0           0       0     254          0        0
  linux_dma_pctrie    144       0       0           0       0      62          0        0
   IOMMU_MAP_ENTRY    104       0       0           0       0     126          0        0
    mbuf_jumbo_16k  16384       0       0           0       0     254          0        0
     mbuf_jumbo_9k   9216       0       0           0       0     254          0        0
      audit_record   1280       0       0           0       0       8          0        0
        MAC labels     40       0       0           0       0     254          0        0
           nfspbuf   2624       0       0           0       0       4          0        0
            swwbuf   2624       0       0           0       0       2          0        0
            swrbuf   2624       0       0           0       0       4          0        0
          umtx_shm     88       0       0           0       0     126          0        0
           umtx pi     96       0       0           0       0     126          0        0
rangeset pctrie nodes    144       0       0           0       0      62          0        0
      malloc-65536  65536       0       0           0       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
      malloc-32768  32768       0       0           0       0       1          0        0
      malloc-16384  16384       0       0           0       0       1          0        0
       malloc-4096   4096       0       0           0       0       2          0        0
       malloc-2048   2048       0       0           0       0       8          0        0
        malloc-384    384       0       0           0       0      30          0        0
         malloc-64     64       0       0           0       0     254          0        0
           pcpu-32     32       0       0           0       0     254          0        0
            pcpu-4      4       0       0           0       0     254          0        0
            fakepg    104       0       0           0       0     126          0        0
          UMA Hash    256       0       0           0       0      62          0        0

Crashes (1):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2023/06/28 23:02 freebsd-src d036adc4e913 ee50e71c console log report ci-freebsd-i386 panic: _mtx_lock_sleep: recursed on non-recursive mutex sctp-tcb @ /syzkaller/managers/i386/kernel/sys/netinet/sctp_pcb.
* Struck through repros no longer work on HEAD.