panic: acquiring blocpkaanbilec: k er snleele p lo c k w i th s p i nl o c k or c r i ti ca l s ec t i o n h e l d (k e r ne l _ l o c k ) &k er n e l_ l o c k
dStopped at db_enter+0x18: addq $0x8,%rsp
TID PID UID PRFLAGS PFLAGS CPU COMMAND
* 55586 69397 0 0 0x4000000 1 syz-executor.0
244276 26886 0 0x14000 0x200 0 reaper
db_enter() at db_enter+0x18 sys/arch/amd64/amd64/db_interface.c:440
panic(ffffffff825a56b6) at panic+0x177 sys/kern/subr_prf.c:202
witness_checkorder(ffffffff82b47030,9,0) at witness_checkorder+0x116d sys/kern/subr_witness.c:833
__mp_lock(ffffffff82b46e28) at __mp_lock+0xa1 read_rflags machine/cpufunc.h:195 [inline]
__mp_lock(ffffffff82b46e28) at __mp_lock+0xa1 intr_disable machine/cpufunc.h:216 [inline]
__mp_lock(ffffffff82b46e28) at __mp_lock+0xa1 sys/kern/kern_lock.c:142
selwakeup(fffffd805b6bbcc0) at selwakeup+0x16 klist_empty sys/sys/event.h:361 [inline]
selwakeup(fffffd805b6bbcc0) at selwakeup+0x16 sys/kern/sys_generic.c:885
sorwakeup(fffffd805b6bbba8) at sorwakeup+0xc9 sys/kern/uipc_socket.c:1699
rip_input(ffff80002e3e2408,ffff80002e3e2414,0,2) at rip_input+0x3b0 sys/netinet/raw_ip.c:188
ip_deliver(ffff80002e3e2408,ffff80002e3e2414,0,2) at ip_deliver+0x322 sys/netinet/ip_input.c:657
ip_ours(ffff80002e3e2408,ffff80002e3e2414,0,0) at ip_ours+0x3ba sys/netinet/ip_input.c:616
ip_input_if(ffff80002e3e2408,ffff80002e3e2414,4,0,ffff800000689000) at ip_input_if+0x2a1
ipv4_input(ffff800000689000,fffffd806d2a0300) at ipv4_input+0x48 sys/netinet/ip_input.c:242
if_input_local(ffff800000689000,fffffd806d2a0300,2) at if_input_local+0x10e sys/net/if.c:774
ip_output(fffffd807b0d8a00,fffffd807b0d8800,fffffd806f67c1b0,20,0,fffffd806f67c138,2c56cc94f22ca71c) at ip_output+0xb05 ip_mloopback sys/netinet/ip_output.c:1791 [inline]
ip_output(fffffd807b0d8a00,fffffd807b0d8800,fffffd806f67c1b0,20,0,fffffd806f67c138,2c56cc94f22ca71c) at ip_output+0xb05 sys/netinet/ip_output.c:332
rip_output(fffffd807b0d8a00,fffffd807cd3e018,ffff80002e3e2660,1) at rip_output+0x2cb sys/netinet/raw_ip.c:302
end trace frame: 0xffff80002e3e26e0, count: 0
https://www.openbsd.org/ddb.html describes the minimum info required in bug
reports. Insufficient info makes it difficult to find and fix bugs.
ddb{1}>
ddb{1}> set $lines = 0
ddb{1}> set $maxwidth = 0
ddb{1}> show panic
cpu0: kernel diagnostic assertion "!_kernel_lock_held()" failed: file "/syzkaller/managers/multicore/kernel/sys/uvm/uvm_map.c", line 2734
*cpu1: acquiring blockable sleep lock with spinlock or critical section held (kernel_lock) &kernel_lock
ddb{1}> trace
db_enter() at db_enter+0x18 sys/arch/amd64/amd64/db_interface.c:440
panic(ffffffff825a56b6) at panic+0x177 sys/kern/subr_prf.c:202
witness_checkorder(ffffffff82b47030,9,0) at witness_checkorder+0x116d sys/kern/subr_witness.c:833
__mp_lock(ffffffff82b46e28) at __mp_lock+0xa1 read_rflags machine/cpufunc.h:195 [inline]
__mp_lock(ffffffff82b46e28) at __mp_lock+0xa1 intr_disable machine/cpufunc.h:216 [inline]
__mp_lock(ffffffff82b46e28) at __mp_lock+0xa1 sys/kern/kern_lock.c:142
selwakeup(fffffd805b6bbcc0) at selwakeup+0x16 klist_empty sys/sys/event.h:361 [inline]
selwakeup(fffffd805b6bbcc0) at selwakeup+0x16 sys/kern/sys_generic.c:885
sorwakeup(fffffd805b6bbba8) at sorwakeup+0xc9 sys/kern/uipc_socket.c:1699
rip_input(ffff80002e3e2408,ffff80002e3e2414,0,2) at rip_input+0x3b0 sys/netinet/raw_ip.c:188
ip_deliver(ffff80002e3e2408,ffff80002e3e2414,0,2) at ip_deliver+0x322 sys/netinet/ip_input.c:657
ip_ours(ffff80002e3e2408,ffff80002e3e2414,0,0) at ip_ours+0x3ba sys/netinet/ip_input.c:616
ip_input_if(ffff80002e3e2408,ffff80002e3e2414,4,0,ffff800000689000) at ip_input_if+0x2a1
ipv4_input(ffff800000689000,fffffd806d2a0300) at ipv4_input+0x48 sys/netinet/ip_input.c:242
if_input_local(ffff800000689000,fffffd806d2a0300,2) at if_input_local+0x10e sys/net/if.c:774
ip_output(fffffd807b0d8a00,fffffd807b0d8800,fffffd806f67c1b0,20,0,fffffd806f67c138,2c56cc94f22ca71c) at ip_output+0xb05 ip_mloopback sys/netinet/ip_output.c:1791 [inline]
ip_output(fffffd807b0d8a00,fffffd807b0d8800,fffffd806f67c1b0,20,0,fffffd806f67c138,2c56cc94f22ca71c) at ip_output+0xb05 sys/netinet/ip_output.c:332
rip_output(fffffd807b0d8a00,fffffd807cd3e018,ffff80002e3e2660,1) at rip_output+0x2cb sys/netinet/raw_ip.c:302
rip_usrreq(fffffd807cd3e018,9,fffffd807b0d8a00,0,0,ffff800027ac87f0) at rip_usrreq+0x49c sys/netinet/raw_ip.c:554
sosend(fffffd807cd3e018,0,ffff80002e3e2878,0,0,0) at sosend+0x632 sys/kern/uipc_socket.c:582
dofilewritev(ffff800027ac87f0,4,ffff80002e3e2878,0,ffff80002e3e2970) at dofilewritev+0x19c sys/kern/sys_generic.c:381
sys_write(ffff800027ac87f0,ffff80002e3e2918,ffff80002e3e2970) at sys_write+0x83 sys/kern/sys_generic.c:301
syscall(ffff80002e3e29e0) at syscall+0x489 mi_syscall sys/sys/syscall_mi.h:102 [inline]
syscall(ffff80002e3e29e0) at syscall+0x489 sys/arch/amd64/amd64/trap.c:585
Xsyscall() at Xsyscall+0x128
end of kernel
end trace frame: 0x5b7dd8df5e0, count: -20
ddb{1}> show registers
rdi 0
rsi 0x1
rbp 0xffff80002e3e1f90
rbx 0xffff800020ce9bff
rdx 0
rcx 0
rax 0xffff800027ac87f0
r8 0x101010101010101
r9 0x8080808080808080
r10 0x8e3c513cdbaa0281
r11 0xbfec0910e1a49c3f
r12 0xffff800020ce9a00
r13 0
r14 0
r15 0x1
rip 0xffffffff81f18858 db_enter+0x18
cs 0x8
rflags 0x246
rsp 0xffff80002e3e1f80
ss 0x10
db_enter+0x18: addq $0x8,%rsp
ddb{1}> show proc
PROC (syz-executor.0) pid=55586 stat=onproc
flags process=0 proc=4000000<THREAD>
pri=32, usrpri=86, nice=20
forw=0xffffffffffffffff, list=0xffff800027ac9a50,0xffffffff82b44c30
process=0xffff8000211a2578 user=0xffff80002e3dd000, vmspace=0xfffffd807baf5d20
estcpu=36, cpticks=2, pctcpu=0.0
user=0, sys=2, intr=0
ddb{1}> ps
PID TID PPID UID S FLAGS WAIT COMMAND
69397 453758 73685 0 2 0 syz-executor.0
*69397 55586 73685 0 7 0x4000000 syz-executor.0
55132 308886 66783 0 2 0 syz-executor.1
55132 89558 66783 0 3 0x4000080 fsleep syz-executor.1
90627 233010 98849 0 2 0x480 syz-executor.5
90627 387146 98849 0 3 0x4000080 fsleep syz-executor.5
90627 321572 98849 0 3 0x4000080 lockf syz-executor.5
94231 512842 41780 0 2 0 syz-executor.4
94231 29189 41780 0 3 0x4000080 fsleep syz-executor.4
35061 454916 0 0 3 0x14280 nfsidl nfsio
61069 392992 0 0 3 0x14280 nfsidl nfsio
73661 327506 0 0 3 0x14280 nfsidl nfsio
51966 113099 0 0 3 0x14280 nfsidl nfsio
76261 77125 0 0 3 0x14280 nfsidl nfsio
88151 59171 0 0 3 0x14280 nfsidl nfsio
55954 337731 0 0 3 0x14280 nfsidl nfsio
47910 410527 0 0 3 0x14280 nfsidl nfsio
9186 417100 0 0 3 0x14280 nfsidl nfsio
46 253135 0 0 3 0x14280 nfsidl nfsio
40862 41730 0 0 3 0x14280 nfsidl nfsio
25371 154223 0 0 3 0x14280 nfsidl nfsio
99074 278437 0 0 3 0x14280 nfsidl nfsio
53806 345379 0 0 3 0x14280 nfsidl nfsio
42320 341614 0 0 3 0x14280 nfsidl nfsio
48011 71016 0 0 3 0x14280 nfsidl nfsio
1130 414008 0 0 3 0x14280 nfsidl nfsio
17571 127540 0 0 3 0x14280 nfsidl nfsio
36254 437044 0 0 3 0x14280 nfsidl nfsio
4846 368429 0 0 3 0x14280 nfsidl nfsio
47156 289769 1 0 3 0x100083 ttyin getty
73685 332646 99211 0 2 0x482 syz-executor.0
98849 145663 99211 0 2 0x482 syz-executor.5
16160 437234 99211 0 2 0x482 syz-executor.7
45169 344859 99211 0 2 0x482 syz-executor.3
42488 204087 99211 0 2 0x482 syz-executor.2
1160 111379 0 0 3 0x14200 bored sosplice
85805 185390 99211 0 2 0x482 syz-executor.6
41780 442204 99211 0 2 0x482 syz-executor.4
66783 524214 99211 0 2 0x482 syz-executor.1
99211 480995 22210 0 3 0x82 thrsleep syz-fuzzer
99211 468053 22210 0 3 0x4000082 thrsleep syz-fuzzer
99211 265034 22210 0 3 0x4000082 thrsleep syz-fuzzer
99211 507581 22210 0 3 0x4000082 thrsleep syz-fuzzer
99211 343371 22210 0 3 0x4000082 thrsleep syz-fuzzer
99211 368330 22210 0 3 0x4000082 kqread syz-fuzzer
99211 297243 22210 0 3 0x4000082 thrsleep syz-fuzzer
99211 326937 22210 0 3 0x4000082 thrsleep syz-fuzzer
99211 237489 22210 0 3 0x4000082 thrsleep syz-fuzzer
22210 437072 8991 0 3 0x10008a sigsusp ksh
8991 225566 40363 0 3 0x9a kqread sshd
40363 398106 1 0 3 0x88 kqread sshd
25232 388831 53092 74 3 0x1100092 bpf pflogd
53092 65724 1 0 3 0x80 netio pflogd
94634 259745 82256 73 3 0x1100090 kqread syslogd
82256 469020 1 0 3 0x100082 netio syslogd
86797 220680 1 0 3 0x100080 kqread resolvd
91234 221672 56905 77 3 0x100092 kqread dhcpleased
47900 475550 56905 77 3 0x100092 kqread dhcpleased
56905 406482 1 0 3 0x80 kqread dhcpleased
29890 31665 0 0 3 0x14200 bored smr
39527 343501 0 0 2 0x14200 zerothread
7363 297529 0 0 3 0x14200 aiodoned aiodoned
24213 21536 0 0 3 0x14200 syncer update
6099 504883 0 0 3 0x14200 cleaner cleaner
26886 244276 0 0 7 0x14200 reaper
33459 515765 0 0 3 0x14200 pgdaemon pagedaemon
45342 222766 0 0 3 0x14200 bored viomb
87106 130064 0 0 3 0x40014200 acpi0 acpi0
19279 334374 0 0 3 0x40014200 idle1
95451 338064 0 0 3 0x14200 bored softnet
54816 458678 0 0 3 0x14200 bored systqmp
46368 270150 0 0 3 0x14200 bored systq
27498 332753 0 0 2 0x40014200 softclock
22031 5708 0 0 3 0x40014200 idle0
1 25753 0 0 3 0x82 wait init
0 0 -1 0 3 0x10200 scheduler swapper
ddb{1}> show all locks
CPU 1:
exclusive mutex &table->inpt_mtx r = 0 (0xffffffff829c70c8)
#0 witness_lock+0x44d
#1 mtx_enter_try+0x100
#2 mtx_enter+0x4b sys/kern/kern_lock.c:266
#3 rip_input+0x135
#4 ip_deliver+0x322 sys/netinet/ip_input.c:657
#5 ip_ours+0x3ba sys/netinet/ip_input.c:616
#6 ip_input_if+0x2a1
#7 ipv4_input+0x48 sys/netinet/ip_input.c:242
#8 if_input_local+0x10e sys/net/if.c:774
#9 ip_output+0xb05 ip_mloopback sys/netinet/ip_output.c:1791 [inline]
#9 ip_output+0xb05 sys/netinet/ip_output.c:332
#10 rip_output+0x2cb sys/netinet/raw_ip.c:302
#11 rip_usrreq+0x49c sys/netinet/raw_ip.c:554
#12 sosend+0x632 sys/kern/uipc_socket.c:582
#13 dofilewritev+0x19c sys/kern/sys_generic.c:381
#14 sys_write+0x83 sys/kern/sys_generic.c:301
#15 syscall+0x489 mi_syscall sys/sys/syscall_mi.h:102 [inline]
#15 syscall+0x489 sys/arch/amd64/amd64/trap.c:585
#16 Xsyscall+0x128
Process 69397 (syz-executor.0) thread 0xffff800027ac87f0 (55586)
exclusive rwlock netlock r = 0 (0xffffffff828f7720)
#0 witness_lock+0x44d
#1 solock+0x86 sys/kern/uipc_socket2.c:295
#2 sosend+0x517 sys/kern/uipc_socket.c:570
#3 dofilewritev+0x19c sys/kern/sys_generic.c:381
#4 sys_write+0x83 sys/kern/sys_generic.c:301
#5 syscall+0x489 mi_syscall sys/sys/syscall_mi.h:102 [inline]
#5 syscall+0x489 sys/arch/amd64/amd64/trap.c:585
#6 Xsyscall+0x128
exclusive mutex &table->inpt_mtx r = 0 (0xffffffff829c70c8)
#0 witness_lock+0x44d
#1 mtx_enter_try+0x100
#2 mtx_enter+0x4b sys/kern/kern_lock.c:266
#3 rip_input+0x135
#4 ip_deliver+0x322 sys/netinet/ip_input.c:657
#5 ip_ours+0x3ba sys/netinet/ip_input.c:616
#6 ip_input_if+0x2a1
#7 ipv4_input+0x48 sys/netinet/ip_input.c:242
#8 if_input_local+0x10e sys/net/if.c:774
#9 ip_output+0xb05 ip_mloopback sys/netinet/ip_output.c:1791 [inline]
#9 ip_output+0xb05 sys/netinet/ip_output.c:332
#10 rip_output+0x2cb sys/netinet/raw_ip.c:302
#11 rip_usrreq+0x49c sys/netinet/raw_ip.c:554
#12 sosend+0x632 sys/kern/uipc_socket.c:582
#13 dofilewritev+0x19c sys/kern/sys_generic.c:381
#14 sys_write+0x83 sys/kern/sys_generic.c:301
#15 syscall+0x489 mi_syscall sys/sys/syscall_mi.h:102 [inline]
#15 syscall+0x489 sys/arch/amd64/amd64/trap.c:585
#16 Xsyscall+0x128
ddb{1}> show malloc
Type InUse MemUse HighUse Limit Requests Type Lim
devbuf 10203 6493K 6881K 78643K 18584 0
pcb 13 14K 16K 78643K 933 0
rtable 231 16K 22K 78643K 1191 0
ifaddr 90 20K 22K 78643K 1356 0
sysctl 3 1K 1K 78643K 3 0
counters 56 35K 36K 78643K 174 0
ioctlops 0 0K 8K 78643K 8623 0
iov 0 0K 32K 78643K 464 0
mount 1 1K 1K 78643K 1 0
log 0 0K 0K 78643K 5 0
vnodes 1364 85K 86K 78643K 4074 0
UFS quota 1 32K 32K 78643K 1 0
UFS mount 5 36K 36K 78643K 5 0
shm 2 1K 9K 78643K 88 0
VM map 2 1K 1K 78643K 2 0
sem 12 0K 1K 78643K 624 0
dirhash 12 2K 2K 78643K 12 0
ACPI 1697 195K 286K 78643K 12548 0
file desc 14 49K 97K 78643K 5975 0
sigio 0 0K 0K 78643K 15 0
proc 70 87K 111K 78643K 1120 0
subproc 104 6K 6K 78643K 264 0
NFS srvsock 1 0K 0K 78643K 1 0
NFS daemon 1 16K 16K 78643K 1 0
ip_moptions 0 0K 0K 78643K 136 0
in_multi 97 6K 7K 78643K 375 0
ether_multi 1 0K 0K 78643K 48 0
mrt 2 0K 0K 78643K 55 0
ISOFS mount 1 32K 32K 78643K 1 0
MSDOSFS mount 1 16K 16K 78643K 1 0
ttys 187 837K 837K 78643K 187 0
exec 0 0K 2K 78643K 1528 0
tdb 3 0K 0K 78643K 3 0
pagedep 1 8K 8K 78643K 1 0
inodedep 1 32K 32K 78643K 1 0
newblk 1 0K 0K 78643K 1 0
VM swap 7 26K 26K 78643K 7 0
UVM amap 449 504K 505K 78643K 78759 0
UVM aobj 131 4K 4K 78643K 134 0
memdesc 1 4K 4K 78643K 1 0
crypto data 1 1K 1K 78643K 1 0
ip6_options 0 0K 0K 78643K 168 0
NDP 12 0K 2K 78643K 121 0
temp 154 4757K 4829K 78643K 68541 0
kqueue 12 18K 25K 78643K 434 0
SYN cache 2 16K 16K 78643K 2 0
ddb{1}> show all pools
Name Size Requests Fail Releases Pgreq Pgrel Npage Hiwat Minpg Maxpg Idle
plcache 128 22 0 0 1 0 1 1 0 8 0
rtpcb 120 341 0 338 6 5 1 3 0 8 0
rtentry 112 339 0 239 4 0 4 4 0 8 0
unpcb 136 4397 0 4379 48 45 3 10 0 8 2
syncache 296 34 0 34 8 7 1 1 0 8 1
sackhl 24 1 0 1 1 1 0 1 0 8 0
tcpqe 32 1024 0 1024 3 3 0 1 0 8 0
tcpcb 736 2099 0 2092 47 45 2 14 0 8 1
arp 120 52 0 33 1 0 1 1 0 8 0
inpcb 312 5255 0 5215 63 56 7 11 0 8 3
rttmr 72 23 0 23 7 6 1 1 0 8 1
nd6 48 83 0 62 1 0 1 1 0 8 0
pkpcb 40 11 0 11 3 3 0 1 0 8 0
kcovpl 48 20 0 12 1 0 1 1 0 8 0
ppxss 1248 21 0 21 4 4 0 1 0 8 0
pfstscr 40 4 0 4 1 1 0 1 0 8 0
pffrag 232 40 0 36 2 1 1 1 0 482 0
pffrnode 88 40 0 36 2 1 1 1 0 8 0
pffrent 40 160 0 156 2 1 1 1 0 8 0
pfosfp 40 1428 0 1005 5 0 5 5 0 8 0
pfosfpen 112 1428 0 714 21 0 21 21 0 8 0
pfrktable 1344 85 0 82 6 5 1 2 0 8 0
pftag 88 12 0 4 1 0 1 1 0 8 0
pfqueue 264 7 0 7 2 2 0 1 0 8 0
pfstitem 24 48 0 46 1 0 1 1 0 8 0
pfstkey 112 52 0 50 1 0 1 1 0 8 0
pfstate 320 50 0 48 2 1 1 2 0 8 0
pfsrctr 152 23 0 23 1 1 0 1 0 8 0
pfrule 1360 6339 0 6327 5 3 2 3 0 8 0
art_heap8 4096 1 0 0 1 0 1 1 0 8 0
art_heap4 256 1504 0 1072 46 19 27 43 0 8 0
art_table 32 1505 0 1072 6 2 4 6 0 8 0
art_node 16 335 0 245 1 0 1 1 0 8 0
sysvmsgpl 40 9 0 8 5 4 1 1 0 8 0
semupl 112 2 0 2 1 1 0 1 0 8 0
semapl 112 622 0 612 1 0 1 1 0 8 0
shmpl 112 131 0 3 4 0 4 4 0 8 0
dirhash 1024 17 0 0 3 0 3 3 0 8 0
dino2pl 256 9147 0 7701 91 0 91 91 0 8 0
ffsino 272 9147 0 7701 97 0 97 97 0 8 0
nchpl 144 17110 0 15482 63 0 63 63 0 8 0
uvmvnodes 80 5926 0 0 121 0 121 121 0 8 0
vnodes 224 5926 0 0 349 0 349 349 0 8 0
namei 1024 64940 0 64940 5 4 1 2 0 8 1
percpumem 16 99 0 59 1 0 1 1 0 8 0
vcpupl 2048 29 0 0 4 0 4 4 0 8 0
vmpool 560 47 0 18 5 2 3 3 0 8 0
pfiaddrpl 120 36 0 32 5 4 1 1 0 8 0
scsiplug 72 9 0 9 3 3 0 1 0 8 0
scxspl 216 60256 0 60256 18 17 1 8 0 8 1
plimitpl 152 566 0 551 1 0 1 1 0 8 0
sigapl 424 6312 0 6246 10 2 8 8 0 8 0
futexpl 64 51593 0 51590 3 2 1 1 0 8 0
knotepl 120 416 0 0 8 1 7 8 0 8 0
kqueuepl 216 1690 0 1682 37 32 5 7 0 8 4
pipepl 336 1087 0 1058 24 21 3 9 0 8 0
fdescpl 496 6243 0 6216 6 2 4 5 0 8 0
filepl 152 45202 0 44924 69 54 15 20 0 8 4
lockfpl 104 1618 0 1614 4 3 1 2 0 8 0
lockfspl 48 418 0 415 1 0 1 1 0 8 0
sessionpl 144 39 0 22 1 0 1 1 0 8 0
pgrppl 48 113 0 96 1 0 1 1 0 8 0
ucredpl 96 5404 0 5392 1 0 1 1 0 8 0
zombiepl 144 6250 0 6246 2 1 1 1 0 8 0
processpl 1064 6312 0 6246 5 0 5 5 0 8 0
procpl 672 18032 0 17950 18 9 9 9 0 8 1
srpgc 96 14 0 14 5 5 0 1 0 8 0
sosppl 168 28 0 28 7 6 1 1 0 8 1
sockpl 480 10008 0 9947 206 194 12 35 0 8 4
mcl64k 65536 18 0 0 3 0 3 3 0 8 0
mcl16k 16384 21 0 0 3 1 2 3 0 8 0
mcl12k 12288 17 0 0 2 0 2 2 0 8 0
mcl9k 9216 25 0 0 2 0 2 2 0 8 0
mcl8k 8192 22 0 0 3 0 3 3 0 8 0
mcl4k 4096 25 0 0 3 0 3 3 0 8 0
mcl2k2 2112 8 0 0 1 0 1 1 0 8 0
mcl2k 2048 249 0 0 24 0 24 24 0 8 0
mtagpl 96 387 0 0 7 0 7 7 0 8 0
mbufpl 256 703 0 0 32 0 32 32 0 8 0
bufpl 288 12689 0 6353 453 0 453 453 0 8 0
anonpl 24 1788083 0 1768676 198 62 136 145 0 186 0
amapchunkpl 152 232727 0 231858 85 45 40 50 0 158 3
amappl16 200 15365 0 14766 82 47 35 45 0 8 0
amappl15 192 1759 0 1753 1 0 1 1 0 8 0
amappl14 184 1100 0 1093 1 0 1 1 0 8 0
amappl13 176 1866 0 1865 1 0 1 1 0 8 0
amappl12 168 59 0 55 2 1 1 1 0 8 0
amappl11 160 48 0 33 1 0 1 1 0 8 0
amappl10 152 1006 0 994 1 0 1 1 0 8 0
amappl9 144 526 0 523 1 0 1 1 0 8 0
amappl8 136 1430 0 1330 4 0 4 4 0 8 0
amappl7 128 635 0 620 1 0 1 1 0 8 0
amappl6 120 296 0 274 2 1 1 2 0 8 0
amappl5 112 6242 0 6220 1 0 1 1 0 8 0
amappl4 104 1355 0 1328 2 1 1 2 0 8 0
amappl3 96 1175 0 1164 1 0 1 1 0 8 0
amappl2 88 2670 0 2618 3 1 2 3 0 8 0
amappl1 80 116701 0 116124 21 7 14 19 0 8 0
amappl 88 77896 0 77605 9 1 8 8 0 92 0
dma4096 4096 1 0 1 1 1 0 1 0 8 0
dma1024 1024 1 0 0 1 0 1 1 0 8 0
dma256 256 6 0 6 1 1 0 1 0 8 0
dma128 128 253 0 253 1 1 0 1 0 8 0
dma64 64 6 0 6 1 1 0 1 0 8 0
dma32 32 7 0 7 1 1 0 1 0 8 0
dma16 16 18 0 17 1 0 1 1 0 8 0
aobjpl 72 133 0 3 3 0 3 3 0 8 0
uaddrrnd 24 6290 0 6233 1 0 1 1 0 8 0
uaddrbest 32 2 0 0 1 0 1 1 0 8 0
uaddr 24 6290 0 6233 1 0 1 1 0 8 0
vmmpekpl 168 54178 0 54110 5 1 4 4 0 8 0
vmmpepl 168 568168 0 565570 222 95 127 145 0 357 1
vmsppl 368 6289 0 6233 7 1 6 6 0 8 0
rwobjpl 56 144623 0 136895 120 8 112 113 0 8 0
pdppl 4096 12587 0 12495 366 268 98 98 0 8 6
pvpl 32 3205661 0 3181713 409 178 231 267 0 265 14
pmappl 248 6289 0 6233 5 1 4 4 0 8 0
extentpl 40 58 0 38 1 0 1 1 0 8 0
phpool 112 1283 0 420 25 0 25 25 0 8 0
ddb{1}> machine ddbcpu 0
Stopped at x86_ipi_db+0x1a: addq $0x8,%rsp
x86_ipi_db(ffffffff8294dff0) at x86_ipi_db+0x1a sys/arch/amd64/amd64/db_interface.c:393
x86_ipi_handler() at x86_ipi_handler+0xb7 sys/arch/amd64/amd64/ipi.c:106
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
x86_bus_space_io_write_1(3f8,0,64) at x86_bus_space_io_write_1+0x31 sys/arch/amd64/amd64/bus_space.c:759
comcnputc(800,64) at comcnputc+0x128 bus_space_barrier machine/bus.h:481 [inline]
comcnputc(800,64) at comcnputc+0x128 sys/dev/ic/com.c:1263
cnputc(64) at cnputc+0x4b sys/dev/cons.c:239
db_putchar(64) at db_putchar+0x3fc sys/ddb/db_output.c:155
kprintf() at kprintf+0x20ec sys/kern/subr_prf.c:1068
db_printf(ffffffff82608896) at db_printf+0x85 sys/kern/subr_prf.c:502
panic(ffffffff8258f849) at panic+0xd7 sys/kern/subr_prf.c:220
__assert(ffffffff826021d1,ffffffff826102ef,aae,ffffffff825c283e) at __assert+0x25 sys/kern/subr_prf.c:161
uvm_map_teardown(fffffd807baf5480) at uvm_map_teardown+0x2e8 sys/uvm/uvm_map.c:2736
uvmspace_free(fffffd807baf5480) at uvmspace_free+0xa6 sys/uvm/uvm_map.c:3685
reaper(ffff8000210f9500) at reaper+0x18b sys/kern/kern_exit.c:457
end trace frame: 0x0, count: 1
ddb{0}> trace
x86_ipi_db(ffffffff8294dff0) at x86_ipi_db+0x1a sys/arch/amd64/amd64/db_interface.c:393
x86_ipi_handler() at x86_ipi_handler+0xb7 sys/arch/amd64/amd64/ipi.c:106
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x23
x86_bus_space_io_write_1(3f8,0,64) at x86_bus_space_io_write_1+0x31 sys/arch/amd64/amd64/bus_space.c:759
comcnputc(800,64) at comcnputc+0x128 bus_space_barrier machine/bus.h:481 [inline]
comcnputc(800,64) at comcnputc+0x128 sys/dev/ic/com.c:1263
cnputc(64) at cnputc+0x4b sys/dev/cons.c:239
db_putchar(64) at db_putchar+0x3fc sys/ddb/db_output.c:155
kprintf() at kprintf+0x20ec sys/kern/subr_prf.c:1068
db_printf(ffffffff82608896) at db_printf+0x85 sys/kern/subr_prf.c:502
panic(ffffffff8258f849) at panic+0xd7 sys/kern/subr_prf.c:220
__assert(ffffffff826021d1,ffffffff826102ef,aae,ffffffff825c283e) at __assert+0x25 sys/kern/subr_prf.c:161
uvm_map_teardown(fffffd807baf5480) at uvm_map_teardown+0x2e8 sys/uvm/uvm_map.c:2736
uvmspace_free(fffffd807baf5480) at uvmspace_free+0xa6 sys/uvm/uvm_map.c:3685
reaper(ffff8000210f9500) at reaper+0x18b sys/kern/kern_exit.c:457
end trace frame: 0x0, count: -14
ddb{0}> machine ddbcpu 1
Stopped at db_enter+0x18: addq $0x8,%rsp
db_enter() at db_enter+0x18 sys/arch/amd64/amd64/db_interface.c:440
panic(ffffffff825a56b6) at panic+0x177 sys/kern/subr_prf.c:202
witness_checkorder(ffffffff82b47030,9,0) at witness_checkorder+0x116d sys/kern/subr_witness.c:833
__mp_lock(ffffffff82b46e28) at __mp_lock+0xa1 read_rflags machine/cpufunc.h:195 [inline]
__mp_lock(ffffffff82b46e28) at __mp_lock+0xa1 intr_disable machine/cpufunc.h:216 [inline]
__mp_lock(ffffffff82b46e28) at __mp_lock+0xa1 sys/kern/kern_lock.c:142
selwakeup(fffffd805b6bbcc0) at selwakeup+0x16 klist_empty sys/sys/event.h:361 [inline]
selwakeup(fffffd805b6bbcc0) at selwakeup+0x16 sys/kern/sys_generic.c:885
sorwakeup(fffffd805b6bbba8) at sorwakeup+0xc9 sys/kern/uipc_socket.c:1699
rip_input(ffff80002e3e2408,ffff80002e3e2414,0,2) at rip_input+0x3b0 sys/netinet/raw_ip.c:188
ip_deliver(ffff80002e3e2408,ffff80002e3e2414,0,2) at ip_deliver+0x322 sys/netinet/ip_input.c:657
ip_ours(ffff80002e3e2408,ffff80002e3e2414,0,0) at ip_ours+0x3ba sys/netinet/ip_input.c:616
ip_input_if(ffff80002e3e2408,ffff80002e3e2414,4,0,ffff800000689000) at ip_input_if+0x2a1
ipv4_input(ffff800000689000,fffffd806d2a0300) at ipv4_input+0x48 sys/netinet/ip_input.c:242
if_input_local(ffff800000689000,fffffd806d2a0300,2) at if_input_local+0x10e sys/net/if.c:774
ip_output(fffffd807b0d8a00,fffffd807b0d8800,fffffd806f67c1b0,20,0,fffffd806f67c138,2c56cc94f22ca71c) at ip_output+0xb05 ip_mloopback sys/netinet/ip_output.c:1791 [inline]
ip_output(fffffd807b0d8a00,fffffd807b0d8800,fffffd806f67c1b0,20,0,fffffd806f67c138,2c56cc94f22ca71c) at ip_output+0xb05 sys/netinet/ip_output.c:332
rip_output(fffffd807b0d8a00,fffffd807cd3e018,ffff80002e3e2660,1) at rip_output+0x2cb sys/netinet/raw_ip.c:302
end trace frame: 0xffff80002e3e26e0, count: 0
ddb{1}> trace
db_enter() at db_enter+0x18 sys/arch/amd64/amd64/db_interface.c:440
panic(ffffffff825a56b6) at panic+0x177 sys/kern/subr_prf.c:202
witness_checkorder(ffffffff82b47030,9,0) at witness_checkorder+0x116d sys/kern/subr_witness.c:833
__mp_lock(ffffffff82b46e28) at __mp_lock+0xa1 read_rflags machine/cpufunc.h:195 [inline]
__mp_lock(ffffffff82b46e28) at __mp_lock+0xa1 intr_disable machine/cpufunc.h:216 [inline]
__mp_lock(ffffffff82b46e28) at __mp_lock+0xa1 sys/kern/kern_lock.c:142
selwakeup(fffffd805b6bbcc0) at selwakeup+0x16 klist_empty sys/sys/event.h:361 [inline]
selwakeup(fffffd805b6bbcc0) at selwakeup+0x16 sys/kern/sys_generic.c:885
sorwakeup(fffffd805b6bbba8) at sorwakeup+0xc9 sys/kern/uipc_socket.c:1699
rip_input(ffff80002e3e2408,ffff80002e3e2414,0,2) at rip_input+0x3b0 sys/netinet/raw_ip.c:188
ip_deliver(ffff80002e3e2408,ffff80002e3e2414,0,2) at ip_deliver+0x322 sys/netinet/ip_input.c:657
ip_ours(ffff80002e3e2408,ffff80002e3e2414,0,0) at ip_ours+0x3ba sys/netinet/ip_input.c:616
ip_input_if(ffff80002e3e2408,ffff80002e3e2414,4,0,ffff800000689000) at ip_input_if+0x2a1
ipv4_input(ffff800000689000,fffffd806d2a0300) at ipv4_input+0x48 sys/netinet/ip_input.c:242
if_input_local(ffff800000689000,fffffd806d2a0300,2) at if_input_local+0x10e sys/net/if.c:774
ip_output(fffffd807b0d8a00,fffffd807b0d8800,fffffd806f67c1b0,20,0,fffffd806f67c138,2c56cc94f22ca71c) at ip_output+0xb05 ip_mloopback sys/netinet/ip_output.c:1791 [inline]
ip_output(fffffd807b0d8a00,fffffd807b0d8800,fffffd806f67c1b0,20,0,fffffd806f67c138,2c56cc94f22ca71c) at ip_output+0xb05 sys/netinet/ip_output.c:332
rip_output(fffffd807b0d8a00,fffffd807cd3e018,ffff80002e3e2660,1) at rip_output+0x2cb sys/netinet/raw_ip.c:302
rip_usrreq(fffffd807cd3e018,9,fffffd807b0d8a00,0,0,ffff800027ac87f0) at rip_usrreq+0x49c sys/netinet/raw_ip.c:554
sosend(fffffd807cd3e018,0,ffff80002e3e2878,0,0,0) at sosend+0x632 sys/kern/uipc_socket.c:582
dofilewritev(ffff800027ac87f0,4,ffff80002e3e2878,0,ffff80002e3e2970) at dofilewritev+0x19c sys/kern/sys_generic.c:381
sys_write(ffff800027ac87f0,ffff80002e3e2918,ffff80002e3e2970) at sys_write+0x83 sys/kern/sys_generic.c:301
syscall(ffff80002e3e29e0) at syscall+0x489 mi_syscall sys/sys/syscall_mi.h:102 [inline]
syscall(ffff80002e3e29e0) at syscall+0x489 sys/arch/amd64/amd64/trap.c:585
Xsyscall() at Xsyscall+0x128
end of kernel
end trace frame: 0x5b7dd8df5e0, count: -20