syzbot


panic: WpAoRNoIl_NcaGc:h Se_PiLt NeOm_T maLOgiWEcR_cEDh eOcNk: S mYSbCuAfLpLl 1c3pu7 f r-8ee87 0li4 sEtX ImTo d0 i9f

Status: closed as dup on 2019/11/13 08:00
Reported-by: syzbot+266baf81edd0b6cc0bbc@syzkaller.appspotmail.com
First crash: 1598d, last: 1598d
Duplicate of
Title Repro Cause bisect Fix bisect Count Last Reported
pool: cpu free list modified: mbufpl syz 15863 1332d 1618d

Sample crash report:
panic: WpAoRNoIl_NcaGc:h Se_PiLt NeOm_T maLOgiWEcR_cEDh eOcNk: S mYSbCuAfLpLl  1c3pu7 f r-8ee87 0li4 sEtX ImTo d0 i9f
i
eStopped at      savectx+0xb1:   movl    $0,%gs:0x530
    TID    PID    UID     PRFLAGS     PFLAGS  CPU  COMMAND
*211665  44008      0         0x2          0    0  syz-executor.0
  67535  18402      0        0x12          0    1  sshd
savectx() at savectx+0xb1
end of kernel
end trace frame: 0x7f7ffffea570, count: 14
https://www.openbsd.org/ddb.html describes the minimum info required in bug
reports.  Insufficient info makes it difficult to find and fix bugs.
ddb{0}> 
ddb{0}> set $lines = 0
ddb{0}> set $maxwidth = 0
ddb{0}> show panic
pool_cache_item_magic_check: mbufpl cpu free list modified: item addr 0xfffffd8060d93300+16 0x0!=0xfdaf2202a1dbdd70
ddb{0}> trace
savectx() at savectx+0xb1
end of kernel
end trace frame: 0x7f7ffffea570, count: -1
ddb{0}> show registers
rdi                                0
rsi                                0
rbp               0xffff800021b9d600
rbx                                0
rdx               0xffff800020ace518
rcx                                0
rax                             0x38
r8                0xffffffff815a9a5f    kprintf+0x16f
r9                               0x1
r10                             0x25
r11               0xe598164a292014a7
r12                                0
r13                                0
r14               0xffff800020ace518
r15                                0
rip               0xffffffff815033f1    savectx+0xb1
cs                               0x8
rflags                          0x46
rsp               0xffff800021b9d580
ss                              0x10
savectx+0xb1:   movl    $0,%gs:0x530
ddb{0}> show proc
PROC (syz-executor.0) pid=211665 stat=onproc
    flags process=2<EXEC> proc=0
    pri=86, usrpri=86, nice=20
    forw=0xffffffffffffffff, list=0xffff800020ace790,0xffff800020acea18
    process=0xffff800020adc000 user=0xffff800021b98000, vmspace=0xfffffd807f00a8a0
    estcpu=36, cpticks=1, pctcpu=0.2
    user=0, sys=1, intr=0
ddb{0}> ps
   PID     TID   PPID    UID  S       FLAGS  WAIT          COMMAND
 41887  171479  44032      0  2           0                syz-executor.1
 41887  237795  44032      0  3   0x4000080  netio         syz-executor.1
 23963  433930      0      0  3     0x14200  acct          acct
*44008  211665  91569      0  7         0x2                syz-executor.0
 44032  209967  91569      0  3        0x82  nanosleep     syz-executor.1
 31765  113997      1      0  3    0x100083  ttyin         getty
 52575  256579      0      0  3     0x14200  bored         sosplice
 91569  120643  72036      0  3        0x82  kqread        syz-fuzzer
 91569  215759  72036      0  3   0x4000082  nanosleep     syz-fuzzer
 91569  459450  72036      0  3   0x4000082  thrsleep      syz-fuzzer
 91569  110197  72036      0  3   0x4000082  thrsleep      syz-fuzzer
 91569   10960  72036      0  3   0x4000082  thrsleep      syz-fuzzer
 91569  233644  72036      0  3   0x4000082  nanosleep     syz-fuzzer
 91569    5529  72036      0  3   0x4000082  thrsleep      syz-fuzzer
 91569   70931  72036      0  3   0x4000082  thrsleep      syz-fuzzer
 91569  231173  72036      0  3   0x4000082  thrsleep      syz-fuzzer
 91569  176368  72036      0  3   0x4000082  thrsleep      syz-fuzzer
 72036    1705  18402      0  3    0x10008a  pause         ksh
 18402   67535  54675      0  7        0x12                sshd
 54675  381107      1      0  3        0x80  select        sshd
  3798  292648  60936     74  3    0x100092  bpf           pflogd
 60936  275536      1      0  3        0x80  netio         pflogd
 51047  494745  79172     73  3    0x100090  kqread        syslogd
 79172   64880      1      0  3    0x100082  netio         syslogd
 31426  127474      1     77  3    0x100090  poll          dhclient
 58314  488191      1      0  3        0x80  poll          dhclient
 27865  399104      0      0  3     0x14200  pgzero        zerothread
 35367  285037      0      0  3     0x14200  aiodoned      aiodoned
  5196   48363      0      0  3     0x14200  syncer        update
 94117  195769      0      0  3     0x14200  cleaner       cleaner
 90503  431182      0      0  3     0x14200  reaper        reaper
  9680   24653      0      0  3     0x14200  pgdaemon      pagedaemon
 66823  267112      0      0  3     0x14200  bored         crynlk
 52731  172588      0      0  3     0x14200  bored         crypto
 68885   31338      0      0  3  0x40014200  acpi0         acpi0
 18674   87569      0      0  3  0x40014200                idle1
 10544  221567      0      0  3     0x14200  bored         softnet
 25624  513926      0      0  3     0x14200  bored         systqmp
   727  462036      0      0  3     0x14200  bored         systq
 97936  244713      0      0  3  0x40014200  bored         softclock
 45073   97556      0      0  3  0x40014200                idle0
 36549  132128      0      0  3     0x14200  bored         smr
     1  294162      0      0  3        0x82  wait          init
     0       0     -1      0  3     0x10200  scheduler     swapper
ddb{0}> show all locks
CPU 0:
exclusive mutex &diskp->dk_mtx r = 0 (0xffff800000172898)
#0  witness_lock+0x52e sys/kern/subr_witness.c:1163
#1  mtx_enter_try+0x102
#2  mtx_enter+0x4b sys/kern/kern_lock.c:266
#3  disk_busy+0x21 sys/kern/subr_disk.c:1235
#4  sdstart+0x3dc sys/scsi/sd.c:711
#5  scsi_iopool_run+0x129 scsi_ioh_pending sys/scsi/scsi_base.c:394 [inline]
#5  scsi_iopool_run+0x129 sys/scsi/scsi_base.c:410
#6  scsi_xsh_runqueue+0x210 sys/scsi/scsi_base.c:586
#7  scsi_xsh_add+0xc9 sys/scsi/scsi_base.c:525
#8  sdstrategy+0x187 sys/scsi/sd.c:582
#9  spec_strategy+0x74 sys/kern/spec_vnops.c:468
#10 VOP_STRATEGY+0x99 sys/kern/vfs_vops.c:727
#11 bwrite+0x1b9 sys/kern/vfs_bio.c:738
#12 ffs_update+0x2c2 sys/ufs/ffs/ffs_inode.c:113
#13 ffs_truncate+0xc76
#14 ufs_rmdir+0x3af sys/ufs/ufs/ufs_vnops.c:1357
#15 VOP_RMDIR+0xf8 sys/kern/vfs_vops.c:474
#16 dounlinkat+0x14c sys/kern/vfs_syscalls.c:1818
#17 syscall+0x4a4 mi_syscall sys/sys/syscall_mi.h:92 [inline]
#17 syscall+0x4a4 sys/arch/amd64/amd64/trap.c:555
#18 Xsyscall+0x128
Process 44008 (syz-executor.0) thread 0xffff800020ace518 (211665)
exclusive kernel_lock &kernel_lock r = 0 (0xffffffff8263a9c8)
#0  witness_lock+0x52e sys/kern/subr_witness.c:1163
#1  __mp_acquire_count+0x51 sys/kern/kern_lock.c:227
#2  mi_switch+0x392 sys/kern/sched_bsd.c:434
#3  sleep_finish+0x113 sys/kern/kern_synch.c:374
#4  sleep_finish_all+0x32 sleep_finish_timeout sys/kern/kern_synch.c:403 [inline]
#4  sleep_finish_all+0x32 sys/kern/kern_synch.c:183
#5  tsleep+0x1cf sys/kern/kern_synch.c:153
#6  biowait+0xa1 sys/kern/vfs_bio.c:1231
#7  bwrite+0x1e4 sys/kern/vfs_bio.c:747
#8  ufs_dirremove+0x291
#9  ufs_rmdir+0x247 sys/ufs/ufs/ufs_vnops.c:1330
#10 VOP_RMDIR+0xf8 sys/kern/vfs_vops.c:474
#11 dounlinkat+0x14c sys/kern/vfs_syscalls.c:1818
#12 syscall+0x4a4 mi_syscall sys/sys/syscall_mi.h:92 [inline]
#12 syscall+0x4a4 sys/arch/amd64/amd64/trap.c:555
#13 Xsyscall+0x128
exclusive rrwlock inode r = 0 (0xfffffd8064d7c920)
#0  witness_lock+0x52e sys/kern/subr_witness.c:1163
#1  rw_enter+0x447 sys/kern/kern_rwlock.c:306
#2  rrw_enter+0x4f sys/kern/kern_rwlock.c:435
#3  VOP_LOCK+0xf0 sys/kern/vfs_vops.c:615
#4  vn_lock+0x81 sys/kern/vfs_vnops.c:571
#5  vget+0x1c3 sys/kern/vfs_subr.c:672
#6  ufs_ihashget+0x141 sys/ufs/ufs/ufs_ihash.c:119
#7  ffs_vget+0x74 sys/ufs/ffs/ffs_vfsops.c:1323
#8  ufs_lookup+0x14b4 sys/ufs/ufs/ufs_lookup.c:487
#9  VOP_LOOKUP+0x5b sys/kern/vfs_vops.c:91
#10 vfs_lookup+0x7a6 sys/kern/vfs_lookup.c:568
#11 namei+0x63c sys/kern/vfs_lookup.c:249
#12 dounlinkat+0x99 sys/kern/vfs_syscalls.c:1785
#13 syscall+0x4a4 mi_syscall sys/sys/syscall_mi.h:92 [inline]
#13 syscall+0x4a4 sys/arch/amd64/amd64/trap.c:555
#14 Xsyscall+0x128
exclusive rrwlock inode r = 0 (0xfffffd806e13de70)
#0  witness_lock+0x52e sys/kern/subr_witness.c:1163
#1  rw_enter+0x447 sys/kern/kern_rwlock.c:306
#2  rrw_enter+0x4f sys/kern/kern_rwlock.c:435
#3  VOP_LOCK+0xf0 sys/kern/vfs_vops.c:615
#4  vn_lock+0x81 sys/kern/vfs_vnops.c:571
#5  vfs_lookup+0xe6 sys/kern/vfs_lookup.c:419
#6  namei+0x63c sys/kern/vfs_lookup.c:249
#7  dounlinkat+0x99 sys/kern/vfs_syscalls.c:1785
#8  syscall+0x4a4 mi_syscall sys/sys/syscall_mi.h:92 [inline]
#8  syscall+0x4a4 sys/arch/amd64/amd64/trap.c:555
#9  Xsyscall+0x128
exclusive mutex &diskp->dk_mtx r = 0 (0xffff800000172898)
#0  witness_lock+0x52e sys/kern/subr_witness.c:1163
#1  mtx_enter_try+0x102
#2  mtx_enter+0x4b sys/kern/kern_lock.c:266
#3  disk_busy+0x21 sys/kern/subr_disk.c:1235
#4  sdstart+0x3dc sys/scsi/sd.c:711
#5  scsi_iopool_run+0x129 scsi_ioh_pending sys/scsi/scsi_base.c:394 [inline]
#5  scsi_iopool_run+0x129 sys/scsi/scsi_base.c:410
#6  scsi_xsh_runqueue+0x210 sys/scsi/scsi_base.c:586
#7  scsi_xsh_add+0xc9 sys/scsi/scsi_base.c:525
#8  sdstrategy+0x187 sys/scsi/sd.c:582
#9  spec_strategy+0x74 sys/kern/spec_vnops.c:468
#10 VOP_STRATEGY+0x99 sys/kern/vfs_vops.c:727
#11 bwrite+0x1b9 sys/kern/vfs_bio.c:738
#12 ffs_update+0x2c2 sys/ufs/ffs/ffs_inode.c:113
#13 ffs_truncate+0xc76
#14 ufs_rmdir+0x3af sys/ufs/ufs/ufs_vnops.c:1357
#15 VOP_RMDIR+0xf8 sys/kern/vfs_vops.c:474
#16 dounlinkat+0x14c sys/kern/vfs_syscalls.c:1818
#17 syscall+0x4a4 mi_syscall sys/sys/syscall_mi.h:92 [inline]
#17 syscall+0x4a4 sys/arch/amd64/amd64/trap.c:555
#18 Xsyscall+0x128
Process 18402 (sshd) thread 0xffff800020ac1b38 (67535)
exclusive rwlock netlock r = 0 (0xffffffff8247ccd8)
#0  witness_lock+0x52e sys/kern/subr_witness.c:1163
#1  solock+0x5a sys/kern/uipc_socket2.c:282
#2  sosend+0x51b sys/kern/uipc_socket.c:512
#3  dofilewritev+0x1b7 sys/kern/sys_generic.c:364
#4  sys_write+0x83 sys/kern/sys_generic.c:284
#5  syscall+0x4a4 mi_syscall sys/sys/syscall_mi.h:92 [inline]
#5  syscall+0x4a4 sys/arch/amd64/amd64/trap.c:555
#6  Xsyscall+0x128
ddb{0}> show malloc
           Type InUse  MemUse  HighUse   Limit  Requests Type Lim Kern Lim
         devbuf  9593   6596K    9405K  78643K     21141        0        0
            pcb    13      9K       9K  78643K      1157        0        0
         rtable   121      6K       6K  78643K      2579        0        0
         ifaddr   274     31K      32K  78643K       977        0        0
       counters    39     33K      33K  78643K        39        0        0
       ioctlops     0      0K       4K  78643K      1687        0        0
            iov     0      0K      32K  78643K       710        0        0
          mount     1      1K       1K  78643K         1        0        0
         vnodes  1234     77K      78K  78643K      4976        0        0
      UFS quota     1     32K      32K  78643K         1        0        0
      UFS mount     5     36K      36K  78643K         5        0        0
            shm     2      1K       5K  78643K        49        0        0
         VM map    40     20K      20K  78643K        56        0        0
            sem    12      0K       1K  78643K      1016        0        0
        dirhash    12      2K       2K  78643K        12        0        0
           ACPI  1808    196K     290K  78643K     12765        0        0
      file desc     5     13K      25K  78643K      3364        0        0
          sigio     0      0K       0K  78643K        86        0        0
           proc    61     63K      95K  78643K      1702        0        0
        subproc    32      2K       2K  78643K       408        0        0
    NFS srvsock     1      0K       0K  78643K         1        0        0
     NFS daemon     1     16K      16K  78643K         1        0        0
    ip_moptions     0      0K       1K  78643K       295        0        0
       in_multi    71      4K       4K  78643K       490        0        0
    ether_multi     1      0K       0K  78643K        34        0        0
            mrt     0      0K       0K  78643K        21        0        0
    ISOFS mount     1     32K      32K  78643K         1        0        0
  MSDOSFS mount     1     16K      16K  78643K         1        0        0
           ttys    84    371K     371K  78643K        84        0        0
           exec     0      0K       1K  78643K       879        0        0
        pagedep     1      8K       8K  78643K         1        0        0
       inodedep     1     32K      32K  78643K         1        0        0
         newblk     1      0K       0K  78643K         1        0        0
        VM swap     7     26K      26K  78643K         7        0        0
       UVM amap   186    301K     302K  78643K     12746        0        0
       UVM aobj   130      6K       6K  78643K       138        0        0
        memdesc     1      4K       4K  78643K         1        0        0
    crypto data     1      1K       1K  78643K         1        0        0
    ip6_options     0      0K       1K  78643K       961        0        0
            NDP    22      0K       1K  78643K       247        0        0
           temp   178   3556K    4195K  78643K     96759        0        0
         kqueue     0      0K       0K  78643K        29        0        0
      SYN cache     2     16K      16K  78643K         2        0        0
ddb{0}> show all pools
Name      Size Requests Fail Releases Pgreq Pgrel Npage Hiwat Minpg Maxpg Idle
arp         64       95    0       86     1     0     1     1     0     8    0
plcache    128       20    0        0     1     0     1     1     0     8    0
rtpcb       80      348    0      346     1     0     1     1     0     8    0
rtentry    112      433    0      387     2     0     2     2     0     8    0
unpcb      120     2083    0     2066     2     1     1     2     0     8    0
syncache   264       14    0       14     6     6     0     1     0     8    0
tcpqe       32      332    0      332     5     5     0     1     0     8    0
tcpcb      544     1733    0     1729    11    10     1     4     0     8    0
ipq         40        1    0        1     1     1     0     1     0     8    0
ipqe        40        2    0        2     1     1     0     1     0     8    0
inpcb      280     5911    0     5903    25    23     2     6     0     8    1
rttmr       72        8    0        7     1     0     1     1     0     8    0
nd6         48       63    0       60     2     1     1     1     0     8    0
pkpcb       40       15    0       15     3     3     0     1     0     8    0
swfcl       56        3    0        0     1     0     1     1     0     8    0
ppxss      1128     110    0      110    16    15     1     1     0     8    1
pffrag     232       91    0       91    14    13     1     1     0   482    1
pffrnode    88       91    0       91    14    13     1     1     0     8    1
pffrent     40     3750    0     3750    14    13     1     1     0     8    1
pfosfp      40      846    0      846     5     0     5     5     0     8    5
pfosfpen   112     1428    0     1428    21     0    21    21     0     8   21
pfstitem    24      304    0      237     1     0     1     1     0     8    0
pfstkey    112      304    0      237     3     0     3     3     0     8    0
pfstate    328      304    0      237     7     0     7     7     0     8    0
pfrule     1360      21    0       16     2     1     1     2     0     8    0
art_heap8  4096       5    0        4     4     3     1     3     0     8    0
art_heap4  256     1949    0     1699    34    18    16    17     0     8    0
art_table   32     1954    0     1703     6     3     3     3     0     8    0
art_node    16      432    0      389     1     0     1     1     0     8    0
sysvmsgpl   40       15    0        8     1     0     1     1     0     8    0
semupl     112        2    0        2     1     1     0     1     0     8    0
semapl     112     1014    0     1004     1     0     1     1     0     8    0
shmpl      112      136    0        8     4     0     4     4     0     8    0
dirhash    1024      17    0        0     3     0     3     3     0     8    0
dino1pl    128     6970    0     5559    46     0    46    46     0     8    0
ffsino     272     6970    0     5559    95     0    95    95     0     8    0
nchpl      144    12342    0    11878    61    40    21    61     0     8    0
uvmvnodes   72     5926    0        0   108     0   108   108     0     8    0
vnodes     208     5926    0        0   312     0   312   312     0     8    0
namei      1024   44975    0    44975     2     1     1     1     0     8    1
percpumem   16       30    0        0     1     0     1     1     0     8    0
vcpupl     1984      38    0        0     5     0     5     5     0     8    0
vmpool     552       54    0       16     3     0     3     3     0     8    0
scxspl     192    40978    0    40978    27    26     1     7     0     8    1
plimitpl   152      288    0      280     1     0     1     1     0     8    0
sigapl     432     3500    0     3485     3     1     2     3     0     8    0
futexpl     56    83805    0    83805     2     1     1     1     0     8    1
knotepl    112      838    0      819     5     4     1     3     0     8    0
kqueuepl   104     1025    0     1022     3     2     1     2     0     8    0
pipepl     160     4820    0     4801     4     2     2     2     0     8    1
fdescpl    488     3501    0     3485     3     0     3     3     0     8    0
filepl     152    34967    0    34860    25    19     6     8     0     8    1
lockfpl    104     1512    0     1511     1     0     1     1     0     8    0
lockfspl    48      473    0      472     1     0     1     1     0     8    0
sessionpl  112       44    0       33     1     0     1     1     0     8    0
pgrppl      48       88    0       77     1     0     1     1     0     8    0
ucredpl     96     3622    0     3611     1     0     1     1     0     8    0
zombiepl   144     3487    0     3487     2     1     1     1     0     8    1
processpl  896     3520    0     3487     4     0     4     4     0     8    0
procpl     632    10716    0    10673     6     1     5     5     0     8    0
srpgc       64       34    0       34    13    12     1     1     0     8    1
sosppl     128      153    0      153    14    14     0     1     0     8    0
sockpl     384     8430    0     8403    40    36     4    10     0     8    1
mcl64k     65536    265    0        0    34    28     6    34     0     8    1
mcl16k     16384     17    0        0     3     0     3     3     0     8    0
mcl12k     12288     25    0        0     2     0     2     2     0     8    0
mcl9k      9216      17    0        0     2     0     2     2     0     8    0
mcl8k      8192      20    0        0     3     0     3     3     0     8    0
mcl4k      4096      17    0        0     3     0     3     3     0     8    0
mcl2k2     2112      10    0        0     1     0     1     1     0     8    0
mcl2k      2048     201    0        0    20     4    16    20     0     8    0
mtagpl      80      122    0        0     2     0     2     2     0     8    0
mbufpl     256      947    0        0    46     0    46    46     0     8    0
bufpl      256    15848    0     8790   442     0   442   442     0     8    0
anonpl      16   491299    0   468199   197    94   103   120     0   124    5
amapchunkpl 152   25427    0    25250    39    28    11    15     0   158    0
amappl16   192    21122    0    19759   184   112    72    92     0     8    0
amappl15   184      751    0      751     5     4     1     1     0     8    1
amappl14   176     1099    0     1088     1     0     1     1     0     8    0
amappl13   168       86    0       86     2     2     0     1     0     8    0
amappl12   160      327    0      323     2     1     1     1     0     8    0
amappl11   152      494    0      478     1     0     1     1     0     8    0
amappl10   144      234    0      227     1     0     1     1     0     8    0
amappl9    136      961    0      958     1     0     1     1     0     8    0
amappl8    128      665    0      614     2     0     2     2     0     8    0
amappl7    120      349    0      340     1     0     1     1     0     8    0
amappl6    112      447    0      436     1     0     1     1     0     8    0
amappl5    104      792    0      776     1     0     1     1     0     8    0
amappl4     96     3734    0     3697     1     0     1     1     0     8    0
amappl3     88      815    0      808     1     0     1     1     0     8    0
amappl2     80    26130    0    26053     3     1     2     3     0     8    0
amappl1     72    89300    0    88859    25    15    10    20     0     8    0
amappl      80    11437    0    11368     2     0     2     2     0    84    0
dma4096    4096       1    0        1     1     1     0     1     0     8    0
dma256     256        6    0        6     1     1     0     1     0     8    0
dma128     128      253    0      253     1     1     0     1     0     8    0
dma64       64        6    0        6     1     1     0     1     0     8    0
dma32       32        7    0        7     1     1     0     1     0     8    0
dma16       16       17    0       17     1     1     0     1     0     8    0
aobjpl      64      137    0        8     3     0     3     3     0     8    0
uaddrrnd    24     3555    0     3485     1     0     1     1     0     8    0
uaddrbest   32        2    0        0     1     0     1     1     0     8    0
uaddr       24     3555    0     3485     1     0     1     1     0     8    0
vmmpekpl   168    36689    0    36645     3     0     3     3     0     8    0
vmmpepl    168   461947    0   459259   303   136   167   178     0   357   36
vmsppl     368     3500    0     3485     2     0     2     2     0     8    0
pdppl      4096    7117    0     7040    13     2    11    11     0     8    1
pvpl        32  1257582    0  1233777   379   143   236   253     0   265   29
pmappl     232     3554    0     3501     4     0     4     4     0     8    0
extentpl    40       41    0       26     1     0     1     1     0     8    0
phpool     112      719    0       69    19     0    19    19     0     8    0

Crashes (1):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2019/11/13 06:08 openbsd f0c2caef18b3 048f2d49 .config console log report ci-openbsd-multicore
* Struck through repros no longer work on HEAD.