syzbot


panic: pool_cache_piatneicm:_m akgericne_cl hedcika:g nmbosutficp la csspeur tfiroeen "li!_stk ernmoeld_ilfiocedk:_h ie

Status: closed as dup on 2019/12/09 03:26
Reported-by: syzbot+f16392e768346389ec45@syzkaller.appspotmail.com
First crash: 1593d, last: 1593d
Duplicate of
Title Repro Cause bisect Fix bisect Count Last Reported
pool: cpu free list modified: mbufpl syz 15863 1353d 1639d

Sample crash report:
login: panic: pool_cache_piatneicm:_m akgericne_cl hedcika:g nmbosutficp la csspeur tfiroeen  "li!_stk ernmoeld_ilfiocedk:_h ieltde(m )a"ddr 0xfffffd806d350200+16 0x0!=0xa0b1b44da062bc75
Stopped at      db_enter+0x18:  addq    $0x8,%rsp
    TID    PID    UID     PRFLAGS     PFLAGS  CPU  COMMAND
  79415   6519      0           0  0x4000000    0  syz-executor.0
*324390   9681      0           0  0x4000000    1  syz-executor.1
db_enter() at db_enter+0x18 sys/arch/amd64/amd64/db_interface.c:398
panic(ffffffff821c307b) at panic+0x15c sys/kern/subr_prf.c:207
pool_cache_get(ffffffff8265bda8) at pool_cache_get+0x323 pool_cache_item_magic_check sys/kern/subr_pool.c:1789 [inline]
pool_cache_get(ffffffff8265bda8) at pool_cache_get+0x323 sys/kern/subr_pool.c:1892
pool_get(ffffffff8265bda8,2) at pool_get+0x91 sys/kern/subr_pool.c:572
m_gethdr(2,2) at m_gethdr+0x4c sys/kern/uipc_mbuf.c:283
ip_fragment(fffffd806f205b00,ffff8000001732a8,5b4) at ip_fragment+0x13a sys/netinet/ip_output.c:682
ip_output(fffffd806f205b00,0,fffffd806f675700,20,0,fffffd806f675690) at ip_output+0xfc1 sys/netinet/ip_output.c:501
rip_output(fffffd806f205b00,fffffd807eadc198,ffff800021581618,ffff800022d94000) at rip_output+0x252 sys/netinet/raw_ip.c:289
rip_usrreq(fffffd807eadc198,9,fffffd806f205b00,0,0,ffff800020adf8d0) at rip_usrreq+0x46a sys/netinet/raw_ip.c:538
sosend(fffffd807eadc198,0,ffff800021581780,0,0,80) at sosend+0x645 sys/kern/uipc_socket.c:524
sendit(ffff800020adf8d0,7,ffff800021581860,0,ffff800021581940) at sendit+0x52b sys/kern/uipc_syscalls.c:662
sys_sendto(ffff800020adf8d0,ffff8000215818f8,ffff800021581940) at sys_sendto+0x80 sys/kern/uipc_syscalls.c:527
syscall(ffff8000215819c0) at syscall+0x4a4 mi_syscall sys/sys/syscall_mi.h:92 [inline]
syscall(ffff8000215819c0) at syscall+0x4a4 sys/arch/amd64/amd64/trap.c:555
Xsyscall() at Xsyscall+0x128
end of kernel
end trace frame: 0xb93970a4c50, count: 1
https://www.openbsd.org/ddb.html describes the minimum info required in bug
reports.  Insufficient info makes it difficult to find and fix bugs.
ddb{1}> 
ddb{1}> set $lines = 0
ddb{1}> set $maxwidth = 0
ddb{1}> show panic
pool_cache_item_magic_check: mbufpl cpu free list modified: item addr 0xfffffd806d350200+16 0x0!=0xa0b1b44da062bc75
ddb{1}> trace
db_enter() at db_enter+0x18 sys/arch/amd64/amd64/db_interface.c:398
panic(ffffffff821c307b) at panic+0x15c sys/kern/subr_prf.c:207
pool_cache_get(ffffffff8265bda8) at pool_cache_get+0x323 pool_cache_item_magic_check sys/kern/subr_pool.c:1789 [inline]
pool_cache_get(ffffffff8265bda8) at pool_cache_get+0x323 sys/kern/subr_pool.c:1892
pool_get(ffffffff8265bda8,2) at pool_get+0x91 sys/kern/subr_pool.c:572
m_gethdr(2,2) at m_gethdr+0x4c sys/kern/uipc_mbuf.c:283
ip_fragment(fffffd806f205b00,ffff8000001732a8,5b4) at ip_fragment+0x13a sys/netinet/ip_output.c:682
ip_output(fffffd806f205b00,0,fffffd806f675700,20,0,fffffd806f675690) at ip_output+0xfc1 sys/netinet/ip_output.c:501
rip_output(fffffd806f205b00,fffffd807eadc198,ffff800021581618,ffff800022d94000) at rip_output+0x252 sys/netinet/raw_ip.c:289
rip_usrreq(fffffd807eadc198,9,fffffd806f205b00,0,0,ffff800020adf8d0) at rip_usrreq+0x46a sys/netinet/raw_ip.c:538
sosend(fffffd807eadc198,0,ffff800021581780,0,0,80) at sosend+0x645 sys/kern/uipc_socket.c:524
sendit(ffff800020adf8d0,7,ffff800021581860,0,ffff800021581940) at sendit+0x52b sys/kern/uipc_syscalls.c:662
sys_sendto(ffff800020adf8d0,ffff8000215818f8,ffff800021581940) at sys_sendto+0x80 sys/kern/uipc_syscalls.c:527
syscall(ffff8000215819c0) at syscall+0x4a4 mi_syscall sys/sys/syscall_mi.h:92 [inline]
syscall(ffff8000215819c0) at syscall+0x4a4 sys/arch/amd64/amd64/trap.c:555
Xsyscall() at Xsyscall+0x128
end of kernel
end trace frame: 0xb93970a4c50, count: -14
ddb{1}> show registers
rdi               0xffffffff814b5e47    db_enter+0x17
rsi                           0x8c1e    __ALIGN_SIZE+0x7c1e
rbp               0xffff8000215811a0
rbx               0xffff800021581250
rdx                           0x8c1f    __ALIGN_SIZE+0x7c1f
rcx               0xffff800022d94000
rax               0xffff800022d94000
r8                0xffffffff81f7d7af    kprintf+0x16f
r9                               0x1
r10                             0x25
r11               0x32426def9129db15
r12                     0x3000000008
r13               0xffff8000215811b0
r14                            0x100
r15                              0x1
rip               0xffffffff814b5e48    db_enter+0x18
cs                               0x8
rflags                         0x246
rsp               0xffff800021581190
ss                              0x10
db_enter+0x18:  addq    $0x8,%rsp
ddb{1}> show proc
PROC (syz-executor.1) pid=324390 stat=onproc
    flags process=0 proc=4000000<THREAD>
    pri=86, usrpri=86, nice=20
    forw=0xffffffffffffffff, list=0xffff800020adeef0,0xffff800020adfb58
    process=0xffff800020aec000 user=0xffff80002157c000, vmspace=0xfffffd807f007000
    estcpu=36, cpticks=1, pctcpu=0.0
    user=0, sys=1, intr=0
ddb{1}> ps
   PID     TID   PPID    UID  S       FLAGS  WAIT          COMMAND
  6519  485200  27625      0  2           0                syz-executor.0
  6519   79415  27625      0  7   0x4000000                syz-executor.0
  9681  222440  10940      0  2           0                syz-executor.1
* 9681  324390  10940      0  7   0x4000000                syz-executor.1
 10940  176910  45118      0  2       0x482                syz-executor.1
  1696  324478      0      0  3     0x14200  bored         sosplice
 27625  411167  45118      0  3        0x82  nanosleep     syz-executor.0
 45118  396361  97936      0  3        0x82  thrsleep      syz-fuzzer
 45118  227670  97936      0  3   0x4000082  nanosleep     syz-fuzzer
 45118   69874  97936      0  3   0x4000082  thrsleep      syz-fuzzer
 45118  415985  97936      0  3   0x4000082  thrsleep      syz-fuzzer
 45118  204573  97936      0  3   0x4000082  thrsleep      syz-fuzzer
 45118  185231  97936      0  3   0x4000082  thrsleep      syz-fuzzer
 45118  456555  97936      0  3   0x4000082  kqread        syz-fuzzer
 45118   63708  97936      0  3   0x4000082  thrsleep      syz-fuzzer
 45118  214849  97936      0  2   0x4000482                syz-fuzzer
 45118  320117  97936      0  3   0x4000082  thrsleep      syz-fuzzer
 97936  331944  10218      0  3    0x10008a  pause         ksh
 10218  467175  83554      0  3        0x92  select        sshd
 62332  129683      1      0  3    0x100083  ttyin         getty
 83554   29714      1      0  3        0x80  select        sshd
 48809  389594  78873     74  3    0x100092  bpf           pflogd
 78873  467589      1      0  3        0x80  netio         pflogd
 85141  205007  57401     73  3    0x100090  kqread        syslogd
 57401  394492      1      0  3    0x100082  netio         syslogd
 88488   50803      1     77  3    0x100090  poll          dhclient
 59549  195531      1      0  3        0x80  poll          dhclient
 45887  369757      0      0  2     0x14200                zerothread
 18744  313309      0      0  3     0x14200  aiodoned      aiodoned
 93229  198747      0      0  3     0x14200  syncer        update
 13103   59762      0      0  3     0x14200  cleaner       cleaner
 54311  486866      0      0  3     0x14200  reaper        reaper
  3146  273405      0      0  3     0x14200  pgdaemon      pagedaemon
 96798  105260      0      0  3     0x14200  bored         crynlk
  8738  256027      0      0  3     0x14200  bored         crypto
 36440  507073      0      0  3  0x40014200  acpi0         acpi0
 40248  266509      0      0  3  0x40014200                idle1
 91085   82183      0      0  3     0x14200  bored         softnet
 16280  445347      0      0  3     0x14200  bored         systqmp
 63777  461504      0      0  3     0x14200  bored         systq
 92006  168480      0      0  3  0x40014200  bored         softclock
 86298  355382      0      0  3  0x40014200                idle0
 66456  490307      0      0  3     0x14200  bored         smr
     1  150225      0      0  3        0x82  wait          init
     0       0     -1      0  3     0x10200  scheduler     swapper
ddb{1}> show all locks
Process 6519 (syz-executor.0) thread 0xffff800020adfb48 (485200)
shared rwlock vmmaplk r = 0 (0xfffffd807f007468)
#0  witness_lock+0x52e sys/kern/subr_witness.c:1163
#1  uvmfault_lookup+0xd9 sys/uvm/uvm_fault.c:1448
#2  uvm_fault+0xd85 sys/uvm/uvm_fault.c:524
#3  pageflttrap+0x20b sys/arch/amd64/amd64/trap.c:199
#4  usertrap+0x21a sys/arch/amd64/amd64/trap.c:369
#5  recall_trap+0x8
exclusive kernel_lock &kernel_lock r = 0 (0xffffffff8264b740)
#0  witness_lock+0x52e sys/kern/subr_witness.c:1163
#1  pageflttrap+0x6f sys/arch/amd64/amd64/trap.c:162
#2  usertrap+0x21a sys/arch/amd64/amd64/trap.c:369
#3  recall_trap+0x8
Process 9681 (syz-executor.1) thread 0xffff800020adf8d0 (324390)
exclusive rwlock netlock r = 0 (0xffffffff8244e7e8)
#0  witness_lock+0x52e sys/kern/subr_witness.c:1163
#1  solock+0x5a sys/kern/uipc_socket2.c:282
#2  sosend+0x51b sys/kern/uipc_socket.c:512
#3  sendit+0x52b sys/kern/uipc_syscalls.c:662
#4  sys_sendto+0x80 sys/kern/uipc_syscalls.c:527
#5  syscall+0x4a4 mi_syscall sys/sys/syscall_mi.h:92 [inline]
#5  syscall+0x4a4 sys/arch/amd64/amd64/trap.c:555
#6  Xsyscall+0x128
ddb{1}> show malloc
           Type InUse  MemUse  HighUse   Limit  Requests Type Lim
         devbuf  9521   6604K    7386K  78643K     11355        0
            pcb    13      8K       8K  78643K        59        0
         rtable   108      4K       4K  78643K       323        0
         ifaddr    63     13K      13K  78643K        95        0
       counters    39     33K      33K  78643K        39        0
       ioctlops     0      0K       4K  78643K      1476        0
            iov     0      0K      16K  78643K        34        0
          mount     1      1K       1K  78643K         1        0
         vnodes  1226     77K      77K  78643K      1423        0
      UFS quota     1     32K      32K  78643K         1        0
      UFS mount     5     36K      36K  78643K         5        0
            shm     2      1K       5K  78643K         5        0
         VM map     2      1K       1K  78643K         2        0
            sem    12      0K       0K  78643K        58        0
        dirhash    12      2K       2K  78643K        12        0
           ACPI  1809    196K     290K  78643K     12766        0
      file desc     6     17K      25K  78643K       178        0
          sigio     0      0K       0K  78643K         4        0
           proc    60     63K      95K  78643K       491        0
        subproc    32      2K       2K  78643K        51        0
    NFS srvsock     1      0K       0K  78643K         1        0
     NFS daemon     1     16K      16K  78643K         1        0
    ip_moptions     0      0K       0K  78643K         8        0
       in_multi    40      2K       2K  78643K        53        0
    ether_multi     1      0K       0K  78643K         2        0
            mrt     0      0K       0K  78643K         5        0
    ISOFS mount     1     32K      32K  78643K         1        0
  MSDOSFS mount     1     16K      16K  78643K         1        0
           ttys    36    159K     159K  78643K        36        0
           exec     0      0K       1K  78643K       234        0
        pagedep     1      8K       8K  78643K         1        0
       inodedep     1     32K      32K  78643K         1        0
         newblk     1      0K       0K  78643K         1        0
        VM swap     7     26K      26K  78643K         7        0
       UVM amap   120     22K      31K  78643K      1560        0
       UVM aobj    29      2K       2K  78643K        29        0
        memdesc     1      4K       4K  78643K         1        0
    crypto data     1      1K       1K  78643K         1        0
    ip6_options     0      0K       0K  78643K        38        0
            NDP    10      0K       0K  78643K        20        0
           temp   103   3012K    3079K  78643K      5529        0
      SYN cache     2     16K      16K  78643K         2        0
ddb{1}> show all pools
Name      Size Requests Fail Releases Pgreq Pgrel Npage Hiwat Minpg Maxpg Idle
arp         64       12    0        6     1     0     1     1     0     8    0
plcache    128       20    0        0     1     0     1     1     0     8    0
rtpcb       80       30    0       27     1     0     1     1     0     8    0
rtentry    112       69    0       25     2     0     2     2     0     8    0
unpcb      120      275    0      264     1     0     1     1     0     8    0
syncache   264        5    0        5     2     2     0     1     0     8    0
tcpqe       32      157    0      157     1     1     0     1     0     8    0
tcpcb      544       97    0       93     1     0     1     1     0     8    0
inpcb      280      255    0      247     2     1     1     2     0     8    0
rttmr       72        2    0        2     2     1     1     1     0     8    1
nd6         48        6    0        2     1     0     1     1     0     8    0
ppxss      1128       3    0        3     2     1     1     1     0     8    1
pffrag     232        2    0        2     1     1     0     1     0   482    0
pffrnode    88        2    0        2     1     1     0     1     0     8    0
pffrent     40        8    0        8     1     1     0     1     0     8    0
pfosfp      40      846    0      423     5     0     5     5     0     8    0
pfosfpen   112     1428    0      714    21     0    21    21     0     8    0
pfstitem    24       31    0        0     1     0     1     1     0     8    0
pfstkey    112       31    0        0     1     0     1     1     0     8    0
pfstate    328       31    0        0     3     0     3     3     0     8    0
pfrule     1360      21    0       16     2     1     1     2     0     8    0
art_heap8  4096       1    0        0     1     0     1     1     0     8    0
art_heap4  256      278    0       63    15     0    15    15     0     8    1
art_table   32      279    0       63     2     0     2     2     0     8    0
art_node    16       68    0       28     1     0     1     1     0     8    0
sysvmsgpl   40        4    0        2     1     0     1     1     0     8    0
semupl     112        2    0        2     1     1     0     1     0     8    0
semapl     112       54    0       44     1     0     1     1     0     8    0
shmpl      112       27    0        0     1     0     1     1     0     8    0
dirhash    1024      17    0        0     3     0     3     3     0     8    0
dino1pl    128     1609    0      201    46     0    46    46     0     8    0
ffsino     272     1609    0      201    95     0    95    95     0     8    0
nchpl      144     2039    0      433    61     0    61    61     0     8    1
uvmvnodes   72     1840    0        0    34     0    34    34     0     8    0
vnodes     208     1840    0        0    97     0    97    97     0     8    0
namei      1024    5709    0     5709     1     0     1     1     0     8    1
percpumem   16       30    0        0     1     0     1     1     0     8    0
scxspl     192     5846    0     5846     8     1     7     7     0     8    7
plimitpl   152       28    0       20     1     0     1     1     0     8    0
sigapl     432      374    0      358     3     1     2     3     0     8    0
futexpl     56     3587    0     3587     1     0     1     1     0     8    1
knotepl    112      214    0      195     1     0     1     1     0     8    0
kqueuepl   104      144    0      142     1     0     1     1     0     8    0
pipepl     160      414    0      395     2     0     2     2     0     8    1
fdescpl    488      375    0      358     3     0     3     3     0     8    0
filepl     152     2819    0     2716     6     0     6     6     0     8    2
lockfpl    104       64    0       63     1     0     1     1     0     8    0
lockfspl    48       23    0       22     1     0     1     1     0     8    0
sessionpl  112       19    0        8     1     0     1     1     0     8    0
pgrppl      48       19    0        8     1     0     1     1     0     8    0
ucredpl     96      105    0       96     1     0     1     1     0     8    0
zombiepl   144      358    0      358     1     0     1     1     0     8    1
processpl  896      391    0      358     4     0     4     4     0     8    0
procpl     632      728    0      684     5     0     5     5     0     8    0
srpgc       64        2    0        2     1     0     1     1     0     8    1
sosppl     128        4    0        4     1     0     1     1     0     8    1
sockpl     384      568    0      546     4     0     4     4     0     8    1
mcl64k     65536      2    0        0     1     0     1     1     0     8    0
mcl16k     16384      2    0        0     1     0     1     1     0     8    0
mcl12k     12288      3    0        0     1     0     1     1     0     8    0
mcl9k      9216       4    0        0     1     0     1     1     0     8    0
mcl8k      8192       5    0        0     1     0     1     1     0     8    0
mcl4k      4096       8    0        0     1     0     1     1     0     8    0
mcl2k      2048     175    0        0    21     0    21    21     0     8    0
mtagpl      80       13    0        0     1     0     1     1     0     8    0
mbufpl     256      173    0        0    11     0    11    11     0     8    0
bufpl      280     6585    0     1340   375     0   375   375     0     8    0
anonpl      16    61296    0    42769    92     2    90    91     0   125   12
amapchunkpl 152    2236    0     2060    12     0    12    12     0   158    4
amappl16   192     1953    0      909    61     1    60    61     0     8    7
amappl15   184       60    0       57     1     0     1     1     0     8    0
amappl14   176      102    0       98     1     0     1     1     0     8    0
amappl13   168       33    0       31     2     1     1     1     0     8    0
amappl12   160       39    0       36     2     1     1     1     0     8    0
amappl11   152       60    0       44     1     0     1     1     0     8    0
amappl10   144       20    0       14     1     0     1     1     0     8    0
amappl9    136      623    0      618     1     0     1     1     0     8    0
amappl8    128      137    0      111     1     0     1     1     0     8    0
amappl7    120      114    0      100     1     0     1     1     0     8    0
amappl6    112       59    0       52     1     0     1     1     0     8    0
amappl5    104      167    0      154     1     0     1     1     0     8    0
amappl4     96      568    0      536     1     0     1     1     0     8    0
amappl3     88      289    0      278     1     0     1     1     0     8    0
amappl2     80     2021    0     1938     3     1     2     3     0     8    0
amappl1     72    18424    0    17961    26    16    10    21     0     8    1
amappl      80     1004    0      953     2     0     2     2     0    84    0
dma4096    4096       1    0        1     1     1     0     1     0     8    0
dma256     256        6    0        6     1     1     0     1     0     8    0
dma128     128      253    0      253     1     1     0     1     0     8    0
dma64       64        6    0        6     1     1     0     1     0     8    0
dma32       32        7    0        7     1     1     0     1     0     8    0
dma16       16       18    0       17     1     0     1     1     0     8    0
aobjpl      64       28    0        0     1     0     1     1     0     8    0
uaddrrnd    24      375    0      358     1     0     1     1     0     8    0
uaddrbest   32        2    0        0     1     0     1     1     0     8    0
uaddr       24      375    0      358     1     0     1     1     0     8    0
vmmpekpl   168     7239    0     7208     2     0     2     2     0     8    0
vmmpepl    168    54860    0    52520   142     3   139   139     0   357   37
vmsppl     368      374    0      358     2     0     2     2     0     8    0
pdppl      4096     757    0      716     6     0     6     6     0     8    0
pvpl        32   184630    0   162841   211     1   210   211     0   265   28
pmappl     232      374    0      358     2     1     1     2     0     8    0
extentpl    40       46    0       29     1     0     1     1     0     8    0
phpool     112      164    0        3     5     0     5     5     0     8    0

Crashes (1):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2019/12/08 23:11 openbsd 6577a79c0f80 1508f453 .config console log report ci-openbsd-multicore
* Struck through repros no longer work on HEAD.