环境信息

主机：3台
osd：每台6个
ceph 版本：L
测试工具：fio
存储网卡：万兆

单块磁盘性能

 

随机读写：
fio --filename=./test -iodepth=64 -ioengine=libaio -direct=1 -rw=randread -bs=4k -size=2G -numjobs=64 -runt
ime=100 -group_reporting -name=test-rand-read
read: IOPS=1517, BW=6070KiB/s (6215kB/s)(524MiB/88369msec)
fio --filename=./test -iodepth=64 -ioengine=libaio -direct=1 -rw=randwrite -bs=4k -size=2G -numjobs=64 -run
time=30 -group_reporting -name=test-rand-read
  write: IOPS=642, BW=2571KiB/s (2633kB/s)(76.4MiB/30448msec)

顺序读：
fio --filename=./test -iodepth=64 -ioengine=libaio -direct=1 -rw=randwrite -bs=4k -size=5G -numjobs=1 -run
time=30 -group_reporting -name=test-rand-read
   read: IOPS=54, BW=220MiB/s (230MB/s)(5120MiB/23292msec)
fio --filename=./test -iodepth=64 -ioengine=libaio -direct=1 -rw=read -bs=4M -size=5G -numjobs=64 -run
time=30 -group_reporting -name=test-rand-read 
   read: IOPS=117, BW=470MiB/s (493MB/s)(13.0GiB/30508msec)

顺序写
fio --filename=./test -iodepth=64 -ioengine=libaio -direct=1 -rw=write -bs=16M -size=5G -numjobs=1 -runtime
=100 -group_reporting -name=test-rand-read 
  write: IOPS=57, BW=229MiB/s (240MB/s)(5120MiB/22360msec)
fio --filename=./test -iodepth=64 -ioengine=libaio -direct=1 -rw=write -bs=4M -size=5G -numjobs=64 -runtime
=30 -group_reporting -name=test-rand-read
write: IOPS=831, BW=3326MiB/s (3488MB/s)(97.8GiB/30120msec)
————————————————
版权声明：本文为CSDN博主「weixin_35664258」的原创文章，遵循CC 4.0 BY-SA版权协议，转载请附上原文出处链接及本声明。
原文链接：https://blog.csdn.net/weixin_35664258/article/details/89318728

 

两块raid1性能

随机读写：
fio --filename=./test -iodepth=64 -ioengine=libaio -direct=1 -rw=randread -bs=4k -size=2G -numjobs=64 -runtim
e=100 -group_reporting -name=test-rand-read
read: IOPS=2875, BW=11.2MiB/s (11.8MB/s)(353MiB/31385msec)
fio --filename=./test -iodepth=64 -ioengine=libaio -direct=1 -rw=randwrite -bs=4k -size=2G -numjobs=64 -runti
me=100 -group_reporting -name=test-rand-read
write: IOPS=639, BW=2559KiB/s (2620kB/s)(76.0MiB/30431msec)

顺序读：
fio --filename=./test -iodepth=64 -ioengine=libaio -direct=1 -rw=read -bs=4M -size=5G -numjobs=1 -run
time=30 -group_reporting -name=test-rand-read
read: IOPS=83, BW=334MiB/s (351MB/s)(5120MiB/15310msec)
fio --filename=./test -iodepth=64 -ioengine=libaio -direct=1 -rw=read -bs=4M -size=5G -numjobs=64 -ru
ntime=100 -group_reporting -name=test-rand-read
read: IOPS=239, BW=959MiB/s (1005MB/s)(28.3GiB/30214msec)

顺序写：
fio --filename=./test -iodepth=64 -ioengine=libaio -direct=1 -rw=write -bs=4M -size=5G -numjobs=1 -ru
ntime=30 -group_reporting -name=test-rand-read
write: IOPS=53, BW=213MiB/s (223MB/s)(5120MiB/24077msec)
fio --filename=./test -iodepth=64 -ioengine=libaio -direct=1 -rw=write -bs=4M -size=5G -numjobs=64 -r
untime=30 -group_reporting -name=test-rand-read
write: IOPS=829, BW=3319MiB/s (3480MB/s)(97.6GiB/30118msec)

 

 

结果对比

 

 

 

 

 

 

ceph性能测试

 

随机读写：
fio --filename=./test -iodepth=64 -ioengine=libaio -direct=1 -rw=randread -bs=4k -size=2G -numjobs=64 -runtim
e=100 -group_reporting -name=test-rand-read
read: IOPS=24.1k, BW=94.3MiB/s (98.9MB/s)(9433MiB/100009msec)
fio --filename=./test -iodepth=64 -ioengine=libaio -direct=1 -rw=randwrite -bs=4k -size=2G -numjobs=64 -runti
me=100 -group_reporting -name=test-rand-read
write: IOPS=3924, BW=15.3MiB/s (16.1MB/s)(1536MiB/100194msec)

顺序读：
fio --filename=./test -iodepth=64 -ioengine=libaio -direct=1 -rw=read -bs=4M -size=20G -numjobs=1 -runtime=
30 -group_reporting -name=test-rand-read
read: IOPS=250, BW=1002MiB/s (1051MB/s)(20.0GiB/20430msec)
fio --filename=./test -iodepth=64 -ioengine=libaio -direct=1 -rw=read -bs=4M -size=20G -numjobs=64 -ru
ntime=100 -group_reporting -name=test-rand-read
read: IOPS=174, BW=696MiB/s (730MB/s)(41.9GiB/61550msec)

顺序写：
fio --filename=./test -iodepth=64 -ioengine=libaio -direct=1 -rw=write -bs=4M -size=5G -numjobs=1 -ru
ntime=30 -group_reporting -name=test-rand-read
write: IOPS=210, BW=841MiB/s (882MB/s)(20.0GiB/24348msec)
fio --filename=./test -iodepth=64 -ioengine=libaio -direct=1 -rw=write -bs=4M -size=5G -numjobs=64 -r
untime=30 -group_reporting -name=test-rand-read
write: IOPS=210, BW=844MiB/s (885MB/s)(25.0GiB/31521msec)

 

结果对比

 

 参考：https://blog.csdn.net/weixin_35664258/article/details/89318728