V2EX = way to explore
V2EX 是一个关于分享和探索的地方
现在注册
已注册用户请  登录
Recommended Services
Amazon Web Services
LeanCloud
New Relic
ClearDB
kitrap
V2EX  ›  云计算

腾讯云高速云盘性能差, IOPS 太低

  •  
  •   kitrap · 2018-11-24 09:17:01 +08:00 · 4266 次点击
    这是一个创建于 2221 天前的主题,其中的信息可能已经有所发展或是发生改变。
    腾讯官网说高速云硬盘 iops 性能为 1500-4500,但是用 fio 实测随机写的 IOPS 才几百-1000。这是被坑了吗???
    测阿里和华为的都能到 2000.

    截取腾讯的两个测试:

    测试一
    ---------------------------------------------------
    [centos ~]$ fio -filename=test/randw -iodepth=64 -ioengine=libaio -direct=1 -rw=randwrite -bs=4k -size=4G -numjobs=64 -runtime=20 -group_reporting -name=test-rand-write
    test-rand-write: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
    ...
    fio-3.1
    Starting 64 processes
    test-rand-write: Laying out IO file (1 file / 4096MiB)
    Jobs: 64 (f=64): [w(64)][100.0%][r=0KiB/s,w=2624KiB/s][r=0,w=656 IOPS][eta 00m:00s]
    test-rand-write: (groupid=0, jobs=64): err= 0: pid=3964: Sat Nov 24 08:43:40 2018
    write: IOPS=736, BW=2946KiB/s (3017kB/s)(58.6MiB/20363msec)
    slat (usec): min=3, max=1994.3k, avg=85405.28, stdev=331000.31
    clat (msec): min=18, max=18100, avg=4578.87, stdev=2672.72
    lat (msec): min=18, max=18850, avg=4664.28, stdev=2698.58
    clat percentiles (msec):
    | 1.00th=[ 284], 5.00th=[ 902], 10.00th=[ 1401], 20.00th=[ 2106],
    | 30.00th=[ 2903], 40.00th=[ 3406], 50.00th=[ 4329], 60.00th=[ 4799],
    | 70.00th=[ 5805], 80.00th=[ 7013], 90.00th=[ 8490], 95.00th=[ 9866],
    | 99.00th=[11476], 99.50th=[12013], 99.90th=[13758], 99.95th=[14697],
    | 99.99th=[17113]
    bw ( KiB/s): min= 8, max= 819, per=4.33%, avg=127.49, stdev=132.69, samples=688
    iops : min= 2, max= 204, avg=31.75, stdev=33.05, samples=688
    lat (msec) : 20=0.03%, 50=0.01%, 100=0.04%, 250=0.87%, 500=2.94%
    lat (msec) : 750=0.59%, 1000=1.40%, 2000=13.32%, >=2000=80.80%
    cpu : usr=0.00%, sys=0.03%, ctx=4468, majf=0, minf=1920
    IO depths : 1=0.4%, 2=0.9%, 4=1.7%, 8=3.4%, 16=6.8%, 32=13.7%, >=64=73.1%
    submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.6%, >=64=0.0%
    issued rwt: total=0,14997,0, short=0,0,0, dropped=0,0,0
    latency : target=0, window=0, percentile=100.00%, depth=64

    Run status group 0 (all jobs):
    WRITE: bw=2946KiB/s (3017kB/s), 2946KiB/s-2946KiB/s (3017kB/s-3017kB/s), io=58.6MiB (61.4MB), run=20363-20363msec

    Disk stats (read/write):
    vda: ios=0/14943, merge=0/524, ticks=0/5045718, in_queue=5364674, util=99.90%
    +++++++++++++++++++++++++++++++++++

    测试二
    ---------------------------------------------------
    [centos ~]$ fio -filename=test/randw10 -iodepth=64 -ioengine=libaio -direct=1 -rw=randwrite -bs=4k -size=10G -numjobs=64 -runtime=30 -group_reporting -name=test-rand-write
    test-rand-write: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
    ...
    fio-3.1
    Starting 64 processes
    test-rand-write: Laying out IO file (1 file / 10240MiB)
    Jobs: 64 (f=64): [w(64)][100.0%][r=0KiB/s,w=2874KiB/s][r=0,w=718 IOPS][eta 00m:00s]
    test-rand-write: (groupid=0, jobs=64): err= 0: pid=5158: Sat Nov 24 09:14:02 2018
    write: IOPS=711, BW=2846KiB/s (2914kB/s)(84.3MiB/30334msec)
    slat (usec): min=4, max=1904.4k, avg=88800.88, stdev=325223.55
    clat (msec): min=32, max=17506, avg=5050.25, stdev=2674.58
    lat (msec): min=32, max=17506, avg=5139.05, stdev=2704.30
    clat percentiles (msec):
    | 1.00th=[ 300], 5.00th=[ 1183], 10.00th=[ 1603], 20.00th=[ 2601],
    | 30.00th=[ 3406], 40.00th=[ 4111], 50.00th=[ 4933], 60.00th=[ 5470],
    | 70.00th=[ 6477], 80.00th=[ 7215], 90.00th=[ 8557], 95.00th=[ 9463],
    | 99.00th=[12147], 99.50th=[12953], 99.90th=[14429], 99.95th=[16308],
    | 99.99th=[17113]
    bw ( KiB/s): min= 7, max= 600, per=3.89%, avg=110.61, stdev=112.30, samples=1271
    iops : min= 1, max= 150, avg=27.55, stdev=27.99, samples=1271
    lat (msec) : 50=0.02%, 100=0.04%, 250=0.69%, 500=1.14%, 750=0.75%
    lat (msec) : 1000=0.94%, 2000=10.03%, >=2000=86.41%
    cpu : usr=0.00%, sys=0.02%, ctx=6972, majf=0, minf=1919
    IO depths : 1=0.3%, 2=0.6%, 4=1.2%, 8=2.4%, 16=4.7%, 32=9.5%, >=64=81.3%
    submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
    complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.4%, >=64=0.0%
    issued rwt: total=0,21580,0, short=0,0,0, dropped=0,0,0
    latency : target=0, window=0, percentile=100.00%, depth=64

    Run status group 0 (all jobs):
    WRITE: bw=2846KiB/s (2914kB/s), 2846KiB/s-2846KiB/s (2914kB/s-2914kB/s), io=84.3MiB (88.4MB), run=30334-30334msec

    Disk stats (read/write):
    vda: ios=0/21421, merge=0/809, ticks=0/7509384, in_queue=8050259, util=100.00%



    腾讯磁盘配置:

    可用区 上海四区
    硬盘类型 高性能云硬盘
    硬盘属性 系统盘
    云硬盘容量 50G
    5 条回复    2018-11-24 20:55:27 +08:00
    Radeon
        1
    Radeon  
       2018-11-24 09:24:29 +08:00
    确实。我昨天试过一次密集写入,IOUtil 到了 100%以后,写入速度竟然只有 6MB/s,我都不敢相信
    kitrap
        2
    kitrap  
    OP
       2018-11-24 09:27:36 +08:00
    @Radeon 阿里和华为的 IOPS 都比较稳定,腾讯的波动也很大。。。
    aliehuhu
        3
    aliehuhu  
       2018-11-24 11:01:56 +08:00
    opengps
        4
    opengps  
       2018-11-24 20:28:48 +08:00
    云服务器硬盘的 iops 一向都很低
    mydns
        5
    mydns  
       2018-11-24 20:55:27 +08:00
    还不如普通盘
    普通盘在压缩打包文件的时候 不影响网站访问;
    高性能云硬盘在压缩打包文件的时候,网站访问明显变慢
    关于   ·   帮助文档   ·   博客   ·   API   ·   FAQ   ·   实用小工具   ·   6131 人在线   最高记录 6679   ·     Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 · 40ms · UTC 02:27 · PVG 10:27 · LAX 18:27 · JFK 21:27
    Developed with CodeLauncher
    ♥ Do have faith in what you're doing.