AnsweredAssumed Answered

Cluster Performance question

Question asked by hastings on Nov 17, 2014
Latest reply on Nov 21, 2014 by nabeel
My cluster is pegged, what do I need more of?
I'm looking at my disks, and I notice a couple things:
One of the storage pools isn't getting much utilization. (4 pools of 3 disks)
throughput is pretty low relative to max tested (150MB/s per disk).
iowait is low in top, CPU is pegged.

Network < 20MBps

    Cpu(s):  3.0%us,  3.3%sy, 84.3%ni,  7.7%id,  1.2%wa,  0.0%hi,  0.4%si,  0.0%st
    Mem:  132110776k total, 109836188k used, 22274588k free,    67700k buffers
    Swap: 134348792k total,  1364708k used, 132984084k free,  1369152k cached

    Device:         rrqm/s   wrqm/s     r/s     w/s    rkB/s    wkB/s avgrq-sz avgqu-sz   await  svctm  %util
    sdb               0.00     0.33   73.67   34.67  1616.00  1298.67    53.81     2.60   24.42   8.22  89.07
    sdd               0.00     0.00   81.33    1.33  1621.33   682.67    55.74     3.44   41.65  11.53  95.30
    sdg               0.00     0.00   50.33   26.67  4130.67   549.33   121.56     0.89   11.53   6.34  48.83
    sdc               0.33     0.00   71.67   40.33  1808.00  1768.00    63.86     2.54   22.78   8.07  90.40
    sdf               0.00     0.00   51.67   43.33  3981.33  1024.00   105.38     0.85    8.79   4.74  45.00
    sdi               0.00     0.00    9.33   13.33   445.33   946.67   122.82     0.03    1.46   1.21   2.73
    sdh               0.00     0.00   14.00    1.33   528.00   682.67   157.91     0.03    1.83   1.67   2.57
    sdj               0.00     0.00    6.67   14.67   464.00   834.67   121.75     0.05    2.14   1.56   3.33
    sdk               0.00     0.00   41.00   37.33  3013.33   970.67   101.72     0.37    4.74   3.71  29.03
    sdl               0.00     0.00   60.67   44.00  4333.33  1365.33   108.89     0.93    8.91   5.64  59.07
    sde               0.00     0.00   46.33   25.00  4250.67   680.00   138.24     0.72   10.08   5.05  36.03
    sdm               0.00     0.00   39.33   24.67  3397.33   869.33   133.33     0.44    6.84   5.04  32.27



Outcomes