START TESTS IO = cached WC = wt PC = on
Sequential Reads
File Blk Num Avg Maximum Lat% Lat% CPU
Identifier Size Size Thr Rate (CPU%) Latency Latency >2s >10s Eff
---------------------------- ------ ----- --- ------ ------ --------- ----------- -------- -------- -----
cached-wt-on 4000 4096 1 462.85 13.51% 0.025 122.28 0.00000 0.00000 3424
cached-wt-on 4000 4096 2 609.24 18.90% 0.038 182.24 0.00000 0.00000 3222
cached-wt-on 4000 4096 4 582.31 77.16% 0.077 440.85 0.00000 0.00000 755
cached-wt-on 4000 4096 8 601.47 176.7% 0.149 880.28 0.00000 0.00000 340
Random Reads
File Blk Num Avg Maximum Lat% Lat% CPU
Identifier Size Size Thr Rate (CPU%) Latency Latency >2s >10s Eff
---------------------------- ------ ----- --- ------ ------ --------- ----------- -------- -------- -----
cached-wt-on 4000 4096 1 0.80 0.539% 14.649 127.61 0.00000 0.00000 148
cached-wt-on 4000 4096 2 1.56 4.215% 14.876 98.72 0.00000 0.00000 37
cached-wt-on 4000 4096 4 2.75 11.68% 15.010 114.78 0.00000 0.00000 24
cached-wt-on 4000 4096 8 4.78 38.97% 17.886 172.75 0.00000 0.00000 12
Sequential Writes
File Blk Num Avg Maximum Lat% Lat% CPU
Identifier Size Size Thr Rate (CPU%) Latency Latency >2s >10s Eff
---------------------------- ------ ----- --- ------ ------ --------- ----------- -------- -------- -----
cached-wt-on 4000 4096 1 448.06 55.54% 0.026 286.06 0.00000 0.00000 807
cached-wt-on 4000 4096 2 294.28 95.77% 0.078 639.71 0.00000 0.00000 307
cached-wt-on 4000 4096 4 229.24 166.0% 0.199 1005.29 0.00000 0.00000 138
cached-wt-on 4000 4096 8 209.42 310.5% 0.436 1184.45 0.00000 0.00000 67
Random Writes
File Blk Num Avg Maximum Lat% Lat% CPU
Identifier Size Size Thr Rate (CPU%) Latency Latency >2s >10s Eff
---------------------------- ------ ----- --- ------ ------ --------- ----------- -------- -------- -----
cached-wt-on 4000 4096 1 5.61 0% 0.009 0.06 0.00000 0.00000 0
cached-wt-on 4000 4096 2 5.37 0% 0.009 0.06 0.00000 0.00000 0
cached-wt-on 4000 4096 4 5.13 0.831% 0.010 0.07 0.00000 0.00000 617
cached-wt-on 4000 4096 8 5.20 17.73% 0.017 0.10 0.00000 0.00000 29
START TESTS IO = cached WC = wt PC =
Sequential Reads
File Blk Num Avg Maximum Lat% Lat% CPU
Identifier Size Size Thr Rate (CPU%) Latency Latency >2s >10s Eff
---------------------------- ------ ----- --- ------ ------ --------- ----------- -------- -------- -----
cached-wt-off 4000 4096 1 475.14 16.39% 0.025 53.90 0.00000 0.00000 2898
cached-wt-off 4000 4096 2 592.56 30.55% 0.039 217.23 0.00000 0.00000 1939
cached-wt-off 4000 4096 4 574.67 84.23% 0.078 404.92 0.00000 0.00000 682
cached-wt-off 4000 4096 8 599.66 179.3% 0.150 927.41 0.00000 0.00000 334
Random Reads
File Blk Num Avg Maximum Lat% Lat% CPU
Identifier Size Size Thr Rate (CPU%) Latency Latency >2s >10s Eff
---------------------------- ------ ----- --- ------ ------ --------- ----------- -------- -------- -----
cached-wt-off 4000 4096 1 0.80 0.964% 14.614 108.20 0.00000 0.00000 83
cached-wt-off 4000 4096 2 1.53 4.133% 14.851 120.26 0.00000 0.00000 37
cached-wt-off 4000 4096 4 2.83 12.06% 14.839 94.00 0.00000 0.00000 23
cached-wt-off 4000 4096 8 4.78 37.66% 17.597 133.40 0.00000 0.00000 13
Sequential Writes
File Blk Num Avg Maximum Lat% Lat% CPU
Identifier Size Size Thr Rate (CPU%) Latency Latency >2s >10s Eff
---------------------------- ------ ----- --- ------ ------ --------- ----------- -------- -------- -----
cached-wt-off 4000 4096 1 405.33 54.45% 0.028 255.12 0.00000 0.00000 744
cached-wt-off 4000 4096 2 243.62 83.19% 0.094 964.72 0.00000 0.00000 293
cached-wt-off 4000 4096 4 182.77 118.7% 0.250 1421.38 0.00000 0.00000 154
cached-wt-off 4000 4096 8 156.26 212.6% 0.585 1716.30 0.00000 0.00000 73
Random Writes
File Blk Num Avg Maximum Lat% Lat% CPU
Identifier Size Size Thr Rate (CPU%) Latency Latency >2s >10s Eff
---------------------------- ------ ----- --- ------ ------ --------- ----------- -------- -------- -----
cached-wt-off 4000 4096 1 5.84 0% 0.010 0.06 0.00000 0.00000 0
cached-wt-off 4000 4096 2 5.61 0% 0.009 0.06 0.00000 0.00000 0
cached-wt-off 4000 4096 4 5.68 0.774% 0.010 0.07 0.00000 0.00000 732
cached-wt-off 4000 4096 8 5.74 24.38% 0.015 0.08 0.00000 0.00000 24
START TESTS IO = cached WC = awb PC = on
Sequential Reads
File Blk Num Avg Maximum Lat% Lat% CPU
Identifier Size Size Thr Rate (CPU%) Latency Latency >2s >10s Eff
---------------------------- ------ ----- --- ------ ------ --------- ----------- -------- -------- -----
cached-awb-on 4000 4096 1 418.05 15.62% 0.028 648.42 0.00000 0.00000 2676
cached-awb-on 4000 4096 2 467.11 15.63% 0.049 798.03 0.00000 0.00000 2988
cached-awb-on 4000 4096 4 475.21 47.65% 0.092 1026.38 0.00000 0.00000 997
cached-awb-on 4000 4096 8 465.94 65.01% 0.184 1639.50 0.00000 0.00000 717
Random Reads
File Blk Num Avg Maximum Lat% Lat% CPU
Identifier Size Size Thr Rate (CPU%) Latency Latency >2s >10s Eff
---------------------------- ------ ----- --- ------ ------ --------- ----------- -------- -------- -----
cached-awb-on 4000 4096 1 0.84 0.810% 13.934 115.33 0.00000 0.00000 104
cached-awb-on 4000 4096 2 1.58 4.261% 14.398 116.67 0.00000 0.00000 37
cached-awb-on 4000 4096 4 2.93 12.62% 14.281 110.91 0.00000 0.00000 23
cached-awb-on 4000 4096 8 4.68 31.20% 17.261 253.25 0.00000 0.00000 15
Sequential Writes
File Blk Num Avg Maximum Lat% Lat% CPU
Identifier Size Size Thr Rate (CPU%) Latency Latency >2s >10s Eff
---------------------------- ------ ----- --- ------ ------ --------- ----------- -------- -------- -----
cached-awb-on 4000 4096 1 498.96 61.54% 0.023 545.80 0.00000 0.00000 811
cached-awb-on 4000 4096 2 497.93 155.0% 0.046 600.66 0.00000 0.00000 321
cached-awb-on 4000 4096 4 484.76 339.7% 0.094 625.07 0.00000 0.00000 143
cached-awb-on 4000 4096 8 482.63 971.8% 0.185 512.20 0.00000 0.00000 50
Random Writes
File Blk Num Avg Maximum Lat% Lat% CPU
Identifier Size Size Thr Rate (CPU%) Latency Latency >2s >10s Eff
---------------------------- ------ ----- --- ------ ------ --------- ----------- -------- -------- -----
cached-awb-on 4000 4096 1 11.13 0.189% 0.009 0.05 0.00000 0.00000 5859
cached-awb-on 4000 4096 2 10.71 0% 0.009 0.06 0.00000 0.00000 0
cached-awb-on 4000 4096 4 10.66 1.092% 0.010 0.08 0.00000 0.00000 977
cached-awb-on 4000 4096 8 10.21 11.76% 0.017 0.09 0.00000 0.00000 87
START TESTS IO = cached WC = awb PC = off
Sequential Reads
File Blk Num Avg Maximum Lat% Lat% CPU
Identifier Size Size Thr Rate (CPU%) Latency Latency >2s >10s Eff
---------------------------- ------ ----- --- ------ ------ --------- ----------- -------- -------- -----
cached-awb-off 4000 4096 1 412.57 14.48% 0.028 784.63 0.00000 0.00000 2849
cached-awb-off 4000 4096 2 518.59 19.50% 0.045 695.77 0.00000 0.00000 2659
cached-awb-off 4000 4096 4 520.66 47.19% 0.083 1043.65 0.00000 0.00000 1103
cached-awb-off 4000 4096 8 519.11 85.76% 0.166 1363.41 0.00000 0.00000 605
Random Reads
File Blk Num Avg Maximum Lat% Lat% CPU
Identifier Size Size Thr Rate (CPU%) Latency Latency >2s >10s Eff
---------------------------- ------ ----- --- ------ ------ --------- ----------- -------- -------- -----
cached-awb-off 4000 4096 1 0.82 0.674% 14.227 158.82 0.00000 0.00000 122
cached-awb-off 4000 4096 2 1.55 4.241% 14.736 157.93 0.00000 0.00000 37
cached-awb-off 4000 4096 4 2.95 12.04% 14.513 120.55 0.00000 0.00000 25
cached-awb-off 4000 4096 8 4.94 31.88% 17.059 137.71 0.00000 0.00000 16
Sequential Writes
File Blk Num Avg Maximum Lat% Lat% CPU
Identifier Size Size Thr Rate (CPU%) Latency Latency >2s >10s Eff
---------------------------- ------ ----- --- ------ ------ --------- ----------- -------- -------- -----
cached-awb-off 4000 4096 1 488.89 61.01% 0.023 456.56 0.00000 0.00000 801
cached-awb-off 4000 4096 2 491.26 149.0% 0.046 512.93 0.00000 0.00000 330
cached-awb-off 4000 4096 4 485.30 328.9% 0.094 529.83 0.00000 0.00000 148
cached-awb-off 4000 4096 8 455.13 925.3% 0.197 562.44 0.00000 0.00000 49
Random Writes
File Blk Num Avg Maximum Lat% Lat% CPU
Identifier Size Size Thr Rate (CPU%) Latency Latency >2s >10s Eff
---------------------------- ------ ----- --- ------ ------ --------- ----------- -------- -------- -----
cached-awb-off 4000 4096 1 9.74 0.083% 0.009 0.05 0.00000 0.00000 11719
cached-awb-off 4000 4096 2 8.70 0% 0.009 0.07 0.00000 0.00000 0
cached-awb-off 4000 4096 4 9.30 3.175% 0.010 0.09 0.00000 0.00000 293
cached-awb-off 4000 4096 8 8.25 9.569% 0.016 0.10 0.00000 0.00000 86
START TESTS IO = direct WC = wt PC = on
Sequential Reads
File Blk Num Avg Maximum Lat% Lat% CPU
Identifier Size Size Thr Rate (CPU%) Latency Latency >2s >10s Eff
---------------------------- ------ ----- --- ------ ------ --------- ----------- -------- -------- -----
direct-wt-on 4000 4096 1 470.31 13.90% 0.025 122.05 0.00000 0.00000 3382
direct-wt-on 4000 4096 2 608.38 20.54% 0.038 230.56 0.00000 0.00000 2961
direct-wt-on 4000 4096 4 593.23 79.81% 0.073 322.20 0.00000 0.00000 743
direct-wt-on 4000 4096 8 602.60 171.7% 0.146 984.91 0.00000 0.00000 351
Random Reads
File Blk Num Avg Maximum Lat% Lat% CPU
Identifier Size Size Thr Rate (CPU%) Latency Latency >2s >10s Eff
---------------------------- ------ ----- --- ------ ------ --------- ----------- -------- -------- -----
direct-wt-on 4000 4096 1 0.79 0.695% 14.800 127.98 0.00000 0.00000 114
direct-wt-on 4000 4096 2 1.41 3.943% 16.363 126.50 0.00000 0.00000 36
direct-wt-on 4000 4096 4 2.72 11.50% 15.148 215.17 0.00000 0.00000 24
direct-wt-on 4000 4096 8 4.62 38.64% 18.004 153.71 0.00000 0.00000 12
Sequential Writes
File Blk Num Avg Maximum Lat% Lat% CPU
Identifier Size Size Thr Rate (CPU%) Latency Latency >2s >10s Eff
---------------------------- ------ ----- --- ------ ------ --------- ----------- -------- -------- -----
direct-wt-on 4000 4096 1 458.64 57.13% 0.025 230.74 0.00000 0.00000 803
direct-wt-on 4000 4096 2 290.16 94.70% 0.079 824.62 0.00000 0.00000 306
direct-wt-on 4000 4096 4 229.99 148.4% 0.199 923.75 0.00000 0.00000 155
direct-wt-on 4000 4096 8 208.63 313.7% 0.433 1068.90 0.00000 0.00000 66
Random Writes
File Blk Num Avg Maximum Lat% Lat% CPU
Identifier Size Size Thr Rate (CPU%) Latency Latency >2s >10s Eff
---------------------------- ------ ----- --- ------ ------ --------- ----------- -------- -------- -----
direct-wt-on 4000 4096 1 5.28 0.090% 0.009 0.06 0.00000 0.00000 5859
direct-wt-on 4000 4096 2 6.08 0.103% 0.009 0.05 0.00000 0.00000 5859
direct-wt-on 4000 4096 4 6.40 3.657% 0.010 0.08 0.00000 0.00000 175
direct-wt-on 4000 4096 8 6.17 8.685% 0.017 0.15 0.00000 0.00000 71
START TESTS IO = direct WC = wt PC = off
Sequential Reads
File Blk Num Avg Maximum Lat% Lat% CPU
Identifier Size Size Thr Rate (CPU%) Latency Latency >2s >10s Eff
---------------------------- ------ ----- --- ------ ------ --------- ----------- -------- -------- -----
direct-wt-off 4000 4096 1 467.03 17.57% 0.025 132.30 0.00000 0.00000 2657
direct-wt-off 4000 4096 2 611.99 34.98% 0.038 211.65 0.00000 0.00000 1749
direct-wt-off 4000 4096 4 589.11 85.15% 0.075 356.54 0.00000 0.00000 692
direct-wt-off 4000 4096 8 597.58 180.5% 0.147 892.34 0.00000 0.00000 331
Random Reads
File Blk Num Avg Maximum Lat% Lat% CPU
Identifier Size Size Thr Rate (CPU%) Latency Latency >2s >10s Eff
---------------------------- ------ ----- --- ------ ------ --------- ----------- -------- -------- -----
direct-wt-off 4000 4096 1 0.79 0.862% 14.831 100.28 0.00000 0.00000 92
direct-wt-off 4000 4096 2 1.51 4.213% 15.191 115.55 0.00000 0.00000 36
direct-wt-off 4000 4096 4 2.72 11.66% 15.295 106.87 0.00000 0.00000 23
direct-wt-off 4000 4096 8 4.55 37.06% 18.315 142.48 0.00000 0.00000 12
Sequential Writes
File Blk Num Avg Maximum Lat% Lat% CPU
Identifier Size Size Thr Rate (CPU%) Latency Latency >2s >10s Eff
---------------------------- ------ ----- --- ------ ------ --------- ----------- -------- -------- -----
direct-wt-off 4000 4096 1 397.09 52.86% 0.029 239.47 0.00000 0.00000 751
direct-wt-off 4000 4096 2 240.42 81.34% 0.095 1297.71 0.00000 0.00000 296
direct-wt-off 4000 4096 4 181.09 126.6% 0.249 1506.76 0.00000 0.00000 143
direct-wt-off 4000 4096 8 157.02 205.9% 0.584 1870.55 0.00000 0.00000 76
Random Writes
File Blk Num Avg Maximum Lat% Lat% CPU
Identifier Size Size Thr Rate (CPU%) Latency Latency >2s >10s Eff
---------------------------- ------ ----- --- ------ ------ --------- ----------- -------- -------- -----
direct-wt-off 4000 4096 1 5.95 0.050% 0.010 0.06 0.00000 0.00000 11719
direct-wt-off 4000 4096 2 6.00 0% 0.009 0.05 0.00000 0.00000 0
direct-wt-off 4000 4096 4 5.79 1.582% 0.010 0.06 0.00000 0.00000 366
direct-wt-off 4000 4096 8 5.94 32.05% 0.017 0.07 0.00000 0.00000 19
START TESTS IO = direct WC = awb PC = on
Sequential Reads
File Blk Num Avg Maximum Lat% Lat% CPU
Identifier Size Size Thr Rate (CPU%) Latency Latency >2s >10s Eff
---------------------------- ------ ----- --- ------ ------ --------- ----------- -------- -------- -----
direct-awb-on 4000 4096 1 409.87 16.53% 0.028 628.68 0.00000 0.00000 2479
direct-awb-on 4000 4096 2 479.43 17.85% 0.048 546.33 0.00000 0.00000 2686
direct-awb-on 4000 4096 4 469.68 48.44% 0.094 1023.92 0.00000 0.00000 970
direct-awb-on 4000 4096 8 470.86 52.61% 0.185 1559.41 0.00000 0.00000 895
Random Reads
File Blk Num Avg Maximum Lat% Lat% CPU
Identifier Size Size Thr Rate (CPU%) Latency Latency >2s >10s Eff
---------------------------- ------ ----- --- ------ ------ --------- ----------- -------- -------- -----
direct-awb-on 4000 4096 1 0.81 0.773% 14.482 143.94 0.00000 0.00000 105
direct-awb-on 4000 4096 2 1.60 4.115% 14.414 96.66 0.00000 0.00000 39
direct-awb-on 4000 4096 4 2.95 13.23% 14.302 90.20 0.00000 0.00000 22
direct-awb-on 4000 4096 8 4.91 26.20% 17.121 146.82 0.00000 0.00000 19
Sequential Writes
File Blk Num Avg Maximum Lat% Lat% CPU
Identifier Size Size Thr Rate (CPU%) Latency Latency >2s >10s Eff
---------------------------- ------ ----- --- ------ ------ --------- ----------- -------- -------- -----
direct-awb-on 4000 4096 1 496.21 61.84% 0.023 51.54 0.00000 0.00000 802
direct-awb-on 4000 4096 2 500.74 151.4% 0.046 346.99 0.00000 0.00000 331
direct-awb-on 4000 4096 4 493.30 326.0% 0.092 367.83 0.00000 0.00000 151
direct-awb-on 4000 4096 8 482.48 972.3% 0.185 394.22 0.00000 0.00000 50
Random Writes
File Blk Num Avg Maximum Lat% Lat% CPU
Identifier Size Size Thr Rate (CPU%) Latency Latency >2s >10s Eff
---------------------------- ------ ----- --- ------ ------ --------- ----------- -------- -------- -----
direct-awb-on 4000 4096 1 12.62 0.107% 0.009 0.07 0.00000 0.00000 11719
direct-awb-on 4000 4096 2 12.54 0.213% 0.009 0.06 0.00000 0.00000 5859
direct-awb-on 4000 4096 4 11.28 3.466% 0.010 0.07 0.00000 0.00000 325
direct-awb-on 4000 4096 8 9.51 4.543% 0.017 0.09 0.00000 0.00000 209
START TESTS IO = direct WC = awb PC = off
Sequential Reads
File Blk Num Avg Maximum Lat% Lat% CPU
Identifier Size Size Thr Rate (CPU%) Latency Latency >2s >10s Eff
---------------------------- ------ ----- --- ------ ------ --------- ----------- -------- -------- -----
direct-awb-off 4000 4096 1 419.91 14.83% 0.028 836.43 0.00000 0.00000 2830
direct-awb-off 4000 4096 2 508.28 20.26% 0.045 741.52 0.00000 0.00000 2508
direct-awb-off 4000 4096 4 515.65 57.17% 0.087 1018.63 0.00000 0.00000 902
direct-awb-off 4000 4096 8 519.17 90.11% 0.168 1168.69 0.00000 0.00000 576
Random Reads
File Blk Num Avg Maximum Lat% Lat% CPU
Identifier Size Size Thr Rate (CPU%) Latency Latency >2s >10s Eff
---------------------------- ------ ----- --- ------ ------ --------- ----------- -------- -------- -----
direct-awb-off 4000 4096 1 0.83 0.620% 14.187 122.07 0.00000 0.00000 133
direct-awb-off 4000 4096 2 1.57 3.062% 14.386 145.25 0.00000 0.00000 51
direct-awb-off 4000 4096 4 2.93 12.51% 14.586 132.94 0.00000 0.00000 23
direct-awb-off 4000 4096 8 4.81 31.41% 17.062 138.90 0.00000 0.00000 15
Sequential Writes
File Blk Num Avg Maximum Lat% Lat% CPU
Identifier Size Size Thr Rate (CPU%) Latency Latency >2s >10s Eff
---------------------------- ------ ----- --- ------ ------ --------- ----------- -------- -------- -----
direct-awb-off 4000 4096 1 489.41 64.14% 0.023 98.94 0.00000 0.00000 763
direct-awb-off 4000 4096 2 475.58 145.4% 0.048 173.13 0.00000 0.00000 327
direct-awb-off 4000 4096 4 463.76 301.8% 0.098 239.71 0.00000 0.00000 154
direct-awb-off 4000 4096 8 440.92 875.4% 0.205 537.00 0.00000 0.00000 50
Random Writes
File Blk Num Avg Maximum Lat% Lat% CPU
Identifier Size Size Thr Rate (CPU%) Latency Latency >2s >10s Eff
---------------------------- ------ ----- --- ------ ------ --------- ----------- -------- -------- -----
direct-awb-off 4000 4096 1 9.07 0% 0.010 0.07 0.00000 0.00000 0
direct-awb-off 4000 4096 2 9.85 0.168% 0.009 0.06 0.00000 0.00000 5859
direct-awb-off 4000 4096 4 9.51 3.894% 0.010 0.09 0.00000 0.00000 244
direct-awb-off 4000 4096 8 8.65 6.868% 0.018 0.11 0.00000 0.00000 126
Skripts
#!/bin/bash
storcli=/opt/MegaRAID/storcli/storcli64
$storcli /c0/vall set iopolicy=cached
$storcli /c0/vall set wrcache=awb
$storcli /c0/vall set pdcache=on
LOGFILE=/root/tio.md.txt
for iopolicy in cached direct
do
$storcli /c0/vall set iopolicy=$iopolicy
IO=$iopolicy
echo = IO=$IO
for wrcache in wt awb
do
$storcli /c0/vall set wrcache=$wrcache
WC=$wrcache
echo == WC=$WC
for pdcache in on off
do
$storcli /c0/vall set pdcache=$pdcache
PC=$pdcache
echo === PC=$PC
echo
IDENT=$IO-$WC-$PC
$storcli /c0/vall show | grep RAID | tee -a $LOGFILE
echo ==== START TESTS IO = $IO WC = $WC PC = $PC ===== `date +%T` ==== | tee -a $LOGFILE
sleep 3
tiobench --size 4000 --ident $IDENT --dir=/mnt/test/ --numruns 3 | tee -a $LOGFILE
done
done
done
