Skip to content

Sysbench

刘涛 edited this page Feb 17, 2019 · 2 revisions

机器配置

类目 指标
baikaldb部署 配置:CPU E5-2620 v3, 内存128GB, 3*nvme SSD (单盘900GB) 4个Server ,每个Server部署一个baikaldb和3个baikalStore

测试结果

prepare模式

select

脚本oltp_point_select.lua 600s

命令

host='xxx'
port=28282
user='root'
passwd='root'
 
 
tables=32
table_size=1000000
events=0
time=600
threads=1024
requests=1000000
interval=10
 
common_file="oltp_point_select.lua"
storage_engine="rocksdb"
 
../sysbench --auto-inc=off --create_secondary=true --db-ps-mode=auto \
 --mysql-host=$host --mysql-port=$port --mysql-user=$user --mysql-password=$passwd \
 --mysql-storage-engine=$storage_engine --table_size=$table_size --tables=$tables \
 --percentile=95 --skip_trx=on --mysql-ignore-errors=1022 \
 --report-interval=$interval --events=$events --time=$time --threads=$threads --rand-type=uniform $common_file run

测试结果

- table count table size sysbench threads qps latency(avg / .95)平均值/95分位值ms
baikalDB 32 100W 256 92287.54 2.77 / 6.21
baikalDB 32 100W 256*2 93611.98 5.47 / 14.73
baikalDB 32 100W 256*4 94019.54 10.89 /33.72

insert

脚本oltp_insert.lua 600s

命令

host='xxx'
port=28282
user='root'
passwd='root'
 
 
tables=32
table_size=1000000
events=0
time=600
threads=1024
requests=1000000
interval=10
 
common_file="oltp_insert.lua"
storage_engine="rocksdb"
 
../sysbench --auto-inc=off --create_secondary=true --db-ps-mode=auto \
 --mysql-host=$host --mysql-port=$port --mysql-user=$user --mysql-password=$passwd \
 --mysql-storage-engine=$storage_engine --table_size=$table_size --tables=$tables \
 --percentile=95 --skip_trx=on --mysql-ignore-errors=1022 \
 --report-interval=$interval --events=$events --time=$time --threads=$threads --rand-type=uniform $common_file run

测试结果:

- table count table size sysbench threads tps latency(avg / .95)平均值/95分位值ms
baikalDB 32 100W 256 29304.12 8.73 / 17.63
baikalDB 32 100W 256*2 29283.40 17.48 / 29.19
baikalDB 32 100W 256*4 29335.59 34.90 / 55.82

read-write

脚本 oltp_read_write.lua 600s

命令:

host='xxx'
port=28282
user='root'
passwd='root'
 
 
tables=32
table_size=1000000
events=0
time=600
threads=1024
requests=1000000
interval=10
 
common_file="oltp_read_write.lua"
storage_engine="rocksdb"
 
../sysbench --auto-inc=off --create_secondary=true --db-ps-mode=auto \
 --mysql-host=$host --mysql-port=$port --mysql-user=$user --mysql-password=$passwd \
 --mysql-storage-engine=$storage_engine --table_size=$table_size --tables=$tables \
 --percentile=95 --skip_trx=on --mysql-ignore-errors=1022 \
 --report-interval=$interval --events=$events --time=$time --threads=$threads --rand-type=uniform $common_file run

测试结果:

- table count table size sysbench threads tps qps latency(avg / .95)平均值/95分位值ms
baikalDB 32 100W 256 2027.75 36499.51 126.20 / 292.60
baikalDB 32 100W 256*2 1924.62 34643.27 265.88 / 861.95
baikalDB 32 100W 256*4 1791.11 32240.13 570.95 / 2238.47

非prepare模式

select

脚本oltp_point_select.lua 600s

- table count table size sysbench threads qps latency(avg / .95)平均值/95分位值ms
baikalDB 32 100W 256 85730.76 2.99 / 5.99
baikalDB 32 100W 256*2 86437.00 5.92 / 13.95
baikalDB 32 100W 256*4 86437.00 11.80 / 31.94

insert

脚本oltp_insert.lua 600s

- table count table size sysbench threads tps latency(avg / .95)平均值/95分位值ms
baikalDB 32 100W 256 28682.18 8.92 / 17.63
baikalDB 32 100W 256*2 29106.65 17.59 / 29.19
baikalDB 32 100W 256*4 29238.82 35.01 / 56.84

read-write

脚本 oltp_read_write.lua 600s

- table count table size sysbench threads tps qps latency(avg / .95)平均值/95分位值ms
baikalDB 32 100W 256 1841.22 33142.07 139.03 / 350.33
baikalDB 32 100W 256*2 1902.40 34243.46 538.14 / 1453.01
baikalDB 32 100W 256*4 1824.92 32848.73 560.95 / 1648.20

详细结果数据

prepare模式

1.1 select oltp_point_select thds: 256 time=600 tables=32 table_size=1000000

SQL statistics:
    queries performed:
        read:                            55374780
        write:                           0
        other:                           0
        total:                           55374780
    transactions:                        55374780 (92287.54 per sec.)
    queries:                             55374780 (92287.54 per sec.)
    ignored errors:                      0      (0.00 per sec.)
    reconnects:                          0      (0.00 per sec.)
 
Throughput:
    events/s (eps):                      92287.5373
    time elapsed:                        600.0245s
    total number of events:              55374780
 
Latency (ms):
         min:                                    0.44
         avg:                                    2.77
         max:                                  144.99
         95th percentile:                        6.21
         sum:                            153566955.61
 
Threads fairness:
    events (avg/stddev):           216307.7344/12789.87
    execution time (avg/stddev):   599.8709/0.01

1.2 select oltp_point_select thds: 512 time=600 tables=32 table_size=1000000


SQL statistics:
    queries performed:
        read:                            56171920
        write:                           0
        other:                           0
        total:                           56171920
    transactions:                        56171920 (93611.98 per sec.)
    queries:                             56171920 (93611.98 per sec.)
    ignored errors:                      0      (0.00 per sec.)
    reconnects:                          0      (0.00 per sec.)
 
Throughput:
    events/s (eps):                      93611.9827
    time elapsed:                        600.0505s
    total number of events:              56171920
 
Latency (ms):
         min:                                    0.44
         avg:                                    5.47
         max:                                  213.22
         95th percentile:                       14.73
         sum:                            307166580.91
 
Threads fairness:
    events (avg/stddev):           109710.7812/7527.21
    execution time (avg/stddev):   599.9347/0.01

1.3 select oltp_point_select thds: 1024 time=600 tables=32 table_size=1000000

SQL statistics:
    queries performed:
        read:                            56422068
        write:                           0
        other:                           0
        total:                           56422068
    transactions:                        56422068 (94019.54 per sec.)
    queries:                             56422068 (94019.54 per sec.)
    ignored errors:                      0      (0.00 per sec.)
    reconnects:                          0      (0.00 per sec.)
 
Throughput:
    events/s (eps):                      94019.5365
    time elapsed:                        600.1100s
    total number of events:              56422068
 
Latency (ms):
         min:                                    0.43
         avg:                                   10.89
         max:                                  564.06
         95th percentile:                       33.72
         sum:                            614373450.15
 
Threads fairness:
    events (avg/stddev):           55099.6758/2550.44
    execution time (avg/stddev):   599.9741/0.02

2.1 insert oltp_insert thds:256 time=600 tables=32 table_size=1000000

SQL statistics:
    queries performed:
        read:                            0
        write:                           17583341
        other:                           0
        total:                           17583341
    transactions:                        17583341 (29304.12 per sec.)
    queries:                             17583341 (29304.12 per sec.)
    ignored errors:                      0      (0.00 per sec.)
    reconnects:                          0      (0.00 per sec.)
 
Throughput:
    events/s (eps):                      29304.1172
    time elapsed:                        600.0297s
    total number of events:              17583341
 
Latency (ms):
         min:                                    0.73
         avg:                                    8.73
         max:                                  102.21
         95th percentile:                       17.63
         sum:                            153552680.67
 
Threads fairness:
    events (avg/stddev):           68684.9258/4336.37
    execution time (avg/stddev):   599.8152/0.01

2.2 insert oltp_insert thds:512 time=600 tables=32 table_size=1000000

SQL statistics:
    queries performed:
        read:                            0
        write:                           17571672
        other:                           0
        total:                           17571672
    transactions:                        17571672 (29283.40 per sec.)
    queries:                             17571672 (29283.40 per sec.)
    ignored errors:                      0      (0.00 per sec.)
    reconnects:                          0      (0.00 per sec.)
 
Throughput:
    events/s (eps):                      29283.4004
    time elapsed:                        600.0557s
    total number of events:              17571672
 
Latency (ms):
         min:                                    0.84
         avg:                                   17.48
         max:                                   89.78
         95th percentile:                       29.19
         sum:                            307147850.88
 
Threads fairness:
    events (avg/stddev):           34319.6719/2247.79
    execution time (avg/stddev):   599.8981/0.01

2.3 insert oltp_insert thds:1024 time=600 tables=32 table_size=1000000

SQL statistics:
    queries performed:
        read:                            0
        write:                           17604757
        other:                           0
        total:                           17604757
    transactions:                        17604757 (29335.59 per sec.)
    queries:                             17604757 (29335.59 per sec.)
    ignored errors:                      0      (0.00 per sec.)
    reconnects:                          0      (0.00 per sec.)
 
Throughput:
    events/s (eps):                      29335.5950
    time elapsed:                        600.1159s
    total number of events:              17604757
 
Latency (ms):
         min:                                    0.87
         avg:                                   34.90
         max:                                  140.31
         95th percentile:                       55.82
         sum:                            614346928.98
 
Threads fairness:
    events (avg/stddev):           17192.1455/673.12
    execution time (avg/stddev):   599.9482/0.01

3.1 read-write oltp_read_write thds: 256 time=600 tables=32 table_size=1000000

SQL statistics:
    queries performed:
        read:                            17040492
        write:                           4868703
        other:                           7
        total:                           21909202
    transactions:                        1217176 (2027.75 per sec.)
    queries:                             21909202 (36499.51 per sec.)
    ignored errors:                      2      (0.00 per sec.)
    reconnects:                          0      (0.00 per sec.)
 
Throughput:
    events/s (eps):                      2027.7473
    time elapsed:                        600.2602s
    total number of events:              1217176
 
Latency (ms):
         min:                                   21.21
         avg:                                  126.20
         max:                                 1427.28
         95th percentile:                      292.60
         sum:                            153613458.99
 
Threads fairness:
    events (avg/stddev):           4754.5938/108.29
    execution time (avg/stddev):   600.0526/0.06

3.2 read-write oltp_read_write thds:512 time=600 tables=32 table_size=1000000

SQL statistics:
    queries performed:
        read:                            16180318
        write:                           4622929
        other:                           13
        total:                           20803260
    transactions:                        1155731 (1924.62 per sec.)
    queries:                             20803260 (34643.27 per sec.)
    ignored errors:                      6      (0.01 per sec.)
    reconnects:                          0      (0.00 per sec.)
 
Throughput:
    events/s (eps):                      1924.6167
    time elapsed:                        600.4993s
    total number of events:              1155731
 
Latency (ms):
         min:                                   22.05
         avg:                                  265.88
         max:                                 3729.90
         95th percentile:                      861.95
         sum:                            307283237.51
 
Threads fairness:
    events (avg/stddev):           2257.2871/57.28
    execution time (avg/stddev):   600.1626/0.13

3.3 read-write oltp_read_write thds:1024time=600 tables=32 table_size=1000000

SQL statistics:
    queries performed:
        read:                            15074136
        write:                           4306875
        other:                           17
        total:                           19381028
    transactions:                        1076720 (1791.11 per sec.)
    queries:                             19381028 (32240.13 per sec.)
    ignored errors:                      4      (0.01 per sec.)
    reconnects:                          0      (0.00 per sec.)
 
Throughput:
    events/s (eps):                      1791.1120
    time elapsed:                        601.1461s
    total number of events:              1076720
 
Latency (ms):
         min:                                   21.50
         avg:                                  570.95
         max:                                 9863.90
         95th percentile:                     2238.47
         sum:                            614754173.38
 
Threads fairness:
    events (avg/stddev):           1051.4844/47.58
    execution time (avg/stddev):   600.3459/0.25

no-prepare模式

1.1 select oltp_point_select thds: 256 time=600 tables=32 table_size=1000000

SQL statistics:
    queries performed:
        read:                            51440449
        write:                           0
        other:                           0
        total:                           51440449
    transactions:                        51440449 (85730.76 per sec.)
    queries:                             51440449 (85730.76 per sec.)
    ignored errors:                      0      (0.00 per sec.)
    reconnects:                          0      (0.00 per sec.)
 
Throughput:
    events/s (eps):                      85730.7580
    time elapsed:                        600.0233s
    total number of events:              51440449
 
Latency (ms):
         min:                                    0.51
         avg:                                    2.99
         max:                                  166.02
         95th percentile:                        5.99
         sum:                            153569802.77
 
Threads fairness:
    events (avg/stddev):           200939.2539/8411.00
    execution time (avg/stddev):   599.8820/0.01

1.2 select oltp_point_select thds: 512 time=600 tables=32 table_size=1000000

SQL statistics:
    queries performed:
        read:                            51866169
        write:                           0
        other:                           0
        total:                           51866169
    transactions:                        51866169 (86437.00 per sec.)
    queries:                             51866169 (86437.00 per sec.)
    ignored errors:                      0      (0.00 per sec.)
    reconnects:                          0      (0.00 per sec.)
 
Throughput:
    events/s (eps):                      86436.9951
    time elapsed:                        600.0460s
    total number of events:              51866169
 
Latency (ms):
         min:                                    0.51
         avg:                                    5.92
         max:                                  179.53
         95th percentile:                       13.95
         sum:                            307169948.13
 
Threads fairness:
    events (avg/stddev):           101301.1113/7386.08
    execution time (avg/stddev):   599.9413/0.01

1.3 select oltp_point_select thds: 1024 time=600 tables=32 table_size=1000000

SQL statistics:
    queries performed:
        read:                            52078781
        write:                           0
        other:                           0
        total:                           52078781
    transactions:                        52078781 (86783.20 per sec.)
    queries:                             52078781 (86783.20 per sec.)
    ignored errors:                      0      (0.00 per sec.)
    reconnects:                          0      (0.00 per sec.)
 
Throughput:
    events/s (eps):                      86783.2050
    time elapsed:                        600.1021s
    total number of events:              52078781
 
Latency (ms):
         min:                                    0.51
         avg:                                   11.80
         max:                                  790.69
         95th percentile:                       31.94
         sum:                            614389064.22
 
Threads fairness:
    events (avg/stddev):           50858.1846/2577.80
    execution time (avg/stddev):   599.9893/0.02

2.1 insert oltp_insert thds:256 time=600 tables=32 table_size=1000000

SQL statistics:
    queries performed:
        read:                            0
        write:                           17210114
        other:                           0
        total:                           17210114
    transactions:                        17210114 (28682.18 per sec.)
    queries:                             17210114 (28682.18 per sec.)
    ignored errors:                      0      (0.00 per sec.)
    reconnects:                          0      (0.00 per sec.)
 
Throughput:
    events/s (eps):                      28682.1838
    time elapsed:                        600.0280s
    total number of events:              17210114
 
Latency (ms):
         min:                                    0.79
         avg:                                    8.92
         max:                                  137.39
         95th percentile:                       17.63
         sum:                            153552754.03
 
Threads fairness:
    events (avg/stddev):           67227.0078/3468.70
    execution time (avg/stddev):   599.8154/0.01

2.2 insert oltp_insert thds:512 time=600 tables=32 table_size=1000000

SQL statistics:
    queries performed:
        read:                            0
        write:                           17465665
        other:                           0
        total:                           17465665
    transactions:                        17465665 (29106.65 per sec.)
    queries:                             17465665 (29106.65 per sec.)
    ignored errors:                      0      (0.00 per sec.)
    reconnects:                          0      (0.00 per sec.)
 
Throughput:
    events/s (eps):                      29106.6478
    time elapsed:                        600.0576s
    total number of events:              17465665
 
Latency (ms):
         min:                                    0.82
         avg:                                   17.59
         max:                                  108.11
         95th percentile:                       29.19
         sum:                            307147220.50
 
Threads fairness:
    events (avg/stddev):           34112.6270/1666.32
    execution time (avg/stddev):   599.8969/0.01

2.3 insert oltp_insert thds:1024 time=600 tables=32 table_size=1000000

SQL statistics:
    queries performed:
        read:                            0
        write:                           17546861
        other:                           0
        total:                           17546861
    transactions:                        17546861 (29238.82 per sec.)
    queries:                             17546861 (29238.82 per sec.)
    ignored errors:                      0      (0.00 per sec.)
    reconnects:                          0      (0.00 per sec.)
 
Throughput:
    events/s (eps):                      29238.8174
    time elapsed:                        600.1221s
    total number of events:              17546861
 
Latency (ms):
         min:                                    0.90
         avg:                                   35.01
         max:                                  155.99
         95th percentile:                       56.84
         sum:                            614346509.38
 
Threads fairness:
    events (avg/stddev):           17135.6064/1193.91
    execution time (avg/stddev):   599.9478/0.01

3.1 read-write oltp_read_write thds: 256 time=600 tables=32 table_size=1000000

SQL statistics:
    queries performed:
        read:                            15468110
        write:                           4419452
        other:                           5
        total:                           19887567
    transactions:                        1104862 (1841.22 per sec.)
    queries:                             19887567 (33142.07 per sec.)
    ignored errors:                      3      (0.00 per sec.)
    reconnects:                          0      (0.00 per sec.)
 
Throughput:
    events/s (eps):                      1841.2216
    time elapsed:                        600.0701s
    total number of events:              1104862
 
Latency (ms):
         min:                                   21.95
         avg:                                  139.03
         max:                                 1601.86
         95th percentile:                      350.33
         sum:                            153606034.02
 
Threads fairness:
    events (avg/stddev):           4315.8672/129.68
    execution time (avg/stddev):   600.0236/0.02

3.2 read-write oltp_read_write thds: 512 time=600 tables=32 table_size=1000000

SQL statistics:
    queries performed:
        read:                            15988742
        write:                           4568181
        other:                           23
        total:                           20556946
    transactions:                        1142045 (1902.40 per sec.)
    queries:                             20556946 (34243.46 per sec.)
    ignored errors:                      8      (0.01 per sec.)
    reconnects:                          0      (0.00 per sec.)
 
Throughput:
    events/s (eps):                      1902.4017
    time elapsed:                        600.3175s
    total number of events:              1142045
 
Latency (ms):
         min:                                   24.68
         avg:                                  538.14
         max:                                 7018.82
         95th percentile:                     1453.01
         sum:                            614575886.48
 
Threads fairness:
    events (avg/stddev):           1115.2783/37.98
    execution time (avg/stddev):   600.1718/0.07

3.3 read-write oltp_read_write thds: 1024 time=600 tables=32 table_size=1000000

SQL statistics:
    queries performed:
        read:                            15337448
        write:                           4382107
        other:                           16
        total:                           19719571
    transactions:                        1095527 (1824.92 per sec.)
    queries:                             19719571 (32848.73 per sec.)
    ignored errors:                      5      (0.01 per sec.)
    reconnects:                          0      (0.00 per sec.)
 
Throughput:
    events/s (eps):                      1824.9218
    time elapsed:                        600.3145s
    total number of events:              1095527
 
Latency (ms):
         min:                                   23.44
         avg:                                  560.95
         max:                                 8093.74
         95th percentile:                     1648.20
         sum:                            614535912.27
 
Threads fairness:
    events (avg/stddev):           1069.8506/39.14
    execution time (avg/stddev):   600.1327/0.08
Clone this wiki locally