Klustron 1.3 Performance Test Report
Klustron 1.3 Performance Test Report
Version: v1.3.1
Cluster Topology and Configuration:
Cluster Topology | Compute Node | Storage Node | Management Node | haproxy | sysbench | benchmarksql |
---|---|---|---|---|---|---|
192.168.0.20 | √ | √ | √ | |||
192.168.0.21 | √ | √ | √ | |||
192.168.0.22 | √ | √ | √ | √ | √ | √ |
Cluster Description: Compute Nodes: Three machines, each deploying a compute node. Storage Nodes: Three shards, each shard with a single primary; the single primaries of the three shards are distributed across these three machines. Management Nodes: The cluster management consists of three machines, forming three nodes, with one primary and two backups.
Machine Configuration: CentOS 8.5 32c 128g 1.9T NVMe SSD 10GbE network card.
Load Balancing: haproxy 2.5.0
sysbench:1.0.20
benchmarksql:5.0
Pre-load Test Preparation:
Create a cluster with 3 shards and 3 compute nodes.
Modifications to compute node system variables before load testing:
alter system set statement_timeout=6000000;
alter system set mysql_read_timeout=1200;
alter system set mysql_write_timeout=1200;
alter system set lock_timeout=1200000;
alter system set log_min_duration_statement=1200000;
alter system set effective_cache_size = '8GB';
alter system set work_mem = '128MB';
alter system set wal_buffers='64MB';
alter system set autovacuum=false;
Note: Modifications to each node require a restart to take effect.
Modifications to storage node system variables before load testing:
mysql -h xxx -P xxx -upgx -ppgx_pwd #Log into the master of each shard to make modifications
set global innodb_buffer_pool_size=32*1024*1024*1024;
set global lock_wait_timeout=1200;
set global innodb_lock_wait_timeout=1200;
set global fullsync_timeout=1200000;
set global enable_fullsync=false;
set global innodb_flush_log_at_trx_commit=2;
set global sync_binlog=0;
set global max_binlog_size=1*1024*1024*1024;
set global enable_fullsync=off;
Set each shard to avoid switchover through XPanel by navigating to [Cluster MGT] -> [Cluster Switch Free Settings]
Remove the backup machines from each shard.
Sysbench
oltp_point_select
Load Test Duration | 5min | 5min | 5min | 5min |
---|---|---|---|---|
Concurrent Users | 100 | 300 | 600 | 900 |
95% Latency (ms) | 0.81 | 2.86 | 64.47 | 70.55 |
TPS | 113007.37 | 95306.52 | 73943.31 | 66162.5 |
QPS | 113007.37 | 95306.52 | 73943.31 | 66162.5 |
CPU (32vC) | 20:29% 21:27% 22:27% | 20:28% 21:26% 22:27% | 20:27% 21:26% 22:26% | 20:27% 21:25% 22:26% |
Memory (128G) | 20:33% 21:33% 22:33% | 20:33% 21:33% 22:33% | 20:33% 21:33% 22:33% | 20:34% 21:34% 22:34% |
IO Utilization | 20:7% 21:7% 22:7% | 20:7% 21:5% 22:4% | 20:5% 21:3% 22:3% | 20:6% 21:7% 22:4% |
oltp_update_non_index
Load Test Duration | 5min | 5min | 5min | 5min |
---|---|---|---|---|
Concurrent Users | 100 | 300 | 600 | 900 |
95% Latency (ms) | 1.44 | 12.3 | 51.02 | 58.92 |
TPS | 66057.79 | 63286.77 | 54899.43 | 51132.19 |
QPS | 66057.79 | 63286.77 | 54899.43 | 51132.19 |
CPU (32vC) | 20:34% 21:32% 22:36% | 20:31% 21:33% 22:36% | 20:33% 21:30% 22:35% | 20:31% 21:32% 22:33% |
Memory (128G) | 20:34% 21:34% 22:34% | 20:34% 21:34% 22:34% | 20:34% 21:34% 22:34% | 20:35% 21:35% 22:35% |
IO Utilization | 20:27% 21:18% 22:39% | 20:99% 21:43% 22:95% | 20:95% 21:99% 22:95% | 20:94% 21:91% 22:96% |
oltp_update_index
Load Test Duration | 5min | 5min | 5min | 5min |
---|---|---|---|---|
Concurrent Users | 100 | 300 | 600 | 900 |
95% Latency (ms) | 2.43 | 11.24 | 46.63 | 55.82 |
TPS | 64748.63 | 54121.36 | 46875.16 | 46347.41 |
QPS | 64748.63 | 54121.36 | 46875.16 | 46347.41 |
CPU (32vC) | 20:40% 21:42% 22:40% | 20:33% 21:32% 22:29% | 20:33% 21:28% 22:28% | 20:32% 21:26% 22:34% |
Memory (128G) | 20:20% 21:21% 22:18% | 20:20% 21:22% 22:19% | 20:21% 21:23% 22:23% | 20:21% 21:23% 22:21% |
IO Utilization | 20:92% 21:97% 22:98% | 20:99% 21:91% 22:94% | 20:96% 21:94% 22:96% | 20:93% 21:92% 22:97% |
oltp_read_write
Load Test Duration | 5min | 5min | 5min | 5min |
---|---|---|---|---|
Concurrent Users | 100 | 300 | 600 | 900 |
95% Latency (ms) | 186.54 | 411.96 | 612.21 | 427.07 |
TPS | 642.61 | 1940.16 | 3095.1 | 3218.29 |
QPS | 2570.43 | 7760.64 | 12380.38 | 12869.15 |
CPU (32vC) | 20:11% 21:10% 22:12% | 20:20% 21:16% 22:21% | 20:23% 21:22% 22:25% | 20:25% 21:24% 22:26% |
Memory (128G) | 20:35% 21:35% 22:35% | 20:36% 21:36% 22:36% | 20:37% 21:37% 22:37% | 20:38% 21:38% 22:38% |
IO Utilization | 20:93% 21:98% 22:98% | 20:60% 21:13% 22:51% | 20:52% 21:54% 22:51% | 20:63% 21:57% 22:61% |
oltp_read_only
Load Test Duration | 5min | 5min | 5min | 5min |
---|---|---|---|---|
Concurrent Users | 100 | 300 | 600 | 900 |
95% Latency (ms) | 183.21 | 502.2 | 383.33 | 427.07 |
TPS | 644.99 | 865.42 | 3086 | 3450.44 |
QPS | 2579.96 | 3461.67 | 12334.18 | 13783.17 |
CPU (32vC) | 20:11% 21:11% 22:12% | 20:29% 21:27% 22:27% | 20:28% 21:27% 22:26% | 20:28% 21:27% 22:26% |
Memory (128G) | 20:34% 21:34% 22:34% | 20:33% 21:33% 22:33% | 20:33% 21:33% 22:33% | 20:33% 21:33% 22:33% |
IO Utilization | 20:100% 21:100% 22:100% | 20:55% 21:60% 22:58% | 20:65% 21:70% 22:68% | 20:75% 21:71% 22:68% |
oltp_write_only
Load Test Duration | 5min | 5min | 5min | 5min |
---|---|---|---|---|
Concurrent Users | 100 | 300 | 600 | 900 |
95% Latency (ms) | 183.21 | 260.72 | 459.18 | 637.08 |
TPS | 651.22 | 433.68 | 264.01 | 198.25 |
QPS | 2604.9 | 1812.3 | 896.45 | 503.76 |
CPU (32vC) | 20:4% 21:4% 22:14% | 20:5% 21:3% 22:10% | 20:6% 21:8% 22:9% | 20:6% 21:7% 22:8% |
Memory (128G) | 20:34% 21:34% 22:34% | 20:35% 21:34% 22:34% | 20:35% 21:34% 22:34% | 20:36% 21:34% 22:34% |
IO Utilization | 20:100% 21:99% 22:100% | 20:100% 21:100% 22:100% | 20:100% 21:100% 22:100% | 20:100% 21:100% 22:100% |
oltp_insert
Load Test Duration | 5min | 5min | 5min | 5min |
---|---|---|---|---|
Concurrent Users | 100 | 300 | 600 | 900 |
95% Latency (ms) | 0.87 | 7.84 | 27.66 | 43.39 |
TPS | 110055.32 | 98261.53 | 75309.96 | 77354.33 |
QPS | 110055.32 | 98261.53 | 75309.96 | 77354.33 |
CPU (32vC) | 20:34% 21:26% 22:27% | 20:33% 21:22% 22:29% | 20:29% 21:27% 22:24% | 20:25% 21:23% 22:38% |
Memory (128G) | 20:34% 21:34% 22:34% | 20:34% 21:34% 22:34% | 20:34% 21:34% 22:34% | 20:35% 21:35% 22:35% |
IO Utilization | 20:56% 21:58% 22:64% | 20:94% 21:47% 22:93% | 20:91% 21:85% 22:93% | 20:94% 21:96% 22:94% |
TPC-C
Load Test Duration | 10min | 10min | 10min | 10min | 10min | 10min | 10min | 10min | 10min | 10min | 10min | 10min |
---|---|---|---|---|---|---|---|---|---|---|---|---|
warehouse | 500 | 500 | 500 | 500 | 500 | 500 | 500 | 500 | 500 | 500 | 500 | 500 |
Concurrent Users | 50 | 50 | 60 | 70 | 80 | 90 | 100 | 150 | 200 | 300 | 400 | 500 |
tpmC (Transactions per Minute of type C) | 86851.53 | 86653.63 | 84991.98 | 84124.6 | 81586.18 | 83623.86 | 46545.82 | 32384.51 | 21039.78 | 21356.62 | 21970.13 | 22568.62 |
tmpTotal | 193198.13 | 192866.59 | 188799.55 | 186880.09 | 181188.01 | 185844.57 | 103319.45 | 71928.44 | 46754.49 | 47422.62 | 48836.39 | 50230.18 |
Notes | node:18,19,20 | node:20,21,22 | ||||||||||
CPU (32vC) | 18:40% 19:39% 20:36% | 20:35% 21:33% 22:33% | 20:38% 21:35% 22:36% | 20:37% 21:32% 22:36% | 20:37% 21:34% 22:36% | 20:36% 21:29% 22:35% | 20:32% 21:30% 22:33% | 20:11% 21:31% 22:29% | 20:26% 21:9% 22:8% | 20:27% 21:8% 22:8% | 20:25% 21:7% 22:8% | 20:27% 21:19% 22:45% |
Memory (128G) | 18:25% 19:20% 20:20% | 20:23% 21:20% 22:21% | 20:23% 21:22% 22:22% | 20:24% 21:22% 22:23% | 20:25% 21:22% 22:23% | 20:26% 21:22% 22:23% | 20:26% 21:23% 22:24% | 20:27% 21:24% 22:25% | 20:27% 21:24% 22:25% | 20:27% 21:24% 22:26% | 20:28% 21:24% 22:26% | 20:28% 21:24% 22:26% |
IO Utilization | 18:70% 19:75% 20:72% | 20:65% 21:67% 22:62% | 20:73% 21:67% 22:72% | 20:78% 21:75% 22:71% | 20:62% 21:65% 22:66% | 20:82% 21:83% 22:85% | 20:81% 21:89% 22:89% | 20:30% 21:35% 22:55% | 20:28% 21:36% 22:44% | 20:22% 21:32% 22:21% | 20:25% 21:24% 22:23% | 20:25% 21:24% 22:31% |
TPC-H
queries | cost (seconds) | result | error |
---|---|---|---|
Q1 | 15.8 | succ | |
Q2 | 1.36 | succ | |
Q3 | 1598.1 | succ | |
Q4 | 3.12 | succ | |
Q5 | 30.23 | succ | |
Q6 | 2.6 | succ | |
Q7 | 2262.64 | succ | |
Q8 | 5.3 | succ | |
Q9 | 14.33 | succ | |
Q10 | 5.15 | succ | |
Q11 | 0.88 | succ | |
Q12 | 3.77 | succ | |
Q13 | 2.54 | succ | |
Q14 | 2.79 | succ | |
Q15 | 5.36 | succ | |
Q16 | 0.88 | succ | |
Q17 | 10.97 | succ | |
Q18 | 13.9 | succ | |
Q19 | 3.14 | succ | |
Q20 | 4.28 | succ | |
Q21 | 9.64 | succ | |
Q22 | 0.71 | succ |
TPC-DS
totalCost: 2986.81s
query | cost (seconds) | result | error |
---|---|---|---|
Q1 | 0.24 | succ | |
Q2 | 4.84 | succ | |
Q3 | 1.51 | succ | |
Q4 | 30.63 | succ | |
Q5 | 5.18 | succ | |
Q6 | 141.67 | succ | |
Q7 | 5.73 | succ | |
Q8 | 2.1 | succ | |
Q9 | 11.49 | succ | |
Q10 | 6.03 | succ | |
Q11 | 20.22 | succ | |
Q12 | 0.52 | succ | |
Q13 | 2.21 | succ | |
Q14 | 9.95 | succ | |
Q15 | 1.08 | succ | |
Q16 | 0.75 | succ | |
Q17 | 6.73 | succ | |
Q18 | 4.26 | succ | |
Q19 | 1.77 | succ | |
Q20 | 1.03 | succ | |
Q21 | 5.88 | succ | |
Q22 | 13.06 | succ | |
Q23 | 20.25 | succ | |
Q24 | 4.44 | succ | |
Q25 | 1292.55 | succ | |
Q26 | 3.52 | succ | |
Q27 | 3.47 | succ | |
Q28 | 7.56 | succ | |
Q29 | 2.66 | succ | |
Q30 | 0.35 | succ | |
Q31 | 19.19 | succ | |
Q32 | 2.14 | succ | |
Q33 | 3.07 | succ | |
Q34 | 0.09 | succ | |
Q35 | 5.05 | succ | |
Q36 | 0.07 | succ | |
Q37 | 0.04 | succ | |
Q38 | 4.56 | succ | |
Q39 | 15.45 | succ | |
Q40 | 1.38 | succ | |
Q41 | 0.05 | succ | |
Q42 | 1.6 | succ | |
Q43 | 0.06 | succ | |
Q44 | 1.1 | succ | |
Q45 | 1029.89 | succ | |
Q46 | 0.07 | succ | |
Q47 | 6.47 | succ | |
Q48 | 2.05 | succ | |
Q49 | 3.12 | succ | |
Q50 | 4.58 | succ | |
Q51 | 4.21 | succ | |
Q52 | 1.52 | succ | |
Q53 | 1.61 | succ | |
Q54 | 0.85 | succ | |
Q55 | 1.59 | succ | |
Q56 | 3.08 | succ | |
Q57 | 2.86 | succ | |
Q58 | 9.27 | succ | |
Q59 | 6.34 | succ | |
Q60 | 3.1 | succ | |
Q61 | 0.14 | succ | |
Q62 | 1 | succ | |
Q63 | 1.63 | succ | |
Q64 | 11.11 | succ | |
Q65 | 3.68 | succ | |
Q66 | 1.37 | succ | |
Q67 | 10.05 | succ | |
Q68 | 0.09 | succ | |
Q69 | 5.24 | succ | |
Q70 | 5.04 | succ | |
Q71 | 1.62 | succ | |
Q72 | 28.57 | succ | |
Q73 | 0.09 | succ | |
Q74 | 7.49 | succ | |
Q75 | 5.74 | succ | |
Q76 | 1.54 | succ | |
Q77 | 4.75 | succ | |
Q78 | 25.25 | succ | |
Q79 | 2.49 | succ | |
Q80 | 6.69 | succ | |
Q81 | 0.33 | succ | |
Q82 | 5.95 | succ | |
Q83 | 1.2 | succ | |
Q84 | 19.2 | succ | |
Q85 | 2.63 | succ | |
Q86 | 0.73 | succ | |
Q87 | 4.54 | succ | |
Q88 | 10.27 | succ | |
Q89 | 1.85 | succ | |
Q90 | 0.79 | succ | |
Q91 | 1.12 | succ | |
Q92 | 1.1 | succ | |
Q93 | 3.59 | succ | |
Q94 | 0.52 | succ | |
Q95 | 32.88 | succ | |
Q96 | 1.25 | succ | |
Q97 | 3.23 | succ | |
Q98 | 1.83 | succ | |
Q99 | 2.03 | succ |