Comments (3)
h-w-chen
commented on August 16, 2024
07-26 1M records
| machine | aws type |
|---|---|
| rkv | t2.xlarge |
| redis (x2) | t2.large |
| jaeger | t2.xlarge |
| ycsb | t2.medium |
data size: value of 10KB
ycsb thread count: 100
note: go-ycsb reports results of INSERT op only (postmortem: it turns out we missed run step)
note: workload-u is handcrafted and added to go-ycsb code, based on workloadb
| workload type | time(s) | count | ops | latency(us): avg | min | max | 99% | 99.9% | 99.99% | jaeger span sample |
|---|---|---|---|---|---|---|---|---|---|---|
| workload-a (50% update, 50% read) | 5906 | 999999 | 169 | 588587 | 3624 | 3399679 | 1157119 | 1622015 | 2910207 | createKV=7119: set-kv=6929, put-idx=25 |
| workload-b (95% read, 5% update) | 5901 | 1000000 | 169 | 588230 | 4248 | 4591615 | 888319 | 1625087 | 3411967 | createKV=6152: set-kv=5961, put-idx=20 |
| workload-u (95% update, 5% read) | 5966 | 1000000 | 167 | 594724 | 3758 | 19775487 | 1053695 | 1652735 | 4607999 | createKV=7867: set-kv=7656, put-idx=14 |
from regionless-storage-service.
h-w-chen
commented on August 16, 2024
07-27 perf test
threadcount: 4
recordcount: 1M/4M
workload: a only
payload size: value of 10KB
rkv: t2.xlarge
redis x5: t2.large
jaeger: t2.xlarge
ycsb: t2.medium
| target | time(s) | count | ops | latency(us): avg | min | max | 99% | 99.9% | 99.99% | jaeger span sample | rkv used mem |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 1M | 4145 | 999999 | 243 | 14595 | 3734 | 3035135 | 33823 | 58463 | 341503 | createKV=4932: set-kv=4764, put-idx=19 | 566M |
| 4M | 17394 | 3999997 | 230 | 14981 | 3628 | 18759679 | 36639 | 56895 | 575999 | createKV=5838: set-kv=5685, put-idx=14 | 1.7G |
from regionless-storage-service.
h-w-chen
commented on August 16, 2024
already served the purpose of milestone; closing
from regionless-storage-service.
Related Issues (20)
- 10M test run HOT 1
- 30M test run
- cross-(2)region
- awscli default region constraint in setup_test_lab.sh
- when only 1 redis backend is set, rkv get query returns unexpected error "the number of nodes is 1, which means there is no replica" HOT 1
- rkv misses revision 2
- 2 micro rkv per test fails, gets "runtime error: invalid memory address or nil pointer dereference" HOT 2
- update failed in perf test run: panic with "store.keyindex: put with unexpected smaller Revision" HOT 1
- ycsb load with mem databases fails, yielding INSERT_ERROR HOT 1
- new feature request: rkv update with current latest revision number HOT 2
- curl client gets "Connection refused" error when rkv uses the default mem database backend HOT 4
- curl client gets "storage not found for 127.0.0.1:6379" when rkv uses dummy+latency storage backend HOT 1
- The last commit #68 does not check the storeType before changing hostip:port to name and causes exceptions to save key value pairs HOT 1
- Hardcoded RemoteStoreLatencyThresholdInMilliSec might cause confusion and zero remote stores be select
- test script: setup-test-lab should get KEY_FILE and KEY_NAME automatically based on the resultant file si_def.json HOT 1
- 930 Performance Test - 5M staging
- 930 Performance Test - 100M staging
- Getting Non-existing Value with Concurrent Operations HOT 2
- rkv get return should be of json format
- rkv get revision of key should respect the revision even if it does not exist
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from regionless-storage-service.