Comments (3)
BrianNichols
commented on June 24, 2024
Which version of the java client are you using?
from aerospike-client-java.
adandris
commented on June 24, 2024
3.1.2
from aerospike-client-java.
BrianNichols
commented on June 24, 2024
If you are using a lot of nested commands (the callback of the current command issues new command(s), AsyncClient is likely to deadlock even without nodes going up/down. Nested commands require the use of a task thread pool that AsyncClient uses to offload user callbacks onto a separate thread.
final AsyncClientPolicy clientPolicy = new AsyncClientPolicy();
clientPolicy.failIfNotConnected = true;
clientPolicy.asyncTaskThreadPool = Executors.newCachedThreadPool(new ThreadFactory() {
public final Thread newThread(Runnable runnable) {
Thread thread = new Thread(runnable);
thread.setDaemon(true);
return thread;
}
});The java benchmark tool has an async option which does not have a asyncTaskThreadPool by default. It also does not use nested commands. This particular scenario works fine when nodes go down/up:
$ ./run_benchmarks -h bn66 -p 3000 -n test -k 100000000 -S 1 -o S:50 -w RU,50 -z 1 -async -asyncMaxCommands00 -asyncSelectorThreads 4
Benchmark: bn66:3000, namespace: test, set: testset, threads: 1, workload: READ_UPDATE
read: 50% (all bins: 100%, single bin: 0%), write: 50% (all bins: 100%, single bin: 0%)
keys: 100000000, start key: 1, transactions: 0, bins: 1, random values: false, throughput: unlimited
read policy: timeout: 0, maxRetries: 1, sleepBetweenRetries: 0, consistencyLevel: CONSISTENCY_ONE, replica: MASTER, reportNotFound: false
write policy: timeout: 0, maxRetries: 1, sleepBetweenRetries: 0, commitLevel: COMMIT_ALL
Async: MaxConnTotal 200, MaxConnAction: BLOCK, SelectorTimeout: 0, SelectorThreads: 4, TaskThreadPool: none
bin[0]: string[50]
debug: false
2015-06-24 11:57:03.728 INFO Thread 1 Add node BB900047C290C00 172.16.70.207:3000
2015-06-24 11:57:03.766 INFO Thread 1 Add node BC300047C290C00 172.16.70.207:3010
2015-06-24 11:57:03.790 write(tps=0 timeouts=0 errors=0) read(tps=0 timeouts=0 errors=0) total(tps=0 timeouts=0 errors=0)
2015-06-24 11:57:04.790 write(tps=6137 timeouts=0 errors=0) read(tps=6295 timeouts=0 errors=0) total(tps=12432 timeouts=0 errors=0)
2015-06-24 11:57:05.790 write(tps=8227 timeouts=0 errors=0) read(tps=8242 timeouts=0 errors=0) total(tps=16469 timeouts=0 errors=0)
2015-06-24 11:57:06.790 write(tps=7942 timeouts=0 errors=0) read(tps=7851 timeouts=0 errors=0) total(tps=15793 timeouts=0 errors=0)
2015-06-24 11:57:07.790 write(tps=7568 timeouts=0 errors=0) read(tps=7519 timeouts=0 errors=0) total(tps=15087 timeouts=0 errors=0)
2015-06-24 11:57:08.791 write(tps=5740 timeouts=0 errors=0) read(tps=5629 timeouts=0 errors=0) total(tps=11369 timeouts=0 errors=0)
2015-06-24 11:57:09.792 write(tps=7774 timeouts=0 errors=0) read(tps=7392 timeouts=0 errors=0) total(tps=15166 timeouts=0 errors=0)
2015-06-24 11:57:10.792 write(tps=7859 timeouts=0 errors=0) read(tps=7742 timeouts=0 errors=0) total(tps=15601 timeouts=0 errors=0)
2015-06-24 11:57:11.793 write(tps=7984 timeouts=0 errors=0) read(tps=8020 timeouts=0 errors=0) total(tps=16004 timeouts=0 errors=0)
2015-06-24 11:57:12.793 write(tps=8002 timeouts=0 errors=0) read(tps=8136 timeouts=0 errors=0) total(tps=16138 timeouts=0 errors=0)
2015-06-24 11:57:13.794 write(tps=8196 timeouts=0 errors=0) read(tps=8097 timeouts=0 errors=0) total(tps=16293 timeouts=0 errors=0)
2015-06-24 11:57:14.794 write(tps=7655 timeouts=0 errors=0) read(tps=7995 timeouts=0 errors=0) total(tps=15650 timeouts=0 errors=0)
2015-06-24 11:57:15.794 write(tps=7815 timeouts=0 errors=0) read(tps=7477 timeouts=0 errors=0) total(tps=15292 timeouts=0 errors=0)
2015-06-24 11:57:16.794 write(tps=7928 timeouts=0 errors=0) read(tps=7986 timeouts=0 errors=0) total(tps=15914 timeouts=0 errors=0)
2015-06-24 11:57:17.795 write(tps=8089 timeouts=0 errors=0) read(tps=8113 timeouts=0 errors=0) total(tps=16202 timeouts=0 errors=0)
2015-06-24 11:57:18.795 write(tps=8023 timeouts=0 errors=0) read(tps=7944 timeouts=0 errors=0) total(tps=15967 timeouts=0 errors=0)
2015-06-24 11:57:19.796 write(tps=8092 timeouts=0 errors=0) read(tps=8163 timeouts=0 errors=0) total(tps=16255 timeouts=0 errors=0)
2015-06-24 11:57:20.797 write(tps=7386 timeouts=0 errors=0) read(tps=7394 timeouts=0 errors=0) total(tps=14780 timeouts=0 errors=0)
2015-06-24 11:57:21.798 write(tps=7538 timeouts=0 errors=0) read(tps=7584 timeouts=0 errors=0) total(tps=15122 timeouts=0 errors=0)
2015-06-24 11:57:22.798 write(tps=7779 timeouts=0 errors=0) read(tps=7631 timeouts=0 errors=0) total(tps=15410 timeouts=0 errors=0)
2015-06-24 11:57:23.799 write(tps=7609 timeouts=0 errors=0) read(tps=7573 timeouts=0 errors=0) total(tps=15182 timeouts=0 errors=0)
2015-06-24 11:57:24.799 write(tps=7985 timeouts=0 errors=0) read(tps=8064 timeouts=0 errors=0) total(tps=16049 timeouts=0 errors=0)
2015-06-24 11:57:25.799 write(tps=7069 timeouts=0 errors=0) read(tps=6829 timeouts=0 errors=0) total(tps=13898 timeouts=0 errors=0)
2015-06-24 11:57:26.801 write(tps=8330 timeouts=0 errors=0) read(tps=7947 timeouts=0 errors=0) total(tps=16277 timeouts=0 errors=0)
2015-06-24 11:57:27.801 write(tps=8468 timeouts=0 errors=0) read(tps=8114 timeouts=0 errors=0) total(tps=16582 timeouts=0 errors=0)
2015-06-24 11:57:28.802 write(tps=7746 timeouts=0 errors=0) read(tps=8008 timeouts=0 errors=0) total(tps=15754 timeouts=0 errors=0)
2015-06-24 11:57:29.802 write(tps=7757 timeouts=0 errors=0) read(tps=7567 timeouts=0 errors=0) total(tps=15324 timeouts=0 errors=0)
2015-06-24 11:57:30.802 write(tps=6651 timeouts=0 errors=866) read(tps=6721 timeouts=0 errors=905) total(tps=13372 timeouts=0 errors=1771)
2015-06-24 11:57:31.507 INFO Thread 12 Node BB900047C290C00 172.16.70.207:3000 refresh failed: java.io.EOFException
2015-06-24 11:57:31.804 write(tps=4428 timeouts=0 errors=4432) read(tps=4496 timeouts=0 errors=4531) total(tps=8924 timeouts=0 errors=8963)
2015-06-24 11:57:32.531 INFO Thread 12 Node BB900047C290C00 172.16.70.207:3000 refresh failed: Error Code 11: java.net.ConnectException: Connection refused
2015-06-24 11:57:32.622 INFO Thread 12 Remove node BB900047C290C00 172.16.70.207:3000
2015-06-24 11:57:32.804 write(tps=5511 timeouts=0 errors=3881) read(tps=5583 timeouts=0 errors=3762) total(tps=11094 timeouts=0 errors=7643)
2015-06-24 11:57:33.804 write(tps=8943 timeouts=0 errors=0) read(tps=9046 timeouts=0 errors=0) total(tps=17989 timeouts=0 errors=0)
2015-06-24 11:57:34.804 write(tps=9180 timeouts=0 errors=0) read(tps=9207 timeouts=0 errors=0) total(tps=18387 timeouts=0 errors=0)
2015-06-24 11:57:35.806 write(tps=9014 timeouts=0 errors=0) read(tps=9101 timeouts=0 errors=0) total(tps=18115 timeouts=0 errors=0)
2015-06-24 11:57:36.806 write(tps=9204 timeouts=0 errors=0) read(tps=9193 timeouts=0 errors=0) total(tps=18397 timeouts=0 errors=0)
2015-06-24 11:57:37.806 write(tps=8920 timeouts=0 errors=0) read(tps=9091 timeouts=0 errors=0) total(tps=18011 timeouts=0 errors=0)
2015-06-24 11:57:38.806 write(tps=8368 timeouts=0 errors=0) read(tps=8341 timeouts=0 errors=0) total(tps=16709 timeouts=0 errors=0)
2015-06-24 11:57:39.808 write(tps=8191 timeouts=0 errors=0) read(tps=8318 timeouts=0 errors=0) total(tps=16509 timeouts=0 errors=0)
2015-06-24 11:57:40.809 write(tps=8222 timeouts=0 errors=0) read(tps=8243 timeouts=0 errors=0) total(tps=16465 timeouts=0 errors=0)
2015-06-24 11:57:41.810 write(tps=8355 timeouts=0 errors=0) read(tps=8280 timeouts=0 errors=0) total(tps=16635 timeouts=0 errors=0)
2015-06-24 11:57:42.810 write(tps=8987 timeouts=0 errors=0) read(tps=9000 timeouts=0 errors=0) total(tps=17987 timeouts=0 errors=0)
2015-06-24 11:57:43.810 write(tps=9164 timeouts=0 errors=0) read(tps=9028 timeouts=0 errors=0) total(tps=18192 timeouts=0 errors=0)
2015-06-24 11:57:44.811 write(tps=9263 timeouts=0 errors=0) read(tps=9083 timeouts=0 errors=0) total(tps=18346 timeouts=0 errors=0)
2015-06-24 11:57:45.811 write(tps=9217 timeouts=0 errors=0) read(tps=9209 timeouts=0 errors=0) total(tps=18426 timeouts=0 errors=0)
2015-06-24 11:57:46.811 write(tps=9254 timeouts=0 errors=0) read(tps=9240 timeouts=0 errors=0) total(tps=18494 timeouts=0 errors=0)
2015-06-24 11:57:47.811 write(tps=9227 timeouts=0 errors=0) read(tps=9219 timeouts=0 errors=0) total(tps=18446 timeouts=0 errors=0)
2015-06-24 11:57:48.812 write(tps=8975 timeouts=0 errors=0) read(tps=8876 timeouts=0 errors=0) total(tps=17851 timeouts=0 errors=0)
2015-06-24 11:57:49.812 write(tps=9057 timeouts=0 errors=0) read(tps=9148 timeouts=0 errors=0) total(tps=18205 timeouts=0 errors=0)
2015-06-24 11:57:50.812 write(tps=9158 timeouts=0 errors=0) read(tps=9249 timeouts=0 errors=0) total(tps=18407 timeouts=0 errors=0)
2015-06-24 11:57:51.813 write(tps=8472 timeouts=0 errors=0) read(tps=8366 timeouts=0 errors=0) total(tps=16838 timeouts=0 errors=0)
2015-06-24 11:57:52.813 write(tps=9205 timeouts=0 errors=0) read(tps=9097 timeouts=0 errors=0) total(tps=18302 timeouts=0 errors=0)
2015-06-24 11:57:53.814 write(tps=8896 timeouts=0 errors=0) read(tps=8933 timeouts=0 errors=0) total(tps=17829 timeouts=0 errors=0)
2015-06-24 11:57:54.815 write(tps=8777 timeouts=0 errors=0) read(tps=8917 timeouts=0 errors=0) total(tps=17694 timeouts=0 errors=0)
2015-06-24 11:57:55.815 write(tps=7417 timeouts=0 errors=0) read(tps=7649 timeouts=0 errors=0) total(tps=15066 timeouts=0 errors=0)
2015-06-24 11:57:56.816 write(tps=6635 timeouts=0 errors=0) read(tps=6713 timeouts=0 errors=0) total(tps=13348 timeouts=0 errors=0)
2015-06-24 11:57:57.816 write(tps=7774 timeouts=0 errors=0) read(tps=7771 timeouts=0 errors=0) total(tps=15545 timeouts=0 errors=0)
2015-06-24 11:57:58.817 write(tps=7172 timeouts=0 errors=0) read(tps=7094 timeouts=0 errors=0) total(tps=14266 timeouts=0 errors=0)
2015-06-24 11:57:59.817 write(tps=7533 timeouts=0 errors=0) read(tps=7636 timeouts=0 errors=0) total(tps=15169 timeouts=0 errors=0)
2015-06-24 11:58:00.817 write(tps=8852 timeouts=0 errors=0) read(tps=8836 timeouts=0 errors=0) total(tps=17688 timeouts=0 errors=0)
2015-06-24 11:58:01.818 write(tps=4384 timeouts=0 errors=0) read(tps=4535 timeouts=0 errors=0) total(tps=8919 timeouts=0 errors=0)
2015-06-24 11:58:02.107 INFO Thread 12 Add node BB900047C290C00 172.16.70.207:3000
2015-06-24 11:58:02.819 write(tps=4633 timeouts=0 errors=0) read(tps=4348 timeouts=0 errors=0) total(tps=8981 timeouts=0 errors=0)
2015-06-24 11:58:03.821 write(tps=5410 timeouts=0 errors=0) read(tps=5453 timeouts=0 errors=0) total(tps=10863 timeouts=0 errors=0)
2015-06-24 11:58:04.821 write(tps=6232 timeouts=0 errors=0) read(tps=6141 timeouts=0 errors=0) total(tps=12373 timeouts=0 errors=0)
2015-06-24 11:58:05.822 write(tps=6227 timeouts=0 errors=0) read(tps=6281 timeouts=0 errors=0) total(tps=12508 timeouts=0 errors=0)
2015-06-24 11:58:06.822 write(tps=5513 timeouts=0 errors=0) read(tps=5575 timeouts=0 errors=0) total(tps=11088 timeouts=0 errors=0)
2015-06-24 11:58:07.823 write(tps=5872 timeouts=0 errors=0) read(tps=6055 timeouts=0 errors=0) total(tps=11927 timeouts=0 errors=0)
2015-06-24 11:58:08.823 write(tps=6323 timeouts=0 errors=0) read(tps=6470 timeouts=0 errors=0) total(tps=12793 timeouts=0 errors=0)
2015-06-24 11:58:09.823 write(tps=6696 timeouts=0 errors=0) read(tps=6562 timeouts=0 errors=0) total(tps=13258 timeouts=0 errors=0)
2015-06-24 11:58:10.824 write(tps=6527 timeouts=0 errors=0) read(tps=6709 timeouts=0 errors=0) total(tps=13236 timeouts=0 errors=0)
2015-06-24 11:58:11.825 write(tps=5684 timeouts=0 errors=0) read(tps=5620 timeouts=0 errors=0) total(tps=11304 timeouts=0 errors=0)
2015-06-24 11:58:12.826 write(tps=6057 timeouts=0 errors=0) read(tps=6319 timeouts=0 errors=0) total(tps=12376 timeouts=0 errors=0)
2015-06-24 11:58:13.827 write(tps=6323 timeouts=0 errors=0) read(tps=6245 timeouts=0 errors=0) total(tps=12568 timeouts=0 errors=0)
2015-06-24 11:58:14.827 write(tps=6039 timeouts=0 errors=0) read(tps=6195 timeouts=0 errors=0) total(tps=12234 timeouts=0 errors=0)
2015-06-24 11:58:15.827 write(tps=6313 timeouts=0 errors=0) read(tps=6391 timeouts=0 errors=0) total(tps=12704 timeouts=0 errors=0)
2015-06-24 11:58:16.828 write(tps=5864 timeouts=0 errors=0) read(tps=5987 timeouts=0 errors=0) total(tps=11851 timeouts=0 errors=0)
2015-06-24 11:58:17.828 write(tps=6048 timeouts=0 errors=0) read(tps=6277 timeouts=0 errors=0) total(tps=12325 timeouts=0 errors=0)
2015-06-24 11:58:18.828 write(tps=6155 timeouts=0 errors=0) read(tps=6257 timeouts=0 errors=0) total(tps=12412 timeouts=0 errors=0)
2015-06-24 11:58:19.828 write(tps=6226 timeouts=0 errors=0) read(tps=6029 timeouts=0 errors=0) total(tps=12255 timeouts=0 errors=0)
2015-06-24 11:58:20.830 write(tps=6138 timeouts=0 errors=0) read(tps=6009 timeouts=0 errors=0) total(tps=12147 timeouts=0 errors=0)
2015-06-24 11:58:21.830 write(tps=5913 timeouts=0 errors=0) read(tps=5981 timeouts=0 errors=0) total(tps=11894 timeouts=0 errors=0)
from aerospike-client-java.
Related Issues (20)
- Get namespaces/sets by AerospikeClient.
- Streaming support for batch operations HOT 2
- rename Record to AerospikeRecord HOT 1
- View screenshot link is broken HOT 1
- Type Erasure in 5.1.11 HOT 7
- Fully support surrogates symbol in Strings HOT 5
- Wrong condition for aeropsike client connectivity HOT 6
- Add RetryListener HOT 7
- Security contact? HOT 2
- Aerospike Cluster Peer Invalid Node Docker HOT 3
- Node name is null HOT 1
- Error 20: Partition map empty ( Issue for java client ) HOT 8
- Add support for findBySinceUpdate using since_update in metadata HOT 2
- What is the difference between `BatchRecordArrayListener` and `RecordArrayListener`? HOT 2
- How to make async queries faster? HOT 3
- java.lang.NullPointerException in AerospikeClient.put() HOT 4
- Setters for Spring HOT 2
- Enable releases in github HOT 2
- Problem reading Date type with client version 7.X HOT 2
- When compiling lua, the client discards the exception which has the lua compilation error details. HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from aerospike-client-java.