RL testing for distributed systems. This repository contains an implementation of a new RL based exploration algorithm and benchmarks (etcd and RSL) to evaluate the new exploration algorithm.

• benchmarks - contains the code to instantiate and run the different algorithms based on the command line parameters provided.
• core - contains the main interfaces, implementations of the generic environments and login run different experiments (in parallel).
• policies - implementations of the different algorithms to benchmark on.
• analysis - code to perform the post-processing of the experiments to generate graphs and data.
• scripts - Easy scripts to run the different benchmarks
• util - auxilliary libraries

To build the docker image,

docker build -t dist-rl-testing .

To run the docker image,

docker run -it dist-rl-testing:latest

The scripts will open an interactive shell to run further experiments

Once the docker has been instantiated, run the following instructions to reproduce results from the table. The results are written to the results folder.

bash scripts/run_cov.sh etcd 1000

For RQ1

bash scripts/run_cov.sh etcd 10000 --num-runs 10

For RQ2

bash scripts/run_hierarchy.sh etcd set1 10000 --num-runs 10

Replace etcd with rsl for the RSL benchmark.