You must have Python 3 and the following packages installed:
pytorch
gym
scipy
matplotlib
This toy problem is configured in the following file:
experiments/toy1/config.json
To run this experiment execute the following commands:
GPU = 0 # -1 for CPU
for EXPERT in noisy_good perfect_good perfect_bad random strong_bad_bias strong_good_bias; do
for SEED in {0..19}; do
python experiments/toy1/01_train_models.py $EXPERT -s $SEED -g $GPU
python experiments/toy1/02_eval_models.py $EXPERT -s $SEED -g $GPU
done
python experiments/toy1/03_plots.py $EXPERT
doneResults are stored in the following folders:
experiments/
toy1/
plots/
results/
trained_models/
This toy problem is configured in the following file:
experiments/toy2/config.json
To run this experiment execute the following commands:
GPU = 0 # -1 for CPU
for EXPERT in noisy_good very_good very_bad random strong_bad_bias strong_good_bias; do
for SEED in {0..19}; do
python experiments/toy2/01_train_models.py $EXPERT -s $SEED -g $GPU
python experiments/toy2/02_eval_models.py $EXPERT -s $SEED -g $GPU
python experiments/toy2/03_train_agents.py $EXPERT -s $SEED -g $GPU
python experiments/toy2/04_eval_agents.py $EXPERT -s $SEED -g $GPU
done
python experiments/toy2/05_plots.py $EXPERT
doneThis toy problem is configured in the following file:
experiments/toy3/config.json
To run this experiment execute the following commands:
GPU = 0 # -1 for CPU
for EXPERT in noisy_good very_good very_bad random strong_bad_bias strong_good_bias; do
for SEED in {0..19}; do
python experiments/toy3/01_train_models.py $EXPERT -s $SEED -g $GPU
python experiments/toy3/02_eval_models.py $EXPERT -s $SEED -g $GPU
python experiments/toy3/03_train_agents.py $EXPERT -s $SEED -g $GPU
python experiments/toy3/04_eval_agents.py $EXPERT -s $SEED -g $GPU
done
python experiments/toy3/05_plots.py $EXPERT
done
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent