ppo_origianl - the original code before the changes merged in 04.11, including - k_last_states, masking_treshold, safety_treshold, changing shield, actor and critic architectures to basic LSTM, adding collision logs, error diffusion for "no safety action according to shield", etc.
run the project:
- create a new virtual env - python 3.7.9 (python3.7 -m venv new_env)
- activate the new env - new_env/Scripts/activate
- install requirements_updated.txt packages - manually or by (pip install -r requirements_updated.txt)