Question: Can I create a completely custom environment? about mushroom-rl HOT 4 CLOSED

@carloderamo Thank you for the quick reply!

In fact, as I continued reading your code on GitHub, there was something I misunderstood.

I'll also read the .py file you mentioned. Thank you.

from mushroom-rl.

Hi,
MushroomRL does not support vectorized environments at the moment. For regular environments, you are free to create custom environments as described in the doc page you mentioned.

Please, if you need further help, provide more details about the implementation problems you have.

Thanks!

from mushroom-rl.

Thanks for your reply, @carloderamo.

I want to define 10 states and 5 actions.
I also want to create a custom reward function, state transition function, etc. for the states and actions.

But in the document, "Creating a new environment" page, I couldn't find the part, but I could find a 'Circle Environment'.
https://mushroomrl.readthedocs.io/en/latest/source/tutorials/tutorials.5_environments.html#creating-a-new-environment

It seems that if I want to define 'State change according to action' and 'reward', I can use the "step()" method.
And I can define the custom 5 actions using Discrete(5).
but I couldn't find the part to define custom 10 states.

I thought that the variables _self.size, _self.goal, and _self.goal_radius seems to be variables for the 'Circle Environment'.
What method can I use to define custom 10 states?

Thanks!

from mushroom-rl.

Hi,

from what I understand you want to create an environment with 5 discrete actions and 10 discrete states. I suggest taking a look at mushroom/environments/grid_world.py to have an idea of how this should be done.

from mushroom-rl.