SHAC and policies for partial observability about diffrl HOT 3 CLOSED

We didn't try either LSTM or transformer models since it has been shown in previous works that simple MLP models work reasonably well on the tasks we considered. In more complicated tasks, those more advanced architectures may have their benefits and we agree that incorporating those models is not trivial and does require some proper implementations.

from diffrl.

Thanks for the fast response; good to know at least I wont be reinventing the wheel if I do try out such an implementation. Quite some work, but conceptually I do not expect there to be any obstacles, would you?

from diffrl.

you are right. I think there should be no big obstacles.

from diffrl.