uidilr / deepirl_chainer Goto Github PK

The paper suggests that the reward is given by: f(s, a, s') - \pi(a | s) (which is the same as logD - log(1-D)) but the reward in the repo is g(s, a).
Why is this discrepancy?

If I have to make demonstration, how do I compose the dimension of demonstration?
For example,
state = [batch, sequence, *observation_shape]
action = [batch, sequence, *action_shape]

I trained "halfcheetah-v4" for above shape of demonstration, but gail and airl does not be learnt at all...

I does not know what I mistake...

and For binary cross entropy loss, why softmax function is more stable??

I think it is good work.
Which is a license of these codes?