Resetting different components of PILCO: Models, controller and reward function about pilco HOT 6 CLOSED

Working on this I decided to print some extra information about the 'Tensorflow' graph in 6882111, and it seems like the number of operations in the graph increases for every iteration (the number of variables stays the same). I assumed this was because the number of data points increases, but after reducing the number of data points collected per run (a smaller horizon, T=10 instead of 40), the number of operations in the graph keeps increasing with the same pace (about 4000 per optimisation run). If this is unnecessary we are wasting a lot of time. Do you think it's normal @nrontsis ?

from pilco.

Very interesting, thanks for digging it up.

It might be related to this.

I will try to investigate today (unless the usual :P )

from pilco.

@kyr-pol which TF version are you using? I am getting deprecation warnings on 6882111:

WARNING:tensorflow:From inverted_pendulum.py:142: all_variables (from tensorflow.python.ops.variables) is deprecated and will be removed after 2017-03-02.

from pilco.

It seems that the problem is with gpflow's minimizer, as described here, and I think this would fix it.

from pilco.

I am running 1.6.0, I'm getting the warning too, just didn't notice it in the output. I'll replace the deprecated function. Good, that looks like the issue we are having, let's see what work around is favoured.

from pilco.

@kyr-pol I think that I fixed it in a88e6e1 but Travis is complaining for some reason.

from pilco.