yrlu / reinforcement_learning Goto Github PK

Hi,

I am trying to run your code with tf 1.0.0, beside some changes like mul to multiply I have the following error:

ddpg$ python pendulum_ddpg.py --device=cpu --episodes=300

Namespace(device='cpu', episodes=300, log_dir='/tmp/pendulum-log-0')
[2017-04-04 20:02:25,839] Making new env: Pendulum-v0
Traceback (most recent call last):
File "pendulum_ddpg.py", line 95, in
critic = CriticNetwork(state_size=STATE_SIZE, action_size=ACTION_SIZE, lr=CRITIC_LEARNING_RATE, tau=TAU)
File "/home/amir-ai/DDPG-Codes/stormmax-TF-VERSION-MISMACH/reinforcement_learning-master/ddpg/critic.py", line 27, in init
self.input_s, self.action, self.critic_variables, self.q_value = self._build_network("critic")
File "/home/amir-ai/DDPG-Codes/stormmax-TF-VERSION-MISMACH/reinforcement_learning-master/ddpg/critic.py", line 44, in _build_network
layer_2 = tf_utils.fc(tf.concat(1, (layer_1, action)), self.n_h2, scope="fc2", activation_fn=tf.nn.relu,
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/ops/array_ops.py", line 1029, in concat
dtype=dtypes.int32).get_shape(
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/framework/ops.py", line 637, in convert_to_tensor
as_ref=False)
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/framework/ops.py", line 702, in internal_convert_to_tensor
ret = conversion_func(value, dtype=dtype, name=name, as_ref=as_ref)
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/framework/constant_op.py", line 110, in _constant_tensor_conversion_function
return constant(v, dtype=dtype, name=name)
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/framework/constant_op.py", line 99, in constant
tensor_util.make_tensor_proto(value, dtype=dtype, shape=shape, verify_shape=verify_shape))
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/framework/tensor_util.py", line 367, in make_tensor_proto
_AssertCompatible(values, dtype)
File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/framework/tensor_util.py", line 302, in _AssertCompatible
(dtype.name, repr(mismatch), type(mismatch).name))
TypeError: Expected int32, got list containing Tensors of type '_Message' instead.

Could you tell me how to fix? and what is your tf version and if you have upgraded to tf 1.0.0?

Thanks,