amarack / python-rl Goto Github PK

Hello,

When I try to run with python -m pyrl.rlglue.run I get the following traceback:

Traceback (most recent call last):
File "/home/jorgedelval/miniconda2/lib/python2.7/runpy.py", line 174, in _run_module_as_main
"main", fname, loader, pkg_name)
File "/home/jorgedelval/miniconda2/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "/home/jorgedelval/edxai/python-rl/pyrl/rlglue/run.py", line 13, in
from pyrl.agents import *
File "pyrl/agents/skeleton_agent.py", line 13, in
from rlglue.agent.Agent import Agent
ImportError: No module named rlglue.agent.Agent

I have installed pyrl with "make" inside the pyrl directory. I'm on Ubuntu 16 64bits.

Did I miss something?

Thank you very much

Hi,

The code in pyrl/Experiments/randomized.py looks for the following function in the method run_experiment

param_parser = self.agent.agent_get_parameters()

should be

param_parser = self.agent.agent_parameters()

as your agents only have agent_parameters()

--Kiril

I would like test REINFORCE algorithm proposed by Williams

after excuting python -m pyrl.rlglue.run

I selected (5): Cart Pole
then I selected (14): REINFORCE
then I selected (1): Episodic

it gives me an error as

Traceback (most recent call last):
File "/usr/lib/python2.7/runpy.py", line 162, in _run_module_as_main
"main", fname, loader, pkg_name)
File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "/home/deepthree/Desktop/deepcontrol/python-rl/pyrl/rlglue/run.py", line 126, in
run(config,local=args.local, result_file=args.output)
File "/home/deepthree/Desktop/deepcontrol/python-rl/pyrl/rlglue/run.py", line 85, in run
experiment = exp(config, agent=agent(*a_args),
File "pyrl/agents/skeleton_agent.py", line 31, in init
self.init_parameters()
File "pyrl/agents/policy_gradient.py", line 123, in init_parameters
super(REINFORCE, self).init_parameters(self)
TypeError: init_parameters() takes exactly 1 argument (2 given)

Is this a bug ?
In fact, if I select other environment (e.g. 1: 3D Mountain Car), it gives me same error

Hi
In the file "pyrl/basis/tilecode.py", line 4, in , there is "from CTiles import tiles" but that file doesn't exist (see the error I got below). I've imported the whole folder and it removes the error.
Best,
Vincent

python -m pyrl.rlglue.run --help

Traceback (most recent call last):
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/runpy.py", line 162, in _run_module_as_main
"main", fname, loader, pkg_name)
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "/Users/vincent/Documents/python-rl-master/pyrl/rlglue/run.py", line 13, in
from pyrl.agents import *
File "pyrl/agents/modelbased.py", line 17, in
from pyrl.agents.planners import fitted_qiteration
File "pyrl/agents/planners/fitted_qiteration.py", line 9, in
import pyrl.basis.tilecode as tilecode
File "pyrl/basis/tilecode.py", line 4, in
from CTiles import tiles
ImportError: cannot import name tiles