seannaren / qlearningexample.torch Goto Github PK
View Code? Open in Web Editor NEWImplementation of a simple example of Q learning in Torch.
License: MIT License
Implementation of a simple example of Q learning in Torch.
License: MIT License
@SeanNaren would you suggest something to visualize the trained model? Maybe an extra script using display or another better way. Maybe in iTorch?
In Train.lua, there is one bug. At line 82, the code is as follows:
local target = model:forward(memoryInput.inputState)
--Gives us Q_sa, the max q for the next state.
local nextStateMaxQ = torch.max(model:forward(memoryInput.nextState), 1)[1]
As you can see, we call model:forward two times.
But after second call of model:forward, target tensor is also changed.
I don't know whether it's a bug of Torch or not.
To learn correctly, you should change above code at line 82 as follows:
local target = model:forward(memoryInput.inputState):clone()
After that when we learn Train.lua, we could see err is diminishing and WinCount is increasing more rapidly.
Anyway, I'd like to thank you for your endeavor. I learned a lot about RL from your code.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.