Git Product home page Git Product logo

dqn-tensorflow-dongjunlee's Introduction

Deep Q Network

Paper

TO DO

  • Test: Atari
    • more complex ConvNet model
  • use TensorBoard
    • average loss
    • average q
    • average reward (consecutive 100 episode)
    • episode reward

Config

python main.py -h

  --discount_rate DISCOUNT_RATE
                        Initial discount rate.
  --replay_memory_length REPLAY_MEMORY_LENGTH
                        Number of replay memory episode.
  --target_update_count TARGET_UPDATE_COUNT
                        DQN Target Network update count.
  --max_episode_count MAX_EPISODE_COUNT
                        Number of maximum episodes.
  --batch_size BATCH_SIZE
                        Batch size. (Must divide evenly into the dataset
                        sizes)
  --frame_size FRAME_SIZE
                        Frame size. (Stack env's observation T-n ~ T)
  --model_name MODEL_NAME
                        DeepLearning Network Model name (MLPv1, ConvNetv1)
  --learning_rate LEARNING_RATE
                        Batch size. (Must divide evenly into the dataset
                        sizes)
  --gym_result_dir GYM_RESULT_DIR
                        Directory to put the gym results.
  --gym_env GYM_ENV     Name of Open Gym's enviroment name. (CartPole-v0,
                        CartPole-v1, MountainCar-v0)
  --step_verbose [STEP_VERBOSE]
                        verbose every step count
  --step_verbose_count STEP_VERBOSE_COUNT
                        verbose step count

Model

1. MLPv1

  • hidden layer (16, 64, 32)
  • AdamOptimizer

2. ConvNetv1

  • 3 Conv + MaxPool Layers (kernel_size [3, 3, 3], filters [32, 64, 128])
  • 2 Fully Connected Layers (hidden_size [128, 32])
  • AdamOptimizer

3. ConvNetv2

  • 5 Conv + MaxPool Layers (kernel_size [7, 5, 3, 3, 3], filters [126, 256, 512, 512, 512]
  • 2 Fully Connected Layers (hidden_size [1024, 256])
  • AdamOptimizer

Expertiments

Classic control

CartPole-v0 CartPole-v1 MountainCar-v0
defines "solving" as getting average reward of 195.0 over 100 consecutive trials. defines "solving" as getting average reward of 475.0 over 100 consecutive trials. defines "solving" as getting average reward of -110.0 over 100 consecutive trials.
Model : MLPv1 Model : MLPv1 Model : MLPv1
Clear : after 177 episode Clear : after 791 episode Clear : after 1182 episode
images images images

Atari

Assault-ram-v0
Maximize your score
Model : ConvNetv2
Score : 421.12 (average from 100 consecutive trials)
images
2000 Episode (Learn something.. but still stupid)
Breakout-ram-v0
Maximize your score
Model : ConvNetv1
Score : 9.69 (average from 100 consecutive trials)

Reference

dqn-tensorflow-dongjunlee's People

Contributors

dongjunlee avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.