Firstly, sorry I posted this as an issue as I wasn't able to find your mail.

Doubt: I am not able to understand whether the solver takes a million steps at solver_->step(1) as mentioned in dqn_solver.txt or only a single step.
According to me 1 step == forward propagate, calculate errors, backpropagate errors and update filter weights.

Can you please clarify this?
Sorry I wasn't able to get this part of caffe documentation.

Thanks!
Regards.

Hello
I am trying to train a network for playing pong ROM, But the results was not good so far, I have trained 5 networks.
After 2 million iterations, my best evaluation score is -12.
I am using default parameters for solver.
My another issue is that the training does not stop after 2 million iterations (max_iter param) and it continues to training.
What is wrong about my experiments?
Thanks in advance

I am trying to install dqn in the caffe.
I cannot find any solution to the following problem.
In the dqn-in-the-caffe directory, I did cmake and then, make, but make command doesn't work well.
There is a problem. I paste the problem below.
Could you tell me a solution ?
Thanks you.

~/dqn-in-the-caffe/build$ make
[ 50%] Building CXX object CMakeFiles/dqn.dir/dqn_main.cpp.o
In file included from /home/mil/ksaito/dqn-in-the-caffe/dqn_main.cpp:3:0:
/home/mil/ksaito/ale_0.4.4/ale_0_4/src/ale_interface.hpp:124:28: warning: ‘auto_ptr’ is deprecated (declared at /usr/include/c++/4.6/backward/auto_ptr.h:87) [-Wdeprecated-declarations]
/home/mil/ksaito/ale_0.4.4/ale_0_4/src/ale_interface.hpp:125:29: warning: ‘auto_ptr’ is deprecated (declared at /usr/include/c++/4.6/backward/auto_ptr.h:87) [-Wdeprecated-declarations]
In file included from /home/mil/ksaito/dqn-in-the-caffe/dqn_main.cpp:6:0:
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:33:19: error: expected nested-name-specifier before ‘yes’
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:33:19: error: using-declaration for non-member at class scope
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:33:23: error: expected ‘;’ before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:33:23: error: expected unqualified-id before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:34:19: error: expected nested-name-specifier before ‘no’
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:34:19: error: using-declaration for non-member at class scope
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:34:23: error: expected ‘;’ before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:34:23: error: expected unqualified-id before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:41:42: error: ‘yes’ does not name a type
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:42:42: error: ‘no’ does not name a type
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:44:46: error: ‘test’ was not declared in this scope
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:44:52: error: expected primary-expression before ‘>’ token
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:44:74: error: ‘yes’ was not declared in this scope
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:45:19: error: expected nested-name-specifier before ‘type’
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:45:19: error: using-declaration for non-member at class scope
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:45:24: error: expected ‘;’ before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:45:24: error: expected unqualified-id before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:53:20: error: ‘yes’ does not name a type
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:57:42: error: ‘no’ does not name a type
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:60:20: error: ‘yes’ does not name a type
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:64:42: error: ‘no’ does not name a type
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:67:50: error: ‘f’ was not declared in this scope
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:67:53: error: expected primary-expression before ‘>’ token
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:67:75: error: ‘yes’ was not declared in this scope
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:68:50: error: ‘g’ was not declared in this scope
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:68:53: error: expected primary-expression before ‘>’ token
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:68:75: error: ‘yes’ was not declared in this scope
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:79:15: error: expected nested-name-specifier before ‘char_type’
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:79:15: error: using-declaration for non-member at class scope
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:79:25: error: expected ‘;’ before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:79:25: error: expected unqualified-id before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:80:15: error: ‘char_type’ does not name a type
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:81:15: error: ‘char_type’ does not name a type
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:82:15: error: ‘char_type’ does not name a type
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:91:15: error: expected nested-name-specifier before ‘type’
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:91:15: error: using-declaration for non-member at class scope
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:91:20: error: expected ‘;’ before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:91:20: error: expected unqualified-id before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:92:22: error: ‘type’ does not name a type
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:106:15: error: expected nested-name-specifier before ‘delimiters_type’
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:106:15: error: using-declaration for non-member at class scope
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:106:31: error: expected ‘;’ before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:106:31: error: expected unqualified-id before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:107:15: error: expected nested-name-specifier before ‘ostream_type’
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:107:15: error: using-declaration for non-member at class scope
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:107:28: error: expected ‘;’ before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:107:28: error: expected unqualified-id before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:112:49: error: ‘ostream_type’ has not been declared
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:139:32: error: ‘ostream_type’ has not been declared
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp: In static member function ‘static void pretty_print::print_container_helper<T, TChar, TCharTraits, TDelimiters>::printer::print_body(const U&, int&)’:
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:128:25: error: ‘delimiters_type’ has not been declared
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:129:35: error: ‘delimiters_type’ has not been declared
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp: In member function ‘void pretty_print::print_container_helper<T, TChar, TCharTraits, TDelimiters>::operator()(int&) const’:
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:141:17: error: ‘delimiters_type’ has not been declared
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:142:27: error: ‘delimiters_type’ has not been declared
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:146:17: error: ‘delimiters_type’ has not been declared
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:147:27: error: ‘delimiters_type’ has not been declared
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp: At global scope:
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:160:15: error: expected nested-name-specifier before ‘ostream_type’
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:160:15: error: using-declaration for non-member at class scope
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:160:28: error: expected ‘;’ before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:160:28: error: expected unqualified-id before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:162:61: error: ‘ostream_type’ has not been declared
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:177:15: error: expected nested-name-specifier before ‘ostream_type’
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:177:15: error: using-declaration for non-member at class scope
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:177:28: error: expected ‘;’ before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:177:28: error: expected unqualified-id before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:178:15: error: expected nested-name-specifier before ‘element_type’
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:178:15: error: using-declaration for non-member at class scope
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:178:28: error: expected ‘;’ before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:178:28: error: expected unqualified-id before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:182:38: error: ‘element_type’ does not name a type
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:182:53: error: ISO C++ forbids declaration of ‘c’ with no type [-fpermissive]
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:182:56: error: ‘ostream_type’ has not been declared
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:187:39: error: ‘element_type’ does not name a type
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:187:52: error: ISO C++ forbids declaration of ‘parameter’ with no type [-fpermissive]
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:187:55: error: ‘ostream_type’ has not been declared
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:191:39: error: ‘element_type’ does not name a type
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:191:54: error: ISO C++ forbids declaration of ‘c’ with no type [-fpermissive]
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:191:57: error: ‘ostream_type’ has not been declared
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:199:39: error: ‘element_type’ does not name a type
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:199:54: error: ISO C++ forbids declaration of ‘c’ with no type [-fpermissive]
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:199:57: error: ‘ostream_type’ has not been declared
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp: In static member function ‘static void pretty_print::print_container_helper<T, TChar, TCharTraits, TDelimiters>::printer<std::tuple<Args ...> >::tuple_print(const int&, int&, typename std::conditional<(sizeof (Args ...) != 0), pretty_print::print_container_helper<T, TChar, TCharTraits, TDelimiters>::printer<std::tuple<Args ...> >::Int<0ul>, std::nullptr_t>::type)’:
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:194:36: error: no matching function for call to ‘get(const int&)’
/home/mil/ksaito/dqn-in-the-caffe/prettyprint.hpp:194:36: note: candidates are:
/usr/include/c++/4.6/utility:133:5: note: template<long unsigned int _Int, class _Tp1, class _Tp2> typename std::tuple_element<_Int, std::pair<_Tp1, _Tp2> >::type& std::get(std::pair<_Tp1, _Tp2>&)
/usr/include/c++/4.6/utility:138:5: note: template<long unsigned int _Int, class _Tp1, class _Tp2> const typename std::tuple_element<_Int, std::pair<_Tp1, _Tp2> >::type& std::get(const std::pair<_Tp1, _Tp2>&)
/usr/include/c++/4.6/tuple:531:5: note: template<long unsigned int __i, class ... _Elements> typename std::__add_ref<typename std::tuple_element<__i, std::tuple<_Elements ...> >::type>::type std::get(std::tuple<_Elements ...>&)
/usr/include/c++/4.6/tuple:538:5: note: template<long unsigned int __i, class ... Elements> typename std::add_c_ref<typename std::tuple_element<i, std::tuple<Elements ...> >::type>::type std::get(const std::tuple<Elements ...>&)
In file included from /home/mil/ksaito/dqn-in-the-caffe/dqn_main.cpp:7:0:
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp: At global scope:
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:27:7: error: expected nested-name-specifier before ‘FrameData’
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:27:7: error: ‘FrameData’ has not been declared
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:27:17: error: expected ‘;’ before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:27:17: error: expected unqualified-id before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:28:7: error: expected nested-name-specifier before ‘FrameDataSp’
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:28:7: error: ‘FrameDataSp’ has not been declared
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:28:19: error: expected ‘;’ before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:28:19: error: expected unqualified-id before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:29:7: error: expected nested-name-specifier before ‘InputFrames’
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:29:7: error: ‘InputFrames’ has not been declared
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:29:19: error: expected ‘;’ before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:29:19: error: expected unqualified-id before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:30:7: error: expected nested-name-specifier before ‘Transition’
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:30:7: error: ‘Transition’ has not been declared
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:30:18: error: expected ‘;’ before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:30:18: error: expected unqualified-id before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:32:7: error: expected nested-name-specifier before ‘FramesLayerInputData’
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:32:7: error: ‘FramesLayerInputData’ has not been declared
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:32:28: error: expected ‘;’ before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:32:28: error: expected unqualified-id before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:33:7: error: expected nested-name-specifier before ‘TargetLayerInputData’
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:33:7: error: ‘TargetLayerInputData’ has not been declared
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:33:28: error: expected ‘;’ before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:33:28: error: expected unqualified-id before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:34:7: error: expected nested-name-specifier before ‘FilterLayerInputData’
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:34:7: error: ‘FilterLayerInputData’ has not been declared
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:34:28: error: expected ‘;’ before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:34:28: error: expected unqualified-id before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:66:29: error: ‘InputFrames’ does not name a type
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:66:42: error: ISO C++ forbids declaration of ‘input_frames’ with no type [-fpermissive]
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:71:28: error: ‘Transition’ does not name a type
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:71:40: error: ISO C++ forbids declaration of ‘transition’ with no type [-fpermissive]
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:82:9: error: expected nested-name-specifier before ‘SolverSp’
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:82:9: error: using-declaration for non-member at class scope
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:82:18: error: expected ‘;’ before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:82:18: error: expected unqualified-id before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:83:9: error: expected nested-name-specifier before ‘NetSp’
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:83:9: error: using-declaration for non-member at class scope
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:83:15: error: expected ‘;’ before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:83:15: error: expected unqualified-id before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:84:9: error: expected nested-name-specifier before ‘BlobSp’
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:84:9: error: using-declaration for non-member at class scope
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:84:16: error: expected ‘;’ before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:84:16: error: expected unqualified-id before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:85:9: error: expected nested-name-specifier before ‘MemoryDataLayerSp’
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:85:9: error: using-declaration for non-member at class scope
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:85:27: error: expected ‘;’ before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:85:27: error: expected unqualified-id before ‘=’ token
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:87:55: error: ‘InputFrames’ does not name a type
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:87:68: error: ISO C++ forbids declaration of ‘last_frames’ with no type [-fpermissive]
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:89:25: error: ‘InputFrames’ was not declared in this scope
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:89:36: error: template argument 1 is invalid
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:89:36: error: template argument 2 is invalid
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:88:41: error: ‘std::vector<std::pair<Action, float> > dqn::DQN::SelectActionGreedily(const int&)’ cannot be overloaded
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:87:28: error: with ‘std::pair<Action, float> dqn::DQN::SelectActionGreedily(const int&)’
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:91:13: error: ‘FramesLayerInputData’ does not name a type
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:91:35: error: ISO C++ forbids declaration of ‘frames_data’ with no type [-fpermissive]
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:92:13: error: ‘TargetLayerInputData’ does not name a type
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:92:35: error: ISO C++ forbids declaration of ‘target_data’ with no type [-fpermissive]
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:93:13: error: ‘FilterLayerInputData’ does not name a type
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:93:35: error: ISO C++ forbids declaration of ‘filter_data’ with no type [-fpermissive]
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:100:14: error: ‘Transition’ was not declared in this scope
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:100:24: error: template argument 1 is invalid
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:100:24: error: template argument 2 is invalid
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:101:3: error: ‘SolverSp’ does not name a type
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:102:3: error: ‘NetSp’ does not name a type
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:103:3: error: ‘BlobSp’ does not name a type
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:104:3: error: ‘MemoryDataLayerSp’ does not name a type
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:105:3: error: ‘MemoryDataLayerSp’ does not name a type
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:106:3: error: ‘MemoryDataLayerSp’ does not name a type
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:107:3: error: ‘TargetLayerInputData’ does not name a type
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp: In member function ‘int dqn::DQN::memory_size() const’:
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:78:51: error: request for member ‘size’ in ‘((const dqn::DQN*)this)->dqn::DQN::replay_memory’, which is of non-class type ‘const int’
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp: At global scope:
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:114:1: error: ‘FrameDataSp’ does not name a type
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:119:29: error: ‘FrameData’ does not name a type
/home/mil/ksaito/dqn-in-the-caffe/dqn.hpp:119:40: error: ISO C++ forbids declaration of ‘frame’ with no type [-fpermissive]
/home/mil/ksaito/dqn-in-the-caffe/dqn_main.cpp: In function ‘double PlayOneEpisode(ALEInterface&, dqn::DQN&, double, bool)’:
/home/mil/ksaito/dqn-in-the-caffe/dqn_main.cpp:41:14: error: ‘FrameDataSp’ is not a member of ‘dqn’
/home/mil/ksaito/dqn-in-the-caffe/dqn_main.cpp:41:14: error: ‘FrameDataSp’ is not a member of ‘dqn’
/home/mil/ksaito/dqn-in-the-caffe/dqn_main.cpp:41:30: error: template argument 1 is invalid
/home/mil/ksaito/dqn-in-the-caffe/dqn_main.cpp:41:30: error: template argument 2 is invalid
/home/mil/ksaito/dqn-in-the-caffe/dqn_main.cpp:41:43: error: invalid type in declaration before ‘;’ token
/home/mil/ksaito/dqn-in-the-caffe/dqn_main.cpp:45:32: error: ‘PreprocessScreen’ is not a member of ‘dqn’
/home/mil/ksaito/dqn-in-the-caffe/dqn_main.cpp:45:69: error: unable to deduce ‘const auto’ from ‘’
/home/mil/ksaito/dqn-in-the-caffe/dqn_main.cpp:49:17: error: request for member ‘push_back’ in ‘past_frames’, which is of non-class type ‘int’
/home/mil/ksaito/dqn-in-the-caffe/dqn_main.cpp:50:21: error: request for member ‘size’ in ‘past_frames’, which is of non-class type ‘int’
/home/mil/ksaito/dqn-in-the-caffe/dqn_main.cpp:56:23: error: request for member ‘size’ in ‘past_frames’, which is of non-class type ‘int’
/home/mil/ksaito/dqn-in-the-caffe/dqn_main.cpp:57:21: error: request for member ‘pop_front’ in ‘past_frames’, which is of non-class type ‘int’
/home/mil/ksaito/dqn-in-the-caffe/dqn_main.cpp:59:7: error: ‘InputFrames’ is not a member of ‘dqn’
/home/mil/ksaito/dqn-in-the-caffe/dqn_main.cpp:59:24: error: expected ‘;’ before ‘input_frames’
/home/mil/ksaito/dqn-in-the-caffe/dqn_main.cpp:60:29: error: request for member ‘begin’ in ‘past_frames’, which is of non-class type ‘int’
/home/mil/ksaito/dqn-in-the-caffe/dqn_main.cpp:60:50: error: request for member ‘end’ in ‘past_frames’, which is of non-class type ‘int’
/home/mil/ksaito/dqn-in-the-caffe/dqn_main.cpp:60:57: error: ‘input_frames’ was not declared in this scope
/home/mil/ksaito/dqn-in-the-caffe/dqn_main.cpp:61:65: error: unable to deduce ‘const aut
o’ from ‘’
/home/mil/ksaito/dqn-in-the-caffe/dqn_main.cpp:77:13: error: ‘Transition’ is not a member of ‘dqn’
/home/mil/ksaito/dqn-in-the-caffe/dqn_main.cpp:78:13: error: ‘Transition’ is not a member of ‘dqn’
/home/mil/ksaito/dqn-in-the-caffe/dqn_main.cpp:82:17: error: ‘PreprocessScreen’ is not a member of ‘dqn’
/home/mil/ksaito/dqn-in-the-caffe/dqn_main.cpp:82:55: error: unable to deduce ‘const auto’ from ‘’
/home/mil/ksaito/ale_0.4.4/ale_0_4/src/ale_interface.hpp: In function ‘void createOSystem(int, char*, std::auto_ptr&, std::auto_ptr&)’:
/home/mil/ksaito/ale_0.4.4/ale_0_4/src/ale_interface.hpp:84:49: warning: ignoring return value of ‘FILE freopen(const char, const char, FILE)’, declared with attribute warn_unused_result [-Wunused-result]
make[2]: ** [CMakeFiles/dqn.dir/dqn_main.cpp.o] Error 1
make[1]: *** [CMakeFiles/dqn.dir/all] Error 2
make: *** [all] Error 2

Sorry I closed the previous issue by mistake?

Here's the exact output I get, when I try to make dqn-in-the-caffe

ajay@ajay-h8-1170uk:$ cd /home/ajay/CppProjects/dqn_caffe/build
ajay@ajay-h8-1170uk:/CppProjects/dqn_caffe/build$ cmake ..
-- Configuring done
-- Generating done
-- Build files have been written to: /home/ajay/CppProjects/dqn_caffe/build
ajay@ajay-h8-1170uk:~/CppProjects/dqn_caffe/build$ make
[ 50%] Building CXX object CMakeFiles/dqn.dir/dqn_main.cpp.o
In file included from /home/ajay/bin/caffe/include/caffe/caffe.hpp:7:0,
from /home/ajay/CppProjects/dqn_caffe/dqn.hpp:10,
from /home/ajay/CppProjects/dqn_caffe/dqn_main.cpp:7:
/home/ajay/bin/caffe/include/caffe/blob.hpp:5:34: fatal error: caffe/proto/caffe.pb.h: No such file or directory

include "caffe/proto/caffe.pb.h"

^
compilation terminated.
make[2]: *** [CMakeFiles/dqn.dir/dqn_main.cpp.o] Error 1
make[1]: *** [CMakeFiles/dqn.dir/all] Error 2
make: *** [all] Error 2

and the CMakeLists.txt I using for cmake

cmake_minimum_required (VERSION 2.6)
project(dqn)

option(CPU_ONLY "Use CPU only for Caffe" ON)
option(USE_CUDNN "Use cuDNN for Caffe" OFF)
option(USE_SDL "Use SDL for ALE" ON)

include_directories(/usr/local/caffe/include)

include_directories(/usr/local/ale_cpp/ale_0.4.4/ale_0_4/src)

link_directories(/usr/local/caffe/build/lib)

link_directories(/usr/local/ale_cpp/ale_0.4.4/ale_0_4)

include_directories(/home/ajay/bin/caffe/include)
include_directories(/usr/local/ale_cpp/ale_0.4.4/ale_0_4/src)
link_directories(/home/ajay/bin/caffe/build/lib)
link_directories(/usr/local/ale_cpp/ale_0.4.4/ale_0_4)

if(USE_CUDNN)
link_directories(~/cudnn-6.5-linux-R1)
endif()

add_executable(dqn dqn_main.cpp dqn.cpp)

set(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} -std=c++11 -O3 -march=native")

target_link_libraries(dqn caffe)
target_link_libraries(dqn glog)
target_link_libraries(dqn gflags)
target_link_libraries(dqn ale)

It definitely seems like its a problem with how I'm installing caffe, but it passes all the tests, and works for MNIST? I've tried to reinstall it 3 times but no luck?

Is the left player or right player controlled by dqn? I can't find clue from your code.

aal@aal-ThinkPad-S5-S540:~/Downloads/dqn-in-the-caffe-master$ ./dqn -gui
A.L.E: Arcade Learning Environment (version 0.5.1)
[Powered by Stella]
Use -help for help screen.
Game console created:
ROM file: breakout.bin
Cart Name: Breakout - Breakaway IV (1978) (Atari)
Cart MD5: f34f08e5eb96e500e851a80be3277a56
Display Format: AUTO-DETECT ==> NTSC
ROM Size: 2048
Bankswitch Type: AUTO-DETECT ==> 2K

Screen display requires directive __USE_SDL to be defined. Please recompile with flag '-D__USE_SDL'. See makefile for more information.

My CMakeLists.txt
cmake_minimum_required (VERSION 2.6)
project(dqn)

option(CPU_ONLY "Use CPU only for Caffe" ON)
option(USE_CUDNN "Use cuDNN for Caffe" OFF)
option(USE_SDL "Use SDL for ALE" ON)

include_directories(/home/aal/Downloads/dqn-in-the-caffe-master/caffe/distribute/include)
include_directories(/home/aal/Downloads/Arcade-Learning-Environment-master/src)
include_directories(/usr/include/SDL)
link_directories(/home/aal/Downloads/dqn-in-the-caffe-master/caffe/build/lib)
link_directories(/home/aal/Downloads/Arcade-Learning-Environment-master/build/CMakeFiles)
if(USE_CUDNN)
link_directories(~/cudnn-6.5-linux-R1)
endif()

add_executable(dqn dqn_main.cpp dqn.cpp)

set(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} -std=c++11 -O3 -march=native")

target_link_libraries(dqn caffe)
target_link_libraries(dqn glog)
target_link_libraries(dqn gflags)
target_link_libraries(dqn ale)
target_link_libraries(dqn /usr/local/lib/libale.so)

if(APPLE)
include_directories(/System/Library/Frameworks/vecLib.framework/Versions/Current/Headers)
endif()

if(USE_SDL)
add_definitions(-D__USE_SDL)
if(APPLE)
set(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} -framework Cocoa")
target_link_libraries(dqn sdl)
target_link_libraries(dqn sdl_gfx)
target_link_libraries(dqn sdl_image)
target_link_libraries(dqn sdlmain)
else()
target_link_libraries(dqn SDL)
target_link_libraries(dqn SDL_gfx)
target_link_libraries(dqn SDL_image)
target_link_libraries(dqn SDLmain)
endif()
endif()

if(NOT CPU_ONLY)
include_directories(/usr/local/cuda-6.5/targets/x86_64-linux/include)
endif()

if(CPU_ONLY)
add_definitions(-DCPU_ONLY)
endif()

if(USE_CUDNN)
target_link_libraries(dqn cudnn)
endif()

Any help?
Thank you in advance

Could you share the source or the link of Arcade Learning Environment

Hello,

I'm trying to compile your code (I changed the absolute paths on the CMakeLists.txt and I download/compiled your Caffe code). When the makefile starts to link, I get the following error:

Undefined symbols for architecture x86_64:
  "caffe::Net<float>::blob_by_name(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&)", referenced from:
      dqn::DQN::Initialize() in dqn.cpp.o
  "caffe::Net<float>::layer_by_name(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&)", referenced from:
      dqn::DQN::Initialize() in dqn.cpp.o
      dqn::DQN::Update() in dqn.cpp.o
  "caffe::Net<float>::CopyTrainedLayersFrom(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >)", referenced from:
      dqn::DQN::LoadTrainedModel(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) in dqn.cpp.o
ld: symbol(s) not found for architecture x86_64
clang: error: linker command failed with exit code 1 (use -v to see invocation)
make[2]: *** [dqn] Error 1
make[1]: *** [CMakeFiles/dqn.dir/all] Error 2
make: *** [all] Error 2

I don't know how I can solve this problem. If it helps, my CMakeLists.txt file is below:

cmake_minimum_required (VERSION 2.6)
project(dqn)

option(CPU_ONLY "Use CPU only for Caffe" ON)
option(USE_CUDNN "Use cuDNN for Caffe" OFF)
option(USE_SDL "Use SDL for ALE" ON)

#caffe/caffe.hpp
include_directories(~/Research/caffe-dqn/include)
#ale_interface.hpp
include_directories(~/Research/ALE_dev/src)

link_directories(~/Research/caffe-dqn/build/lib)
link_directories(~/Research/ALE_dev/)
if(USE_CUDNN)
  link_directories(~/cudnn-6.5-linux-R1)
endif()

add_executable(dqn dqn_main.cpp dqn.cpp)

set(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} -std=c++11 -O3 -march=native")

target_link_libraries(dqn caffe)
target_link_libraries(dqn glog)
target_link_libraries(dqn gflags)
target_link_libraries(dqn ale)

if(APPLE)
  #cblas.h
  include_directories(/System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/Headers)
endif()

if(USE_SDL)
  add_definitions(-D__USE_SDL)
  if(APPLE)
    set(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} -framework Cocoa")
    target_link_libraries(dqn sdl)
    target_link_libraries(dqn sdl_gfx)
    target_link_libraries(dqn sdl_image)
    target_link_libraries(dqn sdlmain)
  else()
    target_link_libraries(dqn SDL)
    target_link_libraries(dqn SDL_gfx)
    target_link_libraries(dqn SDL_image)
    target_link_libraries(dqn SDLmain)
  endif()
endif()

if(NOT CPU_ONLY)
  include_directories(/usr/local/cuda-6.5/targets/x86_64-linux/include)
endif()

if(CPU_ONLY)
  add_definitions(-DCPU_ONLY)
endif()

if(USE_CUDNN)
  target_link_libraries(dqn cudnn)
endif()

Thanks in advance.

Hi, I am modifying the program for my project.
When I see the code, muupan used only one network to solve the problem.
However, if you use one network, the issue of the non-stationary targets will be encountered.
I also tested the code with one week(without GPU) and not getting high score, but the code get over 50 sometimes.
Is there someone developing DQN with two network in the same code and test it?
Let me know.
Thanks.

Hi, I use the caffe-dqn as the caffe, and when I do make, I got this.

CMakeFiles/dqn.dir/dqn_main.cpp.o: In function `PlayOneEpisode(ALEInterface&, dqn::DQN&, double, bool)':
dqn_main.cpp:(.text+0xd14): undefined reference to `DisplayScreen::display_screen(MediaSource const&)'
dqn_main.cpp:(.text+0x1124): undefined reference to `DisplayScreen::display_screen(MediaSource const&)'
CMakeFiles/dqn.dir/dqn_main.cpp.o: In function `PlayOneEpisode(ALEInterface&, dqn::DQN&, double, bool) [clone .constprop.106]':
dqn_main.cpp:(.text+0x2414): undefined reference to `DisplayScreen::display_screen(MediaSource const&)'
dqn_main.cpp:(.text+0x283c): undefined reference to `DisplayScreen::display_screen(MediaSource const&)'
CMakeFiles/dqn.dir/dqn_main.cpp.o: In function `main':
dqn_main.cpp:(.text.startup+0xc20): undefined reference to `DisplayScreen::display_screen(MediaSource const&)'
CMakeFiles/dqn.dir/dqn_main.cpp.o:dqn_main.cpp:(.text.startup+0x10a8): more undefined references to `DisplayScreen::display_screen(MediaSource const&)' follow
collect2: error: ld returned 1 exit status
make[2]: *** [dqn] Error 1
make[1]: *** [CMakeFiles/dqn.dir/all] Error 2
make: *** [all] Error 2

By the way, there are also some warnnings:

In file included from /home/tyler_asus/Software/dqn-in-the-caffe/dqn_main.cpp:3:0:
/home/tyler_asus/Software/ale_0.4.4/ale_0_4/src/ale_interface.hpp:124:28: warning: ‘auto_ptr’ is deprecated (declared at /usr/include/c++/4.8/backward/auto_ptr.h:87) [-Wdeprecated-declarations]
     std::auto_ptr<OSystem> theOSystem;
                            ^
/home/tyler_asus/Software/ale_0.4.4/ale_0_4/src/ale_interface.hpp:125:29: warning: ‘auto_ptr’ is deprecated (declared at /usr/include/c++/4.8/backward/auto_ptr.h:87) [-Wdeprecated-declarations]
     std::auto_ptr<Settings> theSettings;
                             ^
/home/tyler_asus/Software/ale_0.4.4/ale_0_4/src/ale_interface.hpp: In function ‘void createOSystem(int, char**, std::auto_ptr<OSystem>&, std::auto_ptr<Settings>&)’:
/home/tyler_asus/Software/ale_0.4.4/ale_0_4/src/ale_interface.hpp:84:49: warning: ignoring return value of ‘FILE* freopen(const char*, const char*, FILE*)’, declared with attribute warn_unused_result [-Wunused-result]
         freopen(outputFile.c_str(), "w", stdout);

Where did you get a version of pong.bin to test? I was using the atari 2600 version and getting on average about a -10 score. mhauskn was saying he though you were using a different version of pong that would train up to maybe +10. Is that correct? Want to make sure understand things.

Thanks

envy@ub1404:/media/envy/data1t/os_prj/github/_deepmind/dqn-in-the-caffe$ cmake .
-- The C compiler identification is GNU 4.8.4
-- The CXX compiler identification is GNU 4.8.4
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Configuring done
-- Generating done
-- Build files have been written to: /media/envy/data1t/os_prj/github/_deepmind/dqn-in-the-caffe
envy@ub1404:/media/envy/data1t/os_prj/github/_deepmind/dqn-in-the-caffe$ make
Scanning dependencies of target dqn
[ 50%] Building CXX object CMakeFiles/dqn.dir/dqn_main.cpp.o
/media/envy/data1t/os_prj/github/_deepmind/dqn-in-the-caffe/dqn_main.cpp:3:29: fatal error: ale_interface.hpp: No such file or directory
#include <ale_interface.hpp>
^
compilation terminated.
make[2]: *** [CMakeFiles/dqn.dir/dqn_main.cpp.o] Error 1
make[1]: *** [CMakeFiles/dqn.dir/all] Error 2
make: *** [all] Error 2
envy@ub1404:/media/envy/data1t/os_prj/github/_deepmind/dqn-in-the-caffe$ make

@muupan
Hello
My training job has been aborted, How can I resume training from my snapshot files?
Thanks

Hi, I seem to have no problems running the project with CPU. When I make the following changes to try and comiple and run with GPU, I get a run time error.

CMakeLists.txt change

option(CPU_ONLY "Use CPU only for Caffe" OFF)

Change dqn_main.cpp change

DEFINE_bool(gpu, true, "Use GPU to brew Caffe");

Run command

./dqn FLAGS_gpu true

Output is

layers {
bottom: "filtered_q_values"
bottom: "target"
top: "loss"
name: "loss"
type: EUCLIDEAN_LOSS
}
state {
phase: TRAIN
}
I0122 00:46:38.028017 13190 layer_factory.hpp:78] Creating layer frames_input_layer
I0122 00:46:38.028039 13190 net.cpp:67] Creating Layer frames_input_layer

BLAH BLAH BLAH

I0122 00:46:38.028966 13190 net.cpp:394] conv1_layer <- frames
I0122 00:46:38.028975 13190 net.cpp:356] conv1_layer -> conv1
I0122 00:46:38.028986 13190 net.cpp:96] Setting up conv1_layer
*** Aborted at 1421887598 (unix time) try "date -d @1421887598" if you are using GNU date ***
PC: @ 0x7f9dd4bdb600 (unknown)
*** SIGSEGV (@0x1) received by PID 13190 (TID 0x7f9dd517f800) from PID 1; stack trace: ***
@ 0x7f9dd30bed40 (unknown)
@ 0x7f9dd4bdb600 (unknown)
@ 0x7f9dd4be2776 caffe::caffe_rng_gaussian<>()
@ 0x7f9dd4b9e439 caffe::GaussianFiller<>::Fill()
@ 0x7f9dd4bd9d7b caffe::ConvolutionLayer<>::LayerSetUp()
@ 0x7f9dd4b59ae9 caffe::Net<>::Init()
@ 0x7f9dd4b5b4fe caffe::Net<>::Net()
@ 0x7f9dd4b751e0 caffe::Solver<>::InitTrainNet()
@ 0x7f9dd4b76496 caffe::Solver<>::Init()
@ 0x7f9dd4b765fd caffe::Solver<>::Solver()
@ 0x417ea3 caffe::GetSolver<>()
@ 0x415caa dqn::DQN::Initialize()
@ 0x40748a main
@ 0x7f9dd30a9ec5 (unknown)
@ 0x409798 (unknown)
Segmentation fault (core dumped)

Hi, when tying to construct solver, following error occurs, which suggests the shape of filter layer (32,18,1,1) does not match q_values (32, 18). Any idea? Thank you very much!

I0916 20:53:52.315197 2321 net.cpp:127] Top shape: 32 18 (576)
I0916 20:53:52.315212 2321 layer_factory.hpp:74] Creating layer eltwise_layer
I0916 20:53:52.315240 2321 net.cpp:90] Creating Layer eltwise_layer
I0916 20:53:52.315249 2321 net.cpp:410] eltwise_layer <- q_values
I0916 20:53:52.315259 2321 net.cpp:410] eltwise_layer <- filter
I0916 20:53:52.315270 2321 net.cpp:368] eltwise_layer -> filtered_q_values
I0916 20:53:52.315284 2321 net.cpp:120] Setting up eltwise_layer
F0916 20:53:52.315300 2321 eltwise_layer.cpp:35] Check failed: bottom[i]->shape() == bottom[0]->shape()

What parameters were used to learn the pong player showed in the video (https://www.youtube.com/watch?v=p88R2_3yWPA)? Specifically what is the gamma/memory size/iterations needed to train dqn? I attempted to retrain the agent using the default parameters but it shows no progress after 2-million iterations.

Thanks in advance, and very cool repo!

Hi, I really like your code! I'm trying to compile it and I get the following error,

ajay@ajay-h8-1170uk:~/CppProjects/dqn_caffe/build$ make Scanning dependencies of target dqn [ 50%] Building CXX object CMakeFiles/dqn.dir/dqn_main.cpp.o In file included from /usr/local/caffe/include/caffe/caffe.hpp:7:0, from /home/ajay/CppProjects/dqn_caffe/dqn.hpp:10, from /home/ajay/CppProjects/dqn_caffe/dqn_main.cpp:7: /usr/local/caffe/include/caffe/blob.hpp:5:34: fatal error: caffe/proto/caffe.pb.h: No such file or directory #include "caffe/proto/caffe.pb.h" ^ compilation terminated. make[2]: *** [CMakeFiles/dqn.dir/dqn_main.cpp.o] Error 1 make[1]: *** [CMakeFiles/dqn.dir/all] Error 2 make: *** [all] Error 2
My build of caffe works, but maybe there's a legacy problem?

Is it possible to get the video file? I would like to use this in a presentation at my job.

Hello
Thanks for your code.
I have tried to compile and run the code.
Compile was OK but it gives me the following error at runtime.
It seems that the problem is related to ALE interface, but my ALE works fine separately.
I am using recommended versions of ALE and caffe
Thanks

A.L.E: Arcade Learning Environment (version 0.4)
[Powered by Stella]
Use -help for help screen.
*** glibc detected * ./dqn: corrupted double-linked list: 0x00000000019b95f0 ***
======= Backtrace: =========
/lib64/libc.so.6[0x3d5ec75e66]
/lib64/libc.so.6[0x3d5ec762ed]
/lib64/libc.so.6[0x3d5ec79125]
/lib64/libc.so.6(__libc_malloc+0x71)[0x3d5ec7a6b1]
/apps/GCC/4.8.3/lib64/libstdc++.so.6(_Znwm+0x1d)[0x2ac4239f52bd]
/apps/GCC/4.8.3/lib64/libstdc++.so.6(_Znam+0x9)[0x2ac4239f53b9]
/home/mn/ale_0.4.4/ale_0_4/libale.so(_ZN8Settings11setInternalERKSsS1_ib+0x243)[0x2ac422f7acf3]
/home/mn/ale_0.4.4/ale_0_4/libale.so(_ZN8SettingsC1EP7OSystem+0xaa)[0x2ac422f7f48a]
/home/mn/ale_0.4.4/ale_0_4/libale.so(_ZN12SettingsUNIXC1EP7OSystem+0x16)[0x2ac422fab256]
./dqn(_ZN12ALEInterface7loadROMESs+0x164)[0x40a504]
./dqn(main+0x87)[0x40cbe7]
/lib64/libc.so.6(__libc_start_main+0xfd)[0x3d5ec1ed5d]
./dqn[0x406b49]
======= Memory map: ========
00400000-0041d000 r-xp 00000000 00:18 9001770 /home/mn/caffe-dqn-old/dqn-in-the-caffe-master/dqn
0061d000-0061e000 rw-p 0001d000 00:18 9001770 /home/mn/caffe-dqn-old/dqn-in-the-caffe-master/dqn
0194c000-019d0000 rw-p 00000000 00:00 0 [heap]
3cf8400000-3cf8434000 r-xp 00000000 08:03 32506823 /usr/lib64/libfontconfig.so.1.4.4
3cf8434000-3cf8634000 ---p 00034000 08:03 32506823 /usr/lib64/libfontconfig.so.1.4.4
3cf8634000-3cf8636000 rw-p 00034000 08:03 32506823 /usr/lib64/libfontconfig.so.1.4.4
3cf8800000-3cf8898000 r-xp 00000000 08:03 32513694 /usr/lib64/libfreetype.so.6.3.22
3cf8898000-3cf8a97000 ---p 00098000 08:03 32513694 /usr/lib64/libfreetype.so.6.3.22
3cf8a97000-3cf8a9d000 rw-p 00097000 08:03 32513694 /usr/lib64/libfreetype.so.6.3.22
3cf8c00000-3cf8c2a000 r-xp 00000000 08:03 32510995 /usr/lib64/libpangoft2-1.0.so.0.2800.1
3cf8c2a000-3cf8e29000 ---p 0002a000 08:03 32510995 /usr/lib64/libpangoft2-1.0.so.0.2800.1
3cf8e29000-3cf8e2b000 rw-p 00029000 08:03 32510995 /usr/lib64/libpangoft2-1.0.so.0.2800.1
3cf9000000-3cf900b000 r-xp 00000000 08:03 32507285 /usr/lib64/libpangocairo-1.0.so.0.2800.1
3cf900b000-3cf920b000 ---p 0000b000 08:03 32507285 /usr/lib64/libpangocairo-1.0.so.0.2800.1
3cf920b000-3cf920c000 rw-p 0000b000 08:03 32507285 /usr/lib64/libpangocairo-1.0.so.0.2800.1
3cf9400000-3cf9476000 r-xp 00000000 08:03 32513760 /usr/lib64/libcairo.so.2.10800.8
3cf9476000-3cf9676000 ---p 00076000 08:03 32513760 /usr/lib64/libcairo.so.2.10800.8
3cf9676000-3cf9679000 rw-p 00076000 08:03 32513760 /usr/lib64/libcairo.so.2.10800.8
3cf9800000-3cf9c73000 r-xp 00000000 08:03 32513852 /usr/lib64/libgtk-x11-2.0.so.0.2400.23
3cf9c73000-3cf9e73000 ---p 00473000 08:03 32513852 /usr/lib64/libgtk-x11-2.0.so.0.2400.23
3cf9e73000-3cf9e7e000 rw-p 00473000 08:03 32513852 /usr/lib64/libgtk-x11-2.0.so.0.2400.23
3cf9e7e000-3cf9e80000 rw-p 00000000 00:00 0
3cfa000000-3cfa0bb000 r-xp 00000000 08:03 32507037 /usr/lib64/libgdk-x11-2.0.so.0.2400.23
3cfa0bb000-3cfa2bb000 ---p 000bb000 08:03 32507037 /usr/lib64/libgdk-x11-2.0.so.0.2400.23
3cfa2bb000-3cfa2c0000 rw-p 000bb000 08:03 32507037 /usr/lib64/libgdk-x11-2.0.so.0.2400.23
3d5e800000-3d5e820000 r-xp 00000000 08:03 56623130 /lib64/ld-2.12.so
3d5ea1f000-3d5ea20000 r--p 0001f000 08:03 56623130 /lib64/ld-2.12.so
3d5ea20000-3d5ea21000 rw-p 00020000 08:03 56623130 /lib64/ld-2.12.so
3d5ea21000-3d5ea22000 rw-p 00000000 00:00 0
3d5ec00000-3d5ed8a000 r-xp 00000000 08:03 56623132 /lib64/libc-2.12.so
3d5ed8a000-3d5ef8a000 ---p 0018a000 08:03 56623132 /lib64/libc-2.12.so
3d5ef8a000-3d5ef8e000 r--p 0018a000 08:03 56623132 /lib64/libc-2.12.so
3d5ef8e000-3d5ef8f000 rw-p 0018e000 08:03 56623132 /lib64/libc-2.12.so
3d5ef8f000-3d5ef94000 rw-p 00000000 00:00 0
3d5f000000-3d5f002000 r-xp 00000000 08:03 56623234 /lib64/libdl-2.12.so
3d5f002000-3d5f202000 ---p 00002000 08:03 56623234 /lib64/libdl-2.12.so
3d5f202000-3d5f203000 r--p 00002000 08:03 56623234 /lib64/libdl-2.12.so
3d5f203000-3d5f204000 rw-p 00003000 08:03 56623234 /lib64/libdl-2.12.so
3d5f400000-3d5f417000 r-xp 00000000 08:03 56623134 /lib64/libpthread-2.12.so
3d5f417000-3d5f617000 ---p 00017000 08:03 56623134 /lib64/libpthread-2.12.so
3d5f617000-3d5f618000 r--p 00017000 08:03 56623134 /lib64/libpthread-2.12.so
3d5f618000-3d5f619000 rw-p 00018000 08:03 56623134 /lib64/libpthread-2.12.so
3d5f619000-3d5f61d000 rw-p 00000000 00:00 0
3d5f800000-3d5f883000 r-xp 00000000 08:03 56623460 /lib64/libm-2.12.so
3d5f883000-3d5fa82000 ---p 00083000 08:03 56623460 /lib64/libm-2.12.so
3d5fa82000-3d5fa83000 r--p 00082000 08:03 56623460 /lib64/libm-2.12.so
3d5fa83000-3d5fa84000 rw-p 00083000 08:03 56623460 /lib64/libm-2.12.so
3d5fc00000-3d5fc07000 r-xp 00000000 08:03 56623467 /lib64/librt-2.12.so
3d5fc07000-3d5fe06000 ---p 00007000 08:03 56623467 /lib64/librt-2.12.so
3d5fe06000-3d5fe07000 r--p 00006000 08:03 56623467 /lib64/librt-2.12.so
3d5fe07000-3d5fe08000 rw-p 00007000 08:03 56623467 /lib64/librt-2.12.so
3d60000000-3d60015000 r-xp 00000000 08:03 56623474 /lib64/libz.so.1.2.3
3d60015000-3d60214000 ---p 00015000 08:03 56623474 /lib64/libz.so.1.2.3
3d60214000-3d60215000 r--p 00014000 08:03 56623474 /lib64/libz.so.1.2.3
3d60215000-3d60216000 rw-p 00015000 08:03 56623474 /lib64/libz.so.1.2.3
3d60400000-3d604db000 r-xp 00000000 08:03 32510838 /usr/lib64/libgstreamer-0.10.so.0.25.0* Aborted at 1427614429 (unix time) try "date -d @1427614429" if you are using GNU date ***
PC: @ 0x3d5ec32625 (unknown)
*** SIGABRT (@0x4edd00006d34) received by PID 27956 (TID 0x2ac42df8b9c0) from PID 27956; stack trace: ***
@ 0x3d5ec326a0 (unknown)
@ 0x3d5ec32625 (unknown)
@ 0x3d5ec33e05 (unknown)
@ 0x3d5ec70537 (unknown)
@ 0x3d5ec75e66 (unknown)
@ 0x3d5ec762ed (unknown)
@ 0x3d5ec79125 (unknown)
@ 0x3d5ec7a6b1 (unknown)
@ 0x2ac4239f52bd operator new()
@ 0x2ac4239f53b9 operator new
@ 0x2ac422f7acf3 Settings::setInternal()
@ 0x2ac422f7f48a Settings::Settings()
@ 0x2ac422fab256 SettingsUNIX::SettingsUNIX()
@ 0x40a504 ALEInterface::loadROM()
@ 0x40cbe7 main
@ 0x3d5ec1ed5d (unknown)
@ 0x406b49 (unknown)
Aborted (core dumped)