Trails to compare Relu and Leaky Relu.
Found that Leaky Relu is a bit more stable than Relu on this problem. Noitce that you should change parts of the code (to load the dataset) based on the path of your data.
You can visit http://yann.lecun.com/exdb/mnist/ for the dataset.