Working through a re-creation of LeNet 5 from scratch, without using existing deep learning packages.
Data and paper link: http://yann.lecun.com/exdb/mnist/
Build:
./download-mnist.sh # download the MNIST images to ./mnist-data
cabal run
Work-in-progress:
- Loading MNIST images and label sets from raw binary
- Convolution layer forward evaluation
- Convolution layer back-propagation
- CI
- Numerical test of gradient for convolution layer
- Sigmoidal activation function
- Sub-sampling layer forward evaluation
- Sub-sampling layer back-propagation
- Fully-connected layer forward evaluation
- Fully-connected layer back-propagation
- RBF units