This literate programming exercise will construct a simple 2-layer feed-forward neural network to compute the exclusive or, using symbolic differentiation to compute the gradients automatically. In total, about 500 lines of code, including comments. The only functional dependency is numpy. I highly recommend reading Chris Olah's Calculus on Computational Graphs: Backpropagation for more background on what this code is doing.
asleda / differentiation Goto Github PK
View Code? Open in Web Editor NEWThis project forked from jimfleming/differentiation
Implementing (parts of) TensorFlow (almost) from Scratch
Home Page: http://jimfleming.me/differentiation/main.html