- Preprocessing techniques like removing stopwords, punctuations, and contractions
- Custom word encoding and decoding using a Words class
- Attention mechanism implemented from scratch to capture important parts of the input sequence
- Achieved a train accuracy of 87% and validation accuracy of 88% on the Amazon Fine Food Reviews dataset
nilaygaitonde / attention Goto Github PK
View Code? Open in Web Editor NEWMachine translation and Sentiment Analysis with the (scaled dot product) attention mechanism