manuel-silvan / simple-language-recognition-in-european-parliament-proceedings-parallel-corpus Goto Github PK
View Code? Open in Web Editor NEWThe European Parliament Proceedings Parallel Corpus (1996-2011) (https://www.statmt.org/europarl/) is a well-known dataset in Natural Language Processing tasks, it contains proceedings of the European Parliament in 21 European languages. In this project we will only extract data from 6 languages (German, French, Spanish, Italian, Polish and English), we will extract, preprocess, clean and normalize the data and after that we will train on that data some quite simple classifiers that will be able to tell in which language a sentence is written. This was originally a project i did on university.