Language Modelling for Automatic Language Identification.
A probabilistic language identification system which identifies the language of a given input sentence. The model accepts three languages: English, French, and Portuguese.
Notes:
- All diacritics have been removed.
- Monosyllabic words have not been included in the model.
- Tokens have been separated by space, semicolon, comma, period, colon, ellipsis, question mark, hyphen, ampersand, etc.
(November, 2012)