jbremz/idiom-check

Simple language identification models (99.77% Accuracy)

idiom-check

Language identification using ngram frequency distributions (at the character level), Markov chain MLE and LSTM's.

See the notebook for a detailed overview of the models.

Datasets

Train: European Parliament Proceedings Parallel Corpus

Test: Here