Mehrdadghassabi/ngram_next_token_prediction

ngram language model next token prediction

this a next token prediction work in persian dataset, we used unigram,bigram & trigram models to predict the next token.

generated sample: با تشکر از چوب گردو با زیره