/lmkit

language models toolkits with hierarchical softmax setting

Primary LanguagePython

lmkit

accepted paper

Exploration of Tree-based Hierarchical Softmax for Recurrent Language Models. IJCAI 2017.

  1. original: Recurrent Language Model (RNNLM) with LSTM/GRU cells

  2. Nce: noise contrastive estimation for RNNLM

  3. Blackout: Blackout approximation for RNNLM

  4. p-tHSM: paralleled tree-based hierarchical softmax for RNNLM

  5. tHSM: traditional tree-based hierarchical softmax with Huffman coding for RNNLM