Exploration of Tree-based Hierarchical Softmax for Recurrent Language Models. IJCAI 2017.
-
original: Recurrent Language Model (RNNLM) with LSTM/GRU cells
-
Nce: noise contrastive estimation for RNNLM
-
Blackout: Blackout approximation for RNNLM
-
p-tHSM: paralleled tree-based hierarchical softmax for RNNLM
-
tHSM: traditional tree-based hierarchical softmax with Huffman coding for RNNLM