Hi, what can I use this model?

Question

Hi, what can I use this model?

eyuansu62 opened this issue 5 years ago · 3 comments

If I pre-train a model, how can I use to process the text? Is it same as word2vec or Glove?

Answer 1 · 2020-01-02T08:08:55.000Z

Yes, the model gives the embeddings similar to word2vec and GloVe.

Answer 2 · 2020-01-02T08:30:19.000Z

I got it. So if I want to use the model to encode the text to get its embeddings representation, can I directly use the embeddings.txt I trained?

Or is it similar to BERT used as an encoder? which can I fine-tuned on my tasks or using the best model you mentioned in ISSUE #16 as an encoder when I want to get the vector representation of texts?

Answer 3 · 2020-01-15T15:37:19.000Z

Yes, you can use 'embedding.txt' directly. The model is similar to word2vec, not ELMo/BERT.