Download pretrained models?

Question

Download pretrained models?

Closed this issue 5 years ago · 3 comments

Can we download pretrained models to use them for inference?
(Also what is time-to-response for this?)
As i see in paper, it takes 2-3 days to train myself

Answer 1 · 2019-07-22T19:07:43.000Z

Unfortunately, we're not able to release pretrained models for this purpose. Hmm - what kind of time-to-response are you concerned with? Yeah, pretraining took us a few days and fine-tuning took around an hour.

Answer 2 · 2019-07-22T19:56:39.000Z

time-to-response - is time to process one sentence to get result with angry or happy class.
Also, what is the final size of model?

Answer 3 · 2019-07-23T14:22:34.000Z

For the 4-layer retrieval Transformer model, I measure typical forward-pass times of 0.1 sec (for a batch size of 512) and a model size of ~350 MB.