Is there a limit of sentence length for LASER?
maohbao opened this issue · 2 comments
maohbao commented
Hello there,
Is there a limit of sentence length for LASER? How it process long sentence during embedding?
Thank you!
heffernankevin commented
Hi @maohbao! It can accept variable input lengths, so inference will probably depend on the amount of memory available on your hardware. For practical purposes, it may be worthwhile to filter out very long sentences in your input data (e.g. > 1024 tokens).
heffernankevin commented
Closing due to inactivity. Please re-open if needed!