MTEB STS performance and using as feature extraction model

Question

MTEB STS performance and using as feature extraction model

dhruv-anand-aintech opened this issue a year ago · 3 comments

dhruv-anand-aintech commented a year ago

Hi, very interesting approach, and impressive results.
Have you run the MTEB STS benchmark on your trained models?
Would be interesting to see their performance v/s existing models with similar model size.

Thanks

dhruv-anand-aintech commented 10 months ago

congrats!

❤️1

Answer 1 · 2023-10-31T01:02:37.000Z

Hi @dhruv-anand-aintech, thanks for following our work and thanks for your suggestion. We will test the STS performance on MTEB later.

Answer 2 · 2023-12-04T02:32:30.000Z

Hi @dhruv-anand-aintech , we have uploaded our common model (UAE-Large-V1). It achieves SOTA on MTEB with an average score of 64.64.
You can follow the UAE usage to use our latest models:)