trodrigu/text_embeddings_elixir

same result from mean pooling?

Closed this issue · 2 comments

aus70 commented

Hi, I tried your code (found in elixir-nx/bumblebee#100), and the results before and after the pooling are the same, and namely:

[0.8791295289993286, 0.5514416694641113, 0.5670843720436096, 0.4868759512901306]

Am I missing anything?

Thanks!

trodrigu commented

I think it's missing a Scholar normalize function. Let me take a look.

  • 👍1
trodrigu commented

I've updated the example. I've also added the analogous python sentence transformer example for verification.

  • 👍1