UKPLab/sentence-transformers

Core dumped in multi-cpu mode in container

jsirex opened this issue · 1 comments

I tried different versions: it works in host, but doesn't in container.

...
sentence_transformer = SentenceTransformer("thenlper/gte-large")
pool = sentence_transformer.start_multi_process_pool(["cpu"] * 2) # core dumped
# pool = sentence_transformer.start_multi_process_pool(["cpu"] * 4) # core dumped
# pool = sentence_transformer.start_multi_process_pool() # core dumped

I checked different versions, like tried sentence-transformers == 2.7.0 and latest, tried torch == 2.4.1 and latest.
Debian Linux / Python 3.12.7

Am I missing something simple, related to the container? shared memory? other limitations? Tried privileged containers too.

And yes, --shm-size 2G helped. Leave it here for other people.