Core dumped in multi-cpu mode in container
jsirex opened this issue · 1 comments
jsirex commented
I tried different versions: it works in host, but doesn't in container.
...
sentence_transformer = SentenceTransformer("thenlper/gte-large")
pool = sentence_transformer.start_multi_process_pool(["cpu"] * 2) # core dumped
# pool = sentence_transformer.start_multi_process_pool(["cpu"] * 4) # core dumped
# pool = sentence_transformer.start_multi_process_pool() # core dumped
I checked different versions, like tried sentence-transformers == 2.7.0
and latest, tried torch == 2.4.1
and latest.
Debian Linux / Python 3.12.7
Am I missing something simple, related to the container? shared memory? other limitations? Tried privileged containers too.
jsirex commented
And yes, --shm-size 2G
helped. Leave it here for other people.