Aquila-Network/aquila

Store FAISS index onto disk and load it

freakeinstein opened this issue 5 years ago · 1 comments

freakeinstein commented 5 years ago

It is possible to store index data from FAISS to disk. Ref: https://github.com/facebookresearch/faiss/wiki/Index-IO,-index-factory,-cloning-and-hyper-parameter-tuning and https://github.com/facebookresearch/faiss/blob/master/demos/demo_ondisk_ivf.py
It is necessary to fail protect FAISS during restarts. it is also good to distribute indexes to multiple DB instances to avoid training and keep consistent results.

freakeinstein commented 5 years ago

Added. Closing.