Ability to encode/decode buffers when FS not available?
asilvas opened this issue · 4 comments
asilvas commented
Happy to contribute, just wanted to know if there was a logical way to accomplish this? add is very expensive as it performs an encode, which adds up fast. Basically looking for similar efficiency to that of read/write from disk but from memory/buffers.
ewfian commented
Now it is just wraps the faiss api, if you have a good way, please let me know.
ewfian commented
Suddenly remembered: In langchain Python, the serialize_to_bytes was implemented. If faiss-node can also have a similar solution, the feature could also be ported to langchianjs
asilvas commented
My python is terrible, but I'll give it a look thanks.