dvmazur/mixtral-offloading

Can it run with LlamaIndex?

Opened this issue · 0 comments

LeMoussel commented

Is it possible to use mixtral-offloading with llamaindex to construct a RAG?
If yes, do you have an example?