@shubham8550 I imagine this only depended on some Langchain integration once the model ran. Please feel free to share more details about how you managed to get it working if you're able.
shubham8550 opened this issue · 0 comments
shubham8550 commented
@shubham8550 I imagine this only depended on some Langchain integration once the model ran. Please feel free to share more details about how you managed to get it working if you're able.
Originally posted by @ruankie in #7 (comment)
there isnt much you need to doo to runn open source models
just get model from hugging face and swap this
(refer)
https://python.langchain.com/docs/integrations/llms/llamacpp