Integrate with LM Studio
Squallpka1 opened this issue · 2 comments
Try this on 'https://huggingface.co/spaces/LinkSoul/AutoAgents'. 4 chats and blew my 0.50 credit from OpenAI. Its just a test to see how this work.
I just wonder if we can have text box inside this huggingface site that use LM Studio because I use LM Studio and its such a very easy to get and use LLM. Its also have function as a local server. If i just can connect this IP server to the huggingface that you guys build there will be awesome.
With you trying to figure it out
I have been tried to integrate with LM Studio, it doesn't work as expected,
when it send role and plan info to LLMs, models returns nothing,
more funny, I also integrated AutoGPT with LM Studio, it still can not work,
because I found the model cannot accurately select actions, it cause AutoGPT can not found action to execute.
I use TheBloke/Llama-2-13B-chat-GGUF, maybe it has something to do with the model I chose.
Looking forward to more powerful models to choose from.