Can use local LLM？not openai api

[liucheny]

Can use local LLM？not openai api

[allanj]

I think the author make some script there, but just not in the README.

You can simply call codellama, or probably setup VLLM but that requires some additional efforts.

[KylinMountain]

yes, you can. Need update your AnyOpenLLM.
我在知乎写了文章讲解如何运行这个框架，你可以试试看呢。
https://zhuanlan.zhihu.com/p/693251608

[lxz12]

yes, you can. Need update your AnyOpenLLM. 我在知乎写了文章讲解如何运行这个框架，你可以试试看呢。 https://zhuanlan.zhihu.com/p/693251608

消失了，佬，可以再发个嘛

[KylinMountain]

@lxz12 https://zhuanlan.zhihu.com/p/700011008?utm_psn=1780004622041227264

[beishangeyu]

@lxz12 https://zhuanlan.zhihu.com/p/700011008?utm_psn=1780004622041227264

感谢佬