Problems with ailice calling the model after installing it through lm studio
Closed this issue · 4 comments
fatinghenji commented
(AIlice) PS G:\AIlice> ailice_main --modelID=lm-studio:Nexesenex/MIstral-QUantized-70b_Miqu-1-70b-iMat.GGUF --prompt="main" --contextWindowRatio=0.5
Encountered an exception, AIlice is exiting: 'lm-studio'
File "G:\AIlice\ailice\AIliceMain.py", line 123, in main
mainLoop(**kwargs)
File "G:\AIlice\ailice\AIliceMain.py", line 38, in mainLoop
config.Initialize(modelID = modelID)
File "G:\AIlice\ailice\common\AConfig.py", line 125, in Initialize
needAPIKey = ("apikey" in self.models[modelType] and (self.models[modelType]["apikey"] is None))
stevenlu137 commented
It looks like this model is not pre-configured in config.json. Please refer to "How to Add LLM Support/Example 2: LM Studio". If you still encounter problems please let me know.
fatinghenji commented
It looks like this model is not pre-configured in config.json. Please refer to "How to Add LLM Support/Example 2: LM Studio". If you still encounter problems please let me know.看起来这个模型没有在js.json中预先配置。请参考“如何添加LLM支持/示例2:LM Studio”。如果你仍然遇到问题,请让我知道。
stevenlu137 commented
I updated the code of the master branch to let AIlice print out the location of config.json immediately when it starts. Please update the code and try to start AIlice.
fatinghenji commented
fix