Josh-XT/AGiXT

Application error: a client-side exception has occurred (see the browser console for more information).

bozo32 opened this issue · 3 comments

bozo32 commented

Description

When trying to set up local models, I will run into what appears to be an unrecoverable problem. This happens both working on a linux box that has a NVIDIA card and on my M1 Mac. In both cases I tested the models (vicuna and open orca 13b 16k) through ooba before accessing them through AGiXT
agixt-agixt-1 | ERROR: Exception in ASGI application
agixt-agixt-1 | Traceback (most recent call last):
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/uvicorn/protocols/http/httptools_impl.py", line 426, in run_asgi
agixt-agixt-1 | result = await app( # type: ignore[func-returns-value]
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 84, in call
agixt-agixt-1 | return await self.app(scope, receive, send)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/fastapi/applications.py", line 292, in call
agixt-agixt-1 | await super().call(scope, receive, send)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/starlette/applications.py", line 122, in call
agixt-agixt-1 | await self.middleware_stack(scope, receive, send)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 184, in call
agixt-agixt-1 | raise exc
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 162, in call
agixt-agixt-1 | await self.app(scope, receive, _send)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/starlette/middleware/cors.py", line 91, in call
agixt-agixt-1 | await self.simple_response(scope, receive, send, request_headers=headers)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/starlette/middleware/cors.py", line 146, in simple_response
agixt-agixt-1 | await self.app(scope, receive, send)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 79, in call
agixt-agixt-1 | raise exc
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 68, in call
agixt-agixt-1 | await self.app(scope, receive, sender)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/fastapi/middleware/asyncexitstack.py", line 20, in call
agixt-agixt-1 | raise e
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/fastapi/middleware/asyncexitstack.py", line 17, in call
agixt-agixt-1 | await self.app(scope, receive, send)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 718, in call
agixt-agixt-1 | await route.handle(scope, receive, send)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 276, in handle
agixt-agixt-1 | await self.app(scope, receive, send)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 66, in app
agixt-agixt-1 | response = await func(request)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 273, in app
agixt-agixt-1 | raw_response = await run_endpoint_function(
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 190, in run_endpoint_function
agixt-agixt-1 | return await dependant.call(**values)
agixt-agixt-1 | File "/agixt/endpoints/Agent.py", line 101, in get_agentconfig
agixt-agixt-1 | agent_config = Agent(agent_name=agent_name, user=user).get_agent_config()
agixt-agixt-1 | File "/agixt/fb/Agent.py", line 141, in init
agixt-agixt-1 | self.available_commands = Extensions(
agixt-agixt-1 | File "/agixt/Extensions.py", line 26, in init
agixt-agixt-1 | self.commands = self.load_commands()
agixt-agixt-1 | File "/agixt/Extensions.py", line 94, in load_commands
agixt-agixt-1 | command_class = getattr(module, module_name)(**settings)
agixt-agixt-1 | File "/agixt/extensions/voice_chat.py", line 33, in init
agixt-agixt-1 | kwargs["USE_HUGGINGFACE_TTS"].lower() == "true"
agixt-agixt-1 | AttributeError: 'bool' object has no attribute 'lower'
agixt-agixt-1 | INFO: 172.18.0.1:32858 - "GET /api/conversations HTTP/1.1" 200 OK
agixt-agixt-1 | INFO: 172.18.0.1:32870 - "GET /api/prompt/Default HTTP/1.1" 200 OK
agixt-agixt-1 | INFO: 172.18.0.1:32858 - "GET /api/conversation/Test?agent_name=Vicuna&limit=100&page=1 HTTP/1.1" 200 OK
agixt-agixt-1 | INFO: 172.18.0.1:32878 - "GET /api/prompt/categories HTTP/1.1" 200 OK
agixt-agixt-1 | 2023-10-12 15:42:16,220 | INFO | Getting options for provider: fastchat
agixt-agixt-1 | 2023-10-12 15:42:16,222 | INFO | Getting options for provider: custom
agixt-agixt-1 | 2023-10-12 15:42:16,222 | INFO | Getting options for provider: local
agixt-agixt-1 | 2023-10-12 15:42:16,222 | INFO | Getting options for provider: huggingchat
agixt-agixt-1 | 2023-10-12 15:42:16,222 | INFO | Getting options for provider: perplexity
agixt-agixt-1 | 2023-10-12 15:42:16,222 | INFO | Getting options for provider: llamacpp
agixt-agixt-1 | 2023-10-12 15:42:16,222 | INFO | Getting options for provider: bard
agixt-agixt-1 | 2023-10-12 15:42:16,223 | INFO | Getting options for provider: agixt
agixt-agixt-1 | 2023-10-12 15:42:16,223 | INFO | Getting options for provider: openai
agixt-agixt-1 | 2023-10-12 15:42:16,223 | INFO | Getting options for provider: pipeline
agixt-agixt-1 | 2023-10-12 15:42:16,223 | INFO | Getting options for provider: claude
agixt-agixt-1 | 2023-10-12 15:42:16,223 | INFO | Getting options for provider: palm
agixt-agixt-1 | 2023-10-12 15:42:16,223 | INFO | Getting options for provider: azure
agixt-agixt-1 | 2023-10-12 15:42:16,223 | INFO | Getting options for provider: kobold
agixt-agixt-1 | 2023-10-12 15:42:16,223 | INFO | Getting options for provider: runpod
agixt-agixt-1 | 2023-10-12 15:42:16,224 | INFO | Getting options for provider: gpt4free
agixt-agixt-1 | 2023-10-12 15:42:16,224 | INFO | Getting options for provider: oobabooga
agixt-agixt-1 | 2023-10-12 15:42:16,225 | INFO | Getting options for provider: nbox
agixt-agixt-1 | 2023-10-12 15:42:16,225 | INFO | Getting options for provider: huggingface
agixt-agixt-1 | INFO: 172.18.0.1:32890 - "GET /api/providers HTTP/1.1" 200 OK
agixt-agixt-1 | INFO: 172.18.0.1:32888 - "GET /api/agent/Vicuna/command HTTP/1.1" 500 Internal Server Error
agixt-agixt-1 | ERROR: Exception in ASGI application
agixt-agixt-1 | Traceback (most recent call last):
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/uvicorn/protocols/http/httptools_impl.py", line 426, in run_asgi
agixt-agixt-1 | result = await app( # type: ignore[func-returns-value]
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 84, in call
agixt-agixt-1 | return await self.app(scope, receive, send)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/fastapi/applications.py", line 292, in call
agixt-agixt-1 | await super().call(scope, receive, send)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/starlette/applications.py", line 122, in call
agixt-agixt-1 | await self.middleware_stack(scope, receive, send)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 184, in call
agixt-agixt-1 | raise exc
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 162, in call
agixt-agixt-1 | await self.app(scope, receive, _send)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/starlette/middleware/cors.py", line 91, in call
agixt-agixt-1 | await self.simple_response(scope, receive, send, request_headers=headers)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/starlette/middleware/cors.py", line 146, in simple_response
agixt-agixt-1 | await self.app(scope, receive, send)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 79, in call
agixt-agixt-1 | raise exc
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 68, in call
agixt-agixt-1 | await self.app(scope, receive, sender)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/fastapi/middleware/asyncexitstack.py", line 20, in call
agixt-agixt-1 | raise e
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/fastapi/middleware/asyncexitstack.py", line 17, in call
agixt-agixt-1 | await self.app(scope, receive, send)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 718, in call
agixt-agixt-1 | await route.handle(scope, receive, send)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 276, in handle
agixt-agixt-1 | await self.app(scope, receive, send)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 66, in app
agixt-agixt-1 | response = await func(request)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 273, in app
agixt-agixt-1 | raw_response = await run_endpoint_function(
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 190, in run_endpoint_function
agixt-agixt-1 | return await dependant.call(**values)
agixt-agixt-1 | File "/agixt/endpoints/Agent.py", line 127, in get_commands
agixt-agixt-1 | agent = Agent(agent_name=agent_name, user=user)
agixt-agixt-1 | File "/agixt/fb/Agent.py", line 141, in init
agixt-agixt-1 | self.available_commands = Extensions(
agixt-agixt-1 | File "/agixt/Extensions.py", line 26, in init
agixt-agixt-1 | self.commands = self.load_commands()
agixt-agixt-1 | File "/agixt/Extensions.py", line 94, in load_commands
agixt-agixt-1 | command_class = getattr(module, module_name)(**settings)
agixt-agixt-1 | File "/agixt/extensions/voice_chat.py", line 33, in init
agixt-agixt-1 | kwargs["USE_HUGGINGFACE_TTS"].lower() == "true"
agixt-agixt-1 | AttributeError: 'bool' object has no attribute 'lower'
agixt-agixt-1 | INFO: 172.18.0.1:32878 - "GET /api/agent HTTP/1.1" 200 OK
agixt-agixt-1 | INFO: 172.18.0.1:32858 - "GET /api/agent/Vicuna HTTP/1.1" 500 Internal Server Error
agixt-agixt-1 | ERROR: Exception in ASGI application
agixt-agixt-1 | Traceback (most recent call last):
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/uvicorn/protocols/http/httptools_impl.py", line 426, in run_asgi
agixt-agixt-1 | result = await app( # type: ignore[func-returns-value]
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 84, in call
agixt-agixt-1 | return await self.app(scope, receive, send)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/fastapi/applications.py", line 292, in call
agixt-agixt-1 | await super().call(scope, receive, send)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/starlette/applications.py", line 122, in call
agixt-agixt-1 | await self.middleware_stack(scope, receive, send)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 184, in call
agixt-agixt-1 | raise exc
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 162, in call
agixt-agixt-1 | await self.app(scope, receive, _send)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/starlette/middleware/cors.py", line 91, in call
agixt-agixt-1 | await self.simple_response(scope, receive, send, request_headers=headers)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/starlette/middleware/cors.py", line 146, in simple_response
agixt-agixt-1 | await self.app(scope, receive, send)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 79, in call
agixt-agixt-1 | raise exc
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 68, in call
agixt-agixt-1 | await self.app(scope, receive, sender)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/fastapi/middleware/asyncexitstack.py", line 20, in call
agixt-agixt-1 | raise e
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/fastapi/middleware/asyncexitstack.py", line 17, in call
agixt-agixt-1 | await self.app(scope, receive, send)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 718, in call
agixt-agixt-1 | await route.handle(scope, receive, send)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 276, in handle
agixt-agixt-1 | await self.app(scope, receive, send)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/starlette/routing.py", line 66, in app
agixt-agixt-1 | response = await func(request)
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 273, in app
agixt-agixt-1 | raw_response = await run_endpoint_function(
agixt-agixt-1 | File "/usr/local/lib/python3.10/site-packages/fastapi/routing.py", line 190, in run_endpoint_function
agixt-agixt-1 | return await dependant.call(**values)
agixt-agixt-1 | File "/agixt/endpoints/Agent.py", line 101, in get_agentconfig
agixt-agixt-1 | agent_config = Agent(agent_name=agent_name, user=user).get_agent_config()
agixt-agixt-1 | File "/agixt/fb/Agent.py", line 141, in init
agixt-agixt-1 | self.available_commands = Extensions(
agixt-agixt-1 | File "/agixt/Extensions.py", line 26, in init
agixt-agixt-1 | self.commands = self.load_commands()
agixt-agixt-1 | File "/agixt/Extensions.py", line 94, in load_commands
agixt-agixt-1 | command_class = getattr(module, module_name)(**settings)
agixt-agixt-1 | File "/agixt/extensions/voice_chat.py", line 33, in init
agixt-agixt-1 | kwargs["USE_HUGGINGFACE_TTS"].lower() == "true"
agixt-agixt-1 | AttributeError: 'bool' object has no attribute 'lower'
agixt-agixt-1 | INFO: 172.18.0.1:32906 - "GET /api/extensions/settings HTTP/1.1" 200 OK
agixt-agixt-1 | 2023-10-12 15:42:16,953 | INFO | Executing command: Get Local Model List with args: {}. Command Function: <function agixt_actions.models at 0xffff85e62200>
agixt-agixt-1 | 2023-10-12 15:42:18,048 | INFO | Command Output: ['FashionGPT-70B-v1.2', 'chronos007-70B', 'samantha-1.2-mistral-7B', 'sqlcoder2', 'ANIMA-Phi-Neptune-Mistral-7B', 'ZephRP-m7b', 'jackalope-7B', 'dolphin-2.1-mistral-7B', 'UndiMix-v3-13B', 'tinyllama-1.1b-chat-v0.3_platypus', 'TinyLlama-1.1B-1T-OpenOrca', 'zephyr-7B-alpha', 'Tinyllama-2-1b-miniguanaco', 'em_german_leo_mistral', 'em_german_mistral_v01', 'Ziya-Coding-34B-v1.0', 'PsyMedRP-v1-20B', 'Athena-v4', 'Llama2-chat-AYB-13B', 'sheep-duck-llama-2-13B', 'Mistral-Trismegistus-7B', 'UndiMix-v4-13B', 'llama-2-7B-Arguments', 'airoboros-m-7B-3.0', 'airoboros-l2-7B-3.0', 'airoboros-l2-13B-3.0', 'CollectiveCognition-v1.1-Mistral-7B', 'Amethyst-13B-Mistral', 'Mistralic-7B-1', 'Llama-2-7B-vietnamese-20k', 'Dans-TotSirocco-7B', 'Dans-AdventurousWinds-7B', 'airoboros-mistral2.2-7B', 'TinyLlama-1.1B-intermediate-step-480k-1T', 'TinyLlama-1.1B-python-v0.1', 'TinyLlama-1.1B-Chat-v0.3', 'Nous-Hermes-13B', 'Mistral-7B-OpenOrca', 'dolphin-2.0-mistral-7B', 'Nous-Capybara-7B', 'Inkbot-13B-8k-0.2', 'em_german_7b_v01', 'em_german_70b_v01', 'em_german_13b_v01', 'UltraLM-13B-v2.0', 'MythoMakiseMerged-13B', 'lince-zero', 'sheep-duck-llama-2-70B-v1.1', 'MegaMix-T1-13B', 'MegaMix-S1-13B', 'Megamix-A1-13B', 'Kimiko-Mistral-7B', 'Pandalyst_13B_V1.0', 'Pandalyst-7B-V1.1', 'samantha-mistral-instruct-7B', 'samantha-mistral-7B', 'Synthia-7B-v1.3', 'NexusRaven-13B', 'Mistral-7B-Instruct-v0.1', 'Mistral-7B-v0.1', 'leo-hessianai-7B', 'leo-hessianai-7B-chat', 'leo-hessianai-7B-chat-bilingual', 'leo-hessianai-13B', 'leo-hessianai-13B-chat', 'leo-hessianai-13B-chat-bilingual', 'Emerhyst-20B', 'Emerhyst-13B', 'openbuddy-openllama-7B-v12-bf16', 'Marcoroni-70B-v1', 'Athena-v3', 'Llama-2-13B-Ensemble-v6', 'Llama-2-13B-Ensemble-v5', 'COTHuginn-4.5-19B', 'Chronos-Hermes-13b-v2', 'Falcon-180B', 'Falcon-180B-Chat', 'LlongOrca-13B-16K', 'Llama2-22B-GPLATTY', 'L2-MythoMax22b-Instruct-Falseblock', 'chronos-13b-v2', 'Asclepius-13B', 'Airoboros-33B-2.1', 'Huginn-22B-Prototype', 'U-Amethyst-20B', 'sqlcoder', 'vicuna-33B', 'law-LLM', 'openbuddy-llama2-34b-v11.1-bf16', 'openbuddy-coder-34b-v11-bf16', 'Synthia-7B-v1.2', 'Synthia-13B-v1.2', 'MetaMath-7B-V1.0', 'MetaMath-70B-V1.0', 'MAmmoTH-Coder-13B', 'MetaMath-13B-V1.0', 'MXLewdMini-L2-13B', 'storytime-13B', 'MXLewd-L2-20B', 'Athena-v2', 'PuddleJumper-13B-V2', 'MAmmoTH-7B', 'MAmmoTH-13B', 'airoboros-l2-7B-2.2.1', 'airoboros-l2-13B-2.2.1', 'EverythingLM-13B-V3-16K', 'airoboros-c34b-2.2.1', 'ALMA-13B-Pretrain', 'ALMA-7B-Pretrain', 'MLewd-ReMM-L2-Chat-20B-Inverted', 'MLewd-ReMM-L2-Chat-20B', 'Airoboros-L2-70b-2.2.1', 'Xwin-LM-70B-V0.1', 'Xwin-LM-7B-V0.1', 'Inkbot-13B-4k', 'MAmmoTH-Coder-34B', 'MAmmoTH-70B', 'Xwin-LM-13B-V0.1', 'tulu-30B', 'tulu-7B', 'manticore-13b-chat-pyg', 'hippogriff-30b-chat', 'VicUnlocked-30B-LoRA', 'ARIA-70B-V2', 'WizardLM-Uncensored-SuperCOT-StoryTelling-30B', 'Platypus-30B', 'GPlatty-30B', 'medalpaca-13B', 'Vicuna-7B-CoT', 'airochronos-33B', 'Vicuna-13B-CoT', 'wizard-vicuna-13B', 'Chronoboros-33B', 'llama-30b-supercot', 'gorilla-7B', 'Karen_theEditor_13B', 'CAMEL-33B-Combined-Data', 'fin-llama-33B', 'CAMEL-13B-Role-Playing-Data', 'stable-vicuna-13B', 'CAMEL-13B-Combined-Data', 'chronos-wizardlm-uc-scot-st-13B', 'chronos-hermes-13B', 'llama-13b-supercot', 'wizard-mega-13B', 'Manticore-13B', 'minotaur-13B-fixed', 'wizardLM-7B', 'FashionGPT-70B-V1.1', 'WizardLM-30B', 'WizardLM-13B-V1.1', 'WizardLM-13B-1.0', 'upstage-llama-30b-instruct-2048', 'Upstage-Llama1-65B-Instruct', 'Uncensored-Frank-33b', 'guanaco-7B', 'guanaco-65B', 'guanaco-33B', 'SuperPlatty-30B', 'guanaco-13B', 'WizardLM-7B-V1.0-Uncensored', 'Uncensored-Frank-13b', 'WizardLM-33B-V1.0-Uncensored', 'WizardLM-7B-uncensored', 'WizardLM-30B-uncensored', 'Uncensored-Frank-7B', 'Wizard-Vicuna-7B-Uncensored', 'WizardLM-13B-V1.0-Uncensored', 'WizardLM-13B-Uncensored', 'Wizard-Vicuna-30B-Uncensored', 'Wizard-Vicuna-13B-Uncensored', 'Dolphin-Llama-13B', 'based-30B', 'based-7B', 'based-13b', 'MythoLogic-13B', 'MythoBoros-13B', 'chronos-33b', '30B-Lazarus', '30B-Epsilon', 'chronos-13B', '13B-HyperMantis', '13B-Chimera', '13B-Ouroboros', 'tulu-13B', '13B-BlueMethod', 'AlpacaCielo-13B', 'llama2_7b_chat_uncensored', 'Llama-2-70B-LoRA-Assemble-v2', 'ReMM-v2.1-L2-13B', 'MLewd-L2-Chat-13B', 'WizardCoder-Python-7B-V1.0', 'TigerBot-70B-Chat', 'Pygmalion-2-13B-SuperCOT-weighed', 'Synthia-34B-v1.2', 'Airoboros-c34B-2.2', 'Kuchiki-1.1-L2-7B', 'CalliopeDS-L2-13B', 'OpenOrca_Stx', 'ChatAYT-Lora-Assamble-Marcoroni', 'Synthia-70B-v1.2b', 'CodeFuse-CodeLlama-34B', 'Chinese-Llama-2-13B', 'Chinese-Alpaca-2-13B', 'Chinese-Llama-2-7B', 'Chinese-Alpaca-2-7B', 'Marcoroni-70B', 'Pygmalion-2-13B-SuperCOT2', 'Llama-2-13B-LoRA-Assemble', 'Llama-2-7B-LoRA-Assemble', 'BerrySauce-L2-13B', 'AppleSauce-L2-13B', 'Llama-2-Coder-7B', 'Llama2-Chat-AYT-13B', 'Kuchiki-L2-7B', 'Euryale-Inverted-L2-70B', 'Euryale-L2-70B', 'Spicyboros-c34b-2.2', 'Airoboros-L2-70b-2.2', 'Airoboros-L2-13B-2.2', 'Airoboros-L2-7B-2.2', 'Sheep-Duck-Llama-2-70B', 'JanniesBasedLigma-L2-13B', 'Llama-2-13B-Chat-Dutch', 'Marcoroni-13B', 'Marcoroni-7b', 'Spicyboros-70B-2.2', 'Llama-2-70B-Ensemble-v5', 'Unholy-v1-12L-13B', 'Unholy-v1-10l-13B', 'Nous-Hermes-13B-Code', 'ReMM-v2-L2-13B', 'MLewdBoros-L2-13B', 'Tulpar-7B-v0', 'Pygmalion-2-13B-SuperCOT', 'Spicyboros-13B-2.2', 'ORCA_LLaMA_70B_QLoRA', 'Uni-TianYan-70B', 'Spicyboros-7B-2.2', 'airoboros-l2-7B-gpt4-m2.0', 'airoboros-l2-7B-gpt4-2.0', 'airoboros-l2-13b-gpt4-m2.0', 'airoboros-l2-13b-gpt4-2.0', 'Airoboros-L2-13B-2_1-YaRN-64K', 'Guanaco-13B-Uncensored', 'Guanaco-7B-Uncensored', 'Llama-2-PeanutButter_v19_R8-7B', '13B-Thorns-L2', 'YuLan-Chat-2-13B', 'Kimiko-7B', 'Kimiko-13B', 'llama-2-70b-Guanaco-QLoRA', 'llama2_70b_chat_uncensored', 'Llama-2-70B-OASST-1-200', 'WizardLM-70B-V1.0', 'airoboros-l2-70B-gpt4-1.4.1', 'Airoboros-L2-70B-GPT4-m2.0', 'Synthia-70B-v1.2', 'Camel-Platypus2-70B', 'WizardMath-70B-V1.0', 'GodziLLa2-70B', 'Trurl-2-7B', 'airoboros-l2-70B-GPT4-2.0', 'Platypus2-70B', 'orca_mini_v3_70B', 'Trurl-2-13B', 'llama2-7b-chat-codeCherryPop-qLoRA', 'Upstage-Llama-2-70B-instruct-v2', 'Luna-AI-Llama2-Uncensored', 'StableBeluga-13B', 'StableBeluga2-70B', 'LosslessMegaCoder-Llama2-7B-Mini', 'Chronos-70B-v2', 'Llama-2-7B-32K-Instruct', 'Platypus2-70B-Instruct', 'StableBeluga-7B', 'LosslessMegaCoder-Llama2-13B-Mini', 'Llama2-13B-MegaCode2-OASST', 'Mythalion-13B', 'LlongOrca-7B-16K', 'Pygmalion-2-7B', 'Pygmalion-2-13B', 'llama-2-7B-Guanaco-QLoRA', 'Llama2-22B-Daydreamer-v3', 'OpenAssistant-Llama2-13B-Orca-8K-3319', 'Samantha-1.1-70B', 'Synthia-7B', 'OpenOrca-Platypus2-13B', 'Vigogne-2-7B-Instruct', 'Vigogne-2-13B-Instruct', 'WizardLM-1.0-Uncensored-CodeLlama-34B', 'Chronoboros-Grad-L2-13B', 'Airochronos-L2-13B', 'llama2-22B-daydreamer-v2', 'llama-2-13B-German-Assistant-v2', 'llama-2-13B-Guanaco-QLoRA', 'CodeUp-Alpha-13B-HF', 'Synthia-13B', 'Hermes-LLongMA-2-7B-8K', 'Chronorctypus-Limarobormes-13b', 'Vigogne-2-7B-Chat', 'Chronolima-Airo-Grad-L2-13B', 'Airolima-Chronos-Grad-L2-13B', 'Spring-Dragon', 'qCammel-70-x', 'Llama-2-13B-German-Assistant-v4', 'CodeUp-Llama-2-13B-Chat-HF', 'Carl-Llama-2-13B', 'WizardLM-1.0-Uncensored-Llama2-13B', 'LLongMA-2-7B', 'Hermes-LLongMA-2-13B-8K', 'huginnv1.2', 'qCammel-13', 'Chronos-Beluga-v2-13B', '13B-Legerdemain-L2', 'orca_mini_v3_13B', 'Dolphin-Llama2-7B', 'Huginn-v3-13B', 'orca_mini_v3_7B', 'Huginn-13B', 'Zarablend-MX-L2-7B', 'Zarablend-L2-7B', 'HermesLimaRP-L2-7B', 'OpenBuddy-Llama2-70b-v10.1', 'Firefly-Llama2-13B-v1.2', 'WizardMath-7B-V1.0', 'WizardMath-13B-V1.0', 'WizardLM-13B-V1.2', 'ReMM-SLERP-L2-13B', 'Redmond-Puffin-13B', 'EverythingLM-13b-V2-16K', 'AlpacaCielo2-7B-8K', 'EverythingLM-13B-16K', 'Nous-Hermes-Llama2', 'airoboros-l2-7b-gpt4-1.4.1', 'Nous-Hermes-Llama-2-7B', 'airoboros-l2-13B-gpt4-1.4.1', 'Platypus2-13B', 'Stable-Platypus2-13B', 'Chronohermes-Grad-L2-13B', 'Camel-Platypus2-13B', 'vicuna-7B-v1.5', 'vicuna-7B-v1.5-16K', 'vicuna-13B-v1.5', 'vicuna-13B-v1.5-16K', 'MythoMax-L2-13B', 'MythoMix-L2-13B', 'MythoLogic-Mini-7B', 'MythoLogic-L2-13B', 'openchat_v3.2_super', 'Llama-2-70B', 'Llama-2-70B-chat', 'Llama-2-13B', 'Llama-2-13B-chat', 'Llama-2-7b-Chat', 'Llama-2-7B', 'OpenBuddy-Llama2-13B-v11.1', 'Speechless-Llama2-Hermes-Orca-Platypus-WizardLM-13B', 'Speechless-Llama2-13B', 'UndiMix-v2-13B', 'Stheno-L2-13B', 'UndiMix-v1-13B', 'Stheno-Inverted-L2-13B', 'Yarn-Llama-2-13B-128K', 'Yarn-Llama-2-13B-64K', 'Yarn-Llama-2-7B-128K', 'Yarn-Llama-2-7B-64K', 'Synthia-70B-v1.1', 'LoKuS-13B', 'llama-2-13B-chat-limarp-v2-merged', 'Airoboros-L2-70B-2.1-Creative', 'MythoMax-L2-Kimiko-v2-13B', 'fiction.live-Kimiko-V2-70B', 'Kimiko-v2-13B', 'Luban-13B', 'Athena-v1', 'Huginn-13B-v4', 'Huginn-13B-v4.5', 'Mythical-Destroyer-V2-L2-13B', 'Airoboros-L2-7B-2.1', 'model_007-70B', 'Airoboros-L2-13B-2.1', 'Mythical-Destroyer-L2-13B', 'MythoMax-Kimiko-Mix', 'Samantha-1.11-13B', 'Lemur-70B-Chat-v1', 'Phind-CodeLlama-34B-v2', 'WizardCoder-Python-13B-V1.0', 'CodeLlama-13B-oasst-sft-v10', 'Airoboros-L2-70B-2.1', 'Airoboros-c34B-2.1', 'Llama-2-70B-Orca-200k', 'Genz-70b', 'Zarafusionex-1.1-L2-7B', 'Synthia-70B', 'WizardCoder-Python-34B-V1.0', 'Phind-CodeLlama-34B-Python-v1', 'Phind-CodeLlama-34B-v1', 'Llama2-70B-OASST-SFT-v10', 'Samantha-1.11-CodeLlama-34B', 'Samantha-1.11-70B', 'CodeLlama-34B-Instruct', 'CodeLlama-34B-Python', 'CodeLlama-34B', 'CodeLlama-13B-Python', 'CodeLlama-13B-Instruct', 'CodeLlama-13B', 'CodeLlama-7B', 'CodeLlama-7B-Python', 'CodeLlama-7B-Instruct', 'Nous-Puffin-70B', 'Nous-Hermes-Llama2-70B', 'PuddleJumper-13B', 'LLaMA-7b', 'LLaMA-65B', 'LLaMA-30b', 'LLaMA-13b', 'minotaur-13B']
agixt-agixt-1 | INFO: 172.18.0.1:32870 - "POST /api/agent/gpt4free/command HTTP/1.1" 200 OK

Steps to Reproduce the Bug

  1. set up vicuna or open orca
  2. try to send a prompt through agixt (nothing will happen)
  3. open setting for that model
  4. boom

Expected Behavior

open settings for that behaviour
settings open

Operating System

  • Linux
  • Microsoft Windows
  • Apple MacOS
  • Android
  • iOS
  • Other

Python Version

  • Python <= 3.9
  • Python 3.10
  • Python 3.11

Environment Type - Connection

  • Local - You run AGiXT in your home network
  • Remote - You access AGiXT through the internet

Runtime environment

  • Using docker compose
  • Using local
  • Custom setup (please describe above!)

Acknowledgements

  • I have searched the existing issues to make sure this bug has not been reported yet.
  • I am using the latest version of AGiXT.
  • I have provided enough information for the maintainers to reproduce and diagnose the issue.
Josh-XT commented

Hello, once the build finishes for v1.4.18, this will be resolved.

https://github.com/Josh-XT/AGiXT/actions/runs/6498120335

bozo32 commented
  • 🎉1
Josh-XT commented

Thank you Fyi I’m trying to use AGiXT as a flexible platform for clueless MSc students to learn how to responsibly use LLMs for qualitative analysis.

Interesting! Feel free to reach out over discord, I would love to hear more about that. It is always great to hear the fun places people use it.