Raise error "Exception in ASGI application..uvicorn.protocols.utils.ClientDisconnected" when asking questions in Chinese.
shinyke opened this issue · 0 comments
OS: Win10
Lepton search version: lep, version 0.18.0
Deploy method: local machine & deploy in dashboard.lepton.ai
Hi, I try to deploy a search_with_lepton in my local machine.
Here is my param:
export GOOGLE_SEARCH_API_KEY=AIza....
export GOOGLE_SEARCH_CX=0011......
export BACKEND=GOOGLE
After the deployment is successful, there is no problem when asking questions in English. But once the question is in Chinese, there is an anomaly, such as this:
response UI:
error log:
2024-03-19 11:28:12,525 - ERROR: Exception in ASGI application
+ Exception Group Traceback (most recent call last):
| File "...\.conda\envs\ml\Lib\site-packages\uvicorn\protocols\http\h11_impl.py", line 408, in run_asgi
| result = await app( # type: ignore[func-returns-value]
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
| File "...\.conda\envs\ml\Lib\site-packages\uvicorn\middleware\proxy_headers.py", line 69, in __call__
| return await self.app(scope, receive, send)
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
| File "...\.conda\envs\ml\Lib\site-packages\fastapi\applications.py", line 1054, in __call__
| await super().__call__(scope, receive, send)
| File "...\.conda\envs\ml\Lib\site-packages\starlette\applications.py", line 123, in __call__
| await self.middleware_stack(scope, receive, send)
| File "...\.conda\envs\ml\Lib\site-packages\starlette\middleware\errors.py", line 186, in __call__
| raise exc
| File "...\.conda\envs\ml\Lib\site-packages\starlette\middleware\errors.py", line 164, in __call__
| await self.app(scope, receive, _send)
| File "...\.conda\envs\ml\Lib\site-packages\prometheus_fastapi_instrumentator\middleware.py", line 174, in __call__
| raise exc
| File "...\.conda\envs\ml\Lib\site-packages\prometheus_fastapi_instrumentator\middleware.py", line 172, in __call__
| await self.app(scope, receive, send_wrapper)
| File "...\.conda\envs\ml\Lib\site-packages\starlette\middleware\cors.py", line 91, in __call__
| await self.simple_response(scope, receive, send, request_headers=headers)
| File "...\.conda\envs\ml\Lib\site-packages\starlette\middleware\cors.py", line 146, in simple_response
| await self.app(scope, receive, send)
| File "...\.conda\envs\ml\Lib\site-packages\starlette\middleware\exceptions.py", line 62, in __call__
| await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
| File "...\.conda\envs\ml\Lib\site-packages\starlette\_exception_handler.py", line 64, in wrapped_app
| raise exc
| File "...\.conda\envs\ml\Lib\site-packages\starlette\_exception_handler.py", line 53, in wrapped_app
| await app(scope, receive, sender)
| File "...\.conda\envs\ml\Lib\site-packages\starlette\routing.py", line 758, in __call__
| await self.middleware_stack(scope, receive, send)
| File "...\.conda\envs\ml\Lib\site-packages\starlette\routing.py", line 778, in app
| await route.handle(scope, receive, send)
| File "...\.conda\envs\ml\Lib\site-packages\starlette\routing.py", line 299, in handle
| await self.app(scope, receive, send)
| File "...\.conda\envs\ml\Lib\site-packages\starlette\routing.py", line 79, in app
| await wrap_app_handling_exceptions(app, request)(scope, receive, send)
| File "...\.conda\envs\ml\Lib\site-packages\starlette\_exception_handler.py", line 64, in wrapped_app
| raise exc
| File "...\.conda\envs\ml\Lib\site-packages\starlette\_exception_handler.py", line 53, in wrapped_app
| await app(scope, receive, sender)
| File "...\.conda\envs\ml\Lib\site-packages\starlette\routing.py", line 77, in app
| await response(scope, receive, send)
| File "...\.conda\envs\ml\Lib\site-packages\starlette\responses.py", line 257, in __call__
| async with anyio.create_task_group() as task_group:
| File "...\.conda\envs\ml\Lib\site-packages\anyio\_backends\_asyncio.py", line 678, in __aexit__
| raise BaseExceptionGroup(
| ExceptionGroup: unhandled errors in a TaskGroup (1 sub-exception)
+-+---------------- 1 ----------------
| Traceback (most recent call last):
| File "...\.conda\envs\ml\Lib\site-packages\starlette\responses.py", line 260, in wrap
| await func()
| File "...\.conda\envs\ml\Lib\site-packages\starlette\responses.py", line 252, in stream_response
| await send({"type": "http.response.body", "body": chunk, "more_body": True})
| File "...\.conda\envs\ml\Lib\site-packages\starlette\_exception_handler.py", line 50, in sender
| await send(message)
| File "...\.conda\envs\ml\Lib\site-packages\starlette\_exception_handler.py", line 50, in sender
| await send(message)
| File "...\.conda\envs\ml\Lib\site-packages\starlette\middleware\cors.py", line 152, in send
| await send(message)
| File "...\.conda\envs\ml\Lib\site-packages\prometheus_fastapi_instrumentator\middleware.py", line 169, in send_wrapper
| await send(message)
| File "...\.conda\envs\ml\Lib\site-packages\starlette\middleware\errors.py", line 161, in _send
| await send(message)
| File "...\.conda\envs\ml\Lib\site-packages\uvicorn\protocols\http\h11_impl.py", line 461, in send
| raise ClientDisconnected
| uvicorn.protocols.utils.ClientDisconnected
+------------------------------------
I briefly traced the code and the exception occurred here. After getting The first word The
, pronounce the second word incorrectly.
I also try deploy Lepton Search in dashboard.lepton.ai, meet the same problem.
However, there is no such problem in the official demo, all Chinese questions can be answered normally. Can you help me find out what's wrong with my deployment?