sozercan/aikit

[BUG] exllama.py: missing port in address

Closed this issue · 0 comments

Expected Behavior

No response

Actual Behavior

3:17AM ERR Failed starting/connecting to the gRPC service: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial tcp: address /tmp/localai/backend/python/exllama/exllama.py: missing port in address"

Steps To Reproduce

https://github.com/sozercan/aikit/actions/runs/7523782972/job/20477643249#step:11:76

Are you willing to submit PRs to contribute to this bug fix?

  • Yes, I am willing to implement it.