How to speed up bots answers?

Question

Closed this issue a year ago · 3 comments

Dear devs,

Could you give me please some hints, how to speed up companion answers? Because waiting time with their feedback is so long.

May be some settings in project files. Our some hints about services what app uses (I meant to upgrade something).

Thanks in advance!

Answer 1 · 2023-07-25T22:35:32.000Z

Hi there, I believe the slowness is happening to the Vicuna bot. We're working on a #PR to speed it up. The GPT ones should be fairly fast.

Answer 2 · 2023-07-30T16:03:53.000Z

I am using chatgpt bot and the response time for me is around 1.2 minutes on average. Is there any way to make the response faster?

Answer 3 · 2023-08-14T07:36:27.000Z

If it's with ChatGPT the response should be a lot faster than 1.2 min unless the endpoint is congested.