Setting the timeout on requests to ChatCompletionService
Opened this issue · 2 comments
robertstewartnz commented
Is there an easy way to change the timeout.
I've been hitting a timeout issue in my response from the ChatCompletionService. The max appears to be 100seconds.
JZO001 commented
Where is the timeout comes? From the HttpClient or from the OpenAI service?
If your would like to configure HttpClient Timeout value, the quickest way right now, if you extend the ApiHttpClientFactory and replace the service registration in the DI container.
robertstewartnz commented
Thanks.
Get Outlook for Android<https://aka.ms/AAb9ysg>
…________________________________
From: Zoltan Juhasz ***@***.***>
Sent: Tuesday, October 10, 2023 8:49:59 PM
To: JZO001/Forge.OpenAI ***@***.***>
Cc: Robert Stewart ***@***.***>; Author ***@***.***>
Subject: Re: [JZO001/Forge.OpenAI] Setting the timeout on requests to ChatCompletionService (Issue #2)
Where is the timeout comes? From the HttpClient or from the OpenAI service?
If your would like to configure HttpClient Timeout value, the quickest way right now, if you extend the ApiHttpClientFactory and replace the service registration in the DI container.
—
Reply to this email directly, view it on GitHub<#2 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AXN6OCPCBMDPUFH5WU5OFX3X6T42PAVCNFSM6AAAAAA5ZUGLYOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTONJUGYYDQNJZG4>.
You are receiving this because you authored the thread.Message ID: ***@***.***>