[Feature]: Add customheaders field to the AISpec structure in package v1alpha1
Opened this issue · 0 comments
DataVizz commented
Checklist
- I've searched for similar issues and couldn't find anything matching
- I've discussed this feature request in the K8sGPT Slack and got positive feedback
Is this feature request related to a problem?
Yes
Problem Description
When using Serverless Inference Platform(SLIP) endpoints, there is a need to use custom headers (key value pair) as prefix to AI model when using the k8sgpt operator within the cluster.
Solution Description
When applying the k8sGPT configuration object using yaml manifest on the cluster, the customheader field under ai will enable the call to the internal SLIP endpoint hosting the various LLM models. The jsonpath where this feature needs to be added is : .spec.ai.customheaders
Benefits
Addition of this feature to the k8sGPT configuration object will fill in the results object with AI recommendations from SLIP endpoints.
Potential Drawbacks
No response
Additional Information
No response