Any interest in support Claude?

Question

Any interest in support Claude?

justengland opened this issue 5 months ago · 9 comments

Seems like there are some new models like claude and llama3.1 that are pretty exciting, is there any interest in supporting them?

Answer 1 · 2024-07-29T14:24:34.000Z

Absolutely. Have been busy these last few months. Would love to add support for other APIs.

Answer 2 · 2024-07-29T16:21:01.000Z

Seems like the client/client.go is the file currently used to interface with the open ai api. Seems like to support multiple api's an abstract factory or some sort of light abstraction is needed, as I look at the api's they seem similar but not identical. I dont mind lending a hand if we could agree on a path forward.

Answer 3 · 2024-07-30T12:18:11.000Z

I think that makes sense. Would love your help on this. Let me find some time to play around with the perplexity API which seems super similar as well.

Answer 4 · 2024-08-17T14:07:36.000Z

I started putting together some perplexity documentation: https://github.com/kardolus/chatgpt-cli/blob/main/docs/perplexity_api.md

Before proceeding I will add a --debug flag that prints raw request data and responses. I think that will come in handy when talking to different APIs. I am not super happy with the name chatgpt-cli if we are going to support perplexity and claud. But that's a bridge we don't have to cross right now.

Answer 5 · 2024-08-17T15:49:05.000Z

I just cut 1.6.3 with the new debug option.

Answer 6 · 2024-08-17T17:05:07.000Z

I am super stoked. Actually got it to work with perplexity! See the latest README on the main branch. I still have to cut a release though. I needed to omit presence and frequency penalties in case they were 0. So I had to implement my own marshaller.

I will try playing with Claude later on.

Answer 7 · 2024-08-17T20:13:36.000Z

The anthropic API is incompatible with the ChatGPT API: https://github.com/kardolus/chatgpt-cli/blob/main/docs/anthropic_api.md

So yeah, we would have to write anthropic specific code. Kind of a bummer. The code as is works with perplexity, chatgpt and azure openai service.

Supporting this new API would require an interface for the client. We would have to pick the right implementation during runtime based on configuration. Definetely doable, but it would have been nice if it just worked :).

I may do this in a fork.

Answer 8 · 2024-09-16T23:59:37.000Z

Now also supporting Llama :)

Answer 9 · 2024-09-18T12:38:37.000Z

I will be releasing an aichat (still thinking of a good name) somewhere in the upcoming months that will also be supporting Claude