Together AI vendor support.

Question

enricoros opened this issue a year ago · 6 comments

Add support for Together models; for instance, the new Nous Mixtral is released there first.

Answer 1 · 2024-01-15T23:08:36.000Z

Implemented full support, included description (context window) of the latest models, and rate limiting for the free tier.

1.11.0.-.Together.AI.support.-.2024-01-15.150641.mp4

Answer 2 · 2024-01-16T00:27:30.000Z

Very fast performance!

1.11.0.-.Together.AI.support2.-.2024-01-15.162652.mp4

Answer 3 · 2024-01-30T13:11:08.000Z

Awesome project indeed; unfortunately this feature seems to be broken atm; or there's an incompatibility with the API:

Unexpected token 'A', "An error o"... is not valid JSON

Answer 4 · 2024-01-30T19:36:17.000Z

@qdrop17 I just tried it now and it works perfectly here.

Did you self-deploy or used the hosted version?

Anything special related to your API key? (lmk if you are able to provide a temp key for me to try, to check under the same conditions)

Answer 5 · 2024-02-06T21:47:09.000Z

I self-deployed it. But the issue resolved itself when I retried. Maybe a temporary issue with the TogetherAI API.

Answer 6 · 2024-02-06T21:56:45.000Z

I self-deployed it. But the issue resolved itself when I retried. Maybe a temporary issue with the TogetherAI API.

Thanks, very possible.