enricoros/big-AGI

Together AI vendor support.

enricoros opened this issue · 6 comments

Add support for Together models; for instance, the new Nous Mixtral is released there first.

Implemented full support, included description (context window) of the latest models, and rate limiting for the free tier.

1.11.0.-.Together.AI.support.-.2024-01-15.150641.mp4

Very fast performance!

1.11.0.-.Together.AI.support2.-.2024-01-15.162652.mp4

Awesome project indeed; unfortunately this feature seems to be broken atm; or there's an incompatibility with the API:

image

Unexpected token 'A', "An error o"... is not valid JSON

@qdrop17 I just tried it now and it works perfectly here.

Screenshot_20240130_113543_Chrome.jpg

Did you self-deploy or used the hosted version?

Anything special related to your API key? (lmk if you are able to provide a temp key for me to try, to check under the same conditions)

I self-deployed it. But the issue resolved itself when I retried. Maybe a temporary issue with the TogetherAI API.

I self-deployed it. But the issue resolved itself when I retried. Maybe a temporary issue with the TogetherAI API.

Thanks, very possible.