aws-samples/bedrock-access-gateway

Support for Mistral Large 2 (24.07)

Closed this issue · 8 comments

diopresi commented

Hey, I was trying to call Mistral Large 2 (24.07) on the proxy, but I got a "model not supported" error. I was looking at the code and noticed that the entry hasn't been added yet.

diopresi commented

@daixba create a PR #39 for this please review this as you can

fn5 commented

This is still an issue:

"Unsupported model mistral.mistral-large-2407-v1:0, please use models API to get a list of supported models"

I couldn't figure out how to make this edit myself within a deployed cloudstack.

diopresi commented

Hi @fn5,

I understand that you're looking to use the mistral.mistral-large-2407-v1:0 model. Please ensure that this model is both available in the targeted region and enabled.

Additionally, I want to confirm that mistral.mistral-large-2407-v1:0 has been added to the gateway with this #39. For more details on this, you can refer to the following How to upgrade? regarding the upgrade process.

fn5 commented

Hi - the issue is that I deployed it today and it still had this error. Can someone else with it deployed check it?

fn5 commented

@diopresi - apologies to come across so brashly. Is there any chance the .template file hosted on the amazon side has not updated properly? While #39 has been merged, my deployment today to us-west-2 gets this error.

diopresi commented

no prob, @fn5. i just checked, and it seems the ECR image hasn’t been updated yet, and no action has been executed on that side so far. i’ll let @daixba provide more insights or updates on this.

  • 👍1
daixba commented

I apologize that I don't have any bandwidth to maintain this project to keep it update to date recently. Please do host your own ecr image (there is a script for reference in the repo) and that is the recommended way to use this repo.

Sorry about this.

  • 👍1
daixba commented

All new models are already supported. Please update the stack and try again.
Closing this issue.