Issues
- 0
- 3
Unable to use Llama 3.1 or 3.2 - Unsupported model
#71 opened by tahpot - 0
No streaming response for ALB + lambda (I used Dockerfile to build image to push it to ECR)
#74 opened by GxWwT - 1
Unable to access anthropic.claude-3-5-sonnet-20240620-v1:0 -- Invocation of model ID with on-demand throughput isn't supported
#73 opened by plemelin - 0
Support for knowledge base
#68 opened by aviv-ples - 0
Support running bedrock-access-gateway in offline mode (from a PRIVATE_ISOLATED VPC with no NAT Gateway)
#67 opened by sefinx - 1
Support for Anthropic Sonnet 3.5 v2
#66 opened by orossant - 0
Support for Llama 3.2
#62 opened by mickgiles - 7
Documentation for locally running
#34 opened by aaronbolton - 0
Support Document and Image as parameter
#59 opened by orossant - 3
Support for Llama 3.1?
#31 opened by oemd001 - 4
- 1
Custom Image returns 502 Bad Gateway
#48 opened by asongent - 1
Official Docker image
#52 opened by hongbo-miao - 1
Support for setting up TLS on ALB
#54 opened by mtrampic - 0
- 7
Support for Mistral Large 2 (24.07)
#38 opened by diopresi - 0
Add o11y features
#53 opened by lindarr915 - 1
- 1
- 1
作者你好,我来提一个需求:是否可以考虑使用aiobotocore来做比boto3更好的异步调用
#51 opened by GxWwT - 4
Issue with concurrent requests on AWS Fargate
#22 opened by eliran89c - 0
feat: prompt caching
#49 opened by sammcj - 1
Add configurable port
#46 opened by medvekoma - 1
Unable to use inputs larger than 2048 tokens even with models that support more
#41 opened by arnaudaz - 0
Support for Titan Models
#44 opened by btong04 - 0
- 3
- 2
- 0
Support for AzureOpenAI format
#35 opened by hustshawn - 1
Support Custom Model Import
#30 opened by didhd - 10
Need token usage when stream is true
#28 opened by dftty - 0
Tools calling in bedrock
#29 opened by swosty - 3
stream resposne contains a null tool_calls , invalid for typescript resposne validation
#21 opened by yangcheng - 4
- 2
multiple API keys and quota per key?
#18 opened by yangcheng - 1
- 2
Default API Key should be removed
#10 opened by bnusunny - 3
- 5
Cohere Command R Support
#12 opened by kawataki-yoshika - 1
你好, 为什么要Disable TitanEmbeddingsModel?
#9 opened by GxWwT - 2
- 3
- 1
When calling the claude-3 API through the Bedrock Access Gateway, the 'system' parameter does not take effect.
#6 opened by lishiyu - 1
SSL TLS Support
#5 opened by michaellatman