Issues
- 0
bedrock model support...
#48 opened by mmgxa - 0
- 6
Pydantic problem
#23 opened by bacoco - 2
Issue setting huggingface.prompt_builder = 'llama2' when using sagemaker as client
#31 opened by bcarsley - 1
Need to pass custom_attributes='accept_eula=true' when invoking SageMaker endpoint
#41 opened by olinguyen - 1
OverloadedError: Model is overloaded
#34 opened by farshidbalan - 5
Boto dependency shouldn't be foreced
#39 opened by giyaseddin - 2
- 1
bedrock.ChatCompletion.create Raises ValidationError for Non-Integer Token Values in Python 3.9
#40 opened by 5c0rp - 2
- 6
- 7
Is there a way to enable structured output?
#22 opened by phiweger - 0
[Feature] Add support for logit_bias
#35 opened by bitnom - 5
- 1
Streaming support in Sagemaker?
#32 opened by AIByteSmith - 2
Multiple messages
#29 opened by dayuyang1999 - 2
- 3
- 3
Move makefile to hatch scripts
#19 opened by chainyo - 4
Local inference of TGI
#21 opened by bacoco - 3
Bug: `model` must be defined despite docs saying that if not provided, it defaults to base url.
#11 opened by tomaarsen