Issues
- 2
Sagemaker inference not loading model weight from s3
#116 opened by saichethan-a - 3
No support for multi-GPU
#106 opened by parviste-fortum - 0
- 0
Can’t create an inference service for models that depend on packages i.e. `espeak`
#128 opened by ghubnerr - 0
- 2
- 0
- 0
device kernel image is invalid
#119 opened by geraldstanje1 - 7
- 1
- 0
- 5
Sagemaker endpoint inferencing error with HF model loading from s3bucket with new transformer update
#108 opened by miteshkotak - 1
HF_TASK Enviournment Variable error
#110 opened by 316usman - 11
- 3
- 0
Endpoint creation completes before custom model_fn finishes loading resources
#111 opened by Tripping-Hazard - 3
InternalServerException at runtime
#87 opened by krokoko - 0
Support multiple return sequences
#109 opened by Elanmarkowitz - 4
how to load data in inference.py
#49 opened by moshonkel - 6
- 0
🏷️ invalid
#107 opened by pierrishm1987 - 1
Using custom inference script and models from Hub
#102 opened by Tarun02 - 0
- 6
- 1
- 2
How can I delpoy a model with AWS S3 and without downloading model from hunggingface via TGI image on Sagemaker?
#97 opened by weiZhenkun - 1
Error on Sagemaker deployment for v1.0.1
#96 opened by mer0mingian - 2
SageMaker deployment errors
#94 opened by jonrossclaytor - 1
Dead Link for Available HF_Tasks
#91 opened by dcsena - 4
- 1
- 2
trust_remote_code=True in new Hugging Face LLM Inference Container for Amazon SageMaker
#88 opened by krokoko - 1
Support passing model_kwargs to pipeline
#85 opened by lukealexmiller - 9
How to pass device_id to overriden functions?
#66 opened by ririya - 1
Data format for inference
#83 opened by alvaropp - 6
- 1
Make `DEFAULT_HF_HUB_MODEL_EXPORT_DIRECTORY` configurable through environment variable
#78 opened by philschmid - 2
batch transform fails to install
#77 opened by scotteggs - 3
Support for huggingface/peft
#76 opened by dbpprt - 0
Zero Shot Multi-label text classification
#69 opened by OneManArmy93 - 2
How do I use my own config.properties
#65 opened by aj2622 - 0
Any plan to support Diffusers?
#68 opened by MajorTal - 2
Support for return_all_scores in pipeline
#64 opened by CHENHUI-XU - 5
- 6
logs not showing up in cloudwatch
#61 opened by ibegleris - 1
can't load config.json; Model error
#62 opened by mamonalsalihy - 2
Support for image-classification tasks
#55 opened by akuma12 - 3
Serverless Inference
#53 opened by navidre - 1
Update transformers
#54 opened by segments-tobias - 3