need a published docker image with latest huggingface-hub and huggingface-cli
lianhao opened this issue · 2 comments
Is your feature request related to a problem? Please describe.
We need a docker image with latest huggingface-hub and huggingface-cli in it, so we can easily pre-downloaded the model in a k8s and/or docker environment. Currently, the only image we've found is https://hub.docker.com/r/huggingface/downloader, which only contains a pretty old version of huggingface-hub that doesn't support downloading some specific models, e.g. meta-llama/Meta-Llama-3.1-70B-Instruct.
Describe the solution you'd like
A simple published docker image with latest huggingface-hub and huggingface-cli.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.
Hi @lianhao,
thanks for your request and sorry for the inconvenience! The huggingface/downloader image is meant for internal testing only and isn't actively maintained.
Regarding having a Docker image with huggingface-hub and huggingface-cli pre-installed, we don't plan to maintain this image for now. Of course, we'll prioritize this based on community interest and contributions. Meanwhile, the simplest alternative I can suggest is to create a simple Dockerfile with these packages for your use case, and build and push the image to your own registry.
We'll keep this issue open in case someone from the community wants to step up and maintain such image (that would be awesome!)
It's basically:
FROM python:3
RUN pip install huggingface_hub