containers/ai-lab-recipes

https://quay.io/repository/ai-lab/llamacpp-python-cuda is provided only for x86_64

Opened this issue · 1 comments

https://quay.io/repository/ai-lab/llamacpp-python-cuda is provided only for x86_64

This for sure needs to be worked on. For now I would suggest using the ghcr.io candidates which does have both:

$ podman manifest inspect ghcr.io/containers/llamacpp-python-cuda:latest
{
    "schemaVersion": 2,
    "mediaType": "application/vnd.docker.distribution.manifest.list.v2+json",
    "manifests": [
        {
            "mediaType": "application/vnd.docker.distribution.manifest.v2+json",
            "size": 1424,
            "digest": "sha256:1c55f37824c1e5bd1fa4ff352fd618f873843de91b2281bb1dc5ec3548922ed8",
            "platform": {
                "architecture": "amd64",
                "os": "linux"
            }
        },
        {
            "mediaType": "application/vnd.docker.distribution.manifest.v2+json",
            "size": 1424,
            "digest": "sha256:421b1954775d34dc72d55c09b7d6fcae632ffdac852d0df02cf7c90e6358f610",
            "platform": {
                "architecture": "arm64",
                "os": "linux"
            }
        }
    ]
}