https://quay.io/repository/ai-lab/llamacpp-python-cuda is provided only for x86_64
Opened this issue · 1 comments
jeffmaury commented
https://quay.io/repository/ai-lab/llamacpp-python-cuda is provided only for x86_64
Gregory-Pereira commented
This for sure needs to be worked on. For now I would suggest using the ghcr.io
candidates which does have both:
$ podman manifest inspect ghcr.io/containers/llamacpp-python-cuda:latest
{
"schemaVersion": 2,
"mediaType": "application/vnd.docker.distribution.manifest.list.v2+json",
"manifests": [
{
"mediaType": "application/vnd.docker.distribution.manifest.v2+json",
"size": 1424,
"digest": "sha256:1c55f37824c1e5bd1fa4ff352fd618f873843de91b2281bb1dc5ec3548922ed8",
"platform": {
"architecture": "amd64",
"os": "linux"
}
},
{
"mediaType": "application/vnd.docker.distribution.manifest.v2+json",
"size": 1424,
"digest": "sha256:421b1954775d34dc72d55c09b7d6fcae632ffdac852d0df02cf7c90e6358f610",
"platform": {
"architecture": "arm64",
"os": "linux"
}
}
]
}