huggingface/bloom-jax-inference

TPU v4 version

Ontopic opened this issue · 0 comments

Perhaps I overlooked it, but I couldn't find what TPU v4 image your are using for v4-64 pod. Would be a big waste of resources setting up the wrong version ;)

I'm quessing either v2-alpha-tpuv4 or tpu-vm-v4-base? Would love to know for sure.

Aweseome effort again from HuggingFace and BigScience. Truly amazing