google-research/t5x

Is it possible to run T5X using only the CPU?

Shean50 opened this issue · 0 comments

I want to run T5X using only the CPU, but I couldn't find any instructions for doing so.
So, I attempted to follow the GPU guide instead.
(https://github.com/google-research/t5x/blob/main/t5x/contrib/gpu/scripts_gpu/README.md)

t5x/contrib/gpu/docker/build.sh <name>
docker run docker.io/library/<name>
After that, I encountered the error message below:

================
== TensorFlow ==
================

NVIDIA Release 22.08-tf2 (build 42105625)
TensorFlow Version 2.9.1

Container image Copyright (c) 2022, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
Copyright 2017-2022 The TensorFlow Authors.  All rights reserved.

Various files include modifications (c) NVIDIA CORPORATION & AFFILIATES.  All rights reserved.

This container image and its contents are governed by the NVIDIA Deep Learning Container License.
By pulling and using the container, you accept the terms and conditions of this license:
https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license

WARNING: The NVIDIA Driver was not detected.  GPU functionality will not be available.
   Use the NVIDIA Container Toolkit to start this container with GPU support; see
   https://docs.nvidia.com/datacenter/cloud-native/ .

NOTE: The SHMEM allocation limit is set to the default of 64MB.  This may be
   insufficient for TensorFlow.  NVIDIA recommends the use of the following flags:
   docker run --gpus all --ipc=host --ulimit memlock=-1 --ulimit stack=67108864 ...

So I think that this guide is intended only for GPU usage, not CPU.
Is it possible to run T5X using only the CPU?
If so, what modifications do I need to make to the code, scripts or settings?