/transformers-rocm-docker

Transformers on GPU AMD Radeon in Docker

Primary LanguagePython

Transformers on GPU AMD Radeon in Docker

Basic configuration of the docker container hardandheavy/transformers-rocm for working with transformer models on GPU from Radeon.

Requirements

  • Ubuntu
  • make
  • Docker
  • ROCm

Install ROCm

Taken from quick-start install guide:

sudo apt install "linux-headers-$(uname -r)" "linux-modules-extra-$(uname -r)"
sudo usermod -a -G render,video $LOGNAME
wget https://repo.radeon.com/amdgpu-install/6.1.2/ubuntu/jammy/amdgpu-install_6.1.60102-1_all.deb
sudo apt install ./amdgpu-install_6.1.60102-1_all.deb

# If an error occurs, you must run:
sudo chown -Rv _apt:root /var/cache/apt/archives/partial/
sudo chmod -Rv 700 /var/cache/apt/archives/partial/

sudo apt update
sudo apt install amdgpu-dkms
sudo apt install rocm-hip-libraries
sudo reboot

Testing

Tested on AMD Radeon RX 7900 XTX.

make bash
make test