xtreme1-io/xtreme1

some ideas about 'Enable model services' section

Yukun-Cui opened this issue · 3 comments

Yukun-Cui commented

Enable model services

Make sure you have installed NVIDIA Driver and NVIDIA Container Toolkit. But you do not need to install the CUDA Toolkit, as it already contained in the model image.

# You need set "default-runtime" as "nvidia" in  /etc/docker/daemon.json and restart docker to enable NVIDIA Container > Toolkit
{
 "runtimes": {
   "nvidia": {
     "path": "nvidia-container-runtime",
     "runtimeArgs": []
   }
 },
 "default-runtime": "nvidia"
}

In Enable model services section, you need set default-runtime as nvidia. If you use Docker Desktop + WSL2.0, you have to set it at Docker Engine of Docker Desktop just like the picture below.

企业微信截图_16929318134631

nicozhan commented

May I ask if you have successfully run the platform through WSL 2.0?
Is it because some components do not support WSL2.0, causing the platform to fail?

Yukun-Cui commented

Yes, I have successfully run the platform through Docker Desktop + WSL2.0.

nicozhan commented

Great! I will update it to Readme!