TL:DR -- Setting up a computer in Ubuntu for AI and ML programming is currently rather painful. This is written to heal that pain and be one source of good information on how to actually complete a good setup. If you have green bars, dots, black screens and system instability, then this document will help you sort all that out.
There is a lot of scattered information on how to succeed with Nvidia GPUs and Ubuntu 22.04. Getting it right is crucial to working with advanced graphics, artifical intelligence, and machine learning on your Ubuntu Linux PC. This is what worked for us with a 3070 GPU. The resulting happy install is capable of supporting advanced graphics like Unreal Engine 5 as well as AI and ML libraries on the same machine. Further revisions are forthcoming as we continue to experiment with added functionality and clean up these commands.
This repo offers a holistic view of the OTS hardware and software. They need each other to function optimally.
What this is meant to fix:
- Green bars and dots on the screen.
- Lost monitor functionality. If you use more than one screen then this should make them both happy.
- Black screen of death. Windows has a blue screen. Linux has a black screen, with the abyss staring back at you. This is written so you're not lost in space.
- System instability. The green dots kept coming back. After bookmarking over a dozen blog pages with ads, one big repo was better. Imagine trying to read all those pages with annoying ads and green bars flickering in your face. THAT BEHAVIOR IS BEYOND ANNOYING!!!
- The #1 frustration here was that the install was only stable once and ran great. There were mutiple reasons why. Most assume "the card is bad" when they just need a better test procedures and clear instructions. There's admin and setup tricks along the way to making this work. It's all here in just one document with no clickbaiting bullshit. Not sorry.
Preamble
(I’m between jobs and had the time to write this and test it. Skip the like-and-subscribe. There’s no ads. Fork the repo and hire me!)
Chances are you’ve heard about the rapid pace of AI and how Linux is at the heart of it. You will need hardware and software upgrades both to make it work. Configuring both can be a bit of a challenge for some. The needed libraries are really just starting to get their sea legs.
The pattern laid out here for install, test, and debug is what's important. You will likely need to tinker a bit with the revision numbers on your machine. If you have a new Nvidia 3060, 3070, or 3080 graphics card and run Ubuntu Linux 22 you’ve likely had a tough time between 2022-2023. There is a LOT of conflicting information in November 2023 on what libraries to install, from where, in what order, and for what bugs that pop up. What works for a 3060 or 3080 doesn’t work for the 3070 8GB that I have. They’re good bang-for-the-buck cards but they all need something a little different. Ubuntu 20 and 22 both act different, as well. This repo is geared towards 22.04 LTS.
What the problem really is
The Ubuntu libraries and repos are currently a little out of sync. Nvidia drivers need the right cuda toolkit to be happy. The pattern and debug tools listed here will help you along the way. Diagnostic commands and logs are listed at the bottom. The bugs listed are common but solutions are scattered. Weeks of singular effort was extended to research and test all of this. It deserves a good and thorough write-up in one spot.
Situation
The range of Nvidia drivers from 470, 515, 525, 535, 545 --I tested all of them on my Ubuntu 22.04 LTS install with one 3070 8GB graphics card. Most of them puked. This build and debug document helps explain why. The correct CUDA toolkit version changes according to: which driver you use on which card in which Ubuntu version.
The Nvidia driver appears to need the CUDA toolkit to function and for you to build onto. Using the GPU in your data science code requires libraries that talk directly to it. We are building this parallel highway, basically. The CUDA toolkit is the highway for those "vehicles", or libraries. Otherwise you just have a nice gaming rig. This lets you have both! The catch is you can’t cut corners to get there.
As of this writing in November 2023, ubuntu-cuda-toolkit is on version 11.5. I needed version 12.3 directly from Nvidia to make the new 545 driver work. A few simple lines of Ubuntu commands didn't make it work. This is a little involved. That’s a bit of a curve ball for newbies. Ubuntu’s repos just haven’t caught up yet and it’s nobody’s fault. This should be a more straight forward install in a few months and I hope to help that along.
Cuda 10-11.4 is recommended by older posts for Ubuntu 20. Ubuntu 22 only partially works with those later drivers. 470 is supposedly more stable but that crashes in Ubuntu 22 as well. 545 finally works! Whomever did that, good job! I'm standing on the shoulders of giants, and you can too. The extra libraries and configuration shown here were the real challenges to piece together.
If you’ve gone around in circles with this until now, these steps should be more straight forward. GPUS also need more power. You will end up adding a power supply and a cooler for reliability and stability. Do it or you’ll be sorry. If you have a gaming rig then you likely updated these things already. Making them work smoother in Linux is the point of all these words.
(Bookmark or fork this repo. There’s a few reboots involved and you'll need to come back.)
Extra hardware
Install the above or some kind of good equivalent. I had to cut a hole in the side of my A10 ASUS case for the cooler to fit. A bigger case was more money I didn't have.
1.) Enable discreet graphics. Turn off your integrated or Intel graphics card. Nvidia stuff hates them.
2.) Turn off power saver features. They can mess with the GPU causing some fade and instability from low power. AI, ML, and advanced graphics use more power and need more cooling because of that. If you decide to overclock anything later on, you’ll be turning these functions off anyway because that also takes more power. Hot rods drink expensive fuel and this is no different. You are tuning and prepping a hot rod of a computer. Treat it carefully as such.
3.) Blacklist your nouveau driver. Nouveau drivers can clash with Nvidia and fight over control. Bad juju there.
$ sudo bash -c "echo blacklist nouveau > /etc/modprobe.d/blacklist-nvidia-nouveau.conf"
$ sudo bash -c "echo options nouveau modeset=0 >> /etc/modprobe.d/blacklist-nvidia-nouveau.conf"
$ cat /etc/modprobe.d/blacklist-nvidia-nouveau.conf
blacklist nouveau
options nouveau modeset=0
4.) $ sudo update-initramfs -u
5.) update kernel headers.
$ sudo apt-get --reinstall install linux-headers-$(uname -r)
6.) Update GRUB just to be safe.
$ sudo update-grub
7.) sudo reboot
-
) $
sudo apt-get remove nvidia-cuda-toolkit -
) $
sudo apt-get --purge remove "*cud*" "*cublas*" "*cufft*" "*cufile*" "*curand*" "*cusolver*" "*cusparse*" "*gds-tools*" "*npp*" "*nvjpeg*" "nsight*" "*nvvm*" -
) $
sudo apt-get --purge remove "*nvidia*" "libxnvctrl*"(There's asterisks before and after nvidia. github keeps removing them for some reason.) -
) Remove the GDM3 X manager entirely. It will still fight with LightDM and Nvidia. Take it out of the picture entirely. $
sudo apt-get purge --auto-remove gdm3 -
) $
sudo update-grub -
) $
sudo update-initramfs -u -
) $
sudo reboot
- ) $
sudo apt install lightdm inxi nvidia-settings appmenu-gtk3-module nvidia-settings nvidia-smi nvidia-xconfig
(Special note on lightdm. Ubuntu 22 I think defaults to the GDM3 X Display manager. Nvidia drivers HATE it. Your driver setup will work only once before corrupting. You will see screen artifacts, “melting” of pixels, and what looks like API balloons during the boot up log before graphics have even loaded. Stay away from GDM3 for now.)
- ) $
sudo ubuntu-drivers autoinstall(Special note here: My install grabbed the 545 drivers automatically. Lots of blogs will tell you to do this graphically in the Ubuntu Software Center. Others tell you to install specific nvidia drivers like the 510, 515, 525, etc. That may work for you, but it didn’t work for me. I couldn’t follow anything empirically or literally with this and have it work.)
(Important note adjust specs of the as needed for your installation. You'll need to match up the Nvidia CUDA toolkit version to the version that was autoinstalled through Ubuntu. This is the nasty curve ball mentioned earlier. These have to match appropriately.)
(Important Note. When you run the below installer it will bring up a menu at the command prompt. DESELECT the option to install the driver from Nvidia. Keep the one autoinstalled from Ubuntu. It will give you warnings but proceed anyway. The big revision number like 525, 545 etc. is what matters for now.)
$ sudo sh cuda_12.3.1_545.23.08_linux.run
$ sudo nvidia-xconfig
$ sudo reboot
At this point when you reboot, you should hopefully NOT have any more green dots or bars on your screen. The "cleaning and paving" of this parallel highway helps the drivers load correctly upon start up. GDM3 is like a boulder in the road.
$ nvidia-settings
This should bring up the GUI to check things out with your GPU that the system can now hopefully see.
$ nvidia-smi
Fri Nov 24 23:28:37 2023
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 545.29.02 Driver Version: 545.29.02 CUDA Version: 12.3 |
|-----------------------------------------+----------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+======================+======================|
| 0 NVIDIA GeForce RTX 3070 Off | 00000000:01:00.0 On | N/A |
| 54% 50C P8 21W / 240W | 285MiB / 8192MiB | 0% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
+---------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=======================================================================================|
| 0 N/A N/A 2269 G /usr/lib/xorg/Xorg 239MiB |
| 0 N/A N/A 31882 G /usr/bin/gnome-shell 38MiB |
+---------------------------------------------------------------------------------------+
$ nvcc -V
output:
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2023 NVIDIA Corporation
Built on Fri_Nov__3_17:16:49_PDT_2023
Cuda compilation tools, release 12.3, V12.3.103
Build cuda_12.3.r12.3/compiler.33492891_0
If the above library isn’t installed or the driver is not properly installed, the above won’t return any kind of value.
$ dkms status
output:
nvidia/545.29.02, 6.2.0-36-generic, x86_64: installed
nvidia/545.29.02, 6.2.0-37-generic, x86_64: installed
openrazer-driver/3.2.0, 5.15.0-89-generic, x86_64: installed
openrazer-driver/3.2.0, 6.2.0-36-generic, x86_64: installed
openrazer-driver/3.2.0, 6.2.0-37-generic, x86_64: installed
v4l2loopback/0.12.7, 5.15.0-89-generic, x86_64: installed
v4l2loopback/0.12.7, 6.2.0-36-generic, x86_64: installed
v4l2loopback/0.12.7, 6.2.0-37-generic, x86_64: installed
virtualbox/6.1.38, 5.15.0-89-generic, x86_64: installed
virtualbox/6.1.38, 6.2.0-36-generic, x86_64: installed
virtualbox/6.1.38, 6.2.0-37-generic, x86_64: installed
$ sudo prime-select nvidia
Error: no integrated GPU detected.
The above command should output this error if you’ve disabled onboard graphics in the BIOS listed above.
$ grep nvidia /etc/modprobe.d/* /lib/modprobe.d/*
/etc/modprobe.d/blacklist-framebuffer.conf:blacklist nvidiafb
/etc/modprobe.d/nvidia-graphics-drivers-kms.conf:# This file was generated by nvidia-driver-545
/etc/modprobe.d/nvidia-graphics-drivers-kms.conf:options nvidia-drm modeset=1
/etc/modprobe.d/nvidia-installer-disable-nouveau.conf:# generated by nvidia-installer
/lib/modprobe.d/nvidia-installer-disable-nouveau.conf:# generated by nvidia-installer
/lib/modprobe.d/nvidia-kms.conf:# This file was generated by nvidia-prime
/lib/modprobe.d/nvidia-kms.conf:options nvidia-drm modeset=1
The above command will show you if nvidia is blacklisted anywhere. The nvidiafb blacklist should be there but no other nvidia blacklisting as of this writing.
$ grep nouveau /etc/modprobe.d/* /lib/modprobe.d/*
/etc/modprobe.d/blacklist-nouveau.conf:blacklist nouveau
/etc/modprobe.d/blacklist-nouveau.conf:options nouveau modeset=0
/etc/modprobe.d/blacklist-nvidia-nouveau.conf:blacklist nouveau
/etc/modprobe.d/blacklist-nvidia-nouveau.conf:options nouveau modeset=0
/etc/modprobe.d/nvidia-installer-disable-nouveau.conf:blacklist nouveau
/etc/modprobe.d/nvidia-installer-disable-nouveau.conf:options nouveau modeset=0
/lib/modprobe.d/nvidia-graphics-drivers.conf:blacklist nouveau
/lib/modprobe.d/nvidia-graphics-drivers.conf:blacklist lbm-nouveau
/lib/modprobe.d/nvidia-graphics-drivers.conf:alias nouveau off
/lib/modprobe.d/nvidia-graphics-drivers.conf:alias lbm-nouveau off
/lib/modprobe.d/nvidia-installer-disable-nouveau.conf:blacklist nouveau
/lib/modprobe.d/nvidia-installer-disable-nouveau.conf:options nouveau modeset=0
You want to have Nouveau drivers blacklisted. The above command shows that.
$ sudo update-grub
Sourcing file `/etc/default/grub'
Sourcing file `/etc/default/grub.d/init-select.cfg'
Generating grub configuration file ...
Found linux image: /boot/vmlinuz-6.2.0-37-generic
Found initrd image: /boot/initrd.img-6.2.0-37-generic
Found linux image: /boot/vmlinuz-6.2.0-36-generic
Found initrd image: /boot/initrd.img-6.2.0-36-generic
Memtest86+ needs a 16-bit boot, that is not available on EFI, exiting
Warning: os-prober will be executed to detect other bootable partitions.
Its output will be used to detect bootable binaries on them and create new boot entries.
Adding boot menu entry for UEFI Firmware Settings ...
done
The above is more for good house keeping.
$ sudo nvidia-bug-report.sh
You’ll need log file output if anything goes sideways. This document is also written to help you communicate with others effectively. Tech support or other enthusiasts will help you on StackOverflow, Ubuntu, or Nvidia forums. These log file outputs will help you both diagnose any problems.
sudo dpkg -i --force-overwrite /var/cache/apt/archives/nvidia-kernel-common-535_535.129.03-0ubuntu1_amd64.deb