kun-woo-park/Ubuntu_Server_Setting

Ubuntu_Server_Setting

Ubuntu_Desktop GUI install

sudo apt-get update -y
sudo apt-get upgrade -y
sudo apt-get install ubuntu-desktop ssh -y

Install Usefull library

sudo python3 -m pip install --upgrade pip&&
sudo python3 -m pip install -U numpy &&
sudo python3 -m pip install -U matplotlib&&
sudo python3 -m pip install -U pandas&&
sudo python3 -m pip install -U scipy&&
sudo python3 -m pip install -U scikit-learn&&
sudo python3 -m pip install -U jupyter&&
sudo python3 -m pip install -U cython

Install Usefull Utility

sudo apt-get install python-pip python3-pip  python-dev python3-dev python3-numpy python-numpy git vim curl wget cmake build-essential tmux htop unzip locales

Install NVIDIA_Driver

# Add graphic driver repository
sudo add-apt-repository ppa:graphics-drivers/ppa
sudo apt update -y

# Check available driver version
apt-cache search nvidia

# Install driver
sudo apt-get install nvidia-driver-<version>
sudo reboot

# Checking installed driver
nvidia-smi

Install CUDA

1. Install from https://developer.nvidia.com/cuda-downloads
2. Add CUDA PATH in ~/.profile and /etc/environment

• ~/.profile

# set PATH for CUDA installation
if [ -d "/usr/local/cuda/bin/" ]; then
    export PATH=/usr/local/cuda/bin${PATH:+:${PATH}}
    export LD_LIBRARY_PATH=/usr/local/cuda/lib64${LD_LIBRARY_PATH:+:${LD_LIBRARY_PATH}}
fi

• /etc/environment

PATH="/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/usr/local/cuda/bin"

3. Apply changes

source ~/.profile
source /etc/environment

# or
sudo reboot

Install CUDNN

1. Install from https://developer.nvidia.com/cudnn

Setting Jupyter_Notebook

1. Install Jupyter_Notebook

sudo pip3 install jupyter

2. Generate Config file

jupyter notebook --generate-config

3. Modify Config file

vim ~/.jupyter/jupyter_notebook_config.py
# c.NotebookApp.ip
# c.NotebookApp.open_browser
# c.NotebookApp.password
# c.NotebookApp.port

4. Add scripts in /etc/rc.local

• /etc/rc.local

su <username> -c "jupyter notebook --config=/location/of/your/config/file/.jupyter/jupyter_notebook_config.py --no-browser --notebook-dir=/location/of/yournotebooks" &

Install Jupyter_HUB

1. Install Jupyter_HUB

curl https://raw.githubusercontent.com/jupyterhub/the-littlest-jupyterhub/master/bootstrap/bootstrap.py | sudo -E python3 - --admin \<admin-user-name>

2. Modify config file as writing config.yaml

sudo su
vim /opt/tljh/config/config.yaml
sudo tljh-config reload

3. Additional information of Jupyter_HUB https://github.com/jupyterhub/the-littlest-jupyterhub

Mounting hard disk

1. Check UUID

sudo blkid

2. Add directory for mounting

sudo mkdir -p /<name of directory>

3. Add information in /etc/fstab

sudo vim /etc/fstab

• /etc/fstab

UUID=<UUID of hard disk> <directory for mounting> <file system> <options> <dump setting> <file confirm option>
# Example
UUID=f5a90ae5-f49d-4d7d-8ab7-d1050ef911e9 /hdd1 ext4 defaults 0 0

4. Mount hard disk

sudo mount -a

5. Checking mounted hard disk lists

df -h

Useful commands

• Checking share of CPU and DRAM

htop

• Checking storage of disks

df -h

• Checking OS information

lsb_release -a

• Checking CPU model information

cat /proc/cpuinfo | grep CPU | head -1

• Checking CPU core numbers

cat /proc/cpuinfo | grep CPU | wc -l

• Checking Network information

ifconfig

Server Stress test

• CPU

sudo apt-get install stress-ng stress -y
stress -c <number of cores> --io 4 --hdd 1 --hdd-bytes 1024m -t 36000m --vm-bytes $(awk '/MemFree/{printf "%d\n", $2 * 0.097;}' < /proc/meminfo)k --vm-keep -m 10

• GPU

CUDA_VISIBLE_DEVICES=0 python3 gpu_test.py &
CUDA_VISIBLE_DEVICES=1 python3 gpu_test.py &
CUDA_VISIBLE_DEVICES=2 python3 gpu_test.py &
...

SSH connection using Putty, Xming (On Windows)

1. Download and install Xming from below link.

   Download Xming

2. Launch the XLounch, and save default property(path doesn't matter).

3. Download and install Putty from below link.

   Download Putty

4. Launch Putty and click Category-Connection-SSH-X11. Check 'Enable X11 forwarding' off.

5. Enter the host name and available port to Category-Session. Choose SSH as Conection type.

6. Save your network properties and click open button.

*** You should launch Xming before Putty if you want to use xwindow system.

Setting on Jetson Xavier (Jetpack 4.4)

• Install utilities

sudo apt-get update
sudo apt-get upgrade
sudo apt-get install python3-pip libopenblas-base libopenmpi-dev
python3 -m pip install --upgrade pip

• Install jtop

sudo -H pip install -U jetson-stats

• Install pytorch

wget https://nvidia.box.com/shared/static/3ibazbiwtkl181n95n9em3wtrca7tdzp.whl -O torch.whl
sudo pip3 install torch-1.5.0-cp36-cp36m-linux_aarch64.whl
sudo pip3 install torchvision