Some useful tricks in CNN training.Most of them are from paper:Bag of Tricks for Image Classification with Convolutional Neural Networks.
Daic115/Bag-of-Tricks-in-CNN-for-Pytorch
From 'Bag of Tricks for Image Classification with Convolutional Neural Networks'
Python