lxp2013/PIDOptimizer

The Pytorch code for this CVPR 2018 paper: "A PID Controller Approach for Stochastic Optimization of Deep Networks"

Python

PIDOptimizer (Proportional–Integral–Derivative Optimizer)

This repository contains source code of the paper:

A PID Controller Approach for Stochastic Optimization of Deep Networks (CVPR 2018)

Prerequisite:

matplotlib==2.0.2

Train MLP on MNIST DATAST

python mnist_pid.py python mnist_momentum.py python compare.py

PID Vs. SGD-Momentum

Citation:

If PIDOptimizer is used in your paper/experiments, please cite the following paper.

@InProceedings{An_2018_CVPR,
author = {An, Wangpeng and Wang, Haoqian and Sun, Qingyun and Xu, Jun and Dai, Qionghai and Zhang, Lei},
title = {A PID Controller Approach for Stochastic Optimization of Deep Networks},
booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2018}
}