/D-LADMM

Differentiable Linearized ADMM (to appear in ICML 2019)

Primary LanguagePythonMIT LicenseMIT

D-LADMM


This repository is for Differentiable Linearized ADMM (to appear in ICML 2019)

By Xingyu Xie, Jianlong Wu, Zhisheng Zhong, Guangcan Liu and Zhouchen Lin.

For more details or questions, feel free to contact:

Xingyu Xie: nuaaxing@gmail.com and Jianlong Wu: jlwu1992@pku.edu.cn


table of contents


Introduction

we propose Differentiable Linearized ADMM (D-LADMM) for solving the problems with linear constraints. Specifically, D-LADMM is a K-layer LADMM inspired deep neural network, which is obtained by firstly introducing some learnable weights in the classical Linearized ADMM algorithm and then generalizing the proximal operator to some learnable activation function. Notably, we mathematically prove that there exist a set of learnable parameters for D-LADMM to generate globally converged solutions, and we show that those desired parameters can be attained by training D-LADMM in a proper way.


Usage

Here we give a toy example of D-LADMM for the Lena image denoise. An example to run this code:

python main_lena.py

Experiment Results

The testing result of the Lena image denoise. The whole process takes about 30 epochs.

Model Training Loss PSNR
D-LADMM (d = 5) 1.667 33.57
D-LADMM (d = 10) 1.663 35.44
D-LADMM (d = 15) 1.659 35.61

Denoising results of the Lena image:


Citation

If you find this page useful, please cite our paper:

@inproceedings{xie2019differentiable,
	title={Differentiable Linearized ADMM},
	author={Xingyu Xie and Jianlong Wu and Zhisheng Zhong and Guangcan Liu and Zhouchen Lin},
	booktitle={International Conference on Machine Learning},
	pages={6902--6911},
	year={2019}
}

All rights are reserved by the authors.