Network Moments
Network Moments is a toolkit that enables computing some probabilistic moments of deep neural networks given a specific input distribution. The current implementation allows you to compute the first and second Gaussian network moments (GNM) of affine-ReLU-affine networks i.e., the output mean and variance subject to Gaussian input.
The main backend framework is but also
and
are supported.
Requirements
Network Moments was developed and tested with the following:
- Python v3.6.3+
- Option 1:
PyTorch
- torch v0.4.1+
- torchvision v0.2.1+
- Option 2:
TensorFlow
- numpy v1.14.2+
- tensorflow v1.8.0+
- Option 3:
MatLab
- matlab vR2017b+
You need Jupyter to run tightness. It is recommended that you have Jupyter Lab.
Installation
After installing the requirements, to install or update this package run the following in the terminal:
pip install -U git+https://github.com/ModarTensai/network_moments.git
Now go to the tightness notebook to see how to use this tool with the default backend framework.
To uninstall the package:
pip uninstall network_moments
Usage
To import the PyTorch
sub-package:
import network_moments.torch as nm
The basic usage is demonstrated in the tightness notebook.
To import the TensorFlow
sub-package:
import network_moments.tensorflow as nm
Please, refer to tensorflow tests notebook for examples to compare PyTorch
and TensorFlow
implementations.
Cite
This is the official implementation of the method described in this paper (checkout the poster):
@InProceedings{Bibi_2018_CVPR,
author = {Bibi, Adel and Alfadly, Modar and Ghanem, Bernard},
title = {Analytic Expressions for Probabilistic Moments of PL-DNN With Gaussian Input},
booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2018}
}
License
MIT
Author
Contributors
I would gladly accept any pull request that improves any aspect of this repository.