Maxout network is a feedforward neural network which uses maxout units for activation function. Maxout network was initialy described in this paper This repository contains two implementations (tensorflow and pytorch) of a maxout unit.
@ARTICLE{2013arXiv1302.4389G,
author = {Ian J. Goodfellow, David Warde-Farley, Mehdi Mirza,Aaron Courville, Yoshua Bengio},
title = {Maxout Networks},
journal = {ArXiv e-prints arXiv:1302.4389},
year = {2013}
}
python maxout_pytorch_version.py
or maxout_tensorflow_version.py
to run the scripts and to visualize how a maxout unit approximates a non-linear function.
You can know more about it with my story on Medium