/structured-nets

Structured matrices for compressing neural networks

Primary LanguagePythonApache License 2.0Apache-2.0

structured-nets

Code to accompany the paper Learning Compressed Transforms with Low Displacement Rank.

Requirements

Python 3.6+

PyTorch >=0.4.1

Installing CUDA Extensions

Some functions are written in CUDA for speed. To install them:

cd pytorch/structure/hadamard_cuda
python setup.py install

cd pytorch/structure/diag_mult_cuda
python setup.py install

Example Usage

See our PyTorch section.