MagPy is a JIT compiler for PyTorch programs. It can extract the operator graph from PyTorch programs and optimize the graph with a wide range of deep learning graph compilers.
MagPy now supports Python 3.9. The support of other Python versions is working in progress.
- Install CUDA. CUDA 11.8 is recommended.
- Install dependencies:
pip install -r requirements.txt -f https://download.pytorch.org/whl/torch_stable.html
- Install MagPy:
pip install -e . - Compile a shared library to disable Python integer cache by LD_PRELOAD. This script will generates a ``ldlong.v3.9.12.so'' file in build/ directory. You need to set the LD_PRELOAD environment variable to this file when running the PyTorch program.
cd scripts ./compile_longobj.sh
The following script compiles and runs a simple PyTorch program with MagPy.
LD_PRELOAD=build/ldlong.v3.9.12.so python test/example.pyIf you find MagPy useful in your research, please consider citing the following paper:
MagPy: Effective Operator Graph Instantiation for Deep Learning by Execution State Monitoring; Chen Zhang, Rongchao Dong, Haojie Wang, Runxin Zhong, Jike Chen, and Jidong Zhai, Tsinghua University; will be appeared in USENIX ATC'24.