PhoenixOS-Remoting

PhoenixOS-Remoting (PhOS-remote) is an fully-optimized API remoting framework for GPU API calls from various vendors, which is a key technique to implement GPU virtualization / pooling.

Note

The current release version of PhOS (v0.10) relies on RWTH-ACS/cricket for remoting GPU API calls, we thank cricket's authors.
We have fully developped our own Rust-based framework for optimizing API remoting, which would be released soon.
For more details about this framework, please check our paper first: Characterizing Network Requirements for GPU API Remoting in AI Applications