microsoft/DeepSpeedExamples

async_pipeline is not exposed in the library

yaliqin opened this issue · 1 comments

Hi team, I want to use async_pipeline and find mii.async_pipeline is not exposed out with the deepspeed-mii package. Can you add this in the code https://github.com/microsoft/DeepSpeed-MII/blob/main/mii/__init__.py#L6 ?

Thanks

@yaliqin please post MII issues on the MII repository.

You can import with from mii.api import async_pipeline. However, please note that this is only intended for internal use (so we will not expose in the __init__.py file) and is very much tailored to work with the inference server in MII.