API endpoint for Infrence project, which creates a custom API that can be called to run inference on an LM model.
git clone https://github.com/cbauer2018/infrence-endpoint.git
cd infrence-endpoint
pip install -r requirements.txt
python3 app.py {model_type}