Infrence-Endpoint

API endpoint for Infrence project, which creates a custom API that can be called to run inference on an LM model.

Installation

git clone https://github.com/cbauer2018/infrence-endpoint.git
cd infrence-endpoint
pip install -r requirements.txt

Usage

python3 app.py {model_type}