An API to interact with the GPT-J language model in Huggingface!
To launch the API server simply run:
python3 server.py
To launch the API server with dynamic batching run:
python3 server_batch.py
Execute the following commands to run an example in the preferred language:
bash examples/curl_example.bash
python3 examples/python_example.py
cd examples
yarn add axios
node javascript_example.js