This is a port of GPT-Neo that uses OpenVino - and hopefully the Intel Neural Compressor - to run on CPU.
- venv
pip install -r requirements.txtpython ovify.py
pythong main.py
For Embeddings:
Chatbot:
This is a port of GPT-Neo that uses OpenVino - and hopefully the Intel Neural Compressor - to run on CPU.
pip install -r requirements.txtpython ovify.pypythong main.py
For Embeddings:
Chatbot: