NPC-Engine is a deep learning and NLP toolkit for designing NPC AI with natural language.
- Chat-bot dialogue system.
- SoTA tools like text semantic similarity and text to speech.
- Easy, open source deep learning model standard (ONNX with YAML configs).
- GPU accelerated inference with onnxruntime.
- Engine agnostic API through ZMQ server via JSONRPC 2.0.
The easiest way to get started is to use NPC Engine through the Unity integration
You can also use it directly through ZMQ or HTTP. See Documentation for more details.
- Real-time end-to-end chatbot dialogue system
- Semantic similarity
- Real-time speech to text (experimental)
- Unity integration
- CLI tool for importing models from Huggingface
- Asynchronous API features
- Actions and planning
- Unreal integration
- Importing models from popular TTS libraries
- Emotion features
- Multiple languages support
- Much more
-
Create virtualenv and activate it:
> python3 -m venv npc-engine-venv > .\npc-engine-venv\activate.bat
-
Install dependencies
> pip install -e .[dev,dml]
-
(Optional) Compile, build and install your custom ONNX python runtime
Build instructions here https://onnxruntime.ai/
-
(Optional) Run tests
> tox
-
Compile to exe with:
> pyinstaller --hidden-import="sklearn.utils._cython_blas" --hidden-import="sklearn.neighbors.typedefs" ^ --hidden-import="sklearn.neighbors.quad_tree" --hidden-import="sklearn.tree._utils" ^ --hidden-import="sklearn.neighbors._typedefs" --hidden-import="sklearn.utils._typedefs" ^ --hidden-import="sklearn.neighbors._partition_nodes" --additional-hooks-dir hooks ^ --exclude-module tkinter --exclude-module matplotlib .\npc_engine\cli.py --onedir
See also the list of contributors who participated in this project.