/esp-ai

Provide a complete set of AI dialogue solutions for your development board, including but not limited to the IAT+LLM+TTS integration solution for the ESP32 series development board. | 为你的开发板提供全套的AI对话方案，包括但不限于 ESP32 系列开发板的 IAT+LLM+TTS 集成方案。 喜欢本项目的话点个 Star 吧，您的一个 Star 对目前的仓库发展非常重要~

Primary LanguageJavaScriptApache License 2.0Apache-2.0

ESP-AI npm npm

logo.png

简体中文

Provides a complete AI dialogue solution for your development board, including but not limited to the IAT(ASR)+LLM+TTS integration solution for the ESP32 series development boards. It is injected into the project as a dependency without affecting existing projects.

For developing the dialogue functionality of robots, you only need to prepare the IAT(ASR), LLM, and TTS services, and leave the rest to ESP-AI.

The server-side code of this project is based on Node.js, and the hardware code is based on Arduino IDE.

Open source is not easy, click the Star button in the upper right corner to show your support~

Website Homepage

Features

  • Customizable offline voice wake-up
  • IAT(ASR) ➡️ LLM/RAG ➡️ TTS
  • Configurable
  • Plugin-based
  • Ready to use

Next Steps

  • Provide a no-code access solution
  • Integrate AI into the user intent inference process (e.g., "Turn off the light", "Quickly turn on the light", both recognized as the "turn on the light" command)
  • Offer both free and paid services
  • Online generation of wake words
  • Support for writing plugins in other languages (avoiding the need to use Node.js exclusively for plugin development)
  • Provide dedicated development boards (to avoid the current complex wiring)

Inject Soul into Your Robot with Just a Few Lines of Code

Below are the Node.js and Arduino codes you need to write if you only require dialogue functionality.

Discussion Group

QQ Discussion Group: 854445223

Detailed Usage Tutorial

Connecting Hardware to Large Language Models (LLM) Made Simple~

Case Study Video

bilibili