Open RealtimeAPI Embedded SDK

Table of Contents

Platform/Device Support

This SDK has been developed tested on a esp32s3 and linux. You don't need any physical hardware to run this SDK. You can use it from Linux directly.

To use it on hardware purchase either of these microcontrollers. Others may work, but this is what has been developed against.

You can get a ESP32S3 for much less money on eBay/AliExpress.

Installation

Set your the following env variables

  • export WIFI_SSID=foo
  • export WIFI_PASSWORD=bar
  • export OPENAI_API_KEY=bing
  • export GREETING="Arr I am a pirate. Are you looking for my treasure?"
  • export INSTRUCTIONS="You are a pirate and only want to talk about pirate things."

Build

  • idf.py build

If you built for esp32s3 run the following to flash to the device

  • sudo -E idf.py flash

If you built for linux you can run the binary directly

  • ./build/src.elf

See build.yaml for a Docker command to do this all in one step.

Usage