Wyoming Whisper.cpp

Wyoming protocol server for the whisper.cpp speech to text system.

Local Install

Install dependencies:

sudo apt-get install build-essential

Clone the repository and set up Python virtual environment:

git clone https://github.com/rhasspy/wyoming-whisper-cpp.git
cd wyoming-whisper-cpp
script/setup

Build the whisper.cpp main executable:

make -C whisper.cpp/ main

Run a server anyone can connect to:

script/run \
  --whisper-cpp-dir ./whisper.cpp \
  --model tiny.en-q5_1 \
  --language en \
  --uri 'tcp://0.0.0.0:10300' \
  --data-dir /data \
  --download-dir /data

Docker Image

docker run -it -p 10300:10300 -v /path/to/local/data:/data rhasspy/wyoming-whisper-cpp \
    --data-dir /data --model tiny.en-q5_1 --language en

Source

GPU Support

For more advanced use cases, consider the community-built wyoming-whisper-api-client