This repo is to support the korean language of wire-pod. It's very tricky solution using google asr api (e.g. python speechrecognition package). It was tested under ubuntu 20.04. Raspbian on Raspberry pi will also work but not tested.
Please check the video from https://youtu.be/cUl_Y1ydzWs
Here is how to set up.
- install speechrecognition package from https://pypi.org/project/SpeechRecognition/
- "sudo pip3 install SpeechRecognition"
- "sudo pip3 install pyaudio"
- python3 was tested but python2 will also work
- portaudio might be requested using "sudo apt-get install portaudio19-dev"
- ffmpeg is also required to convert raw pcm to wave file using "sudo apt install ffmpeg"
- Just follow install instruction as described in wire-pod
- "sudo STT=vosk ./setup.sh"
- vosk should be selected as asr engine
- Set hostname
- During authentification, vector will find the ubuntu server named "escapepod"
- "sudo hostnamectl set-hostname escapepod"
- "sudo systemctl restart avahi-daemon"
- "sudo systemctl enable avahi-daemon"
- Install vectorx from "https://github.com/fforchino/vectorx"
- "git clone https://github.com/fforchino/vectorx"
- "cd vectorx"
- "sudo setup.sh"
- Run wire-pod
- "sudo chipper/start.sh"
- Server setting
- console log will show "Wire-pod is not setup. Use the webserver at port 8080 to set up wire-pod."
- go to "http://localhost:8080" from chrome browser
- follow the instruction as wire-pod to authentification
- Enjoy
Tips:
- You can change the ASR language from chipper/asr.py "lang='ko-KR'" <-> "lang='en-US'"
- You can find the supported korean command from chipper/intent-data/en-US.json
- You can update the NLU part from chipper/intent-data/en-US.json
- add more korean to match internal intent
Disclaimer: I am not expert in golang.
wire-pod is fully-featured server software for the Digital Dream Labs Vector robot. It was created thanks to Digital Dream Labs' open-sourced code, and is primarily based on chipper.
It allows voice commands to work with any Vector 1.0 or 2.0 for no fee, including regular production robots. Not just with OSKR/dev-unlocked robots.
Check out the wiki for more information on what wire-pod is, a guide on how to install wire-pod, how to develop for it, and for some helpful tips.
- Digital Dream Labs for saving Vector and for open sourcing chipper which made this possible
- dietb for rewriting chipper and giving tips
- fforchino for adding many features such as localization and multilanguage, and for helping out
- xanathon for the publicity and web interface help
- Anyone who has opened an issue and/or created a pull request for wire-pod