/FRIDAY-JAVA

NLP interface for IoT

Primary LanguageJava

FRIDAY-JAVA

NLP interface for IoT

Java+Google Speech API+NodeMcu(ESP8266)+P9813 based LED Strip driver

The porcupine hotword detection has a lot of dependencies (python3, numpy, soundfile, simple, pyaudio(unoffical binary here if pip doesnt work))

All libraries are open source and active so its advisable to get new versions if possible

The voice recognition grammmar is built from the xml nodes e.g

<XML>
<Node>
  <FName>lights</FName>
  <Mac>A0:20:A6:02:_2:_6</Mac>
  <IP>100.71.194.167</IP>
  <Verbs>switch,turn</Verbs>
  <Vals>on,off,blink</Vals>
</Node>
</XML>

If user says a FName and a verb followed by a Val then the value is send to the corresponding node

Current functionality

  • Find all Nodes on a local network (brute force + subnet clues)
  • Communication by http with Node
  • Porcupine hotword detection /Google speech API
  • Webserver interface