This is an Android application for a magic mirror. I had an old Nexus 7 (2012) lying around collecting dust and got the idea from HomeMirror by Hannah Mitt.

I started this project because I wanted to explore the MVP pattern for Android and Hannah's app did not have all the functionality I needed. Feel free to make this application look good on your own device (it was designed for the Nexus 7). Have any great ideas to make this more configurable or usable on more devices? Submit a pull request!

###Mirror

###Application screens

Configuration	Running

Features

Date and time
Weather powered by Yahoo Weather
- Metric or Imperial
- Wind information
  - Temperature
  - Speed
  - Direction
- Humidity
- Pressure
- Visibility
- Four day forecast
- Sunrise and sunset time
Your upcoming Google Calendar event
One of the top posts of your favorite subreddit
Update data by using voice command

How do I use this

Clone project in Android Studio
Make nescessary adjustments for your device
Run on device or generate .APK
Turn on "Stay Awake" in Developer Options on your device
If you turned on voice recognition change the Text to Speech language to English in the language options on your device

Update data with voice command

When you've turned on the voice command option in the setup screen you can talk to your device and make it update the data. To do this wake the device up by saying hello magic mirror, the device will then respond with hello there, how can I help you?. You then have 5 seconds to say get me new data and the data will refresh, if you don't say anything for 5 seconds the device will go back to sleep by itself, you can also force this by saying go back to sleep in the 5 second timeframe. You can watch a small video demonstration below.

###Add your own commands

Although this is a bit out of the scope for this document I had a hard time understanding and configuring the Pocketsphinx library so I figure this might come in handy when you want to add your own functions to this application. The SpeechRecognizer in this application has two modes; listen to one keyphrase (the wake up phrase) and listen to a list of keywords. The keyphrase to wake up the device is pretty straight forward, if you want to edit the phrase go to Constants.java, and change

public static final String KEYPHRASE = "hello magic mirror";

to anything you want. When this phrase is recognized the SpeechRecognizer will switch to listening to any of the commands in a grammar file you specified. I specified the commands.gram file in the initialization of the SpeechRecognizer as shown below.

// Create grammar-based search for command recognition
File commands = new File(assetsDir, "commands.gram");
recognizer.addKeywordSearch(Constants.COMMANDS_SEARCH, commands);

The actual grammar file can be found in /assets/sync/commands.gram, you can change the command list or create a new file in that folder and pass it to the SpeechRecognizer at initialization. The grammar file must have this format:

get me new data/1e-40/
go back to sleep/1e-40/
turn on lights/1e-40/
turn off lights/1e-40/
talk/1e-1/

The number beween the // is the threshold for detecting the keywords, the general rule is; the longer the keyword the bigger the threshold (e.g. one-word phrases /1e-1/ and four-word phrases /1e-40/) but you can experiment with these values yourself. Also, every word in the commands you choose must exist in the dictionary file, which can be found in /assets/sync/cmudict-en-us.dict.

After you add your commands add them individually to Constants.java as well.

public static final String KEYPHRASE = "hello magic mirror";
public static final String UPDATE_PHRASE = "get me new data";
public static final String SLEEP_PHRASE = "go back to sleep";
public static final String LIGHTS_ON_PHRASE = "turn on lights";
public static final String LIGHTS_OFF_PHRASE = "turn off lights";
public static final String TALK_PHRASE = "talk";

Now you set your SpeechRecognizer to listen to the commands list.

recognizer.stop();
//second parameter is the time to listen specified in milliseconds
recognizer.startListening(Constants.COMMANDS_SEARCH, 5000);

Whenever the SpeechRecognizer recognizes a command I pass the command to the presenter.

 @Override
 public void onPartialResult(Hypothesis hypothesis) {
    if (hypothesis == null)
        return;
    mMainPresenter.processCommand(hypothesis.getHypstr());
}

Now you only have to assign your custom actions to the commands in the presenter. You can assign your own actions to the commands in the processCommand() method in the MainPresenterImpl.java.

@Override
public void processCommand(String command) {
     switch (command) {
         case Constants.KEYPHRASE:
            // start listening for commands
            break;
         case Constants.SLEEP_PHRASE:
             // listen to wake up phrase again
             break;
         case Constants.UPDATE_PHRASE:
             // update data and listen to wake up phrase again
             break;
        }
    }
}

The way you make the SpeechRecognizer listen to the wake up phrase is similar to the commands method only this time do not pass a time to listen value as parameter.

recognizer.stop();
recognizer.startListening(Constants.KWS_SEARCH);

After changing anything related to the commands reinstall the application wake up the device and enjoy!

###Thresholds More info can be found in the Pocketsphinx tutorial.

###Other languages and dictionaries I have not experimented with this, however it is possible to create your own dictionary file. Please refer to the CMU Sphinx tutorial.

How I made my mirror

Since pre-made two way mirrors are very expensive and hard to get by in my country (The Netherlands) I decided to make my own. I bought some polished transparent plexiglass (60x40cm and 4mm thick) and some two way mirror foil normally used on windows for privacy. I built a wooden frame around it and used some small pieces of wood to hold the tablet in place (I left an opening on the bottom for the charger and on the top to expose the microphone). I then painted the back of the plexiglass black and that's it!

Thanks to

#####gijsdewit for awesome designs

###Used libraries

License