a personal healthcare assistant
Ava makes use of the following technologies:
Ava’s front end was designed in:
- Bootstrap
- CSS
- HTML5
- JavaScript
Ava’s server communications are handled by:
- Node.js
We use this hardware to assist Ava: 2. Muse Headband (Brain wave sensor) 3. Oculus
Ava’s Brain:
- VR Development
- Cloud Speech API
- Dialogflow Enterprise Edition
- Natural language processing
- MATLAB
- EEG module (3D modelling of muse sensor data)
- AI
- Machine Learning
- APIs
- Big Data
Working: The user visits our website/app and is taken through a simple questionnaire where he’s asked a set of questions designed by medical professionals to ascertain the user’s mental state, and information about the user’s lifestyle and health. The data entered by him will be collected and stored as part of his user profile. Every interaction the user has with the intelligent assistant “Ava” builds upon that. If the user preliminarily shows signs of distress, then they are requested to visit a healthcare provider to undergo further testing/diagnosis. If the user showed a likelihood for suspected mental health issues, certain questions that aid their diagnosis, designed by psychologists are presented to the user on the website while collecting EEG data through the Muse Headband. The EEG data points are used to generate a 3D brain activity heat map, which can be used to identify potential fear responses to certain stimuli, aiding in diagnosis. Finally, this also serves as a platform to help alleviate certain conditions through special exposure therapy designed on the VR platform, in conjunction with progress indicated via lower fear responses collected via the Muse Headband.
Before you can run or deploy the sample, you need to do the following:
With npm:
npm install
With npm:
npm start