Ever wanted to lead your own choir? Want to be a DJ JAAV? Wanted to generate music just by your moving your hands? Its not some magic! !
It determines what hand gesture you are making from the American Sign Language and plays music corresponding to each of them.
- First, we made a webapp using React js with a cool Music Visualizer.
- Developed a Deep Learning model using Cognitive Services.
- Integrated the model with webapp and made an API for the same.
- Added the Keyboard Music Player.
- Experienced great difficult in sending the image from the frontend to the API as API accepted only URLs
- Even though in the 24hr hackathon, we made an awesome interface with an authentication system.
- Developed a Highly accurate Deep Learning model and trained over a data of thousands of images.
- We managed the work very well right from the team formation to the providing the MVP.
- About postman API.
- Conversion of Image to DataURL and vice versa
- At moment, it works on images(kept due to less number of Cloud credits). When brought commercially with huge number of cloud credits, can be expanded to videos as well.