For Hack the North 2019, in under 24 hours, we created a mobile app that lets you take a photo and receive a quick audio and text response of the content of the image in the language of your choice. View more about it on: Youtube and on Devpost.
Notes: It is assumed that you have node, git, npm, python and pip installed on your machine. Besides that, this app uses Expo Client, therefore in order to run it, you will need to have the Expo App downloaded on your phone. It is also required that the phone which you will run the app on and the computer which you are running the app from are under the same network.
- git clone https://github.com/lnogueir/HackTheNorth2019.git
- cd HackTheNorth2019
- python setup_ip.py (this step is required because the phone can't access the endpoints with localhost as the host)
- Open two terminal windows -> cd into HackTheNorth2019 -> follow server and app setup
On the first terminal window, assuming you are under HackTheNorth2019 directory:
- cd server
- pip install -r requirements.txt
- python server.py
On the other terminal window, assuming you are under HackTheNorth2019 directory:
- cd app
- sudo npm install
- npm start
- Scan QR Code displayed on terminal window
The app should be now running on your phone.
We wanted to give people a new way to learn languages. Since we both come from international families, we believed in something that would help new people in a foreign country.
Having just met this weekend, we were able to form a team and finish the complete project within 24 hours. This was a great experience for our first hackathon!
The app is built using the javascript framework for mobile apps, react-native. We used a flask server as well as the google apis (vision, speech, translate) to process the user requests from the app.
- React Native
- Python Flask
- Google Apis