SightCom-2

For more information, visit: SightCom 2 Article

Overview

Around the world, there exists an inequality affecting visually impaired individuals who lack access to essential accessibility services. This has driven me to develop a software for Smart Glasses that blind people can wear. SightCom2 software utilizes OpenAI technologies, namely Whisper for speech transcription, GPT-3.5 as a LLM, DALL-E for image generation; image captioning, OCR and color recognition models from Clarifai API. This software is served on streamlit cloud, and is a prototype that can potentially be deployed on a microprocessor, assembled in an integrated circuit, between input devices like camera and microphone, and output devices like speakers.

How it works?

Run App Locally

Clone the Repository:

git clone https://github.com/Louisljz/SightCom-2.git

Install Virtual Environment:
```
python -m venv venv
```
Activate the virtual environment:
- On Windows: venv\Scripts\Activate
- On macOS and Linux: source venv/bin/activate
Install Required Packages:
```
pip install -r requirements.txt
```
Run the Streamlit App:
```
streamlit run app.py
```
Open the App:
The app should now be running. Open your web browser and go to http://localhost:8501/ to interact with the app.