/TalkToMe

Consume the crux of any content in a more engaging fashion! In our app, a user can upload an audio file/ document of their choice. Based on Google Cloud's latest technology, we create an avatar out of the content that can summarize the content and engage with the user in a Q&A format.

Primary LanguageJavaScript


Logo

TalkToMe

Consume the crux of any content in a more engaging fashion! In our app, a user can upload an audio file/ document of their choice. Based on Google Cloud's latest technology, we create an avatar out of the content that can summarize the content and engage with the user in a Q&A format.
Explore the docs »

View Demo · Report Bug · Request Feature

Problem Statement

In today's day and age, users find it increasingly difficult to extract crucial information from long-form content. We try to address this problem with our app TalkToMe where users can consume the crux of the content in a more engaging fashion.

Installation Steps:

  1. Install npm, if you haven't already on your computer.

  2. Clone this repository locally

  3. Open the command prompt and run npm install

You are now ready to run your project!

Steps to run the project:

Open a command prompt from the root directory of the repository and type npm run dev

Ensure that you are on Chrome to be able to use the speech to text feature!

List of implemented features:

  • Uploading of text files, PDF files, as well as Audio files!
  • Content Summarization by Google's PaLM2
  • Ability to converse with AI Chat Bot with Speech
  • Interactive Question and Answer Format in Conversation
  • Storage of Chat History of Files uploaded previously by User
  • Integration of Google OAuth
  • Access from anywhere in the World!
  • Responsive UI on Mobile Devices

System Architecture

System Architecture

List of planned features:

  • Multi-lingual Support
  • Integration with Note-Taking tools
  • Feedback and Rating Systems
  • Collaboration features

Screenshots:

Landing Page

Landing Page

Home Page

Home Page

Dashboard for a New User

Dashboard for a New User

Dashboard after Upload

Dashboard after Upload

Question and Answers

Question and Answers with the Agent More Question and Answers with the Agent

Contributors

  • Harshit Gupta
  • Devaansh Kumar
  • Chinmaya Sahu
  • Bharadwaja Meher
  • Ankit Dash