Can’t decide whether or not to watch an entire video or don’t have much time to watch that? Use SummaryScape and get a “summarised version” of any video!
We provide an Android Application that generates the summary of any video on YouTube that you want to watch quickly. We use NLP to process the subtitles of the video and give you a crunched video that encompasses all the essential parts while leaving out filler words and stop words. We compress the video and deliver to you a considerably shortened video. This can be especially useful for students who wish to quickly go through an educational video on youtube or elsewhere and want to see if what they are looking for is available in the video. They can then decide whether or not to watch the entire video.
At the heart of the processing are the sumy and nltk libraries. These help us detect the most important parts of the subtitles and then we crop the video that has those parts.
First the text in the captions is extracted using YoutubeDL. Then the whitespaces and punctuation is removed, and sumy provides many functions for the tasks. Next, the stopwords are extracted from the captions and removed. After that, for each subtitle segment, a time frame is obtained i.e., time when the subtitle segment appears in the video.
The LSA summariser is a major part of the extraction of the summarised video. Latent Semantic Analysis(LSA) is a relatively new algorithm in NLP that combines term frequency with singular value decomposition. “Importance” is assigned to each subtitle segment and finally the video where these “important” subtitle segments occur are cropped out of the main video and compiled into the compressed video. Segments are classified as important or not important using the LSA summariser which internally uses a Truncated Singular Value Decomposition (SVD).
To install requirements(virtual environment recommended)
pip install -r requirements.txt
To Run
python server.py
After the Flask server is running, set the variable backendIP to IP:Port of the Flask server. Check MainActivity.kt for the variable.
Now, you can go ahead and run the application on an Android phone or emulator.
