/YoutubeDataHarvestingAndWarehousing

Collecting YouTube data using google API and storing the data in MongoDB(NoSQL) and Migrating the stored data from MongoDB into SQL and creating a user friendly Streamlit web app for the visualization and to get a better understanding of the YouTube channels and video details. All with the help of Python and Python libraries.

Primary LanguagePython

Youtube_DataHarvesting_And_Warehousing

#Introduction

Collecting YouTube data using google API and storing the data in MongoDB(NoSQL) and Migrating the stored data from MongoDB into SQL and creating a user friendly Streamlit web app for the visualization and to get a better understanding of the YouTube channels and video details. All with the help of Python and Python libraries.

Skills takeaway

  • Python scripting
  • Data Collection
  • API integration
  • Streamlit
  • Data Management using MongoDB and SQL

Libraries/Packages used

from googleapiclient.discovery import build  # for youtube api
import pymongo  # for mongoDB
import psycopg2  # for postgresSQL
import pandas as pd  # for DataFrame
import streamlit as st  # for web app

Technology Stack Used

  1. Python 3.11
  2. PostgreSQL
  3. MongoDB
  4. Google Client Library
  5. Streamlit
  6. IDE (VS Code)

Contact