YouTube Data Insights

Overview

This project collects data from the YouTube API, stores it in a PostgreSQL database, and displays insights using a Streamlit app.

Setup

Clone the repository:

git clone <repository-url>
cd pythonProject

Create a virtual environment and activate it:

python -m venv venv
source venv/bin/activate

Install the required packages:
```
pip install -r requirements.txt
```

Set up the PostgreSQL database:

Update the database URL in app/database/db_setup.py.

Run the following to initialize the database:

  CREATE TABLE channels (
  channel_id VARCHAR PRIMARY KEY,
  channel_title VARCHAR NOT NULL,
  subscriber_count INTEGER NOT NULL DEFAULT 0,
  video_count INTEGER NOT NULL DEFAULT 0,
  view_count INTEGER NOT NULL DEFAULT 0,
  created_at TIMESTAMP DEFAULT CURRENT_TIMESTAMP);

  CREATE TABLE videos (
  video_id VARCHAR PRIMARY KEY,
  channel_id VARCHAR NOT NULL,
  title VARCHAR NOT NULL,
  description TEXT NOT NULL,
  published_at TIMESTAMP NOT NULL,
  view_count INTEGER NOT NULL,
  like_count INTEGER,
  comment_count INTEGER,
  FOREIGN KEY (channel_id) REFERENCES channels (channel_id));

  CREATE TABLE video_insights (
  id SERIAL PRIMARY KEY,
  video_id VARCHAR NOT NULL,
  top_keywords TEXT NOT NULL,
  engagement_score FLOAT NOT NULL,
  FOREIGN KEY (video_id) REFERENCES videos (video_id),
  created_at TIMESTAMP DEFAULT CURRENT_TIMESTAMP);

Update app/config.py with your YouTube API key.
Run the scheduler to fetch data periodically:
```
python app/scheduler/scheduler.py
```
Start the FastApi app:
```
uvicorn main:app --reload
```
Start the Streamlit app:
```
streamlit run streamlit_app.py
```

Usage

The Streamlit app will display the YouTube data, including trends in views and keywords or you can hit the APIs.

aishuo07/youtube-api

YouTube Data Insights

Overview

Setup

Usage