Youtube crawler & scraper based on scrapy. Write in Python3.
Python 3.6+ SQLAlchemy (optional if save in MariaDB) Pytest (optional to test unit)
Configuration is in ./yt/settings.py
Default save in CSV. Uncomment yt.pipelines.SqlAlchemy if you need store items in DB
ITEM_PIPELINES = {
# 'yt.pipelines.SqlAlchemy': 300,
'yt.pipelines.Csv': 300,
}
scrapy crawl youtube
pytest yt/test.py