/DouyinScraper

Scraper built with selenium and bs4 to scrape video metadata for JJ's 大数据案例实践class research

Primary LanguagePython

Douyin Scraper

discontinued due to douyin web's security upgrade

Note

You need to have a correct version of chromedriver in your corresponding python interpreter path for the script to work. Download chromedrivers here

Installing

Create a conda environment

conda create -n douyinscraper python=3.8
conda acitvate douyinscraper

Install dependencies

pip install -e .