This is my project (#2) for the summer semester (30240522-3) in Tsinghua University. Mainly focused on wb crawling, web framework and data visualization.
Author: Ren Zihou
Go into the project path and execute command:
> python .\data\database.py
> python .\crawler\bili_crawler_new.py
Then your database will be initiated and all the data and images would be stored in ./data
> python .\manage.py runserver
Then You can visit your web page in browser through 127.0.0.1:8000
> python .\analysis\plot.py
The results will be saved in ./analysis/output
- video list - 2021/08/30
- video detail - 2021/08/30
- download image - 2021/08/31
- massive data - 2021/09/01
- framework - 2021/09/01
- list page - 2021/09/01
- detail page - 2021/09/02
- author page - 2021/09/03
- search page - 2021/09/03
- visualization - 2021/09/06
- conclusion - 2021/09/07