This project is inspired by someone who sometimes use HotDeal Community Site. He is very thankful for HotDeal board manager and creator. but There are so many HotDeal board in a lot of Community Site. so I want to get and share as much as possible HotDeal infomation over the world. so basically, a few Community Site Scraping and Share. and moreover Extending Community Site and Integreting them adaquetely.
- Must obey robots.txt
It is very very important rule than any other rule. This project strictly observe Website's robots.txt. If I missed that, Please Notify to me.
- Crawling
- Scrapy
- DB
- DuckDB (Maybe?)
- Front
- React
- Back
- FastAPI
- Infra
- k8s
- docker