/noticiascv_http

Web scraper for Cape-Verdean news website using httpx, async and queue.

Primary LanguagePython

noticiascv_http

Web scraper for Cape-Verdean news website using httpx package and asyncio. It uses queue to manage scraped items before saving them to db. Websites currently scraped are:

Run by doing python -m src.main