The server that allows you to subscribe information crawled by scraper
This server opens up multiple endpoints that will allows you to fetch information, mainly from pre-scraped data, or scrape on demand as you perform the request.
Also, this server opens up basic scraping functionality e.g screenshotting web pages, getting full HTML source code as well as a complete sets of available scraping method.
So you can use this server to do scraping without having to implement yourself.
Worth to note that, the maintainer also make a custom scraper, specially made to scrape some websites.
Below are feature lists and it's status (available / todo):
| Feature Name | Status | Description |
|---|---|---|
| Instagram Post Crawler | TODO | Get user's instagram post pictures and videos from user's username |
| Company Jobs Scraper | TODO | Crawl data about company open position, include everything available on that job description. Usually, this crawler will be made specifically for every company to increase data fetched by the crawler |