/WebScraper

Primary LanguageC#MIT LicenseMIT

WebScraper Experiment

This project is an example of website scraper written in .NET Core 2.0. It is very specific for a particular public server. It requires heavy customization based on the pages you want the scrape. If you plan to use the code, you need to customize every part of it for your needs.

Features

  • Getting list of content
  • Recursively itterating through children a main content panel
    • looking for links
    • looking for content

Contribute

Check out the contribution guidelines if you want to contribute to this project.

License

MIT