/csgostatsgg-scraper

A consumable package to (heavy-handedly) scrape data from csgostats.gg

Primary LanguageTypeScriptMIT LicenseMIT

csgostatsgg-scraper

A consumable Node package to (heavy-handedly) scrape data from csgostats.gg. Due to csgostats.gg not having an API, and being mostly protected by Cloudflare, the best approach is to spin up a headless browser to load the page and scrape it. Ulixee Hero is used to bypass Cloudflare and manage the DOM scraping.

Progress

  • Player page summary data
  • Player page large performance stats
  • Player page detailed performance stats
  • Player page graph data
  • Player page weapon stats
  • Player page map stats
  • Player page matches data
  • Player page "Played With" section
  • Global recent matches list
  • Match page summary data
  • Match page scoreboard
  • Match page rounds
  • Match page weapons
  • Match page duels
  • Match page heatmaps
  • Leaderboards

Usage

Install

To start, it's best to run with a local Hero Core, so you should install @ulixee/hero-core as a peer dependency:

npm i csgostatsgg-scraper @ulixee/hero-core

Later, if you'd like to use a remote Hero Core, you can remove the @ulixee/hero-core peer dependency.