/lb-scraper

A scraper to help me pick which Limp Bizkit songs to learn to maximize my chances of performing with them on stage

Primary LanguageTypeScript

Limp Bizkit Scraper

Purpose

Limp Bizkit brings an audience member on stage to perform with them every once in a while.

If my friend and I are going to see them live, what songs should we learn to be the most prepared to perform a song with them and kill it?

To figure this out, I'll need some data, and then I'll do some analysis on that data. The site setlist.fm documents what songs a band played for any given concert. There are additional details about the songs as well, including whether a fan joined them to play. Here's the information about the songs referenced in the videos above.

I'll use Playwright to scrape the data. Here's the data I'm looking for:

  • Song order
  • Song title
  • Info (if it's present)
  • Concert name
  • Performance date

Method

  1. Go to Limp Bizkit's setlist.fm page
  2. Click each link in the list of set lists
  3. Read the song list of each
  4. Write the song data to STDOUT
  5. Use a spreadsheet application to analyze the data

Installation

Install the dependencies.

npm install

Compile the TypeScript index.ts file

npm run compile

Run the index.js file to start scraping.

node .
Usage: node . [-s <number>] [-e <number>]
   -s <number>
     start scraping at page <number> (1 by default)
   -e <number>
     end scraping at page <number> (104 by default)