/brazil-scraper

Primary LanguageGo

Instructions to run

  1. Download Golang
  2. In this directory, run: 
    mkdir DATUMS
  3. From the command line, run 
    go run scraper.go > log.txt
  4. Wait...
  5. In a separate terminal pane, monitor progress by running the following: 
    cd DATUMS
watch 'ls | wc -l'

Instructions to create ids.txt

I've created a file that just contains the IDs you're looking for with the following command:

cat acordo_colectivo_salarios.csv | cut -d, -f3 | tail -n +2 > ids.txt