biglocalnews/covid-world-scraper

Issues

• Brainstorming for Phase 2 (another demo/test ticket)

  #81 opened 3 years ago by zstumgoren
  0

• Here is a new task - just an example for demo'g worfklow

  #80 opened 3 years ago by zstumgoren
  0

• Reach out to JHU and see if we can be a part of their scraping operation

  #79 opened 4 years ago by Dilcia19
  4

• Figure out why John Hopkins does not have Nigeria and South Africa data

  #78 opened 4 years ago by Dilcia19
  3

• Which countries do we want that we don't have?

  #77 opened 4 years ago by Dilcia19
  0

• South Africa scraper breaks in production sporadically

  #76 opened 4 years ago by zstumgoren
  2

• Fix India scrape following page structure update

  #75 opened 4 years ago by zstumgoren
  1

• Deploy code to GCP vm and set to run on cron

  #19 opened 4 years ago by zstumgoren
  1

• Fix zero-byte download on Brazil

  #74 opened 4 years ago by zstumgoren
  1

• Fix bra.py downloading in production

  #73 opened 4 years ago by zstumgoren
  0

• Fix pre_process in Bra.py

  #72 opened 4 years ago by zstumgoren
  0

• Add exception handling and alerting to CLI script

  #25 opened 4 years ago by zstumgoren
  0

• Prepare for open-sourcing

  #56 opened 4 years ago by zstumgoren
  0

• CLI list is broken

  #70 opened 4 years ago by Dilcia19
  1

• Pakistan scraper is broken

  #65 opened 4 years ago by zstumgoren
  0

• Update Pakistan scraper to wait for presence of update time on page

  #69 opened 4 years ago by zstumgoren
  0

• Refactor CLI to use Runner class

  #66 opened 4 years ago by zstumgoren
  0

• Add `--list` flag to CLI tool

  #30 opened 4 years ago by zstumgoren
  0

• Add test coverage for cli.py module

  #67 opened 4 years ago by zstumgoren
  0

• Implement "--all" flag on CLI tool

  #23 opened 4 years ago by zstumgoren
  0

• Add "--headful/headless" flag to CLI tool

  #29 opened 4 years ago by zstumgoren
  2

• Create script to generate country_codes.py module

  #64 opened 4 years ago by zstumgoren
  0

• Change default of cache directory so it's cross-compatible for OSes

  #60 opened 4 years ago by zstumgoren
  0

• Make cache dir configurable from CLI

  #61 opened 4 years ago by zstumgoren
  0

• Add date fields to Brazil and fix epoch time

  #49 opened 4 years ago by zstumgoren
  3

• Update all scrapers to include date_of_scrape and date fields in processed files

  #43 opened 4 years ago by zstumgoren
  3

• Brazil Scraper - @Retry

  #63 opened 4 years ago by Dilcia19
  1

• Add date fields to nigeria

  #52 opened 4 years ago by zstumgoren
  1

• Create a process for converting countries metadata spreadsheet to a markdown page for repo docs

  #59 opened 4 years ago by zstumgoren
  0

• Move data sources from README to a dedicated page for countries

  #57 opened 4 years ago by zstumgoren
  1

• Add date fields to Germany

  #51 opened 4 years ago by zstumgoren
  1

• Add development and usage notes to README.md

  #20 opened 4 years ago by zstumgoren
  1

• Add date fields to Pakistan

  #50 opened 4 years ago by zstumgoren
  1

• Export data in long rather than wide format?

  #54 opened 4 years ago by zstumgoren
  2

• Add utility function to determine current year on on January 1st

  #47 opened 4 years ago by zstumgoren
  0

• Assess time information for all countries

  #48 opened 4 years ago by zstumgoren
  7

• Port South Korea

  #41 opened 4 years ago by Dilcia19
  2

• Port Nigeria

  #34 opened 4 years ago by zstumgoren
  1

• Port South Africa

  #35 opened 4 years ago by zstumgoren
  1

• Update India scraper to include additional (non-state cases) and totals lines

  #38 opened 4 years ago by zstumgoren
  1

• India Unassigned Data

  #39 opened 4 years ago by Dilcia19
  1

• Port India

  #33 opened 4 years ago by zstumgoren
  0

• Port Germany (deu)

  #32 opened 4 years ago by zstumgoren
  0

• Port Brazil to use CountryScraper

  #17 opened 4 years ago by zstumgoren
  0

• Add "--fetch" flag to CLI tool

  #27 opened 4 years ago by zstumgoren
  0

• Add "--extract" flag to CLI tool

  #28 opened 4 years ago by zstumgoren
  0

• Fix console logging in cli.py

  #26 opened 4 years ago by zstumgoren
  0

• Add setup.cfg

  #22 opened 4 years ago by zstumgoren
  0

• Port Pakistan to use CountryScraper

  #18 opened 4 years ago by zstumgoren
  0

• Create new repo to handle covid world data transformations to pitch map format

  #21 opened 4 years ago by zstumgoren
  0