libscie/liberator

Access data collect and ingest

Opened this issue · 1 comments

chartgerink commented

It is easy to collect the relevant data from CrossRef, but some of these scholarly articles might already be freely available. We don't want to duplicate work, so we can collect access information from oaDOI and Zenodo.

Zenodo

  • Figure out API calls to check DOI records
  • Collect raw availability of DOIs collected from CrossRef
  • Ingest availability into database

oaDOI

  • Download raw JSON for all CrossRef ingested DOIs
    • Had contact with oaDOI, allowed to do 600k calls over three days, but preferably data dump that is forthcoming.
  • Ingest whether freely available or not (one variable in data table indicating 0 or 1)
chartgerink commented

Just need to ingest over the weekend! Same as #2