inspirehep/hepcrawl

Issues

• Source value for desy-ingested records

  #134 opened 7 years ago by david-caro
  1

• Spider: Refresh the IOP spider

  #205 opened 7 years ago by david-caro
  0

• arXiv spider: collaborations

  #251 opened 6 years ago by ksachs
  0

• Q: arXiv spider: collaborations

  #248 opened 6 years ago by ksachs
  1

• populate raw_affiliations instead of affiliations

  #185 opened 7 years ago by michamos
  0

• OAI: allow harvesting single records (GetRecord oai verb)

  #212 opened 7 years ago by david-caro
  0

• Generalize the usage of `__future__.unicode_literals`

  #114 opened 7 years ago by david-caro
  0

• Deploy docker `hepcrawl_base` image to dockerhub

  #109 opened 7 years ago by spirosdelviniotis
  0

• Add `keywords` field

  #121 opened 7 years ago by spirosdelviniotis
  4

• OSTI spider

  #157 opened 7 years ago by michamos
  0

• Support multiple publication_info entries

  #125 opened 7 years ago by david-caro
  1

• Datacite spider

  #192 opened 7 years ago by michamos
  4

• Kill get_journal_and_section

  #191 opened 7 years ago by michamos
  0

• Use self.logger instead of deprecated self.log in spiders

  #183 opened 7 years ago by michamos
  1

• Directly harvest oai sources

  #197 opened 7 years ago by david-caro
  3

• Investigate how scrapy uses the `*args` and `**kwargs` in the `__init__` of the spider and see if we can add

  #218 opened 7 years ago by david-caro
  0

• Support multiple sets for OAI spiders

  #201 opened 7 years ago by david-caro
  0

• OAI: Improve last_run generation/loading

  #202 opened 7 years ago by david-caro
  0

• Use more metadata from APS

  #184 opened 7 years ago by michamos
  0

• harvest CDS through dojson directly

  #199 opened 7 years ago by michamos
  0

• loader: digest "all" possible date formats

  #169 opened 7 years ago by fschwenn
  2

• Use the JATS parser for Hindawi

  #190 opened 7 years ago by michamos
  0

• Create/update PoS spider

  #159 opened 7 years ago by david-caro
  0

• post-enhancement: complete CC-license information

  #172 opened 7 years ago by fschwenn
  7

• Handling "on behalf of the ATLAS Collaboration"

  #176 opened 7 years ago by kaplun
  4

• loader: calculate "number_of_pages"

  #170 opened 7 years ago by fschwenn
  1

• CDS Spider

  #178 opened 7 years ago by kaplun
  0

• Duplicated code that generates 'acquisition_source'

  #175 opened 7 years ago by iulianav
  3

• Add mechanism for crawling only once

  #161 opened 7 years ago by spirosdelviniotis
  0

• post-enhancement: automatically set 'citeable=True'

  #173 opened 7 years ago by fschwenn
  5

• post-enhancement: add experiment from collaboration data

  #171 opened 7 years ago by fschwenn
  0

• loader: get arXiv number from ADS?

  #168 opened 7 years ago by fschwenn
  0

• desy spider

  #133 opened 7 years ago by david-caro
  1

• Using refextract for unstructured references

  #156 opened 7 years ago by fschwenn
  1

• Use material whenever possible

  #128 opened 7 years ago by michamos
  8

• Add missing crawler2hep unit tests

  #138 opened 7 years ago by david-caro
  1

• Unit tests: mock the connection to external services

  #120 opened 7 years ago by david-caro
  1

• global: bump `hepcrawl` to version `~36.0`

  #147 opened 7 years ago by spirosdelviniotis
  0

• Upgrade to schemas 40

  #153 opened 7 years ago by david-caro
  0

• docs: use Sphinx bundled napoleon

  #152 opened 7 years ago by david-caro
  0

• Upgrade `inspire-schemas` to the current latest (`34.3`) version

  #139 opened 7 years ago by spirosdelviniotis
  0

• Add functional tests to arxiv spider

  #127 opened 7 years ago by spirosdelviniotis
  1

• source should always be spider name, not hepcrawl

  #130 opened 7 years ago by michamos
  0

• Harvesting Books from Amazon

  #137 opened 7 years ago by kaplun
  0

• Tests: move reusable code into testlib

  #131 opened 7 years ago by spirosdelviniotis
  0

• docker-compose: remove doc service

  #123 opened 7 years ago by david-caro
  1

• Introduce functional tests for WSP spider

  #118 opened 7 years ago by spirosdelviniotis
  0

• Introduce `public_notes` field to the WSP spider

  #117 opened 7 years ago by spirosdelviniotis
  1

• Use the full pipeline output on the wsp tests

  #111 opened 7 years ago by david-caro
  2

• unit tests: create environment handler fixture

  #113 opened 7 years ago by david-caro
  3