CenterForOpenScience/scrapi
A data processing pipeline that schedules and runs content harvesters, normalizes their data, and outputs that normalized data to a variety of output streams. This is part of the SHARE project, and will be used to create a free and open dataset of research (meta)data. Data collected can be explored at https://osf.io/share/, and viewed at https://osf.io/api/v1/share/search/. Developer docs can be viewed at https://osf.io/wur56/wiki
PythonApache-2.0
Issues
- 2
- 2
- 3
Cyberleninka not harvesting new records
#307 opened by erinspace - 5
- 1
Add harvester for Addis Ababa University
#318 opened by erinspace - 1
Add NOAA as a harvester
#279 opened by erinspace - 2
Add OpenAIRE as a data source!
#274 opened by erinspace - 2
Add Bouira University Digital Space as a harvester
#308 opened by erinspace - 3
"Avian community structure and incidence of human West Nile infection" shows up multiple times
#330 opened by fabianvf - 1
Harvester tests
#172 opened by fabianvf - 1
See if Normalized/Raw Document objects are being modified without being copied
#226 opened by fabianvf - 1
Add registered provider harvard dataverse
#236 opened by erinspace - 2
Add registered provider Hacettepe University, Department of Information Management
#237 opened by erinspace - 4
Events with multiple descriptions
#243 opened by samanehsan - 1
port request caching to postgres
#314 opened by erinspace - 0
Add harvester for Texas A&M University Libraries
#323 opened by erinspace - 6
Add harvester for Political Analysis
#324 opened by erinspace - 2
Evaulate ORCID API
#342 opened by erinspace - 0
Add harvester for Portland State University
#332 opened by erinspace - 0
- 1
- 1
Evaluate CHORUS API
#349 opened by erinspace - 0
Add harvester for cyberleninka.ru
#247 opened by erinspace - 0
Add DataCite
#251 opened by erinspace - 2
- 2
Add University of Malaya
#280 opened by erinspace - 2
Add ICPSR as a data souce
#278 opened by erinspace - 2
Gather more OSF registrations
#281 opened by erinspace - 3
New Harvester - Iowa State University
#285 opened by erinspace - 0
- 1
New Harvester - ScholarsArchive@OSU
#294 opened by erinspace - 0
Add harvester for MBLWHOI LIbrary
#303 opened by erinspace - 1
Migratons that need to be run
#298 opened by fabianvf - 1
Renormalize Harvesters
#312 opened by erinspace - 0
- 2
evaluate and add NIH RePORT as data source
#246 opened by erinspace - 0
Language specific analysis
#272 opened by fabianvf - 0
Harvester from Scopus
#291 opened by AndrewSallans - 0
write test for correct # of resumption token calls
#302 opened by erinspace - 0
Easy way to import test data
#317 opened by erinspace - 5
- 0
- 1
BioMed Central Results from the Future
#282 opened by erinspace - 1
Daily SSRN errors in cassandra
#287 opened by fabianvf - 2
BioMed Central results with no titles
#283 opened by erinspace - 3
- 3
periodic cassandra setup cqlengine error message
#210 opened by erinspace - 2
Incorrect links in TDAR Harvester
#290 opened by erinspace - 2
Error raised in figshare harvester
#200 opened by fabianvf - 1
SSRN Invalid Dates on OSF search
#273 opened by erinspace