Issues
- 0
- 0
devops docs: add wasapi-downloader docs
#49 opened by ndushay - 0
devops docs: update was-downloader VM docs
#50 opened by ndushay - 1
[was-registrar-app/stage] RuntimeError: Fetching WARCs failed: Exception in thread "main" com.fasterxml.jackson.databind.exc.UnrecognizedPropertyException: Unrecognized field "store-time" (class edu.stanford.dlss.was.WasapiFile), not marked as ignorable (10 known properties: "checksums", "size", "crawl-time", "filetype", "filename", "crawl-start", "account", "locations", "crawl", "collection"]) at [Source: org.apache.http.conn.EofSensorInputStream@4b0b0854; line: 1, column: 565] (through reference chain...
#126 opened by honeybadger - 0
Enable incremental retries
#123 opened by aaron-collier - 2
Reduce RAM needs for large jobs
#120 opened by ndushay - 0
allow execution from arbitrary directory paths
#119 opened by nullhandle - 0
report download progress to console
#118 opened by nullhandle - 0
do a github release and deploy to VMs
#117 opened by ndushay - 0
integer settings validation improvements
#83 opened by ndushay - 2
actually deploy finished code to prod
#80 opened by ndushay - 3
- 1
- 3
review and approve README
#99 opened by ndushay - 0
- 0
rename "jobId" in command line to "crawlId" ?
#98 opened by ndushay - 1
tests: intermittent test failure
#103 opened by ndushay - 0
output shows download attempt number
#109 opened by ndushay - 0
- 0
download action retries until limit
#64 opened by ndushay - 1
download WARCs into correct location
#74 opened by ndushay - 0
hook up checksum validation of downloaded files
#75 opened by ndushay - 0
- 0
- 0
refactor WasapiValidator.validateResponse()
#94 opened by ndushay - 0
command line allows single file download requests
#81 opened by ndushay - 0
- 1
VMs get memory they need
#76 opened by ndushay - 0
build/deploy configures "ready-to-run" app
#79 opened by ndushay - 0
baseurl can end with or without slash
#90 opened by ndushay - 0
output basedir can end with or without slash
#89 opened by ndushay - 0
hook up crawl selection
#73 opened by ndushay - 4
- 0
- 0
- 1
add command line arg for last-known-crawl (and crawl-start-date-after if not there)
#45 opened by ndushay - 0
add account ID to settings
#70 opened by jmartin-sul - 0
- 0
- 0
Add logging
#41 opened by tingulfsen - 0
- 3
validate command line arguments (and settings)
#42 opened by ndushay - 1
- 0
Add tests for WasapiClient
#60 opened by tingulfsen - 0
Test WasapiConnection
#59 opened by tingulfsen - 0
move validate checksum methods to WasapiValidator
#63 opened by ndushay - 0
all settings should be available from either .properties file or command line args
#54 opened by jmartin-sul - 1
add lint checker (checkstyle?)
#52 opened by ndushay - 0
if wasapi adds login endpoint as part of spec, then remove it from settings file
#57 opened by ndushay - 0