Knowledge-Graph-Hub/kg-covid-19

Add function in directory-indexer.py to add existing build

Opened this issue · 0 comments

Describe the desired behavior

Right now in Jenkins we manually add a (blank) directory for each existing build in our projectdir:

sh "for dir in `s3cmd ls s3://kg-hub-public-data/kg-covid-19/ | grep '\\/\$' | awk '{print \$NF}' | grep -w -v -E 'raw|current' | xargs -n1 basename`; do mkdir -p $S3PROJECTDIR/$dir; done"

on the command-line.

A better solution would be to add this functionality to directory-indexer.py on our fork of go-site

Additional context

Basically we'd just add flags for the bucket and project directory, and some ignore args to ignore directories like raw and current. The existing builds would be added to the HTML as href links.