git_to_rdf
what
A utility (that runs in a Docker container) that transforms a git repository on disk into RDF. It uses SPARQL Anything to transform the intermediate csv and json git repository representations into RDF using SPARQL construct queries.
why
I've blogged about using this tool to view a git repository as RDF.
how
Say you cloned this git repo to /home/alice/repo/git_to_rdf, your git repository of interest is at /home/alice/repo/projX, and you want to put the RDF this tool produces at /home/alice/RDF
First build the Docker image.
- have Docker installed
- have
makeandwgetinstalled - cd to
/home/alice/repo/git_to_rdf - in a
bashshell run:make build
Now use the Docker image .
- cd to
/home/alice/ - in a
bashshell run:/home/alice/repo/git_to_rdf/git_to_rdf.sh --repository /mnt/repo/projX --output /mnt/RDF - find your 2 output files
summaries.nqandhunks.nqat/home/alice/RDFand the log filegit_to_rdf.login your current directory.
speed
It took 6 minutes to transform this git repository (consisting of 1,122 commits) into 2,207,235 triples.
notes
I don't have instructions on using the jar file directly because this utility uses the /tmp directory and it doesn't clean up after itself. Running it in a disposable Docker container means that /tmp directory goes away after it is done running. Also the utility needs splitpatch installed and that comes in the Docker image.
Note the use of /mnt in the instructions. When you run git_to_rdf.sh your current directory gets mapped into the Docker container at /mnt. A drawback of this is that if you want to put the produced RDF at /tmp/ and the git repo of interest lives at /home/alice/repos/projX you'd have to cd to / then run /home/alice/repo/git_to_rdf/git_to_rdf.sh --repository /mnt/home/alice/repo/projX --output /mnt/tmp.
I might address those shortcomings of the utility but my immediate goal is to use the RDF not polish a utility for tidy deployments.
Also, you'll find many TODOs in the source. I may get to those one day.