carsdotcom/skelebot

S3Repo Pull Artifacts in Python

Closed this issue · 0 comments

Context

Currently with Skelebot the S3Repo class provides the functionality to pull artifacts using its own Latest Compatible Version logic and save them to disk. Due to the need to include artifact retrieval for DS packages that will be used in a real-time API, I would like to be able to import the S3Repo class and pull the artifacts down (using the same consistent logic that was used to push them) directly in Python.

Feature

A small tweak with a new parameter on the pull function (in_memory) would allow for the artifact to be pulled down, but instead of saving to disk, to return the artifact from the function directly. This will not alter the behavior of the "skelebot pull" command, it merely provides more functionality to the class for if/when it is imported as a lib.


Acceptance Criteria

  • New in_memory parameter that if set to True returns the artifact directly from the pull function in S3Repo class
  • Bump Minor Version
  • Update Unit Tests
  • Update Docs