/s3insync

Sync an S3 folder to localhost

Primary LanguagePythonApache License 2.0Apache-2.0

S3InSync

Python package

Daemon to continuously and incrementally synchronize a directory from remote object store to a local directory. Inspired by objinsync but written in python and presently less fully featured.

Usage

s3insync pull --exclude '*/__pycache__/*' s3://bucket/prefix ./localdir

When running in daemon mode, a prometheus metrics endpoint is served at :8087/metrics.

Enable debug logs by passing the --debug flag s3insync --debug pull ...

Installation

Simply download the prebuilt single binary from release page or use pip command:

python3 -m pip install s3insync

Development

Run tests

pytest

Run from source

python -m s3insync pull --exclude '*/__pycache__/*' s3://bucket/prefix ./localdir