Azure/azure-storage-python

BlobStorage: Possibility of downloading a batch of blobs

casparjespersen opened this issue · 5 comments

casparjespersen commented

Which service(blob, file, queue) does this issue concern?

blob

Which version of the SDK was used? Please provide the output of pip freeze.

azure-storage-blob==1.4.0
azure-storage-common==1.4.0

What problem was encountered?

I am missing the possibility of downloading/reading a batch of blobs (specifically a "folder") -- a functionality which is already present in the Azure CLI (az storage blob download-batch). I am currently using the service.get_blob_to_text(container: str, path: str), and I imagine the syntax being service.get_blobs_to_text(container: str, paths: iterable).

Have you found a mitigation/solution?

Currently I am reading the files one-by-one, which generates a performance overhead.

zezha-msft commented

Hi @casparjespersen, thanks for reaching out!

We already have this feature on our roadmap, but I unfortunately do not have a timeline to share yet.

  • 👍4
dreamflasher commented

@zezha-msft Any progress update on this?

zezha-msft commented

Sorry @dreamflasher, there is no update for now, as we've been working on a new version of the SDK.

erfannariman commented

I created a Python wrapper for the Azure CLI to do downloads / uploads in batches, see here for more details:

Installation:

pip install azurebatchload

See the GitHub repo for usage examples.

  • ❤️1
ilayn commented

Other than @erfannariman 's noble attempt, is there any update for this getting support from the offical sdk?