tombuildsstuff/giovanni

Blob Blob Uploads: support for configurable parallelisation

tombuildsstuff opened this issue · 0 comments

Currently the entire blob is uploaded in a single HTTP Request - it's possible to optimize this using the BlockList API.

Terraform used to achieve this using the Storage SDK in the Azure SDK for Go previously - however it's worth noting that approach uploaded the entire contents of the file multiple times; so that's got an implementation bug but shows the principal.

In either case it'd be good to add a helper which handles this so that it's possible for users to configure the required Parallelism for Block uploads