opensearch-project/opensearch-ci

Improve Docker Image extraction speed for linux ec2 instances

Closed this issue · 2 comments

Is your feature request related to a problem? Please describe

Docker image extraction can be sped by extracting files in parallel. While Linux extraction time is fast already, parallelizing this process will be a good quality of life change.

Describe the solution you'd like

We can use Pigz instead of Gzip within the al2023 agent's [scripts].(https://github.com/opensearch-project/opensearch-ci/blob/main/packer/scripts/al2023/al2023-agent-setups.sh)

@peterzhuamazon has already done this implementation for the Windows agent instance in this code block.

Describe alternatives you've considered

No response

Additional context

No response

Thanks for opening this issue and PR, the community willl review it and comment ... thanks again !!

I will add more changes of pigz soon.