Dfget support S3 protocol and supports directory recursive downloading

[gaius-qi]

GitLink Programming Summer Camp (GLCC) is a summer programming activity for college students nationwide, under the guidance of the China Computer Federation (CCF) and organized by the CCF Open Source Development Committee (CCF ODC). The event will cover nearly a thousand colleges and universities, and will unite various open source foundations, enterprises, communities, and experts with the aim of encouraging young students to participate in real open source software development, enhancing their technical skills, and providing outstanding talent for the open source community. GLCC also provides an open and friendly platform for young students to communicate and hopes to further promote the prosperity and development of the domestic open source community.

Dragonfly will participate as a guiding organization in “GitLink Programming Summer Camp (GLCC)”.

Background

Dragonfly rust client does not support back-to-source downloading of different object storage protocols. Priority is given to supporting S3 protocol back-to-source downloads. Need to support S3 protocol in dragonfly-client-backend crate, implemented based on trait Backend and it needs to support directory recursive downloading.

Target

Support dfget s3://example/config -O output to download S3 object and dfget needs to add a recursive option to support directory recursive downloads. Complete feature, unit testing and E2E testing.

Difficulty

Intermediate

Mentor

Wenbo Qi(Gaius)
gaius.qi@gmail.com

Output Requirements

• Add S3 backend feature.
• Add Unit testings.
• Add E2E testings.
• Add usage document.

Technical Requirements

• Familiar with Rust programming language.
• Familiar with P2P Technology.