awslabs/s3-connector-for-pytorch
The Amazon S3 Connector for PyTorch delivers high throughput for PyTorch training jobs that access and store data in Amazon S3.
PythonBSD-3-Clause
Issues
- 5
Allow disabling virtual-hosted-style addressing
#208 opened by DamienMatias - 1
CRT reaise AWS_ERROR_S3_REQUEST_HAS_COMPLETED when upload Llama 70b checkpoints.
#219 opened by crazyguitar - 2
Does the S3 Connector use Mountpoint-s3?
#216 opened by ekaynar - 1
- 1
- 1
Configure parallelism
#215 opened by tsdev - 3
_PickleableListObjectStream expects invalid XML element in "ListAllMyBucketsResult"
#211 opened by N-o-Z - 5
- 2
- 4
Improve performance for loading checkpoints
#199 opened by IsaevIlya - 7
- 7
Can we get some benchmarks ?
#127 opened by tchaton - 0
Improve output formatting for `s3torch-benchmark`
#175 opened by muddyfish - 3
An error occurs when launching the benchmark.
#166 opened by shiwk - 7
S3MapDataset hangs forever
#167 opened by TommasoBendinelli - 1
- 0
- 3
Error when importing laion-art dataset
#102 opened by awsankur - 3
Can't install on Windows 11
#101 opened by bouachalazhar - 1
High memory usage with S3MapDataset
#89 opened by IsaevIlya - 2
WARNING: Generating metadata for package s3torchconnector produced metadata for project name unknown. Fix your #egg=s3torchconnector fragments.
#92 opened by rgxb2807 - 2
- 0
[Public Launch] Push protection
#5 opened by dnanuti - 0
- 0
[Launch Readiness] Add documentation
#4 opened by muddyfish - 0
[Launch Readiness] Review and address TODO items
#13 opened by dnanuti - 0
[Launch Readiness] Licensing
#2 opened by dnanuti