aliyun/ossutil

-r 批量上传文件时,大文件丢失严重,尝试上传单个丢失的文件时。每过10%报一次500的错

Opened this issue · 0 comments

版本1.7.18
用-r上传 10多个g的文件夹 成功6104个文件 丢了1256个。
Total num: 88740, size: 142,084,483,830. Error num: 1256. OK num: 87484(upload 6104 files, skip 81380 files), OK size: 138,753,343,892(transfer: 18,230,971,399, skip: 120,522,372,493).
对比了一下找到个没上传的文件:xxxx.tgz,大小一个G,不用-r,采用单个文件上传,每上传10%左右就报以下错误,连续试了7次都是这样,最后断在72%的地方,不知道是代码哪里有限制。
retry count:9,multipart upload file:E:\1606.tgz.

Total num: 1, size: 1,104,783,720. Dealed num: 0, OK size: 441,913,600, Progress: 40.000%, Speed: 0.00KB/s

Total num: 1, size: 1,104,783,720. Dealed num: 0, Transfer size: 24,857,640. When error happens.

average speed 652000(byte/s)
Error: oss: service returned invalid response body, status = 500 Internal Server Error, RequestId = , File=E:\1606.tgz