Downloading multiple files results into MemoryError
tanishqjasoria opened this issue · 2 comments
tanishqjasoria commented
PyDrive keep files in the memory even after the file is saved on the disk.
shcheklein commented
@tanishqjasoria this (and many other) issue is fixed in the iterative/PyDrive2 - a maintained fork. GetContentFile does not store content in memory at all now (so it can handle large files as well).
Here is an example on how it is used in DVC - https://github.com/iterative/dvc/blob/b57077af11ae287941b4d2939071fda2ad01f483/dvc/remote/gdrive.py#L376
tanishqjasoria commented
Okay. Thanks for the info!