ccloli/E-Hentai-Downloader

Error occured when downloading galleries with size over 2GB

clockworksheep opened this issue · 2 comments

Script version: 1.34.10
Browser: Firefox 117.0.1 (64-bit) / Nightly 120.0a1 (2023-09-30)
Extension: Greasemonkey v4.19.0
Error Encountered:

Below error message appears when downloading galleries with size over 2GB (https://e-hentai.org/g/2692575/3ee3db95d1/)

"An error occurred when generating Blob object.

Error Name: TypeError
Error Message: Blob constructor: ArrayBuffer branch of ((ArrayBufferView or ArrayBuffer) or Blob or USVString) can't be an ArrayBuffer or an ArrayBufferView larger than 2 GB

Try again?"

An attempt to work-around the error by setting "javascript.options.large_arraybuffers" to "True" was tried (According to https://bugzilla.mozilla.org/show_bug.cgi?id=1392234), but the above error message still recurs.

ccloli commented

First of all, you should never download a gallery larger than 1GB.

From your error message, looks like it's because the Blob Constructor in Firefox cannot handle an Array Buffer larger than 2GB? Since from Bugzilla, the setting has been enabled by default since 87.

For now you should try downloading with torrents, or the official archiver if you have enough GPS, or some other tools that not having browser's limitation like gallery-dl.

That greatly depend on you're browser, you're system and you're available resource overall.

With my old PC i was able to download a max of 1GB with Google Chrome, this is actually the best setting to be sure, just dowload part of the images to not exeed this.

That said, with my new PC i was able to download a 9 Gb gallery in one go but my image limit got to 250K over a max of 50K and i needed days to recover it (it is fixed to failed images, until you have to download a failed image you can go on up to 250K image limit, when you need to redownload a failed image you are blocked if you are over 50K points).