nwaples/rardecode

Error unpacking large archive writing file: rardecode: ...

Closed this issue · 3 comments

I have problems with unpacking a large rar archive, the archive itself takes about 6GB and unpacked 25GB. The archive contains XML files with a database of Russian addresses.
You can download it from the official site http://fias.nalog.ru or from the direct link http://fias.nalog.ru/Public/Downloads/Actual/fias_xml.rar
The full error text
ERROR: 2017/10/12 00:37:10 unpack.go:12: Error unpack archive: data\AS_HOUSE_20171008_bed24a8e-4646-448d-acb8-8de765818389.XML: writing file: rardecode: decoder expected more data than is in packed file
I'm new to Go, you can tell me what the problem is.

Well if it works with normal rar/unrar then its a problem with my library.
I can have a look at it, but it might take a little while since its a large file.

Okay, I will be waiting. I wonder what the problem is, I was thinking here on my laptop 16GB RAM and the file it's 20GB maybe when unpacking the data is not immediately discarded on the disk but accumulated in the operative memory

Sorry for the delay. It looks to be a bug that I had already fixed in the experimental branch. I've merged it back into the main branch. That seems to have fixed it in my testing.