HKUST-KnowComp/ASER

Add gzip compression to downloadable files

Closed this issue · 4 comments

Hello, and thank you for making this resource.

I am downloading the KG files from here.

I just wanted to point out that if the files were gzipped, they would likely weigh much less, making for shorter download times and, most notably for you guys, less space occupied on your server and fewer bandwidth costs to pay.

We have tried, but gzip and 7z cannot save too much space as the DB has already involved some technologies to help improve the space efficiency.

Oh ok! No problem then. I am almost done writing the small script to parse everything into a format that is compatible with what I'll be doing with it, is it okay if I upload the result on the internet archive? That way it'll be a bit easier for me to download automatically on the different machines where I run stuff.

Sure, you can upload and share the processed data for nonprofit purposes.

Perfect, this is just for non-profit research so it should be quite ok. Thanks again!