Loading Big files using fromMatrixMarket (Memory Performance)
Closed this issue · 2 comments
LsKoder commented
I'm trying to load big matrix as https://sparse.tamu.edu/Janna/Flan_1565
Actually, it's necessary to read entire file on memory (several GBs) and pass it as string argument to fromMatrixMarket() function.
It could be better to pass the file path, proceeding to read file row by row (improving memory usage).
vkostyukov commented
Hey @LsKoder! Thanks for the issue! Any chance you want to work on a fix?
vkostyukov commented
Fixed in #297.