pyarrow 0.14 made fetch_parquet extremely slow

Question

pyarrow 0.14 made fetch_parquet extremely slow

Closed this issue 5 years ago · 3 comments

Answer 1 · 2019-08-24T18:56:22.000Z

I did an isolated test in google colab to see if it was any other library.

Answer 2 · 2019-08-28T19:11:36.000Z

I will try with version 0.13. They will take a long time to fix it. As it is mixed python/C++ I would take a even longer time to do it.
But it is a serious problem for us..

Answer 3 · 2019-08-28T20:56:30.000Z

switch back to 0.13.0 in pycarol 2.21