Closed this issue 2 years ago · 1 comments
Think deafult shuffle partitions is 200. Let's try 1 or 2 and quantify how much that speeds up the test suite.
Added in this commit: d39cfa4
This trick doesn't help so much for this particular project because it's mainly slow because of I/O.