Add #sink_parquet method

Question

shreeve opened this issue a year ago · 4 comments

For files bigger than memory, it would be great to be able to use:

Polars.scan_csv(csv_file).sink_parquet(parquet_file)

Answer 1 · 2023-04-01T17:19:46.000Z

Thanks @shreeve, added in the commit above.

Answer 2 · 2023-04-01T17:38:10.000Z

@ankane - You are the man! Thank you so much.

Answer 3 · 2023-04-01T19:44:21.000Z

@ankane - This is extremely helpful. I was unable to process several large files and now I am able to do so. Thanks again.

Answer 4 · 2023-04-01T21:29:59.000Z

Great to hear. Just pushed a new release (0.4.0).