pacman82/odbc2parquet

Is there a flag to split the parquet output by size?

samaguire opened this issue · 3 comments

samaguire commented

as per the title

i.e. i want to output a large table, but have several parquet files generated, that are no bigger than 1GB

pacman82 commented

Hello @samaguire,

Seems to me you are looking for the --file-size-threshold option of the query subcommand. See #190 , let me know if this solves your issue.

Cheers, Markus

pacman82 commented

FYI: To learn more about --file-size-threshold or to see all options and flags for the query subcommand, you can execute odbc2parquet query --help.

  • 👍1
samaguire commented

Ah. I thought it was odd to not have so ething like this. I didn't realize I could do the --help after query. 👍