xitongsys/parquet-go

How to read & write at the same on a parquet file.

tchaton opened this issue · 0 comments

Hey there,

I would like to have 1 go-routine writing a stream of metrics to a parquet file and another go-routine triggered from a server to read the parquet file.

I went through the code and it seems this isn't support as the footer is required for reading. However, this would make it very nice to provide a more natural mechanism for streaming data with a producer and consumer.

For the time being, I will keep records in memory to alleviate this limitation.

Best,
T.C