How to read & write at the same on a parquet file.
tchaton opened this issue · 0 comments
tchaton commented
Hey there,
I would like to have 1 go-routine writing a stream of metrics to a parquet file and another go-routine triggered from a server to read the parquet file.
I went through the code and it seems this isn't support as the footer is required for reading. However, this would make it very nice to provide a more natural mechanism for streaming data with a producer and consumer.
For the time being, I will keep records in memory to alleviate this limitation.
Best,
T.C