sryza/spark-timeseries

Streaming/Live

Closed this issue · 3 comments

Is any support for streaming planned? Is there an existing way to append data to a TimeSeriesRDD?

I'm heavily interested and could start to implement this. Any hints on how and where you imagine this functionality?

Thanks!

I am also interested in it

sryza commented

@hellno sorry for the great delay here. There isn't a current plan to support streaming. In general, appending data to a TimeSeriesRDD is difficult, because the layout is more optimized for analysis. That said, if you have a proposal, I'd definitely be open to hearing ideas.

+1 for streaming. Structured streaming may be easier to implement (?).

Regardless, I'm in need of a streaming solution myself so you can count me in to contribute