opendistro-for-elasticsearch/data-prepper

Support checkpointing back to Source plugins

Opened this issue · 0 comments

Is your feature request related to a problem? Please describe.

Some source plugins need to know when records are saved successfully in the sink.

Describe the solution you'd like

DataPrepper should provide a mechanism for reporting back to the source plugin. Each source plugin should be responsible for its own internal checkpointing.