Kafka transactions
JohnColeman-CTO opened this issue · 1 comments
JohnColeman-CTO commented
Are transactions fully implemented?
I do not see anything in the code indicating that the feature is supported. This means that you cannot guarantee one time delivery in a consumer-producer pipeline.
natansil commented
Hi @JohnColeman-CTO,
Currently Greyhound does not have support for exactly-once-processing (i.e. Kafka transactions).
But we plan to introduce it in 2021.
The idea is to have an additional ExactlyOnceProcessor (which will encapsulate both a consumer and producer) alongside RecordConsumer (which provides at least once guarantees)
CC: @berman7