mailgun/kafka-pixy

Negative Offsets

Closed this issue · 0 comments

How is it possible that a negative offset is generated?

{
    "partition": 2,
    "begin": 659004,
    "end": 1122013,
    "count": 463009,
    "offset": 1122121,
    "lag": -108,
    "metadata": "7UzI",
    "sparse_acks": "667-942"
}

It seems that when this occurs no message is emitted.

When I saw this - I did seek to the end of the stream so perhaps there is something going on with a batch being pulled that forces the offsets forward to a value which doesn't really make sense.