buger/goreplay

send kafka error

zer0e opened this issue · 1 comments

zer0e commented

[DEBUG][elapsed 6.2756408s]: Failed to write access log entry: kafka: Failed to produce message to topic gor-1679038301199: kafka server: Message was too large, server rejected it to avoid allocation error.

I set kafka server config max.message.bytes=104857600, but goreplay is also send error.
Should I config other settings?

zer0e commented

Well, the kafka producer should add c.Producer.MaxMessageBytes config to enable the message size larger 1M.
If possible, goreplay can add flag to set MaxMessageBytes with KafkaOutput?