`UnicodeDecodeError` causing `InvalidMessageError` trying to deserialize a message when chunked
Closed this issue · 0 comments
nickwilliams-eventbrite commented
When chunking is enabled, some large, chunked messages are causing a UnicodeDecodeError which causes an InvalidMessageError when the re-assembled chucks are deserialized by Message Pack.
Root cause analysis: We are stripping whitespace from serialized messages when extracting header information. When messages are chunked and the chunk boundary lands on a whitespace character, this causes the re-assembled message to fail to deserialize.