Make sink grpc client options configurable
Closed this issue · 3 comments
Is your feature request related to a problem? Please describe.
Streaming using a filter that produces a large amount of data results in an error. This is because grpc is very conservative with the maximum message size.
Describe the solution you'd like
Maximum message size should be configurable. There should be an option to set other grpc options too.
Additional context
This is similar to what's done in the Typescript and Python SDK.
Happy to take this one
Sounds good! It seems the only configuration possible in tonic is the message size, so I would add a flag --max-message-size that accepts a string as argument. Use the bytesize crate to parse human-readable values into bytes. Use the provided value to update the client config.