ssl-hep/ServiceX_App

Create Kafka Topics

Closed this issue 5 years ago · 0 comments

BenGalewsky commented 5 years ago

Story

As an analyzer I want Kafka topics to be created with the correct parameters so I can perform my analysis efficiently

Acceptance Criteria

Given I have a submitted transformation request, when it passes preflight checks, then a Kafka topic should be created that ha the correct number of partitions and max.message.bytes

Assumptions

Partitions is a setting in app.conf
max.message.bytes set with current heuristic of 40 bytes/column/event