Add support to streaming architectures (Kafka, RabbitMQ, Pub/Sub, Queues, etc)

[ivanpfalcao]

Use case

We frequently need to connect the ML models to an event streaming platform. Today we need to create an external application to consume de API model. The idea is add support to streaming technologies like Kafka, RabbitMQ, Pub/Sub, etc.

Feature description

We need to create an agent capable of connect to the most used streaming platforms (Kafka, RabbitMQ, Pub/Sub, etc.), receive messages (streaming) and redirect to predict function of a model.

Alternatives

Nowadays we need to create a separate agent to listen to a queue and call through HTTP request the model API