senzing-garage/stream-producer

Support Azure Service Bus Queues

Closed this issue · 1 comments

To build the Senzing Stack on Azure using the Azure Message Bus Queue, additional sub-commands are needed.

Subcommands

  1. avro-to-azure-queue
  2. csv-to-azure-queue
  3. gzipped-json-to-azure-queue
  4. json-to-azure-queue
  5. parquet-to-azure-queue

Enviroment variables

  1. SENZING_AZURE_QUEUE_CONNECTION_STRING
  2. SENZING_AZURE_QUEUE_QUEUE_NAME
  3. SENZING_AZURE_QUEUE_INFO_CONNECTION_STRING
  4. SENZING_AZURE_QUEUE_INFO_QUEUE_NAME
  5. SENZING_AZURE_QUEUE_FAILURE_CONNECTION_STRING
  6. SENZING_AZURE_QUEUE_FAILURE_QUEUE_NAME

References

  1. Use the Azure CLI to create a Service Bus namespace and a queue
  2. Python
    1. https://docs.microsoft.com/en-us/azure/service-bus-messaging/service-bus-python-how-to-use-queues
    2. https://pypi.org/project/azure-servicebus/
  3. Other language references
    1. https://docs.microsoft.com/en-us/azure/service-bus-messaging/service-bus-quickstart-cli#next-steps

Pull requests

  1. #78
  2. #79