/AzureEvents_DataPipeLine_EndToEndd

Processing Stream data in real time through Azure Functions, Event Hubs ,Persisting to cosmos DB & Visualizing using Power BI

Primary LanguagePython

Azure Stream/Event Data Processing - An End to End Data Pipeline

Processing Stream data in real time through Azure Functions, Event Hubs ,Persisting to cosmos DB & Visualizing using Power BI

Azure Resources Used in the Architecture

  1. Connect: API Management (APIM)
  2. Process: Azure Functions in Python
  3. Buffer: Event Hub
  4. Store & Serve:
    • Azure Blob Storage
    • Cosmos DB ( Core SQL API)
  5. Visualize: Power BI

High Level Architecture

image