Welcome to my BI department.
The purpose of this department is to support the analytics requirements of a DVD rental company. The BI department currently supports the following features:
The company stores its ongoing production data in a PostgreSQL database.
Continuously inserts transactions into the company's production database.
The company's Data Warehouse is a fact table in Google BigQuery.
Scheduled to run every 5 minutes and transfer batches of new data to the company's Data Warehouse.
For more detailed information, check out my Medium article: Part 1: https://medium.com/@bdadon50/data-engineering-project-bi-department-part-1-cb6086da3662