data mgt

GazProm Data Engineering Project

Motivation

  • Data has to be securely and efficiently added to a database to be accessed by Data Analysts and Scientists

Aims and Objectives

  1. Construction of data models using an ORM ideally SQL-Alchemy.
  2. Data manipulation
  3. Data Validation before data upload to the Database
  4. Python module that obtains different views from the database;
  5. Answer the qestions provided in the specification using the module constructed in objetive 4

Tools Used

  • Python
  • Object-Relational Mapping --> SQLAlchemy ORM
  • Database --> PostgreSQL
  • Data Manipulation --> Pandas