ikmalzulkifli

ikmalzulkifli's Stars

• josephmachado/spark_submit_airflow

  Simple repo to demonstrate how to submit a spark job to EMR from Airflow

  Language:Python3223

• alex/what-happens-when

  An attempt to answer the age old interview question "What happens when you type google.com into your browser and press enter?"

  40.1k5.5k

• data-engineering-community/data-engineering-wiki

  The best place to learn data engineering. Built and maintained by the data engineering community.

  Language:CSS1.4k153

• josephmachado/python-v-sql-for-data-transform

  Python or SQL for data transformation

  Language:Python8

• janaom/gcp-de-project-streaming-pubsub-beam-dataflow

  This project demonstrates an end-to-end solution for processing and analyzing real-time conversations data from a JSON file using GCP services and infrastructure automation, showcasing data storage, streaming, processing, and analysis at scale.

  Language:Python81

• josephmachado/sde_de101_josephmachado

  Sample repo for startdataengineering DE 101 free course

  3523

• josephmachado/python_essentials_for_data_engineers

  Code for blog at https://www.startdataengineering.com/post/python-for-de/

  Language:Python5561

• josephmachado/cost_effective_data_pipelines

  Cost Efficient Data Pipelines with DuckDB

  Language:C4666

• Rhoteh/exam-testing-engine-vumingo

  Free full version of exam testing engine vumingo

  4576

• AlexTheAnalyst/Power-BI

  177124

• TheAlgorithms/Python

  All Algorithms implemented in Python

  Language:Python194k45.6k

• darshilparmar/python-for-data-engineering

  This repo contains all the code used in the Python for Data Engineering Course

  Language:Jupyter Notebook228615

• Thevesh/analysis-election-msia

  Data on Malaysian parliamentary election results + dataviz with the consolidated datasets

  Language:Jupyter Notebook8138

• Thevesh/data

  Data which, to the best of my knowledge, I am the first / only to collate and make freely available in a machine-readable way. I will delete files for which I discover a better previous source.

  Language:Python83

• josephmachado/data

  open data for blog content at https://www.startdataengineering.com/

  11

• josephmachado/soho

  Minimalist Hugo theme based on Hyde

  1

• josephmachado/spark_submit_airflow-

  Simple repo to demonstrate how to submit a spark job

  3

• josephmachado/unit_test_dbt

  unit test example in DBT

  Language:Shell52

• josephmachado/sde_superset_demo

  Apache Superset Demp

  24

• josephmachado/trigger_spark_with_lambda

  Simple example showing how to trigger a spark job with AWS Lambda

  Language:Shell46

• josephmachado/idempotent-data-pipeline

  Making data pipelines idempotent

  Language:Python55

• josephmachado/e2e_datapipeline_test

  Example repo to create end to end tests for data pipeline.

  Language:Python216

• josephmachado/files

  public file hosting

  Language:Shell11

• josephmachado/josephmachado

  Profile readme

  64

• josephmachado/data_test_ci

  Repository showing how to automate data testing as part of CI

  Language:Python97

• josephmachado/docker-trino-cluster

  Multiple node presto cluster on docker container

  3

• josephmachado/dbt_development

  Repo to explain development, CI/CD cycle in dbt

  721

• josephmachado/bitcoinMonitor

  Near real time ETL to populate a dashboard.

  Language:Python7037

• josephmachado/online_store

  End to end data engineering project

  Language:Python4917

• josephmachado/simple_dbt_project

  Code for dbt tutorial

  14374