igvog

igvog's Stars

• apache/spark

  Apache Spark - A unified analytics engine for large-scale data processing

  Language:Scala40.3k2k028.4k

• pola-rs/polars

  Dataframes powered by a multithreaded, vectorized query engine, written in Rust

  Language:Rust31.3k1689.5k2k

• modularml/mojo

  The Mojo Programming Language

  Language:Mojo23.5k2662.3k2.6k

• prestodb/presto

  The official home of the Presto distributed SQL query engine for big data

  Language:Java16.1k8516.7k5.4k

• scala/scala

  Scala 2 compiler and standard library. Scala 2 bugs at https://github.com/scala/bug; Scala 3 at https://github.com/scala/scala3

  Language:Scala14.4k71603.1k

• debezium/debezium

  Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.

  Language:Java10.9k21702.6k

• datahub-project/datahub

  The Metadata Platform for your Data and AI Stack

  Language:Java10.1k2552.3k3k

• StarRocks/starrocks

  The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.

  Language:Java9.5k2128k1.9k

• lauris/awesome-scala

  A community driven list of useful Scala libraries, frameworks and software.

  Language:Python9.1k601751.3k

• jupyter/docker-stacks

  Ready-to-run Docker images containing Jupyter applications

  Language:Python8.1k1889053k

• apache/hudi

  Upserts, Deletes And Incremental Processing on Big Data.

  Language:Java5.5k1.2k3.3k2.4k

• Eventual-Inc/Daft

  Distributed data engine for Python/SQL designed for the cloud, powered by Rust

  Language:Rust2.5k18862175

• delta-io/delta-rs

  A native Rust library for Delta Lake, with bindings into Python

  Language:Rust2.5k361.2k421

• teamclairvoyant/airflow-maintenance-dags

  A series of DAGs/Workflows to help maintain the operation of Airflow

  Language:Python1.7k8775395

• san089/Udacity-Data-Engineering-Projects

  Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.

  Language:Python1.5k395494

• zinggAI/zingg

  Scalable identity resolution, entity resolution, data mastering and deduplication using ML

  Language:Java96616501123

• astronomer/astronomer-cosmos

  Run your dbt Core projects as Apache Airflow DAGs and Task Groups with a few lines of code

  Language:Python81312675179

• Azure-Samples/modern-data-warehouse-dataops

  DataOps for Microsoft Data Platform technologies. https://aka.ms/dataops-repo

  Language:Jupyter Notebook60157492474

• ActivitySchema/ActivitySchema

  Repository for the ActivitySchema spec and supporting materials

  405161030

• awslabs/amazon-kinesis-client-python

  Amazon Kinesis Client Library for Python

  Language:Python37150102222

• delta-io/delta-examples

  Delta Lake examples

  Language:Jupyter Notebook212142176

• bryzgaloff/airflow-clickhouse-plugin

  The most popular ClickHouse plugin for Airflow. 🔝 Top-1% downloads on PyPI: https://pypi.org/project/airflow-clickhouse-plugin! Based on mymarilyn/clickhouse-driver.

  Language:Python14794136

• ScalefreeCOM/datavault4dbt

  Scalefree's dbt package for a Data Vault 2.0 implementation congruent to the original Data Vault 2.0 definition by Dan Linstedt including the Staging Area, DV2.0 main entities, PITs and Snapshot Tables.

  Language:PLSQL144166328

• minio/openlake

  Build Data Lake using Open Source tools

  Language:Jupyter Notebook8511215

• dremio/dbt-dremio

  dbt (data build tool) adapter for the Dremio

  Language:Python47711225

• isaaclucky/data-warehousing

  Data warehouse tech stack with PostgreSQL, DBT and Airflow

  Language:Python14105

• semashkinvg/DataVault

  14204

• aravinthsci/Spark_Delta_Lake

  Delta Lake Examples

  Language:Jupyter Notebook122012

• saboye/Data-Modeling-with-Postgres

  A project to design a fact and dimension star schema for optimizing queries on a flight booking database using PostgreSQL, a relational database management system. This schema is well-suited for a flight booking database, as it allows for efficient querying of data such as booking dates, flight routes, and passenger information.

  Language:PLpgSQL10203

• jiteshsoni/material_for_public_consumption

  Language:Python32