roomanidzee

roomanidzee's Stars

• seaweedfs/seaweedfs

  SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.

  Language:Go23.3k5372.9k2.3k

• casey/just

  🤖 Just a command runner

  Language:Rust22.9k791.1k498

• NewTendermint/awesome-bigdata

  A curated list of awesome big data frameworks, ressources and other awesomeness.

  12.8k848492.5k

• lightdash/lightdash

  Self-serve BI to 10x your data team ⚡️

  Language:TypeScript4.1k296.4k440

• apache/kyuubi

  Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.

  Language:Scala2.1k632.3k919

• mito-ds/monorepo

  The mitosheet package, trymito.io, and other public Mito code.

  Language:Python1.8k20236120

• bytewax/bytewax

  Python Stream Processing

  Language:Python1.6k199665

• dbt-labs/dbt-utils

  Utility functions for dbt projects.

  Language:Makefile1.4k39400505

• ploomber/jupysql

  Better SQL in Jupyter. 📊

  Language:Python732850277

• databrickslabs/pyspark-ai

  English SDK for Apache Spark

  Language:Python722192190

• LineaLabs/lineapy

  Move fast from data science prototype to pipeline. Capture, analyze, and transform messy notebooks into data pipelines with just two lines of code.

  Language:Jupyter Notebook6642029058

• Lancetnik/Propan

  Propan is a powerful and easy-to-use Python framework for building event-driven applications that interact with any MQ Broker

  Language:Python484117728

• LucaCanali/Miscellaneous

  Includes notes on using Apache Spark in general, notes on using Spark for Physics, how to run TPCDS on PySpark, how to create histograms with Spark, tools for performance testing CPUs, Jupyter notebooks examples for Spark, examples for Oracle and other DB systems.

  Language:Jupyter Notebook427256150

• zsvoboda/ngods-stocks

  New Generation Opensource Data Stack Demo

  Language:Jupyter Notebook416161895

• andreax79/airflow-code-editor

  A plugin for Apache Airflow that allows you to edit DAGs in browser

  Language:JavaScript412114651

• Miksus/red-mail

  Advanced email sending for Python

  Language:Python39864031

• microsoft/sql-spark-connector

  Apache Spark Connector for SQL Server and Azure SQL

  Language:Scala27837182120

• ClickHouse/clickhouse-kafka-connect

  ClickHouse Kafka Connector

  Language:Java1581116445

• sbrunk/storch

  GPU accelerated deep learning and numeric computing for Scala 3.

  Language:Scala11911278

• confluentinc/parallel-consumer

  Parallel Apache Kafka client wrapper with per message ACK, client side queueing, a simpler consumer/producer API with key concurrency and extendable non-blocking IO processing.

  Language:Java111123228136

• AugustNagro/java-async-await

  Async-Await support for Java

  Language:Java1055111

• Miksus/red-box

  Next generation email box manager

  Language:Python1013811

• typelevel/toolkit

  Quickstart your next app with the Typelevel Toolkit!

  Language:Scala959149

• LamaAni/KubernetesJobOperator

  An airflow operator that executes a task in a kubernetes cluster, given a kubernetes yaml configuration or an image refrence.

  Language:Python587239

• astronomer/airflow-provider-kafka

  A provider package for kafka

  Language:Python37212016

• yaooqinn/spark-postgres

  PostgreSQL and GreenPlum Data Source for Apache Spark

  Language:Scala354714

• bakdata/streams-bootstrap

  Utility functions and base classes for Kafka Streams applications

  Language:Java3012383

• oracle/spark-oracle

  On the fly, translation of Spark programs to run natively on your Oracle DB. Your Spark programs require no changes.

  Language:Scala2910110

• 10xfuturetechnologies/kafka-connect-iceberg

  Kafka Connector for Iceberg tables

  Language:Java165105

• jitapichab/apache-nifi-kafka

  https://medium.com/@jitapichab/apache-nifi-integrate-kafka-to-consume-and-produce-387968b8bd6b

  Language:Python73212