dominicpacquing

dominicpacquing's Stars

• apache/iceberg

  Apache Iceberg

  Language:Java6.1k2.1k

• aws-samples/data-science-on-aws

  Language:Jupyter Notebook13844

• data-dot-all/dataall

  A modern data marketplace that makes collaboration among diverse users (like business, analysts and engineers) easier, increasing efficiency and agility in data projects on AWS.

  Language:Python22682

• aws-samples/transactional-datalake-using-apache-iceberg-on-aws-glue

  Stream CDC into an Amazon S3 data lake in Apache Iceberg table format with AWS Glue Streaming and DMS

  Language:Python231

• tabular-io/docker-spark-iceberg

  Language:Jupyter Notebook226117

• aws-samples/amazon-sagemaker-feature-store-end-to-end-workshop

  Language:Jupyter Notebook12548

• awslabs/amazon-asdi

  Docs and supporting material for the Amazon Sustainability Data Initiative.

  Language:Jupyter Notebook8037

• donnemartin/system-design-primer

  Learn how to design large-scale systems. Prep for the system design interview. Includes Anki flashcards.

  Language:Python269k45.4k

• datastacktv/data-engineer-roadmap

  Roadmap to becoming a data engineer in 2021

  12.3k1.3k

• awslabs/amazon-kinesis-data-generator

  A UI that simplifies testing with Amazon Kinesis Streams and Firehose. Create and save record templates, and easily send data to Amazon Kinesis.

  Language:JavaScript19875

• microsoft/hummingbird

  Hummingbird compiles trained ML models into tensor computation for faster inference.

  Language:Python3.3k277

• h2oai/sparkling-water

  Sparkling Water provides H2O functionality inside Spark cluster

  Language:Scala960361

• kubeflow/spark-operator

  Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

  Language:Go2.7k1.4k

• crossplane/crossplane

  The Cloud Native Control Plane

  Language:Go9.3k929

• mozilla-services/mozilla-pipeline-schemas

  Schemas for Mozilla's data ingestion pipeline and data lake outputs

  Language:Python4694

• apache/systemds

  An open source ML system for the end-to-end data science lifecycle

  Language:Java1k463

• microsoft/SynapseML

  Simple and Distributed Machine Learning

  Language:Scala5k827

• aws/amazon-sagemaker-examples

  Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.

  Language:Jupyter Notebook9.9k6.7k

• aws/aws-step-functions-data-science-sdk-python

  Step Functions Data Science SDK for building machine learning (ML) workflows and pipelines on AWS

  Language:Python28487

• polyaxon/polyaxon

  MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle

  3.5k312

• mozilla/bigquery-etl

  Bigquery ETL

  Language:Python24998

• awsdocs/amazon-emr-management-guide

  The open source version of the Amazon EMR Management Guide. You can submit feedback & requests for changes by submitting issues in this repo or by making proposed changes & submitting a pull request.

  6183

• mozilla/emr-bootstrap-spark

  AWS bootstrap scripts for Mozilla's flavoured Spark setup.

  Language:Python4623

• mozilla/telemetry-airflow

  Airflow configuration for Telemetry

  Language:Python17490

• uber-common/cadence-samples

  Language:Go19091

• aws-samples/aws-dbs-refarch-datalake

  Reference Architectures for Datalakes on AWS

  Language:HTML7531

• uber/cadence

  Cadence is a distributed, scalable, durable, and highly available orchestration engine to execute asynchronous long-running business logic in a scalable and resilient way.

  Language:Go8.1k787

• linkedin/dr-elephant

  Dr. Elephant is a job and flow-level performance monitoring and tuning tool for Apache Hadoop and Apache Spark

  Language:Java1.4k857

• recommenders-team/recommenders

  Best Practices on Recommendation Systems

  Language:Python18.7k3.1k

• audienceproject/spark-dynamodb

  Plug-and-play implementation of an Apache Spark custom data source for AWS DynamoDB.

  Language:Scala17390