dominicpacquing's Stars
apache/iceberg
Apache Iceberg
aws-samples/data-science-on-aws
data-dot-all/dataall
A modern data marketplace that makes collaboration among diverse users (like business, analysts and engineers) easier, increasing efficiency and agility in data projects on AWS.
aws-samples/transactional-datalake-using-apache-iceberg-on-aws-glue
Stream CDC into an Amazon S3 data lake in Apache Iceberg table format with AWS Glue Streaming and DMS
tabular-io/docker-spark-iceberg
aws-samples/amazon-sagemaker-feature-store-end-to-end-workshop
awslabs/amazon-asdi
Docs and supporting material for the Amazon Sustainability Data Initiative.
donnemartin/system-design-primer
Learn how to design large-scale systems. Prep for the system design interview. Includes Anki flashcards.
datastacktv/data-engineer-roadmap
Roadmap to becoming a data engineer in 2021
awslabs/amazon-kinesis-data-generator
A UI that simplifies testing with Amazon Kinesis Streams and Firehose. Create and save record templates, and easily send data to Amazon Kinesis.
microsoft/hummingbird
Hummingbird compiles trained ML models into tensor computation for faster inference.
h2oai/sparkling-water
Sparkling Water provides H2O functionality inside Spark cluster
kubeflow/spark-operator
Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.
crossplane/crossplane
The Cloud Native Control Plane
mozilla-services/mozilla-pipeline-schemas
Schemas for Mozilla's data ingestion pipeline and data lake outputs
apache/systemds
An open source ML system for the end-to-end data science lifecycle
microsoft/SynapseML
Simple and Distributed Machine Learning
aws/amazon-sagemaker-examples
Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.
aws/aws-step-functions-data-science-sdk-python
Step Functions Data Science SDK for building machine learning (ML) workflows and pipelines on AWS
polyaxon/polyaxon
MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle
mozilla/bigquery-etl
Bigquery ETL
awsdocs/amazon-emr-management-guide
The open source version of the Amazon EMR Management Guide. You can submit feedback & requests for changes by submitting issues in this repo or by making proposed changes & submitting a pull request.
mozilla/emr-bootstrap-spark
AWS bootstrap scripts for Mozilla's flavoured Spark setup.
mozilla/telemetry-airflow
Airflow configuration for Telemetry
uber-common/cadence-samples
aws-samples/aws-dbs-refarch-datalake
Reference Architectures for Datalakes on AWS
uber/cadence
Cadence is a distributed, scalable, durable, and highly available orchestration engine to execute asynchronous long-running business logic in a scalable and resilient way.
linkedin/dr-elephant
Dr. Elephant is a job and flow-level performance monitoring and tuning tool for Apache Hadoop and Apache Spark
recommenders-team/recommenders
Best Practices on Recommendation Systems
audienceproject/spark-dynamodb
Plug-and-play implementation of an Apache Spark custom data source for AWS DynamoDB.