Pinned Repositories
Agent-Specification
darwin
Avro Schema Evolution made easy
data-platform-shaper
Data-Product-Specification
An open specification for data products in Data Mesh
DataQuality
DataQuality for BigData
governance-decision-record
The Governance Decision Record (GDR) is a specification model for (computational) data governance policies inspired from the ADR (Architectural Decision Record).
sparksearchengine
Big Data search with Spark and Lucene
wasp
WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.
whitefox
Lake Sharing is an open protocol, heavily influenced by Delta Sharing, for secure exchange of large datasets, which enables organizations to share data regardless of which computing platforms and table/file format they use. Forked from Delta Sharing
witboost-starter-kit
Witboost is a versatile platform that addresses a wide range of sophisticated data engineering challenges. The Starter Kit showcases the integration capabilities and provides a "batteries-included" product.
Agile Lab's Repositories
agile-lab-dev/wasp
WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.
agile-lab-dev/witboost-starter-kit
Witboost is a versatile platform that addresses a wide range of sophisticated data engineering challenges. The Starter Kit showcases the integration capabilities and provides a "batteries-included" product.
agile-lab-dev/Agent-Specification
agile-lab-dev/whitefox
Lake Sharing is an open protocol, heavily influenced by Delta Sharing, for secure exchange of large datasets, which enables organizations to share data regardless of which computing platforms and table/file format they use. Forked from Delta Sharing
agile-lab-dev/witboost-argocd-tech-adapter
The Argo CD Tech Adapter. Part of the Witboost Starter Kit: https://github.com/agile-lab-dev/witboost-starter-kit
agile-lab-dev/witboost-argocd-workload-template
The Argo CD Workload Template. Part of the Witboost Starter Kit: https://github.com/agile-lab-dev/witboost-starter-kit
agile-lab-dev/witboost-aws-athena-output-port-template
The AWS Athena Output Port Template. Part of the Witboost Starter Kit: https://github.com/agile-lab-dev/witboost-starter-kit
agile-lab-dev/witboost-aws-glue-workload-template
The AWS Glue Workload Template. Part of the Witboost Starter Kit: https://github.com/agile-lab-dev/witboost-starter-kit
agile-lab-dev/witboost-aws-s3-storage-area-template
The AWS S3 Storage Area Template. Part of the Witboost Starter Kit: https://github.com/agile-lab-dev/witboost-starter-kit
agile-lab-dev/witboost-aws-s3-tech-adapter
The AWS S3 Tech Adapter. Part of the Witboost Starter Kit: https://github.com/agile-lab-dev/witboost-starter-kit
agile-lab-dev/witboost-azure-adls-output-port-tech-adapter
The Azure ADLS Output Port Tech Adapter. Part of the Witboost Starter Kit: https://github.com/agile-lab-dev/witboost-starter-kit
agile-lab-dev/witboost-azure-adls-output-port-template
The Azure ADLS Output Port Template. Part of the Witboost Starter Kit: https://github.com/agile-lab-dev/witboost-starter-kit
agile-lab-dev/witboost-azure-adls-storage-area-helm
agile-lab-dev/witboost-azure-adls-storage-area-template
agile-lab-dev/witboost-azure-ai-document-intelligence-workload-template
The Azure AI Document intelligence Workload Template. Part of the Witboost Starter Kit: https://github.com/agile-lab-dev/witboost-starter-kit
agile-lab-dev/witboost-azure-datafactory-workload-template
agile-lab-dev/witboost-cdp-hdfs-output-port-template
agile-lab-dev/witboost-cdp-hdfs-storage-area-template
agile-lab-dev/witboost-confluent-kafka-output-port-template
The Confluent Kafka Output Port Template. Part of the Witboost Starter Kit: https://github.com/agile-lab-dev/witboost-starter-kit
agile-lab-dev/witboost-databricks-python-tech-adapter
The Databricks Python Tech Adapter. Part of the Witboost Starter Kit: https://github.com/agile-lab-dev/witboost-starter-kit
agile-lab-dev/witboost-databricks-tech-adapter
agile-lab-dev/witboost-google-bigquery-output-port-template
The Google BigQuery Output Port Template. Part of the Witboost Starter Kit: https://github.com/agile-lab-dev/witboost-starter-kit
agile-lab-dev/witboost-google-bigquery-storage-area-template
The Google BigQuery Storage Area Template. Part of the Witboost Starter Kit: https://github.com/agile-lab-dev/witboost-starter-kit
agile-lab-dev/witboost-great-expectations-guardian-workload-template
The Great Expectations Guardian Workload Template. Part of the Witboost Starter Kit: https://github.com/agile-lab-dev/witboost-starter-kit
agile-lab-dev/witboost-java-tech-adapter-framework
agile-lab-dev/witboost-mongodb-output-port-template
The MongoDB Output Port Template. Part of the Witboost Starter Kit: https://github.com/agile-lab-dev/witboost-starter-kit
agile-lab-dev/witboost-mongodb-tech-adapter
The MongoDB Tech Adapter. Part of the Witboost Starter Kit: https://github.com/agile-lab-dev/witboost-starter-kit
agile-lab-dev/witboost-mwaa-specific-provisioner
agile-lab-dev/witboost-mwaa-workload-template
agile-lab-dev/witboost-python-scaffold