Data quality is used to ensure the accuracy of data in the process of integration and processing. It is also the core component of DataOps. DataVines is an easy-to-use data quality service platform that supports multiple metric.
Need: Maven 3.6.1 and later
$ mvn clean package -Prelease -DskipTests-
Easy to use
-
Built in multiple Metric、ExpectedType、ResultFormula
-
Modular and plug-in mechanism, easy to extend
-
Support Spark 2.x、JDBC Engine
- java runtime environment: jdk8
- If the data volume is small, or the goal is merely for functional verification, you can use JDBC engine
- If you want to run DataVines based on Spark, you need to ensure that your server has spark installed
For guides on how to contribute, visit: Contribution Guidelines
DataVines is licensed under the Apache License 2.0. DataVines relies on some third-party components, and their open source protocols are also Apache License 2.0 or compatible with Apache License 2.0. In addition, DataVines also directly references or modifies some codes in Apache DolphinScheduler, SeaTunnel and Dubbo, all of which are Apache License 2.0. Thanks for contributions to these projects.