timgent/data-flare

Issues

• Any plans for support spark 3.0 ?

  #144 opened 3 years ago by luancaarvalho
  5

• data-flare-api endpoints for pushing qc results and getting latest qc results

  #127 opened 4 years ago by timgent
  0

• Setup CI for data-flare-UI

  #126 opened 4 years ago by timgent
  0

• Setup CI for data-flare-api

  #125 opened 4 years ago by timgent
  0

• Dockerize data-flare-ui

  #124 opened 4 years ago by timgent
  0

• Dockerize data-flare-api

  #123 opened 4 years ago by timgent
  0

• Add data-flare-api endpoint for viewing check results for a given qc run id

  #122 opened 4 years ago by timgent
  0

• Add data-flare-api endpoint for viewing qc runs for a given check suite description

  #121 opened 4 years ago by timgent
  0

• Add QcResultsRepository implementation for saving via the API

  #120 opened 4 years ago by timgent
  0

• Finish hooking up UI to API

  #119 opened 4 years ago by timgent
  0

• Add compliance Not Null check metric

  #116 opened 4 years ago by Yashnov09
  0

• Docs for datasets are equal methods

  #115 opened 4 years ago by timgent
  0

• Datasets are equal check to be configurable how many mismatched rows are returned

  #114 opened 4 years ago by timgent
  0

• Min/max value metrics and checks

  #112 opened 4 years ago by timgent
  0

• Check for comparing 2 tables are identical (will be less efficient than metrics based check)

  #97 opened 4 years ago by timgent
  2

• Helper for check to compare schemas

  #108 opened 4 years ago by timgent
  0

• Remove cats from the library

  #99 opened 4 years ago by timgent
  1

• Add column distinctness metric

  #90 opened 4 years ago by timgent
  2

• Compliance Metric should be 0 for empty dataset

  #101 opened 4 years ago by timgent
  1

• Introductory blog past

  #28 opened 4 years ago by timgent
  1

• Add runBlocking method for running checks suite without returning a future

  #88 opened 4 years ago by timgent
  0

• Make releasing automatically update library version number for docs

  #86 opened 4 years ago by timgent
  1

• Add check that checks list of distinct values match a given list of values

  #37 opened 4 years ago by timgent
  1

• Rename the project before publicising!!

  #87 opened 4 years ago by timgent
  0

• Cross builds for different spark versions

  #91 opened 4 years ago by timgent
  0

• If tracking metrics have errors when being calculated those are currently silent, and instead should be reported back to the user somehow

  #85 opened 4 years ago by timgent
  0

• Docs for Deequ based checks

  #58 opened 4 years ago by timgent
  1

• Build for Scala 2.12

  #27 opened 4 years ago by timgent
  2

• Sort out error handling when arbitrary checks can't be calculated (due to exception being thrown)

  #81 opened 4 years ago by timgent
  0

• Sort out error handling when metrics can't be calculated

  #24 opened 4 years ago by timgent
  0

• Helper for writing filters where filter is a string and is the same as the description

  #66 opened 4 years ago by timgent
  0

• Add ability to pretty print QC Results

  #40 opened 4 years ago by timgent
  0

• Add Comparator helper to check values within X percent of each other

  #65 opened 4 years ago by timgent
  0

• Code should not compile but does issue

  #69 opened 4 years ago by timgent
  0

• SumValues metric descriptor does not add onColumn info to SimpleMetricDescriptor

  #70 opened 4 years ago by timgent
  0

• DualMetricCheck description is hard to read

  #71 opened 4 years ago by timgent
  0

• API Naming

  #68 opened 4 years ago by timgent
  0

• Comparison of arbitrary number of metrics

  #67 opened 4 years ago by timgent
  0

• Setup CI for publishing a release

  #56 opened 5 years ago by timgent
  0

• Make it possible for someone to add custom metric checks

  #45 opened 5 years ago by timgent
  0

• Remove distinction between metric calculator and metric descriptor

  #23 opened 5 years ago by timgent
  0

• Use release plugin for releases

  #57 opened 4 years ago by timgent
  0

• Add proper documentation in README

  #48 opened 4 years ago by timgent
  1

• Add versioning for documentation to docusaurus

  #63 opened 4 years ago by timgent
  0

• Polish the QC results storage layer

  #26 opened 5 years ago by timgent
  0

• Polish the external API

  #25 opened 5 years ago by timgent
  1

• Can we replace all metric based checks with one generic implementation?

  #42 opened 5 years ago by timgent
  1

• A convincing example and demo

  #19 opened 5 years ago by timgent
  0

• Publish and link to javadocs

  #35 opened 5 years ago by timgent
  0

• Polish the Metrics storage layer

  #33 opened 5 years ago by timgent
  0