piotr-kalanski/data-quality-monitoring

Issues

• Group level trend rules - percentage increase current vs last day per group

  #51 opened 7 years ago by piotr-kalanski
  0

• ColumnStatistics - Double.NaN for min,max

  #62 opened 7 years ago by piotr-kalanski
  0

• Log executed SQL statements

  #60 opened 7 years ago by piotr-kalanski
  0

• ColumnStatistics.percentageNotMissing for empty rows is NaN

  #58 opened 7 years ago by piotr-kalanski
  0

• Replace existing log result statistics after running logger twice

  #44 opened 7 years ago by piotr-kalanski
  0

• Insert to MySQL - only one statement

  #56 opened 7 years ago by piotr-kalanski
  0

• Logger - not logging empty records

  #54 opened 7 years ago by piotr-kalanski
  0

• Validating empty groups - expection

  #52 opened 7 years ago by piotr-kalanski
  0

• Validation rule - number of rows

  #16 opened 7 years ago by piotr-kalanski
  0

• Trend rules - percentage increase current vs last day

  #47 opened 7 years ago by piotr-kalanski
  0

• FileConfigurationLoader - with single table configuration

  #48 opened 7 years ago by piotr-kalanski
  0

• DatabaseConfigurationInstaller.installTableConfiguration not working

  #45 opened 7 years ago by piotr-kalanski
  0

• Configuration Loader - directory

  #26 opened 7 years ago by piotr-kalanski
  0

• Update validation rules in database if already exists

  #42 opened 7 years ago by piotr-kalanski
  0

• Validation Result Logger - composite

  #31 opened 7 years ago by piotr-kalanski
  0

• Basic documentation

  #40 opened 7 years ago by piotr-kalanski
  0

• Exception handling when reading configuration

  #27 opened 7 years ago by piotr-kalanski
  0

• Alert Sender - email

  #10 opened 7 years ago by piotr-kalanski
  0

• Configuration loader - dynamo db

  #5 opened 7 years ago by piotr-kalanski
  0

• Validation result logger - S3

  #8 opened 7 years ago by piotr-kalanski
  0

• Validation rule - data type

  #11 opened 7 years ago by piotr-kalanski
  0

• Table location - CSV file

  #22 opened 7 years ago by piotr-kalanski
  0

• Validation rule per group - missing rows

  #37 opened 7 years ago by piotr-kalanski
  3

• Add logging with Info about actions

  #39 opened 7 years ago by piotr-kalanski
  0

• Validation result - numbers of rows per group

  #33 opened 7 years ago by piotr-kalanski
  0

• Alert Sender - Slack

  #9 opened 7 years ago by piotr-kalanski
  1

• Support for processing date

  #30 opened 7 years ago by piotr-kalanski
  0

• Table location - Redshift

  #36 opened 7 years ago by piotr-kalanski
  0

• Redshift SQL data validator

  #35 opened 7 years ago by piotr-kalanski
  0

• Log information about column name in invalid record

  #34 opened 7 years ago by piotr-kalanski
  0

• Table location - Hive

  #18 opened 7 years ago by piotr-kalanski
  0

• Validation rule - regex

  #12 opened 7 years ago by piotr-kalanski
  0

• Configuration loader - DB

  #3 opened 7 years ago by piotr-kalanski
  0

• Log information about table in invalid records

  #21 opened 7 years ago by piotr-kalanski
  0

• ValidationResult - number of rows

  #19 opened 7 years ago by piotr-kalanski
  0

• ValidationResult - number of not missing rows for each column

  #20 opened 7 years ago by piotr-kalanski
  0

• Alert Sender - Composite

  #32 opened 7 years ago by piotr-kalanski
  0

• Validation rule - dictionary value

  #13 opened 7 years ago by piotr-kalanski
  0

• Data Validator not dependent on Spark

  #29 opened 7 years ago by piotr-kalanski
  0

• Create tables for validation result if not exists

  #28 opened 7 years ago by piotr-kalanski
  0

• Validation result logger - RDBMS

  #6 opened 7 years ago by piotr-kalanski
  0

• Table location - JDBC table

  #25 opened 7 years ago by piotr-kalanski
  0

• Table location - avro file

  #24 opened 7 years ago by piotr-kalanski
  0

• Table location - parquet file

  #23 opened 7 years ago by piotr-kalanski
  0

• Validation result logger - Elasticsearch

  #7 opened 7 years ago by piotr-kalanski
  0

• Validation rule - min, max

  #15 opened 7 years ago by piotr-kalanski
  0

• Configuration loader - file

  #4 opened 7 years ago by piotr-kalanski
  0

• Configuration loader - manual

  #2 opened 7 years ago by piotr-kalanski
  0

• Data Quality Monitor Runner

  #17 opened 7 years ago by piotr-kalanski
  0

• Validation rule - not null

  #14 opened 7 years ago by piotr-kalanski
  0