sparkutils/quality

Issues

• add generic tuple based metarule

  #44 opened a year ago by chris-twiner
  0

• expressionRunner - needs better serialization options

  #42 opened a year ago by chris-twiner
  2

• CalendarInteval can't be compared (another map thing)

  #43 opened a year ago by chris-twiner
  1

• 3.5 with delta - NakedLocalFileSystem$NakedLocalFileStatus cannot be cast to FileStatusWithMetadata

  #27 opened a year ago by chris-twiner
  1

• 3.5 doesn't work with barenaked anymore

  #39 opened a year ago by chris-twiner
  1

• add async filter optimisation for cast removal

  #41 opened a year ago by chris-twiner
  0

• add bloom and map lookups to validation

  #40 opened a year ago by chris-twiner
  0

• DBR Optimizer Rule ignored

  #29 opened a year ago by chris-twiner
  2

• dsl in functions package for lambda related functions

  #35 opened a year ago by chris-twiner
  1

• Remove 2.4.x support

  #21 opened a year ago by chris-twiner
  0

• update_field doesn't replace nested structs

  #36 opened a year ago by chris-twiner
  1

• make a functions package - import all functions there, make sure they exist for all expressions

  #34 opened a year ago by chris-twiner
  0

• update_field with resolveWith do not mix

  #38 opened a year ago by chris-twiner
  0

• deprecate 3.0

  #37 opened a year ago by chris-twiner
  0

• clean top level quality package items

  #33 opened a year ago by chris-twiner
  1

• dataset level aggregates

  #32 opened a year ago by chris-twiner
  1

• add argument length checks to function registration

  #31 opened a year ago by chris-twiner
  1

• simplify aggregate dq result checks for individual rules

  #28 opened a year ago by chris-twiner
  0

• 3.3.2 and 3.4.1 version bumps

  #30 opened a year ago by chris-twiner
  0

• Handle conversion issues - retain the previous comparison on extensions

  #19 opened a year ago by chris-twiner
  3

• extension / optimisations do not work with hive layer on Databricks

  #25 opened a year ago by chris-twiner
  3

• 0.0.3

  #26 opened a year ago by chris-twiner
  0

• simplified creation of maps and blooms via config

  #15 opened a year ago by chris-twiner
  2

• remove saferLongPair / rowid expression

  #24 opened a year ago by chris-twiner
  0

• make all traits forwarders

  #23 opened a year ago by chris-twiner
  0

• view loader for subqueries

  #18 opened a year ago by chris-twiner
  0

• coverage capture on 3.3 AND 3.4

  #17 opened a year ago by chris-twiner
  2

• use types in extensiontests

  #22 opened a year ago by chris-twiner
  0

• 3.5 starter support

  #20 opened a year ago by chris-twiner
  1

• build in support for 3.4 and dbr 12.2 and 13.x starter

  #5 opened a year ago by chris-twiner
  11

• Attempt to move away from winutil usage

  #16 opened a year ago by chris-twiner
  0

• Support for scalar / correlated subqueries in rules

  #13 opened a year ago by chris-twiner
  7

• pdf name incorrect and subtitle missing

  #2 opened a year ago by chris-twiner
  1

• Add documentation for the use of subquerys and their names

  #14 opened a year ago by chris-twiner
  0

• Support for asymmetric Filter's

  #9 opened a year ago by chris-twiner
  6

• Add hash functions for id's

  #11 opened 2 years ago by chris-twiner
  1

• use underscore spark function standard

  #12 opened a year ago by chris-twiner
  0

• Add hash functions for id's

  #10 opened 2 years ago by chris-twiner
  1

• create function to allow map comparison / set operations

  #4 opened 2 years ago by chris-twiner
  4

• allow easier syntax in the folder output expressions

  #8 opened 2 years ago by chris-twiner
  1

• simpler as_uuid function

  #6 opened 2 years ago by chris-twiner
  0

• SparkPlugin - create a spark plugin to auto-register sql functions

  #7 opened 2 years ago by chris-twiner
  2

• row id bit layout mermaid broken

  #3 opened 2 years ago by chris-twiner
  0

• initial version

  #1 opened 2 years ago by chris-twiner
  0