capitalone/datacompy

Issues

• consolidate the common functions between pandas and spark

  #197 opened 2 months ago by fdosani
  2

• Please add Snowpark support

  #290 opened 2 months ago by achrusciel
  3

• Drop support for Python 3.9 by the EoY.

  #342 opened 2 months ago by fdosani
  0

• Fixes for numpy 2.0 support

  #323 opened 2 months ago by fdosani
  5

• Add column names to column summary

  #334 opened 2 months ago by MariusMerkleQC
  3

• Comparison of two pandas "period"-Columns is always False/not working

  #336 opened 2 months ago by Salfiii
  3

• pandas df with datetime.date cols returns false differences if ignore_case=True

  #327 opened 3 months ago by sundeep-longledge
  6

• switch to ruff for linting and all the things.

  #289 opened 4 months ago by fdosani
  0

• Comparison fails on dataframes with a single column

  #253 opened a year ago by rupertbarton
  9

• Polars v1 support

  #324 opened 5 months ago by fdosani
  0

• Spark Comparison fails to detect similarities in unordered data

  #314 opened 5 months ago by shreya-goddu
  3

• SparkSQLCompare only checks for instance "pyspark.sql.DataFrame", but not for instance "pyspark.sql.connect.dataframe.DataFrame"

  #320 opened 5 months ago by achrusciel
  7

• SparkSQLCompare only works when grpcio and protobuf are installed manually outside of datacompy

  #319 opened 6 months ago by shreya-goddu
  4

• Benchmark Documentation between pandas, fugue, and native spark.

  #254 opened 6 months ago by fdosani
  1

• It seems `SparkCompare` object has no attribute 'sample_mismatch` ?

  #283 opened 6 months ago by pangjac
  2

• SparkCompare fails on Databricks DBR Spark clusters with Unity Catalog enabled

  #312 opened 6 months ago by lingeshr-db
  2

• datacompy v0.12 spark sample with 5 rows only takes more than a minute to execute on databricks

  #300 opened 7 months ago by satniks
  10

• Are there plans to support Python 3.12.1?

  #262 opened 7 months ago by RicardoEscobar
  14

• v0.12.0 doesn't appear to have LegacySparkCompare

  #302 opened 7 months ago by isaacmartin1
  1

• Datatype standardization before comparing for dataframes from DASK or Pyspark

  #273 opened 8 months ago by xs005
  3

• Fugue support for extra helper functions from core

  #214 opened 2 years ago by fdosani
  2

• `Compare` method is modifying input dataframes

  #292 opened 8 months ago by william-chu-github
  2

• [Discussion] Deprecate the native Spark implementation in favour of Fugue or Pandas on Spark

  #274 opened 9 months ago by fdosani
  1

• Just going to add a note here for future, currently seeing a small difference in pandas vs spark report sample rows when there are rows only in one dataframe.

  #288 opened 9 months ago by fdosani
  0

• SparkCompare [PARSE_SYNTAX_ERROR] if a non-join column name contains unicode symbols

  #284 opened 9 months ago by kformanowicz-dotdata
  1

• SparkCompare [PARSE_SYNTAX_ERROR] if column name contains unicode symbols

  #280 opened 9 months ago by kformanowicz-dotdata
  2

• `report` throws an exception when all columns match but no rows match

  #276 opened 9 months ago by SimonBFrank
  0

• Add list of dissimilar columns to report

  #235 opened 10 months ago by janinebp
  8

• Adding column naming differences to the column summary page

  #222 opened 10 months ago by lva290
  4

• Abstract base class for native Compare functionality

  #260 opened 10 months ago by fdosani
  3

• Python 3.11 support

  #227 opened 10 months ago by fdosani
  12

• edgetest is broken and needs some investigating.

  #267 opened 10 months ago by fdosani
  0

• Issue in writing report

  #256 opened 10 months ago by rangav07
  9

• Snowflake and SQL support via Fugue

  #264 opened a year ago by fdosani
  0

• Look into porting Compare to a polars backend for performance testing.

  #257 opened a year ago by fdosani
  2

• who can help make the result significantly

  #255 opened a year ago by swloveydp
  2

• Add new action for running tests when PySpark is NOT installed

  #250 opened a year ago by fdosani
  1

• Add mypy to the project

  #247 opened a year ago by aguiddir
  4

• confused about df_unq_rows

  #243 opened a year ago by swloveydp
  2

• Restrictive dependency versions - NumPy 1.24.4 blocked

  #237 opened a year ago by jason-vitaler
  6

• No objects to concatenate issue with Fugue

  #218 opened a year ago by fdosani
  3

• The intersection logic of Compare has problems.

  #221 opened a year ago by goodwanghan
  3

• Datacompare for Date field is not working

  #230 opened a year ago by RRajavel
  4

• SparkCompare() not working for dask - dropDuplicates

  #233 opened a year ago by hb0313
  1

• Feature Request: Ability to Update Compare Object Over Multiple Chunks

  #228 opened a year ago by SuleymanKaya
  4

• Speed up spark unit tests

  #223 opened a year ago by krishnanravi
  2

• Pandas 2.0 support

  #213 opened 2 years ago by fdosani
  0

• documentation about fugue functionality

  #203 opened 2 years ago by fdosani
  1

• modernize docs

  #204 opened 2 years ago by fdosani
  0

• Fugue Phase 2 functionality

  #206 opened 2 years ago by fdosani
  2