holdenk/spark-testing-base

Issues

• Replace deprecated SQLContext with SparkSession for DataFrame / DataSet / RDD generators

  #418 opened 5 months ago by AndyLeGrand
  0

• Codec [lz4] is not available. Consider setting spark.io.compression.codec=snappy

  #413 opened 9 months ago by surajnakka
  0

• assertDataFrameApproximateEquals params show when failing

  #404 opened 9 months ago by eruizalo
  5

• What is the reason this project uses inheritance rather than implementing Junit's Rule?

  #400 opened a year ago by BenjaminMalley
  0

• Need Junit 5 Support

  #340 opened 3 years ago by akhilasankar
  4

• Hive support is required to CREATE Hive TABLE (AS SELECT);;

  #292 opened 6 years ago by minnieshi
  14

• Support JDK17

  #358 opened 2 years ago by holdenk
  3

• saveAsTable function doesn't create a table after updating to the spark 3.1.1

  #349 opened 3 years ago by kimtox
  1

• New python release

  #314 opened 5 years ago by h-vetinari
  7

• Add cross support for Scala 2.13

  #347 opened 2 years ago by Wosin
  5

• 'java.io.FileNotFoundException: HADOOP_HOME and hadoop.home.dir are unset'

  #345 opened 2 years ago by shikhil-gupta
  2

• Remove Spark pre-1.6 support from the build

  #294 opened 2 years ago by holdenk
  0

• Executors tab in Spark UI not working

  #301 opened 2 years ago by miramar-labs
  2

• spark 2.4.0 cdh6.3.3 dependancies not compatible with spark-testing-base_2.11 2.4.0_0.14.0

  #335 opened 2 years ago by dileepbarla
  1

• Publish Spark 3 Version?

  #329 opened 2 years ago by etspaceman
  2

• Publish Spark 2.4.6 and Spark 2.4.7 versions of spark-testing-base

  #337 opened 2 years ago by nsutcliffe
  2

• scala version

  #338 opened 2 years ago by tufanrakshit
  1

• Tests always fail if I have more than one test file extends `StreamingSuiteBase`

  #341 opened 3 years ago by imtiny
  1

• Error when using SharedSparkContext

  #343 opened 2 years ago by GuoJing
  1

• netty: java.lang.NoSuchMethodError:'void io.netty.buffer.PooledByteBufAllocator.<init>(boolean, int, int, int, int, int, int, boolean)'

  #353 opened 2 years ago by arumallap7
  1

• Log4J dependency issue

  #351 opened 2 years ago by Aditya-Amgaonkar
  1

• Support for Spark 3.2.2 (Due to CVE-2022-33891)

  #356 opened 2 years ago by lucleite
  0

• Use HiveSupport in SparkSession and Azure storages

  #299 opened 2 years ago by LvffY
  2

• Unable to run tests with Spark v3.2.1 and scalatest v3.2.x

  #354 opened 2 years ago by mdadil-dk
  0

• Sbt dependency download issues

  #352 opened 3 years ago by minnieshi
  5

• Add module supporting munit

  #350 opened 3 years ago by Daenyth
  0

• ZIO-test support ?

  #348 opened 3 years ago by leobenkel
  0

• NoSuchMethodError: org.scalatest.Assertions.assertionsHelper

  #315 opened 5 years ago by remisharoon
  4

• Building Spark session fails with Hadoop 3 because of Hive Shims

  #321 opened 5 years ago by mikitakandratsiuk
  2

• Expected instance not static method org.scalatest.Assertions in DataFrame and DataSet SuitBase

  #342 opened 3 years ago by timshen24
  1

• `assertDataFrameNoOrderEquals` fails to catch some inequalities

  #318 opened 3 years ago by IvanVergiliev
  2

• Setting dedicated warehouse and metastore temp-directory doens't work

  #339 opened 4 years ago by qnob
  0

• Reduce log in unit test

  #333 opened 4 years ago by kination
  0

• SparkSession with DeltaLake related settings

  #324 opened 4 years ago by ashikaumanga
  1

• Incompatibility with Spark 3.0.1

  #328 opened 4 years ago by gnsantos
  0

• Can't publish a local version

  #331 opened 4 years ago by wrwills
  1

• Upgrade to Spark 3.0.0

  #323 opened 4 years ago by mahmoudmahdi24
  0

• Cannot get sources to become available in VSCode

  #316 opened 4 years ago by robbyki
  2

• Hortonworks Hive Warehouse Connector & Hadoop 3

  #317 opened 5 years ago by geoHeil
  2

• Add support for Spark Streaming Kafka 0.10

  #313 opened 5 years ago by holdenk
  2

• Spark Streaming Kafka 0-8_2.12;2.4.0: not found

  #306 opened 5 years ago by amoralca16
  2

• Spark 2.4.4 maven repo release

  #310 opened 5 years ago by claudiaii
  0

• Custom ArrayType Fields

  #309 opened 5 years ago by michaelknopf
  0

• A lot of exceptions during cleanup

  #307 opened 5 years ago by Salatich
  0

• Add new conf to SparkSession

  #304 opened 5 years ago by girish-kamble
  0

• Returning nulls for nullable types

  #302 opened 5 years ago by nightscape
  1

• Hide INFO log "FileOutputCommitter"

  #298 opened 5 years ago by leobenkel
  1

• Option to turn Spark UI back on ?

  #297 opened 5 years ago by leobenkel
  1

• NullPointerException while assertDataFrameEquals

  #295 opened 5 years ago by belgacea
  1

• py SparkTestingBase: incorrect code to instantiate SparkSession

  #289 opened 6 years ago by mmistroni
  0