Kotlin/kotlin-spark-api

Issues

• Spark 3.4+ / -Connect support

  #195 opened a year ago by Jolanrensen
  61

• Should we use this project current?

  #221 opened 2 months ago by sola1tmy
  1

• The future of this project

  #220 opened 3 months ago by evkaky
  5

• Unable to initialize spark in Jupyter Notebook

  #205 opened a year ago by mlcohen
  8

• No way to define data class with Decimal(38, 0) in Spark schema

  #181 opened 2 years ago by jkylling
  13

• Dynamically invoking withSpark in dockerized Ktor web app throws UnsupportedFileSystemException

  #219 opened 5 months ago by tyknkd
  3

• Rendering HTML tables in Jupyter notebooks seems broken

  #216 opened 9 months ago by Jolanrensen
  0

• Cannot create RDDs in notebooks

  #215 opened 10 months ago by Jolanrensen
  1

• Questions regarding RoaringBitmap processing fail

  #211 opened a year ago by Kimakjun
  0

• Question: Is there a way to speed up dependency resolution for jupyter integration?

  #207 opened a year ago by devongleeson
  5

• `kotlin.Any! is unsupported` error when trying to create a DataFrame

  #210 opened a year ago by barrettc
  1

• Publish POM-only artifacts for Jupyter purposes

  #208 opened a year ago by ileasile
  1

• spark-yarn dependency missing in Jupyter integration

  #196 opened a year ago by Jolanrensen
  0

• Jupyter integration not compatible with Java 8

  #199 opened a year ago by zenwan
  2

• Could not parse Master URL: 'yarn'

  #197 opened a year ago by zenwan
  1

• Question About Mapping

  #185 opened 2 years ago by bkenn
  2

• Questions regarding scala.ScalaReflectionException

  #194 opened 2 years ago by RuizhuYang
  4

• for JVM target 1.8

  #190 opened 2 years ago by emesday
  3

• Spark runs on Java 8/11/17, Scala 2.12/2.13, Python 3.7+ and R 3.5+. the library only support Java 11

  #186 opened 2 years ago by etika-garry
  8

• Questions regarding `java.lang.NoSuchMethodError`

  #184 opened 2 years ago by hawkaa
  4

• Java 8 support

  #183 opened 2 years ago by hawkaa
  3

• Explore crossbuild gradle plugin

  #179 opened 2 years ago by Jolanrensen
  4

• Encoding for Scala Option and Optional

  #150 opened 2 years ago by Jolanrensen
  0

• Improve maintainability with Spark: Explore UDTs for data class encoding

  #178 opened 2 years ago by Jolanrensen
  0

• JavaRDD Key/Value functions

  #151 opened 2 years ago by Jolanrensen
  2

• Jupyter 1.2.0

  #176 opened 2 years ago by Jolanrensen
  1

• JavaCoverters for Scala data types can be replaced with CollectionConverters

  #148 opened 2 years ago by pihanya
  4

• Seq creation function

  #163 opened 2 years ago by Jolanrensen
  5

• isSomething cannot be encoded in data class

  #170 opened 2 years ago by Jolanrensen
  0

• Data class serialization fails with `v1.0.3` and Spark `3.2.0`

  #141 opened 2 years ago by devictr
  9

• support Spark 3.2.0 and other patch-versions

  #166 opened 2 years ago by Jolanrensen
  2

• Spark 3.3 support

  #167 opened 2 years ago by Jolanrensen
  0

• Extension function forEachBatch can be added for DataStreamWriter

  #149 opened 2 years ago by pihanya
  9

• Could not find org.jetbrains.kotlinx.spark:kotlin-spark-api

  #169 opened 2 years ago by vagdevik
  3

• Documentation on how to use UDFs

  #142 opened 2 years ago by vegarsti
  4

• Test MLib

  #161 opened 2 years ago by Jolanrensen
  1

• Define udf using by-delegate?

  #143 opened 2 years ago by Jolanrensen
  3

• Cannot read file from Jupyter in Datalore

  #164 opened 2 years ago by Jolanrensen
  1

• Tuple copy method with changing types

  #156 opened 2 years ago by Jolanrensen
  3

• Spark Streaming

  #122 opened 2 years ago by Jolanrensen
  0

• spark mllib ALS.Rating get ClassCastException error

  #146 opened 2 years ago by Icyrockton
  2

• SparkSession ClassNotFoundException gradle kts

  #145 opened 2 years ago by Icyrockton
  1

• Release 1.0.3 on Maven Central

  #139 opened 2 years ago by devictr
  4

• Reorganize API

  #123 opened 2 years ago by Jolanrensen
  1

• Add easy conversion with TupleX and ArityX

  #135 opened 2 years ago by Jolanrensen
  1

• Add Spark 3.2 encoders

  #131 opened 2 years ago by Jolanrensen
  0

• Default value SparkHelper overrides config for spark.master

  #120 opened 3 years ago by christopherfrieler
  4

• Questions about project roadmap and adoption

  #121 opened 3 years ago by devictr
  2

• For the future: Remove KSparkSession using new context()

  #125 opened 3 years ago by Jolanrensen
  1

• Spark 3.2.x support

  #115 opened 3 years ago by hawkaa
  3