dotnet/spark

Issues

• Experiment

  #1176 opened 4 days ago by Adlinke
  0

• Can we breathe life back into this project?

  #1162 opened 9 months ago by GoEddie
  23

• [BUG]:

  #1164 opened 5 months ago by johnstaveley
  11

• [FEATURE REQUEST]: Replacement for BinaryFormatter

  #1167 opened a month ago by GeorgeS2019
  1

• [FEATURE REQUEST]: Deprecate and/or evict Microsoft.Data.Analysis from the Microsoft.Spark assembly

  #1171 opened 2 months ago by dbeavon
  1

• [FEATURE REQUEST]: Spark version 3.1.3 is not supported by current dotnet on spark code. This is preventing Migration to HDI 5.0 which uses spark version 3.1.3

  #1161 opened 9 months ago by aadithya0701
  1

• [BUG]:

  #1148 opened a year ago by varanasitarun
  1

• [FEATURE REQUEST]: .Net 8.0 support

  #1170 opened 2 months ago by dbeavon
  0

• [FEATURE REQUEST]: Stop targeting .net standard (both 2.0 and 2.1)

  #1169 opened 2 months ago by dbeavon
  0

• [FEATURE REQUEST]: .Net 6.0/7.0 Support

  #1149 opened a year ago by Vislesha
  24

• JVM IPC Deserialization uses BinaryFormatter, which is now Deprecated for OWASP CWE

  #1131 opened 2 months ago by cutecycle
  3

• .NET for Apache Spark v2.1.2 in .NET7 ?

  #1139 opened a year ago by GeorgeS2019
  20

• I am facing the following issue: The system cannot find the path specified but my pyspark opens up.

  #1165 opened 3 months ago by saumyatiwari03
  4

• support Apache Spark 3.4

  #1158 opened 9 months ago by Ponyo1234
  4

• [FEATURE REQUEST]: Status of Project

  #1151 opened a year ago by mmihalikcs
  1

• [BUG]: Failed to execute 'collectToPython' on 'org.apache.spark.sql.Dataset' with args=()

  #1159 opened 9 months ago by Ling-Andrew
  0

• Question: How to use DataFrame API to achieve the function equivalent to map/reduce in spark.net

  #1156 opened 10 months ago by JunweiSUN
  0

• [BUG]: When collected, long values are cast to int

  #1155 opened 10 months ago by aesteve
  0

• Support for spark v3.3.1

  #1123 opened 2 years ago by natilivni
  3

• [BUG]: Running a job with ForeachBatch under Databricks causes the Job to never stop

  #1114 opened 2 years ago by muhammad-s-zainal
  2

• [FEATURE REQUEST]: Benchmark Spark.NET versus PySpark and SparkR

  #1147 opened a year ago by GeorgeS2019
  0

• Issue with TokenLibrary on Synapse - can't authenticate to a normal oauth2 scope

  #1098 opened a year ago by dbeavon
  3

• [BUG]: Hive incompatibility when using microsoft-spark-3-1_2.12-2.1.1.jar

  #1146 opened a year ago by dcosta91
  1

• Want to authenticate in synapse spark pool using managed identity.

  #1099 opened 2 years ago by dbeavon
  1

• Support for NotebookUtils

  #1145 opened a year ago by mzivtins
  0

• Error Trying to load json file from spark with delta enabled

  #1107 opened a year ago by relcodedev
  1

• Can't a .netcore program connect to a remote spark cluster? If so, what should I do? please help me

  #1142 opened a year ago by Ponyo1234
  0

• If you are a webapi project, you also need to use spark-submit? Is there a webapi example to refer to

  #1141 opened a year ago by Ponyo1234
  0

• 如果是web api项目也需要用spark-submit嘛

  #1140 opened a year ago by Ponyo1234
  0

• [FEATURE REQUEST]: Support for Spark 3.3.0 using autogen language bindings similar to SynapseML

  #1100 opened 2 years ago by rrekapalli
  5

• What is the future of this project?

  #1097 opened 2 years ago by selvavm
  9

• Error from many DataFrame methods after UDF called in DataFrame.WithColumn

  #1137 opened a year ago by dogulas-accip
  1

• Question: can I use the spark extension to read a delta table?

  #1136 opened a year ago by funkysandman
  2

• Q: How to handle exceptions?

  #1134 opened a year ago by Krumelur
  0

• Q: How to output to logs?

  #1135 opened a year ago by Krumelur
  0

• Couchbase spark example in dotnet

  #1128 opened a year ago by sandiprkumbhar
  0

• [FEATURE REQUEST]: Any idea to call .net UDF in scala spark? Also need some generic parameters

  #1126 opened a year ago by hh23485
  0

• spark-submit' is not recognized as an internal or external command

  #1124 opened 2 years ago by ssrieddy
  0

• [BUG]: Not able to run VectorUDF from Synapse notebook

  #1120 opened 2 years ago by selvavm
  0

• Can I write data to a Stream in ORC format with this library?

  #1117 opened 2 years ago by wertzui
  0

• Easy path to support stream receivers like RabbitMQ

  #1116 opened 2 years ago by mfidemraizer
  0

• spark-submit --version error

  #1113 opened 2 years ago by fzf003
  0

• Getting [Exception] [JvmBridge] Connection refused 127.0.0.1:5567 when running example project

  #1110 opened 2 years ago by anybodysguest
  0

• Question: Is it possible to write custom application logs?

  #1109 opened 2 years ago by lucashby
  0

• Spark installation instructions are tricky / DOTNETBACKEND_PORT environment variable is not set ??

  #1106 opened 2 years ago by Devtr0n
  1

• Issues while setting up Spark.Net locally

  #1105 opened 2 years ago by loneshark99
  0

• spark application without output and threw illegal reflective access exception

  #1104 opened 2 years ago by YuanchengTu
  0

• install spark issue

  #1103 opened 2 years ago by YuanchengTu
  0

• Running code on Java > 8

  #1102 opened 2 years ago by sijonelis
  0

• [BUG]: Spark session does not update number of files for partition

  #1101 opened 2 years ago by FFCMSouza
  0