databricks/spark-avro

Issues

• How to parse Avro messages while read a stream of messages from Kakfa in Spark 2.2.0?

  #260 opened 7 years ago by kant111
  21

• Spark 2.3 support

  #294 opened 6 years ago by functicons
  3

• Consume Avro stream from Kafka topic

  #232 opened 7 years ago by ananth3010
  3

• spark-structured-streaming with Avro kafka messages

  #236 opened 7 years ago by amoussoubaruch
  2

• read decimal logicalType

  #248 opened 7 years ago by eliviu
  2

• spark 2.1.0 : NullpointerException Issue in java while reading avro file as dataframe with kryo enabled as serializer

  #289 opened 6 years ago by erparas
  2

• spark-avro merged into spark 2.4

  #296 opened 6 years ago by fxbonnet
  0

• Avro schemas with a self-reference yield StackOverflowError

  #295 opened 6 years ago by quadrokeith
  0

• can't add avro_2.11:4.0.0 in spark-shell

  #264 opened 7 years ago by seekmayank
  3

• Custom read schema support for Spark 1.6

  #293 opened 6 years ago by nshah99
  0

• Is .avro extension necessary for reading avro files?

  #228 opened 7 years ago by devender-yadav
  5

• Read/write timestamps

  #229 opened 7 years ago by leotac
  6

• 'Unknown datum type' exception generated by ArrayType elements

  #285 opened 6 years ago by florin1288
  1

• Is it really necessary to support Java 7?

  #292 opened 6 years ago by ivanobulo
  0

• Big performance issue when moving from 2.0.1 to 4.0.0 when loading column of type ArrayType

  #267 opened 7 years ago by arthurdk
  4

• Spark1.6 with databricks 2.0.1 : Exception in thread "main" java.lang.UnsupportedOperationException: This mix of union types is not supported (see README): ArrayBuffer(RECORD) at

  #290 opened 6 years ago by sagarsvp
  0

• Namespace name is set when undefined

  #255 opened 7 years ago by jung-kim
  8

• why all fields are nullable

  #288 opened 6 years ago by yuryn
  1

• Upgrade to Spark 2.3.0

  #282 opened 6 years ago by xmj
  2

• Support for more compression algorithms in addition to snappy and deflate

  #287 opened 6 years ago by BensonQiu
  0

• using the SchemaConverters.convertStructToAvro

  #277 opened 6 years ago by divo77
  1

• Request to add supported options list in README

  #284 opened 6 years ago by shsachin
  0

• Read bytes and fixed avro types with decimal logicalType as DecimalType

  #268 opened 7 years ago by peter-ungvari
  2

• Py4JJavaError: An error occurred while calling o37.save.

  #281 opened 6 years ago by surajkb74
  0

• Spark 2.2 + spark-avro_2.11-4.0.0.jar is very slow for certain job comparing Spark 1.6.3 + spark-avro_2.10-2.0.1.jar

  #280 opened 6 years ago by java8964
  2

• Provider org.apache.spark.sql.hive.orc.DefaultSource could not be instantiated

  #278 opened 6 years ago by sunny1978
  3

• Row to AVRO for Streaming Usecase

  #274 opened 7 years ago by sunny1978
  2

• Save Compressed avro to Hdfs using PySpark

  #224 opened 7 years ago by YonoloX
  3

• Add support to convert to Avro IndexedRecord

  #275 opened 7 years ago by mquraishi
  0

• Fails to write record containing map of array of record

  #272 opened 7 years ago by laymain
  3

• spark-avro ignores the compression option in DataFrameWriter

  #259 opened 7 years ago by juarezr
  0

• write as bytes decimal logical type

  #246 opened 7 years ago by eliviu
  3

• Support for Spark ML Vector types

  #266 opened 7 years ago by tovbinm
  0

• Support nested directory structure?

  #225 opened 7 years ago by qiaojialin
  3

• Getting schema name from Avro file

  #265 opened 7 years ago by dmateusp
  0

• How to convert Avro Schema Object to StructType?

  #261 opened 7 years ago by kant111
  2

• How to convert RDD[GenericRecord] to dataframe in scala ?

  #254 opened 7 years ago by slim-azaiz
  0

• spark-avro 3.2.0 doesn't work with spark 2.2.0 (abstract OutputWriter.write)

  #240 opened 7 years ago by gnmerritt
  33

• Error converting MapType to avro

  #247 opened 7 years ago by davecromberge
  0

• java.lang.NoSuchMethodError: org.apache.spark.sql.DataFrameReader.load

  #241 opened 7 years ago by Leela1229
  1

• Specifying avro schema in Dataframe writer

  #243 opened 7 years ago by ernvalentino88
  9

• spark-avro 3.2.0 doesn't work on HDP-2.6.1.0

  #245 opened 7 years ago by dpimenov
  0

• Read partitioned data - Random number of records

  #244 opened 7 years ago
  0

• NPE in outputWriterFactory.newInstance

  #237 opened 7 years ago by qiaojialin
  2

• User defined type or enums support

  #235 opened 7 years ago by Ravil-Safin
  1

• Convert avro file to structureType

  #238 opened 7 years ago by amoussoubaruch
  0

• NullPointerException in Initializing HDFSInputStream

  #234 opened 7 years ago by qiaojialin
  2

• spark.read.myfile() not allowed in spark-shell

  #233 opened 7 years ago by qiaojialin
  2

• Handling NULL datatype

  #230 opened 7 years ago by wabu
  0

• Partition according to the block size of HDFS

  #226 opened 7 years ago by phonchi
  1