databricks/spark-avro

Is .avro extension necessary for reading avro files?

Opened this issue · 5 comments

My hdfs file has name 000000_0. It's showing an error

No avro files present at file ...

If I rename it like emp.avro it's working fine.

try creating your SparkSession with this setting:
avro.mapred.ignore.inputs.without.extension=false

Hi @koertkuipers,

I am using spark 1.6.2. It's not working for me. Is this fix related to Spark 2 only?

the hadoop configuration setting avro.mapred.ignore.inputs.without.extension also exists in the older versions of this library for spark 1.x

Hi @devender-yadav where are you setting the property? In the runtimeConfig of SparkSession?

Duplicates #203