Is .avro extension necessary for reading avro files?
Opened this issue · 5 comments
devender-yadav commented
My hdfs file has name 000000_0. It's showing an error
No avro files present at file ...
If I rename it like emp.avro
it's working fine.
koertkuipers commented
try creating your SparkSession with this setting:
avro.mapred.ignore.inputs.without.extension=false
devender-yadav commented
Hi @koertkuipers,
I am using spark 1.6.2. It's not working for me. Is this fix related to Spark 2 only?
koertkuipers commented
the hadoop configuration setting avro.mapred.ignore.inputs.without.extension also exists in the older versions of this library for spark 1.x
praneetsharma commented
Hi @devender-yadav where are you setting the property? In the runtimeConfig of SparkSession?
OneCricketeer commented
Duplicates #203