NICTA/scoobi

As S3 is not the default file system on Amazon EMR

ondrejivanic opened this issue · 0 comments

This code throws the exception below (0.8.0-cdh3-SNAPSHOT):

  • if (Helper.deletePath(new Path(path))(configuration)) {
This file system object (hdfs://10.248.22.247:9000) does not support access to the request path 's3://bucket/table/year=0/month=0/day=0'
 You possibly called FileSystem.get(conf) when you should have called FileSystem.get(uri, conf)
 to obtain a file system supporting your path.
    at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:384)
    at org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:129)
    at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:513)
    at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:770)
        ...

See #185, #239, #199