IBMStreams/streamsx.hdfs

Bluemix branch: WebHdfsDirectoryScan limitations

Closed this issue · 1 comments

hildrum commented
  • WebHdfsDirectoryScan won't handle filenames containing quotes or commas correctly.
  • It stores all the files that have ever appeared in the directory in a map. For extremely long running applications where lots of files arrive in the input directory, this could make the map too large. However, I think this situation is rare.
natashadsilva commented

Closing because the curl based bluemix toolkit is obsolete.