AbsaOSS/pramen

Allow case-insensitive patterns in RawFileSource

Closed this issue · 0 comments

Background

This is to simplify patterns like:

input.path="s3://bigdata/landing/FILE_{{yyyy-MM-dd}}.{DAT,dat}"

Feature

Allow case-insensitive patterns in RawFileSource

Proposed Solution

Add case-sensitivity flag to FsUtils.getHadoopFiles()