AbsaOSS/cobrix

Simplify processing ASCII text files that have line ending character

yruslan opened this issue · 0 comments

Background

Currently, all parameters must be specified in this code snippet:

    val parsedCopybook = CopybookParser.parseTree(ASCII(), copybook, dropGroupFillers = false, segmentRedefines = Seq(), stringTrimmingPolicy = StringTrimmingPolicy.TrimNone, ebcdicCodePage = CodePage.getCodePageByName("common"), nonTerminals = Seq())
    val cobolSchema = new CobolSchema(parsedCopybook, SchemaRetentionPolicy.CollapseRoot, false)
    val sparkSchema = cobolSchema.getSparkSchema

Feature

  • Simplify loading ASCII files by creating a method that has default options for all parameters.
  • Add direct support for such kind of files.
  • Update the documentation.