AbsaOSS/cobrix

Record length option is ignored when generate record id is turued on

yruslan opened this issue · 0 comments

Describe the bug

A fixed length file with record size that does not match the copybook can be read using

.option("record_length", 100)

But when this options is combined with

.option("generate_record_id", true)

the record size option is seems to be ignored.

Code snippet that caused the issue

  spark.read
   .format("cobol")
   .option("record_length", 100)
   .option("generate_record_id", true)

Expected behavior

These options should work well in combination

Context

  • Cobrix version: 2.6.10
  • Spark version: 2.4.4
  • Scala version: 2.11

Copybook (if possible)

--

Attach a small data file that can help reproduce the issue, if possible.