Record length option is ignored when generate record id is turued on
yruslan opened this issue · 0 comments
yruslan commented
Describe the bug
A fixed length file with record size that does not match the copybook can be read using
.option("record_length", 100)
But when this options is combined with
.option("generate_record_id", true)
the record size option is seems to be ignored.
Code snippet that caused the issue
spark.read
.format("cobol")
.option("record_length", 100)
.option("generate_record_id", true)
Expected behavior
These options should work well in combination
Context
- Cobrix version: 2.6.10
- Spark version: 2.4.4
- Scala version: 2.11
Copybook (if possible)
--
Attach a small data file that can help reproduce the issue, if possible.