spotify/magnolify

Support schema annotations for magnolify-parquet

clairemcginty opened this issue · 1 comments

Annotations would be for both field-level and record-level.

Since Parquet schema Types don't natively support raw string annotations we'd have to decide on a standardized way to represent them in the file metadata header, too, maybe as key-value pairs like:

annotations:
   nested.field.path: "some annotation text..."
   top-level-field: "other annotation text..."

The change is implemented in #618