Metadata copying method does not retain existing metadata

[yruslan]

Describe the bug

This method should not replace the metadata, but merge metadata from 2 schemas:

val schemaMerged = SparkUtils.copyMetadata(schemaFrom, schemaTo)

Code snippet that caused the issue

--

Expected behavior

Metadata copying method should retain existing metadata.

Context

--

Copybook (if possible)

--

[saikumare-a]

is it possible to use this method using pyspark?. if yes, could you please share a sample example

[yruslan]

Yes, see the PySpark example: https://github.com/AbsaOSS/cobrix/tree/v2.7.4?tab=readme-ov-file#flattening-schema-with-groups-and-occurs

[saikumare-a]

Thank you . This helps