/SerialFormats

Apache License 2.0Apache-2.0

Exploring data and serialization protocols

Using python 3.11.9

Avro: AvroExample.py, schema.avsc, and test.avro (generated from copilot) grpc: helloworld, route_guide from https://grpc.io/docs/what-is-grpc/introduction/ parquet: https://towardsdatascience.com/easy-parquet-tutorial-best-practices-237955e46cb7 Delta: - https://formulae.brew.sh/formula/apache-spark - https://docs.delta.io/latest/quick-start.html - https://medium.com/@ansabiqbal/delta-lake-introduction-with-examples-using-pyspark-cb2a0d7a549d Iceberg: - https://iceberg.apache.org/spark-quickstart/ AWS - https://py.iceberg.apache.org/ - https://tabular.medium.com/reading-apache-iceberg-from-python-with-pyiceberg-8b8cff36f4f0 - https://www.dremio.com/blog/intro-to-dremio-nessie-and-apache-iceberg-on-your-laptop/