Need a method for writing and reading Pint-Pandas dataframes
MichaelTiemannOSC opened this issue · 3 comments
The new pint-demo notebook illustrates the fact that we don't yet have a defined way to write (let alone read) Pint-Pandas dataframes. There are several directions we can go, which we have discussed. We should use this test case to make a decision, document it, and publish it.
https://github.com/os-climate/data-platform-demo/blob/master/notebooks/pint-demo.ipynb
Cross-referenced with: hgrecco/pint-pandas#123
Updated the above notebook to provide complete round-tripping. Should provide an easy way to "borrow" functions into osc-ingest-tools.
Potential candidate here: https://github.com/os-climate/PCAF-sovereign-footprint/blob/develop_mutlu-dbt/notebooks/pcaf_env.py
Especially the functions requantify_df and dequantify_df. So maybe we should migrate this functionality (that is duplicated across multiple ingestion pipeline repos) into osc-ingest-tools.