Use Parquet files in Ingest and Delta update
Closed this issue · 0 comments
soad003 commented
- evaluate replacing fs-cache (tron and eth) with parquet file access
- remove eth-csv code, make a command to extract portions of the parquet files as csv
- allow the ingest pipeline to read from the deltalake