The original data we have is in json format, I want to convert this format into two specific formats, csv and parquet.
- https://stackoverflow.com/questions/1347791/unicode-error-unicodeescape-codec-cant-decode-bytes-cannot-open-text-file
- https://stackoverflow.com/questions/28171696/python-json-to-csv-bad-encoding-unicodedecodeerror-charmap-codec-cant-dec
- https://stackoverflow.com/questions/17530542/how-to-add-pandas-data-to-an-existing-csv-file
- https://stackoverflow.com/questions/47113813/using-pyarrow-how-do-you-append-to-parquet-file
- https://sparkbyexamples.com/pandas/pandas-drop-first-column-from-dataframe/#:~:text=Drop%20First%20Column%20of%20DataFrame%20Using%20pop()&text=pop()%20function%20to%20drop,the%20first%20column%20of%20DataFrame.
- https://stackoverflow.com/questions/15891038/change-column-type-in-pandas
- https://stackoverflow.com/questions/3207219/how-do-i-list-all-files-of-a-directory