zach-blumenfeld/demo-lp-for-entity-resolution

Minor error running prepare-data script

Closed this issue · 2 comments

When running the prepare-data script without explicitly creating a ./data/clean I get the following error:

Traceback (most recent call last):
  File "prepare-data.py", line 77, in <module>
    clean_facts_df.to_csv('./data/clean/clean_facts_checkpoint_df.csv', index=False)
  File "/home/adam/.local/lib/python3.8/site-packages/pandas/core/generic.py", line 3466, in to_csv
    return DataFrameRenderer(formatter).to_csv(
  File "/home/adam/.local/lib/python3.8/site-packages/pandas/io/formats/format.py", line 1105, in to_csv
    csv_formatter.save()
  File "/home/adam/.local/lib/python3.8/site-packages/pandas/io/formats/csvs.py", line 237, in save
    with get_handle(
  File "/home/adam/.local/lib/python3.8/site-packages/pandas/io/common.py", line 702, in get_handle
    handle = open(
FileNotFoundError: [Errno 2] No such file or directory: './data/clean/clean_facts_checkpoint_df.csv'

Perhaps we should add creating the directory to the instructions? Or add a os.mkdir cmd to the notebook?

@adamnsch, merged some changes in #2 . Please let me know if that satisfies. Thank you.

thank you zach 🙏 great work with this btw :)