comic/evalutils

pandas read_csv error on pytests python 3.7+

silvandeleemput opened this issue · 0 comments

Description

When working on #299 I discovered that some (unrelated) pytests would fail due to a difference in pandas:

What I Did

3.6, pandas==1.1.5, tests pass
3.7, pandas==1.2.2, tests fail
3.8, pandas==1.2.2, tests fail

CSVLoader
 read_csv(fname, skipinitialspace=True).to_dict(
                orient="records"
            )


pandas.errors.ParserError: Error tokenizing data. C error: Expected 1 fields in line 7, saw 2

This can be fixed by explicitly setting the encoding to utf-8.