AbsaOSS/py2k

Work with iterables instead of lists

vesely-david opened this issue · 0 comments

We've hit memory issues and the main problem seems to be creating a list of Pydantic models out of a large pandas dataframe.

The suggestion is to exchange lists for generators as we discussed earlier.