rewrite DataPreparator
monkey0head opened this issue · 0 comments
monkey0head commented
🚀 Feature Request
Datapreparator should become a class used to:
- convert dataframe to spark
- check dataframe for NaNs
- convert timestamp
Motivation
To make a preprocessing sequence:
DataPreparator (get spark dataframe with valid data types) - Splitters/Filters (split/crop dataframe) - Indexer (create indexers for train at first)