This repo demonstrates the data pipeline from pyspark to pytorch.
Use this repo with https://blog.munhou.com/2020/01/17/Data-Pipeline-From-Pyspark-to-Pytorch/
conda env create -f environment.yml
Run main.py
python main.py
This repo demonstrates the data pipeline from pyspark to pytorch.
Use this repo with https://blog.munhou.com/2020/01/17/Data-Pipeline-From-Pyspark-to-Pytorch/
conda env create -f environment.yml
Run main.py
python main.py