Step-by-step Deep Learning Tutorials on Apache Spark using BigDL. The tutorials are inspired by Apache Spark examples, the Theano Tutorials and the Tensorflow tutorials.
- RDD
- DataFrame
- SparkSQL
- StructureStreaming
- Forward and backward
- Linear Regression
- Introduction to MNIST
- Logistic Regression
- Feedforward Neural Network
- Convolutional Neural Network
- Recurrent Neural Network
- LSTM
- Bi-directional RNN
- Auto-encoder
- Python 2.7
- JDK 8
- Apache Spark 2.2.0
- Jupyter Notebook 4.1
- BigDL 0.4.0
- Setup env on Mac OS / Setup env on Linux
- Run
pip install BigDL==0.4.0
- Run
jupyter notebook --notebook-dir=./ --ip=* --no-browser
- Run
pip install BigDL==0.4.0
- Run
pip install https://dist.apache.org/repos/dist/dev/incubator/toree/0.2.0/snapshots/dev1/toree-pip/toree-0.2.0.dev1.tar.gz
- Run
./toree_install.sh
- Run
jupyter notebook --notebook-dir=./ --ip=* --no-browser
- Open a browser - Suggest Chrome or Firefox or Safari
- Access notebook client at address http://localhost:8888, open the example ipynb files and execute.
- This notebook is for BigDL 0.4.0. Please refer branch-0.3 if you need to use BigDL 0.3.0.