Step-by-step Deep Leaning Tutorials on Apache Spark using BigDL. The tutorials are inspired by Apache Spark examples, the Theano Tutorials and the Tensorflow tutorials.
- RDD
- DataFrame
- SparkSQL
- StructureStreaming
- Forward and backward
- Linear Regression
- Introduction to MNIST
- Logistic Regression
- Feedforward Neural Network
- Convolutional Neural Network
- Recurrent Neural Network
- LSTM
- Bi-directional RNN
- Auto-encoder
- Python 2.7
- JDK 8
- Apache Spark 2.1.0
- Jupyter Notebook 4.1
- BigDL 0.2.0
- Setup env on Mac OS / Setup env on Linux
- Download BigDL 0.2.0(linux64, mac) and unzip file.
- Run
export BIGDL_HOME=where is your unzipped bigdl folder
- Run
export SPARK_HOME=where is your unpacked spark folder
- Run
./start_notebook.sh
- Open a browser - Suggest Chrome or Firefox or Safari
- Access notebook client at address http://localhost:8888, open the example ipynb files and execute.