/a-simple-neural-network-on-spark

A simple implementation of an artificial neural network based with Apache Spark and python. this is another implementation of my toy program https://github.com/lzhengchun/step-by-step-neural-network

Primary LanguageJupyter Notebook

a simple neural network using apache spark

A simple implementation of an artificial neural network using Apache Spark and python. this is another implementation of my toy program https://github.com/lzhengchun/step-by-step-neural-network.

a virtual machine used for testing is provided by an online course: https://courses.edx.org/courses/BerkeleyX/CS190.1x/1T2015/info, with which a spark environemnt has been properly configured.

about detailed comments about this ANN model, please refer to: https://github.com/lzhengchun/step-by-step-neural-network

process flow chart:

alt text

todo:

  1. add comments about the implementaion

  2. well abstract as a class and make the model more general

Notes:

As you can see, it is firly easy to implement a simple aritfical neural netowork, as I said in my another ANN toy model, ANN is not magic and not that difficult to understand and implement, the only thing you should do is just do it! Get it working before you optimize it.

Further improvement may be carried out via calibrate the neural network model parameter like hidden layer size.