codeAshu/opencv-machine-learning

Machine Learning for OpenCV: A practical introduction to the world of machine learning using OpenCV and Python

Machine Learning for OpenCV

This is the Jupyter notebook version of the following book:

Michael Beyeler
Machine Learning for OpenCV: A practical introduction to the world of machine learning and image processing using OpenCV and Python

14 July 2017
Packt Publishing Ltd., London, England
Paperback: 382 pages
ISBN 978-178398028-4

The content is available on GitHub. The code is released under the MIT license.

Table of Contents

Preface

Foreword by Ariel Rokem

1. A Taste of Machine Learning

2. Working with Data in OpenCV

   • Dealing with Data Using Python's NumPy Package
   • Loading External Datasets in Python
   • Visualizing Data Using Matplotlib
   • Dealing with Data Using OpenCV's TrainData container

3. First Steps in Supervised Learning

   • Measuring Model Performance with Scoring Functions
   • Understanding the k-NN Algorithm
   • Using Regression Models to Predict Continuous Outcomes
   • Applying Lasso and Ridge Regression
   • Classifying Iris Species Using Logistic Regression

4. Representing Data and Engineering Features

   • Preprocessing Data
   • Reducing the Dimensionality of the Data
   • Representing Categorical Variables
   • Representing Text Features
   • Representing Images

5. Using Decision Trees to Make a Medical Diagnosis

   • Building Your First Decision Tree
   • Using Decision Trees to Diagnose Breast Cancer
   • Using Decision Trees for Regression

6. Detecting Pedestrians with Support Vector Machines

   • Implementing Your First Support Vector Machine
   • Detecting Pedestrians in the Wild
   • Additional SVM Exercises

7. Implementing a Spam Filter with Bayesian Learning

   • Implementing Our First Bayesian Classifier
   • Classifying E-Mails Using Naive Bayes

8. Discovering Hidden Structures with Unsupervised Learning

   • Understanding k-Means Clustering
   • Compressing Color Images Using k-Means
   • Classifying Handwritten Digits Using k-Means
   • Implementing Agglomerative Hierarchical Clustering

9. Using Deep Learning to Classify Handwritten Digits

   • Understanding Perceptrons
   • Implementing a Multi-Layer Perceptron in OpenCV
   • Getting Acquainted with Deep Learning
   • Training an MLP in OpenCV to Classify Handwritten Digits
   • Training a Deep Neural Net to Classify Handwritten Digits Using Keras

10. Combining Different Algorithms Into an Ensemble

    • Understanding Ensemble Methods
    • Combining Decision Trees Into a Random Forest
    • Using Random Forests for Face Recognition
    • Implementing AdaBoost
    • Combining Different Models Into a Voting Classifier

11. Selecting the Right Model with Hyper-Parameter Tuning

    • Evaluating a Model
    • Understanding Cross-Validation, Bootstrapping, and McNemar's Test
    • Tuning Hyperparameters with Grid Search
    • Chaining Algorithms Together to Form a Pipeline

12. Wrapping Up

Running the Code

There are at least two ways you can run the code:

• Using Binder (no installation required).
• Using Jupyter Notebook on your local machine.

The code in this book was tested with Python 3.5, although older versions of Python should work as well (such as Python 2.7).

Using Binder

Binder allows you to run Jupyter notebooks in an interactive Docker container. No installation required!

Launch the project: mbeyeler/opencv-machine-learning

Using Jupyter Notebook

You basically want to follow the installation instructions in Chapter 1 of the book.

In short:

1. Download and install Python Anaconda.

2. Add Conda-Forge to your trusted channels (to simplify installation of OpenCV on Windows platforms):

   $ conda config --add channels conda-forge
   

3. Create a conda environment for Python 3 with all required packages:

   $ conda create -n Python3 python=3.5 --file requirements.txt
   

4. Activate the conda environment. On Linux / Mac OS X:

   $ source activate Python3
   

   On Windows:

   $ activate Python3
   

   You can learn more about conda environments in the Managing Environments section of the conda documentation.

5. Fork and clone the GitHub repo:

   • Click the Fork button in the top-right corner of this page.

   • Clone the repo, where YourUsername is your actual GitHub user name:

     $ git clone https://github.com/YourUsername/opencv-machine-learning
     

6. Launch Jupyter notebook:

   $ jupyter notebook
   

   This will open up a browser window in your current directory. Navigate to the folder opencv-machine-learning. The README file has a table of contents. Else navigate to the notebooks folder, click on the notebook of your choice, and select Kernel > Restart & Run All from the top menu.

Acknowledgment

This book was inspired in many ways by the following authors and their corresponding publications:

• Jake VanderPlas, Python Data Science Handbook: Essential Tools for Working with Data. O'Reilly, ISBN 978-149191205-8, 2016, https://github.com/jakevdp/PythonDataScienceHandbook
• Andreas Muller and Sarah Guido, Introduction to Machine Learning with Python: A Guide for Data Scientists. O'Reilly, ISBN 978-144936941-5, 2016, https://github.com/amueller/introduction_to_ml_with_python
• Sebastian Raschka, Python Machine Learning. Packt, ISBN 978-178355513-0, 2015, https://github.com/rasbt/python-machine-learning-book

These books all come with their own open-source code - check them out when you get a chance!