yichuan9527/finch

machine learning models I have coded (tensorflow / pytorch / mxnet)

I will keep adding more models in the near future

Installation

The following command clones all the files (>200MB)

git clone https://github.com/zhedongzheng/finch.git

Any test file can be run directly

python xxxx_test.py

The main dependence is:

• tensorflow >= 1.2.2
• pytorch >= 0.20
• mxnet >= 0.11
• scikit-learn

Other Language Support

中文

Style of My Code

I write each model as a single Class with fit() and predict() methods (scikit-learn API style), and then write separate test files for different incoming data. All the code below follow this style.

Contents

• Machine Learning
  • Linear Model
  • Non-Linear Model
  • Ensemble
• Deep Learning
  • Multilayer Perceptron
  • Convolutional Network
  • Recurrent Network
  • Autoencoder
  • Highway Network
  • Generative Adversarial Network
• Reinforcement Learning
• Natural Language Processing
  • Preprocessing
  • Word Representation
  • Text Classification
  • Text Generation
  • Sequence Labelling
  • Sequence to Sequence
• Information Retrieval
  • Recommendation System
• Computer Vision
  • OpenCV

Machine Learning

Linear Model

• TensorFlow   |   Linear Regression     Model     Test   |  

• TensorFlow   |   Logistic Regression     Model     Test   |  

• TensorFlow   |   SVM (Linear) Classifier     Model     Test   |  

• Java   |   Logistic Regression     Model     Test   |  

• Java   |   SVM (Linear) Classifier     Model     Test   |  

Non-Linear Model

• TensorFlow   |   Random Forest     Model     MNIST Test   |  

Ensemble

• Python   |   Bagging Classifier     Model     Test   |  

• Python   |   Adaboost Classifier     Pseudocode     Model     Test   |  

• Python   |   Random Forest Classifier     Model     Test   |  

Deep Learning

Multilayer Perceptron

• TensorFlow   |   MLP Classifier     Model     MNIST Test     CIFAR10 Test   |  

• PyTorch   |   MLP Classifier     Model     MNIST Test     CIFAR10 Test   |  

Convolutional Network

• TensorFlow   |   Conv2D Classifier     Model     MNIST Test     CIFAR10 Test   |  

• PyTorch   |   Conv2D Classifier     Model     MNIST Test     CIFAR10 Test   |  

• MXNet   |   Conv2D Classifier     Model     MNIST Test     CIFAR10 Test   |  

Recurrent Network

• TensorFlow   |   LSTM Classifier     Model     MNIST Test     CIFAR10 Test   |  

• TensorFlow   |   LSTM Regressor     Model     Test     Preview   |  

• PyTorch   |   LSTM Classifier     Model     MNIST Test     CIFAR10 Test   |  

• PyTorch   |   GRU Regressor     Model     Test   |  

• MXNet   |   LSTM Classifier     Model     MNIST Test     CIFAR10 Test   |  

• MXNet   |   LSTM Regressor     Model     Test   |  

Autoencoder

• TensorFlow   |   Stacked Autoencoder (weights-tied)     Model     MNIST Test   |  

• TensorFlow   |   Denoising Autoencoder     Model     MNIST Test   |  

• TensorFlow   |   Sparse Autoencoder     Model     MNIST Test   |  

• TensorFlow   |   Variational Autoencoder     Model     MNIST Test   |  

• TensorFlow   |   Conv2D Autoencoder (weights-tied)     Model     MNIST Test     CIFAR10 Test   |  

• PyTorch   |   Stacked Autoencoder (weights-tied)     Model     MNIST Test   |  

• PyTorch   |   Denoising Autoencoder     Model     MNIST Test   |  

• PyTorch   |   Sparse Autoencoder     Model     MNIST Test   |  

• PyTorch   |   Variational Autoencoder     Model     MNIST Test   |  

• PyTorch   |   Conv2D Autoencoder (weights-tied)     Model     MNIST Test     CIFAR10 Test   |  

Highway Network

• TensorFlow   |   MLP Highway Classifier     Model     MNIST Test   |  

• TensorFlow   |   Conv1D Highway Classifier     Model     IMDB Test   |  

Generative Adversarial Network

• TensorFlow   |   DCGAN     Model     MNIST Test     Result   |  

• PyTorch   |   DCGAN     Model     MNIST Test   |  

• MXNet   |   DCGAN     Model     MNIST Test   |  

Reinforcement Learning

• TensorFlow   |   Policy Gradient     Model     CartPole Test   |  

• PyTorch   |   Policy Gradient     Model     CartPole Test   |  

Natural Language Processing

Text Preprocessing

• Python   |   Text Cleaning

• Python   |   Word Indexing

Word Representation

• Python   |   LSA     Model     Test   |  

• Python   |   TF-IDF     Model     Test     Result   |  

• TensorFlow   |   Word2vec (Skip-Gram)     Model     Test   |  

Text Classification

• Python   |   TF-IDF + LR     Model     IMDB Test   |  

• TensorFlow   |   Conv1D     Model     IMDB Test   |  

• TensorFlow   |   Multi-kernel Conv1D     Model     IMDB Test     Result   |  

• TensorFlow   |   LSTM     Model     IMDB Test   |  

• TensorFlow   |   Conv1D-LSTM     Model     IMDB Test   |  

• TensorFlow   |   LSTM + Attention     Model     IMDB Test   |  

• PyTorch   |   Conv1D     Model     IMDB Test   |  

• PyTorch   |   LSTM     Model     IMDB Test   |  

• PyTorch   |   Conv1D-LSTM     Model     IMDB Test   |  

• PyTorch   |   LSTM + Attention     Model     IMDB Test   |  

• MXNet   |   Conv1D     Model     IMDB Test   |  

Text Generation

• Python   |   2nd order Markov     Model     Robert Frost Test   |  

• TensorFlow   |   Char-RNN     Model   |   《Anna Karenina》 Test   |   Beijing Address Test   |  

• PyTorch   |   Char-RNN     Model   |   《Anna Karenina》 Test   |   Beijing Address Test   |  

• MXNet   |   Char-RNN     Model   |   《Anna Karenina》 Test   |   Beijing Address Test   |  

Sequence Labelling

• TensorFlow   |   LSTM     Model   |   POS Tagging Test   |   Chinese Segmentation Test   |  

• TensorFlow   |   Bi-directional LSTM     Model   |   POS Tagging Test   |   Chinese Segmentation Test   |  

• TensorFlow   |   Bi-directional LSTM + CRF     Model   |   POS Tagging Test   |   Chinese Segmentation Test   |  

• PyTorch   |   LSTM     Model   |   POS Tagging Test   |   Chinese Segmentation Test   |  

• PyTorch   |   Bi-directional LSTM     Model   |   POS Tagging Test   |   Chinese Segmentation Test   |  

Sequence to Sequence

• TensorFlow   |   Seq2Seq     Model     Sorting Test   |  

• TensorFlow   |   Seq2Seq + Attention     Model     Sorting Test   |  

• TensorFlow   |   Seq2Seq + Bi-directional Encoder     Model     Sorting Test   |  

• TensorFlow   |   Seq2Seq + Beam-Search Decoder     Model     Sorting Test   |  

• TensorFlow   |   Seq2Seq + Bi-directional Encoder + Attention + Beam-Search Decoder     Model     Sorting Test   |  

• PyTorch   |   Seq2Seq     Model     Sorting Test   |  

• PyTorch   |   Seq2Seq + Attention     Model     Sorting Test   |  

• PyTorch   |   Seq2Seq + Bi-directional Encoder     Model     Sorting Test   |  

Information Retrieval

Recommendation System

• Python   |   Collborative Filtering   |   MovieLens     User-based Model     Test   |  

• Python   |   Apriori     Model     MovieLens Test   |  

• TensorFlow   |   Matrix Factorization     Model     MovieLens Test   |  

Computer Vision

OpenCV

• OP   |   Resize

• OP   |   Rotations

• Segmentation   |   Contours

• Segmentation   |   Sorting Contours

• Detection   |   Face & Eye Detection Using Cascade Classifier

• Detection   |   Walker & Car Detection Using Cascade Classifier