Fran0K/awesome-tensorlayer

TensorLayer - A curated list of dedicated resources

Awesome Tensorlayer - A curated list of dedicated resources

You have just found TensorLayer! High performance DL and RL library for industry and academic.

Contribute

Contributions welcome! Read the contribution guidelines first.

Contents

• Tips and Tricks
• 1. Basics Examples
• 2. Computer Vision
• 3. Natural Language Processing
• 4. Reinforcement Learning
• 5. Adversarial Learning
• 6. Pretrained Models
• 7. Auto Encoders
• 8. Data and Model Managment Tools

Tips and Tricks

• Tricks to use TensorLayer is a third party repository to collect tricks to use TensorLayer better.

1. Basics Examples

1.1 MNIST and CIFAR10

TensorLayer has two types of models. Static model allows you to build model in a fluent way while dynamic model allows you to fully control the forward process. Please read this DOCS before you start.

• MNIST Simplest Example
• MNIST Static Example
• MNIST Static Example for Reused Model
• MNIST Dynamic Example
• MNIST Dynamic Example for Seperated Models
• MNIST Static Siamese Model Example
• CIFAR10 Static Example with Data Augmentation

1.2 DatasetAPI and TFRecord Examples

• Downloading and Preprocessing PASCAL VOC with TensorLayer VOC data loader. 知乎文章

• Read and Save data in TFRecord Format.

• Read and Save time-series data in TFRecord Format.

• Convert CIFAR10 in TFRecord Format for performance optimization.

• More dataset loader can be found in tl.files.load_xxx

2. Computer Vision

2.1 Computer Vision Applications

• Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization

• OpenPose: Real-time multi-person keypoint detection

• InsignFace - Additive Angular Margin Loss for Deep Face Recognition

• Spatial-Transformer-Nets (STN) trained on MNIST dataset based on the paper by [M. Jaderberg et al, 2015].

• U-Net Brain Tumor Segmentation trained on BRATS 2017 dataset based on the paper by [M. Jaderberg et al, 2015] with some modifications.

• Image2Text: im2txt based on the paper by [O. Vinyals et al, 2016].

• More Computer Vision Application can be found in Adversarial Learning Section

2.2 CNN and Computational Speed or Memory Footprint Bandwitdh Optimization

Quantization Networks

See examples/quantized_net.

• Binary Networks works on mnist and cifar10.

• Ternary Network works on mnist and cifar10.

• DoReFa-Net works on mnist and cifar10.

• Quantization For Efficient Integer-Arithmetic-Only Inference works on mnist and cifar10.

3. Natural Language Processing

3.1 ChatBot

• Seq2Seq Chatbot in 200 lines of code for Seq2Seq.

3.2 Text Generation

• Text Generation with LSTMs - Generating Trump Speech.

• Modelling PennTreebank code1 and code2, see blog post.

3.3 Text Classification

• FastText Classifier running on the IMDB dataset based on the paper by [A. Joulin et al, 2016].

3.4 Word Embedding

• Minimalistic Implementation of Word2Vec based on the paper by [T. Mikolov et al, 2013].

3.5 Spam Detection

• Chinese Spam Detector.

4. Reinforcement Learning

• DRL Model Zoo

5. Adversarial Learning

• DCGAN trained on the CelebA dataset based on the paper by [A. Radford et al, 2015].

• CycleGAN improved with resize-convolution based on the paper by [J. Zhu et al, 2017].

• SRGAN - A Super Resolution GAN based on the paper by [C. Ledig et al, 2016].

• DAGAN: Fast Compressed Sensing MRI Reconstruction based on the paper by [G. Yang et al, 2017].

• GAN-CLS for Text to Image Synthesis based on the paper by [S. Reed et al, 2016]

• Unsupervised Image-to-Image Translation with Generative Adversarial Networks, code

• BEGAN: Boundary Equilibrium Generative Adversarial Networks based on the paper by [D. Berthelot et al, 2017].

6. Pretrained Models

• The guideline of using pretrained models is here.

7. Auto Encoders

Variational Autoencoder (VAE)

• Variational Autoencoder trained on the CelebA dataset.

• Variational Autoencoder trained on the MNIST dataset.

8. Data and Model Managment Tools

• Why Database?.

• Put Tasks into Database and Execute on Other Agents, see code.

• TensorDB applied on Pong Game on OpenAI Gym: Trainer File and Generator File based on the following blog post.

• TensorDB applied to classification task on MNIST dataset: Master File and Worker File.

How to cite TL in Research Papers ?

If you find this project useful, we would be grateful if you cite the TensorLayer paper：

@article{tensorlayer2017,
    author  = {Dong, Hao and Supratak, Akara and Mai, Luo and Liu, Fangde and Oehmichen, Axel and Yu, Simiao and Guo, Yike},
    journal = {ACM Multimedia},
    title   = {{TensorLayer: A Versatile Library for Efficient Deep Learning Development}},
    url     = {http://tensorlayer.org},
    year    = {2017}
}

ENJOY