/tensorflow-resources

Tutorials and Resources on Tensorflow

Resources for TensorFlow

Reading Data into TensorFlow

UPDATE:

There is a new input pipeline for tensorflow tf.contrib.Dataset. Read these:

  1. https://www.tensorflow.org/programmers_guide/datasets
  2. https://kratzert.github.io/2017/06/15/example-of-tensorflows-new-input-pipeline.html
  3. https://developers.googleblog.com/2017/09/introducing-tensorflow-datasets.html
  4. https://goo.gl/EZwyiY

Links using older/legacy pipelines:

  1. https://indico.io/blog/tensorflow-data-inputs-part1-placeholders-protobufs-queues/
  2. https://indico.io/blog/tensorflow-data-input-part2-extensions/
  3. https://ischlag.github.io/2016/06/19/tensorflow-input-pipeline-example/
  4. https://www.tensorflow.org/versions/r0.10/how_tos/reading_data/index.html#reading-from-files
  5. http://tneal.org/post/tensorflow-iris/TensorFlowIris/
  6. https://gist.github.com/HamedMP
  7. http://stackoverflow.com/questions/37898617/having-problems-feeding-data-to-tensorflow-graph
  8. tensorflow/tensorflow#2514
  9. https://github.com/tensorflow/tensorflow/blob/master/tensorflow/g3doc/api_docs/python/functions_and_classes/shard3/tf.contrib.training.bucket.md
  10. http://stackoverflow.com/questions/39617686/tensorflow-data-input-toggle-train-validation/39620485#39620485

Reading Images into TensorFlow

  1. https://github.com/HamedMP/ImageFlow]
  2. http://stackoverflow.com/questions/34340489/tensorflow-read-images-with-labels
  3. http://stackoverflow.com/questions/33648322/tensorflow-image-reading-display
  4. http://stackoverflow.com/questions/36075319/how-do-you-load-label-and-feed-jpeg-data-into-tensorflow
  5. https://github.com/TensorVision/TensorVision/blob/master/examples/inputs/generic_input.py
  6. http://stackoverflow.com/questions/33849617/how-do-i-convert-a-directory-of-jpeg-images-to-tfrecords-file-in-tensorflow
  7. https://gist.github.com/HamedMP/25fe0ee167c5f4d06e45

Saving Images in Tensorflow

  1. http://stackoverflow.com/questions/34783030/saving-image-files-in-tensorflow

Displaying DNN Layer Weights

  1. http://stackoverflow.com/questions/33802336/visualizing-output-of-convolutional-layer-in-tensorflow
  2. http://stackoverflow.com/questions/33783672/how-can-i-visualize-the-weightsvariables-in-cnn-in-tensorflow

Batch Normalization in Tensorflow

  1. tensorflow/tensorflow#1122
  2. http://r2rt.com/implementing-batch-normalization-in-tensorflow.html

Restoring weights and checkpoints

  1. http://cv-tricks.com/tensorflow-tutorial/save-restore-tensorflow-models-quick-complete-tutorial/
  2. http://web.stanford.edu/class/cs20si/lectures/notes_05.pdf

Deconvolution layers

  1. http://stackoverflow.com/questions/37444951/how-to-stack-multiple-layers-of-conv2d-transpose-of-tensorflow
  2. http://stackoverflow.com/questions/35488717/confused-about-conv2d-transpose
  3. http://stackoverflow.com/questions/37771321/how-to-use-tensorflow-to-implement-deconvolution

Saving,re-using and fine-tuning models

  1. https://nathanbrixius.wordpress.com/2016/05/24/checkpointing-and-reusing-tensorflow-models/
  2. http://stackoverflow.com/questions/33759623/tensorflow-how-to-restore-a-previously-saved-model-python
  3. https://kevincodeidea.wordpress.com/2016/08/02/tensorflow-save-and-load-a-model-in-a-serious-way-from-different-files/
  4. https://github.com/joelthchao/tensorflow-finetune-flickr-style
  5. http://stackoverflow.com/questions/37326002/tensorflow-get-variable-change-shared-variable-trainable-to-false
  6. http://stackoverflow.com/questions/38978972/how-to-reuse-an-existing-neural-network-to-train-a-new-one-using-tensorflow?rq=1
  7. https://blog.metaflow.fr/tensorflow-saving-restoring-and-mixing-multiple-models-c4c94d5d7125#.80gda5w2w

Computing Loss

1.http://stackoverflow.com/questions/34240703/difference-between-tensorflow-tf-nn-softmax-and-tf-nn-softmax-cross-entropy-with 2.http://stackoverflow.com/questions/38546903/semantic-segmentation-with-tensorflow-valueerror-in-loss-function-sparse-soft 3.https://datascience.stackexchange.com/questions/12886/tensorflow-adjusting-cost-function-for-imbalanced-data

High-level APIs for Tensorflow

  1. https://github.com/tensorflow/tensorflow/tree/master/tensorflow/contrib/slim
  2. https://www.tensorflow.org/versions/r0.10/api_docs/python/contrib.learn.html

Variable-sized inputs to TensorFlow

  1. http://stackoverflow.com/questions/37616503/feeding-a-convolutional-neural-network-with-variable-sized-inputs-in-tensorflow
  2. http://stackoverflow.com/questions/37594350/tensorflow-introducing-a-matrix-of-different-size-in-a-placeholder#answer-37602227
  3. http://stackoverflow.com/questions/39774449/fully-convolutional-resnets-using-tf-slim-run-very-slow

FCNN and Semantic Segmentation in Tensorflow

  1. https://github.com/MarvinTeichmann/tensorflow-fcn
  2. http://stackoverflow.com/questions/38546903/semantic-segmentation-with-tensorflow-valueerror-in-loss-function-sparse-soft?rq=1
  3. https://github.com/tensorflow/tensorflow/issues/2169
  4. http://stackoverflow.com/questions/36728239/bilinear-upsample-in-tensorflow
  5. https://github.com/fabianbormann/Tensorflow-DeconvNet-Segmentation
  6. https://github.com/ecobost/cnn4brca

Models in TF and TF-Slim

VGG

  1. https://github.com/huyng/tensorflow-vgg
  2. https://www.cs.toronto.edu/~frossard/post/vgg16/
  3. https://github.com/machrisaa/tensorflow-vgg

ResNet

  1. https://github.com/ppwwyyxx/tensorpack/tree/master/examples/ResNet
  2. https://github.com/ry/tensorflow-resnet

Other Models

  1. https://github.com/tensorflow/models/tree/master/slim
  2. http://www.wildml.com/2015/12/implementing-a-cnn-for-text-classification-in-tensorflow/
  3. https://github.com/ebenolson/pydata2015/blob/master/3%20-%20Convolutional%20Networks/Finetuning%20for%20Image%20Classification.ipynb

Other Implementations

Semantic Segmentation

  1. keras-team/keras#3354
  2. https://github.com/jocicmarko/ultrasound-nerve-segmentation
  3. http://datascience.stackexchange.com/questions/8999/deconvolutional-network-in-semantic-segmentation
  4. http://stackoverflow.com/questions/38155836/data-augmentation-image-data-generator-keras-semantic-segmentation
  5. https://github.com/fyu/dilation
  6. https://github.com/fvisin/reseg
  7. https://github.com/dhaneshr/ultrasound-nerve-segmentation
  8. https://handong1587.github.io/deep_learning/2015/10/09/segmentation.html
  9. https://devblogs.nvidia.com/parallelforall/image-segmentation-using-digits-5/
  10. https://github.com/loliverhennigh/All-Convnet-Autoencoder-Example/blob/master/all_conv_autoencoder.py

Deep Convolutional Generative Adversarial Networks

  1. https://github.com/carpedm20/DCGAN-tensorflow
  2. https://tryolabs.com/blog/2016/12/06/major-advancements-deep-learning-2016/
  3. http://blog.aylien.com/introduction-generative-adversarial-networks-code-tensorflow/

Domain Adversarial Neural Network

  1. https://github.com/pumpikano/tf-dann
  2. http://bamos.github.io/2016/08/09/deep-completion/

Context-Encoders

  1. https://github.com/pathak22/context-encoder (Torch)
  2. https://github.com/jazzsaxmafia/Inpainting

SuperResolution

  1. https://github.com/Tetrachrome/subpixel
  2. https://github.com/buriburisuri/SRGAN

CRFs in Python

  1. https://pystruct.github.io/auto_examples/image_segmentation.html#sphx-glr-auto-examples-image-segmentation-py
  2. http://warmspringwinds.github.io/tensorflow/tf-slim/2016/12/18/image-segmentation-with-tensorflow-using-cnns-and-conditional-random-fields/
  3. https://github.com/lucasb-eyer/pydensecrf

Multitask learning in Tensorflow

  1. http://www.kdnuggets.com/2016/07/multi-task-learning-tensorflow-part-1.html
  2. https://jg8610.github.io/Multi-Task/

Autocolorize and hypercolumns

  1. https://github.com/gustavla/autocolorize/tree/master/tensorflow
  2. http://tinyclouds.org/colorize/
  3. http://blog.christianperone.com/2016/01/convolutional-hypercolumns-in-python/
  4. http://stackoverflow.com/questions/37904614/implementing-hypercolumn-in-neural-nets-with-tensorflow

Quantization of Tensorflow models

  1. https://petewarden.com/2016/05/03/how-to-quantize-neural-networks-with-tensorflow/