/one-network-many-uses

Four-in-one deep network: image search, image captioning, similar words and similar images using a single model

Primary LanguageJupyter Notebook

One neural network, many uses

Jupyter notebook corresponding to tutorial: One neural network network, many uses: image captioning, image search, similar images and similar words using one model

Requires following packages:

  • PyTorch
  • Numpy
  • Matplotlib

Dataset NOT included (please download separately)

To follow along, you'll need to download the Flickr8K dataset. Fill this form and you'll receive a download link on your email. (There's also a direct link to download the 1GB Flickr8K dataset, though not sure how long it'll stay like that). Extract the zip file in the 'Flicker8k_Dataset' folder in the same directory as your notebook. You'll also need to download captions from here. Extract captions in the folder 'caption_datasets'.

Example performance

Image caption example:

art 1

Similar words example

art 2

Similar images example

asrt 3

Image search example

search example

search example

Made by @paraschopra

MIT License.