IOSD/captionate

Captionate - Image Captioning Toolkit

Image Caption Generator

A Neural Network to generate captions for an image.

Members

Ajay Dabas - DTU

Examples

Credits : Towardsdatascience

Requirements

Recommended System Requirements to train model.

• A good CPU and a GPU
• Atleast 8gb of RAM

Required Libraries for python

• Keras
• Pillow
• nltk
• Matplotlib

Flickr8k Dataset: Dataset Request Form

Important: After downloading the dataset, put the reqired files in train_data folder

Procedure to Train Model

1. Clone the repository to preserve directory structure
2. Put the required data files in train_data Folder
3. Run train.py

Procedure to Test on new image(s)

1. Clone the repository to preserve directory structure
2. Put the test image(s) in test_data folder
3. Run test.py

References

• Show and Tell: A Neural Image Caption Generator - Oriol Vinyals, Alexander Toshev, Samy Bengio, Dumitru Erhan