Image-Captioning
Given the image as an input, it tries to generate the descrption of the image.
Dataset:
The Flickr_8K dataset is used for the model training of image caption generators.
1 .Basic Model Inference(CNN, LSTM):
It includes the labeling of an image with English keywords with the help of datasets provided during model training. Imagenet dataset is used to train the CNN model called Xception. Xception is responsible for image feature extraction. These extracted features will be fed to the LSTM model which in turn generates the image caption.
2 .Improvised Model (Transformers):
The Transformer, a model architecture eschewing recurrence and instead relying entirely on an attention mechanism to draw global dependencies between input and output. The Transformer architecture allows for significantly more parallelization and can reach new state of the art results in translation quality.
Download the Improvise model from here link.
Comparison:
Team Members:
19PD01 : Mathanamathav A S
19PD31 : Selva k