/VideoCaption

Video captioning using LSTM and CNN. This is the Visual Learning project done by Rui Zhang, Yujia Huang and Yu Zhang

Primary LanguageJupyter Notebook

VideoCaption

Video captioning using LSTM and CNN following the paper sequence to sequence - video to text. This is the Visual Learning project done by Rui Zhang, Yujia Huang and Yu Zhang. Neuraltalk2 from Karpathy is taken as reference.

##Model As states in the paper, the model can be divided into two parts: encoder and decoder. Encoder and Decoder share the same architecture but: frames are fed into the framework and outputs are ignored during encoding while both frames and words get fed into the framework and output taken as final output during decoding. alt text