Ajayan – Final Project Overview and Update

For my final project I would like to create a personal diary.

Each diary will have an image, the text ‘Dear Diary’, and a generated story. The images will be picked at random from a Flickr image collection (>50000 images). The metadata for this imageset also has captions for these images, written by the uploader.

I will use NeuralTalk2 and train it with the captioned images I have. Then I will pull an image from random and generate a caption using this generator.

I will pass the generated caption as a seed into a Char-RNN generator. This generator will be trained in a particular style. Right now I am leaning towards mystery novels for which I found a corpus online. Finally this text will be made to look handwritten, in the style of a diary.