Multimodal Neural Language Models
Ryan Kiros, Ruslan Salakhutdinov, Rich Zemel · 2014
This paper focuses on multimodal neural language models: models of natural language that can be conditional on other modalities Can perform image retrival from text, as well as generating text or text retrival given an image