A Dataset for Telling the Stories of Social Media Videos
Spandana Gella, Mike Lewis, Marcus Rohrbach · 2018
Video content on social media platforms constitutes a major part of the communication between people, as it allows everyone to share their stories.However, if someone is unable to consume video, either due to a disability or network bandwidth, this severely limits their participation and communication.Automatically telling the stories using multi-sentence descriptions of videos would allow bridging this gap.To learn and evaluate such models, we introduce VideoStory, a new large-scale dataset for video description as a new challenge for multisentence video description.Our VideoStory captions dataset is complementary to prior work and contains 20k videos posted publicly on a social media platform amounting to 396 hours of video with 123k sentences, temporally aligned to the video.* *Work done while SG was intern at Facebook AI Research.