Predicting Future Instance Segmentation with Contextual Pyramid ConvLSTMs
Jiangxin Sun, Jiafeng Xie, Jian–Fang Hu, Zihang Lin, Jianhuang Lai, Wenjun Zeng, Wei‐Shi Zheng · 2019
Despite the remarkable progress in instance segmentation, the problem of predicting future instance segmentation remains challenging due to the unobservability of future data. Existing methods mainly address this challenge by forecasting pyramid features to represent unobserved future frames. However, they mainly predict features for each pyramid level independently, and ignore the underlying structural relationship between features of different levels.