Real-time detection and tracking of multiple objects with partial decoding in H.264/AVC bitstream domain
Wonsang You, Muhammad Syah Houari Sabirin, Munchurl Kim · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · 2009
In this paper, we show that we can apply probabilistic spatiotemporal macroblock filtering (PSMF) and partial decoding processes to effectively detect and track multiple objects in real time in H.264|AVC bitstreams with stationary background. Our contribution is that our method cannot only show fast processing time but also handle multiple moving objects that are articulated, changing in size or internally have monotonous color, even though they contain a chaotic set of non-homogeneous motion vectors inside. In addition, our partial decoding process for H.264|AVC bitstreams enables to improve the accuracy of object trajectories and overcome long occlusion by using extracted color information.