Object Detection driven Composite Block MotionEstimation Algorithm for High-FidelitySurveillance Video Coding
Arup Kumar Pal, Bhaskar Biswas, Mihir Digamber Jichkar, Adarsh Nandan Jena, Manish Kumar · Research Square · 2023
Abstract The accurate estimation of motion in video sequences is a critical task in various computer vision applications, such as video compression, video surveillance, and autonomous navigation. Block matching is a popular method for motion estimation that involves finding the best match between blocks of pixels in consecutive frames. However, using a single block matching algorithm for the entire frame may not be efficient, especially when dealing with dynamic scenes containing moving objects. In this paper, we propose a novel approach for motion estimation using composite block matching algorithms based on object detection. Our method first detects the moving objects in the video frame using a deep learningbased object detection algorithm. Then, we use one block matching algorithm for the area of the frame where the objects are detected, and another block matching algorithm for the remaining part of the frame. The rationale behind using two different algorithms is that the area containing the objects usually has more complex motion patterns and may require a more sophisticated and rigorous algorithm than the rest of the frame. Our results show that the proposed method achieves higher accuracy and faster processing time compared to any single motion estimation methods. The composite block matching algorithm provides more accurate motion estimation in the object regions, leading to better object tracking and less motion artifacts. Moreover, the use of a simpler block matching algorithm for the non-object regions reduces computational overhead, making the overall process more efficient for compression surveillance video.