Object Knowledge Distillation for Joint Detection and Tracking in Satellite Videos
Wenhua Zhang, Wenjing Deng, Zhen Cui, Jia Liu, Licheng Jiao · IEEE Transactions on Geoscience and Remote Sensing · 2024
Existing mainstream MOT methods can be categorised into two frameworks including two-stage and one-stage ones. Two-stage ones divide MOT task into object detection and association tasks which usually achieve high accuracy. One-stage ones train a joint model to achieve both detection and tracking. So their advantage usually lies in the high tracking efficiency. In this paper, we inherit the advantages of the two types frameworks and propose the object knowledge distilled joint detection and tracking framework (OKD-JDT) to achieve accurate as well as efficient tracking. Firstly, the performance of two-stage methods largely depends on the highly performed detection network. So, we treat the detection network as the teacher network to guide the discriminative object feature learning in one-stage methods by using knowledge distillation. Then, in distillation learning, we design the adaptive attention learning to learn the discriminative features from teacher network to student network. In addition, with the similar appearance and uniform moving behaviour of objects in satellite videos, we propose to use joint center point distance and intersection-over-onion (IOU) to generate tracklets. Experiments on JiLin-1 satellite videos with different objects demonstrate the effectiveness and the state-of-the-art performance of the proposed method.