Real-Time Video Forgery Detection via Vision-WiFi Silhouette Correspondence
Jianwei Liu, Xinyue Fang, Yike Chen, Jiantao Yuan, Guanding Yu, Jinsong Han · IEEE Transactions on Mobile Computing · 2024
For safety guard and crime prevention, video surveillance systems have been pervasively deployed in many security-critical scenarios, such as the residence, retail stores, and banks. However, these systems could be infiltrated by the adversary and the video streams would be modified or replaced, i.e., under the video forgery attack. The prevalence of Internet of Things (IoT) devices and the emergence of Deepfake-like techniques severely emphasize the vulnerability of video surveillance systems under such attacks. To secure existing surveillance systems, in this paper we propose a vision-WiFi cross-modal video forgery detection system, namelyWiSil. Leveraging a theoretical model based on the principle of signal propagation,WiSilconstructs wave front information of the object in the monitoring area from WiFi signals. With a well-designed deep learning network,WiSilfurther recovers silhouettes from the wave front information. Based on a Siamese network-based semantic feature extractor,WiSilcan eventually determine whether a frame is manipulated by comparing the semantic feature vectors extracted from the video’s silhouette with those extracted from the WiFi’s silhouette. We enhance the basic version ofWiSilFang et al. 2023 by developing a model compression method and a forgery trace localization method. Extensive experiments show thatWiSilachieves 95%$+$accuracy in detecting tampered frames.