Combining DNN-Based Screen Detection and Correlation-Based Preamble Detection for Image Overlay Screen Camera Communication
Keima Takechi, Wataru Chujo, Hayate Ohtani, Kentaro Kobayashi · 2025
Image overlay uplink screen camera communication has been studied, which consists of a small screen transmitter with LED backlight modulation and a rolling shutter camera receiver, allowing the user to transmit data while displaying the received image on the screen. This study investigates a method that enables data demodulation even when the transmitter screen is captured only in a part of the received image as the transmitter moves. To detect only the screen captured as part of the received image and further detect the preamble, threshold decision, object detection deep learning (DNN), and correlation coefficients are compared. It has been revealed that object detection DNN is suitable for screen detection, while correlation coefficients are suitable for preamble detection.