Privacy-preserving Reflection Rendering for Augmented Reality

Yiqin Zhao, Sheng Wei, Tian Jiao Guo · Proceedings of the 30th ACM International Conference on Multimedia · 2022

When the virtual objects consist of reflective materials, the required lighting information to render such objects can consist of privacy-sensitive information outside the current camera view. In this paper, we show, for the first time, that accuracy-driven multi-view environment lighting can reveal out-of-camera scene information and compromise privacy. We present a simple yet effective privacy attack that extracts sensitive scene information such as human faces and text from rendered objects under several application scenarios.

Read the paper · More papers on PaperTik