Efficient reconstruction of light fields for consistently augmented reality using dense multi-view systems
Seiya Suda, Kazuya Kodama, Takayuki Hamamoto · International Workshop on Advanced Image Technology (IWAIT) 2019 · 2019
In this paper, we study dense multi-view systems transmitting light fields beyond a visual obstruction as if it were transparent. Multi-view 3d displays appropriately combined with camera arrays or lens arrays provide consistently augmented reality for many users at the same time as a simple solution of such occlusion in the real world. We first describe a design of our proposed multi-view system, appearances of which are evaluated by assuming state-of-the-art visual devices to be used. Then, in order to reduce image sensors acquiring light fields for inexpensive systems, efficient interpolation is introduced to reconstruct the entire 4d light field in real time for consistency with the real world. We show that our practical implementation on a GPGPU actually achieves real-time interpolation obtaining enormous data of light fields without severe degradation for various depths.