Array Camera Image Fusion using Physics-Aware Transformers
Qian Huang, Minghao Hu, David J. Brady · Journal of Imaging Science and Technology · 2022
We demonstrate a physics-aware transformer for feature-based data fusion from cameras with diverse resolution, color spaces, focal planes, focal lengths, and exposure. We also demonstrate a scalable solution for synthetic training data generation for the transformer using open-source computer graphics software. We demonstrate image synthesis on arrays with diverse spectral responses, instantaneous field of view and frame rate.