Correlation-aware Encoder-Decoder with Adapters for SVBRDF Acquisition
Di Luo, Hanxiao Sun, Лей Ма, Jian Jun Yang, Beibei Wang · 2024
Fig. 1.By modeling the correlation among input images with an encoder, together with an adapter-equipped decoder, our network achieves high-quality SVBRDF recovery on both isotropic and anisotropic (with roughness encoded in red and green channels) materials.Here we show re-rendered views for four materials under environment illumination.(Please use Adobe Acrobat and click the renderings to see the animation.)Capturing materials from the real world avoids laborious manual material authoring.However, recovering high-fidelity Spatially Varying Bidirectional Reflectance Distribution Function (SVBRDF) maps from a few captured images is challenging due to its ill-posed nature.Existing approaches have made extensive efforts to alleviate this ambiguity issue by leveraging generative models with latent space optimization or extracting features with variant encoder-decoders.Albeit the rendered images at input views can match input images, the problematic decomposition among maps leads to significant differences when rendered under novel views/lighting.We observe that for human eyes, besides individual images, the correlation (or the highlights variation) among input images also serves as an important hint to recognize * Contribute equally.