Deep image inpainting via contextual modelling in ADCT domain
Adhiyaman Manickam, Jianmin Jiang, Yu Zhou · IET Image Processing · 2022
Abstract Pixel‐based generative image inpainting has been widely researched over recent years and certain level of success via deep learning of feature representations and hallucinations of missing pixel values from surrounding backgrounds have also been reported in the literature. However, existing approaches rely on context‐based attentions and progressive inferences to capture the pixel correlations yet such pixel‐based approaches often fail to adapt to the constantly varying ranges and distances among surrounding background pixels. On the other hand, the modelling cost is also increasingly expensive whenever correlations of those pixels at longer distance away are to be exploited. To resolve the problem, we implement the principle of learning and hallucinating frequency components rather than pixel values. Therefore, we can avoid the dilemma that, on one hand the wish is to exploit all correlated pixels inside the image no matter how far away they are spatially located, but on the other, the price of increasing the modelling cost incurred by those pixels far away from the missing regions has to be paid. Extensive experiments carried out verify the effectiveness of the proposed method, which outperforms the representative existing state of the arts in terms of all assessment metrics.