End-to-end Piece-wise Unwarping of Document Images
Sagnik Das, Kunwar Yashraj Singh, Jon Wu, Erhan Bas, Vijay S. Mahadevan, Rahul Bhotika, Dimitris Samaras · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · 2021
Document unwarping attempts to undo physical deformations of the paper and recover a ’flatbed’ scanned document-image for downstream tasks such as OCR. Current state-of-the-art relies on global unwarping of the document which is not robust to local deformation changes. Moreover, a global unwarping often produces spurious warping artifacts in less warped regions to compensate for severe warps present in other parts of the document. In this paper, we propose the first end-to-end trainable piece-wise unwarping1method that predicts local deformation fields and stitches them together with global information to obtain an improved unwarping. The proposed piece-wise formulation results in 4% improvement in terms of multi-scale structural similarity (MS-SSIM) and shows better performance in terms of OCR metrics, character error rate (CER) and word error rate (WER) compared to the state-of-the-art.