Robot Localization Through Optical Character Recognition of Signs
Rômulo Pacher Júnior, Marcelo R. Petry · 2019
Optical character recognition (OCR) is the process by which the textual content of an image is converted into strings. Localization is the problem of figuring out where one is in a given environment. In this work we approach the application of OCR in robot localization. We develop and test a vision based localization system that is capable of detecting room identification signs present in the environment, recognizing their textual contents and apply them to determine its location referent to a topological map of the environment. A sign detection method based on image segmentation by color and corner detection by contour analysis is developed. The recognition of characters is performed with the application of an open-source OCR engine. Localization is performed through the comparison of sign readings with the textual information embedded in the topological representation of the environment. The algorithm was tested in a dataset of images acquired in a corridor. Experimental results show that the system successfully determines its localization in 83.33% of tested cases.