Interactive User Interface for Recognizing Online Handwritten Mathematical Expressions and Correcting Misrecognition
Vu Tran Minh Khuong, Minh Khanh Phan, Masaki Nakagawa · 2019
This paper presents an interactive user interface for the recognition of online handwritten mathematical expressions (HMEs). Since the recognition results may have errors, our objective is to make a user interface by which the users could verify and edit the recognition result of an HME easily without rewriting it. Multiple editing gestures are proposed to correct recognition errors in symbol recognition, symbol segmentation, and structure analysis. We implemented prototypes and conducted a user study to compare two variations for the user interface and a few variations for gestures. The results show that participants prefer the user interface showing the recognition result of each symbol apart from its bounding box to the one which embeds the recognition result into its bounding box. Moreover, the user study confirmed that our correcting gestures enable the users to modify the recognition result as they expected.