KySS 1.0: a Framework for Automatic Evaluation of Chinese Input Method Engines
Zhongye Jia, Hai Zhao · 2013
Chinese Input Method Engine (IME) plays an important role in Chinese language pro-cessing. However, it has been subjected to lacking a proper evaluation metric for a long time. The natural metric for IME is user experience, which is a rather vague goal for research purpose. We propose a novel approach of quantifying user expe-rience by using keystroke count and then correspondingly develop a framework of IME evaluation, which is fast and accu-rate. With the underlying linguistic back-ground, the proposed evaluation frame-work can properly model the user behavior as Chinese is input through English key-board. It is helpful to point out a way to improve the current Chinese IME perfor-mance. 1 1