Interactive spoken content retrieval with different types of actions optimized by a Markov decision process
Tsung-Hsien Wen, Hung-yi Lee, Lin-shan Lee · 2012
Interaction with user is specially important for spoken con-tent retrieval, not only because of the recognition uncertainty, but because the retrieved spoken content items are difficult to be shown on the screen and difficult to be scanned and selected by the user. The user cannot playback and go through all the retrieved items and then find out they are not what he is look-ing for. In this paper, we propose a new approach for inter-active spoken content retrieval, in which the system can esti-mate the quality of the retrieved results, and take different types of actions to clarify the user’s intention based on an intrinsic policy. The policy is optimized by a Markov Decision Process (MDP) trained with Reinforcement Learning based on a set of pre-defined rewards considering the extra burden given to the user.