A Gesture-Controlled Internet-Based Spoken Conversation Partner On A Mobile Device
Nikolaos Tsourakis, Emmanuel Rayner, Matthew Fuchs · Archive ouverte UNIGE (University of Geneva) · 2011
We describe a version of the CALL-SLT spoken conversation partner adapted for use on a mobile device. The system allows beginner/intermediate language students to practise interactive spoken language skills, using a version of MIT’s “translation game” concept: the machine prompts using an abstract description of what the student is supposed to say, and the student gives a spoken response. We focus on issues concerning the mobile version, which uses a Internet-based client/server configuration in which most processing is performed on the remote server; the client is controlled using accelerometer-based gesture recognition. We present an initial evaluation addressing two central questions: comparison of performance on mobile, Web and desktop versions and accuracy of gesture recognition