Leveraging study of robustness and portability of spoken language understanding systems across languages and domains: the PORTMEDIA corpora
Fabrice Lefèvre, Djamel Mostefa, Laurent Besacier, Yannick Estève, Matthieu Quignard, Nathalie Camelin, Benoît Favre, Bassam Jabaian, Lina M. Rojas Barahona · 2012
The PORTMEDIA project is intended to develop new corpora for the evaluation of spoken language understanding systems.The newly collected data are in the field of human-machine dialogue systems for tourist information in French in line with the MEDIA corpus.Transcriptions and semantic annotations, obtained by low-cost procedures, are provided to allow a thorough evaluation of the systems' capabilities in terms of robustness and portability across languages and domains.A new test set with some adaptation data is prepared for each case: in Italian as an example of a new language, for ticket reservation as an example of a new domain.Finally the work is complemented by the proposition of a new high level semantic annotation scheme well-suited to dialogue data.