BBN BYBLOS and HARC February 1992 ATIS benchmark results
Francis Kubala, David G. Stallard, Chris J. Barry, Madeleine Bates, Robert Bobrow, Pascale Fung, Robert J. P. Ingria, John I. Makhoul, Long Nguyen, Richard Schwartz · 1992
We present results from the February '92 evaluation on the ATIS travel planning domain for HARC, the BBN spoken language system (SLS). In addition, we discuss in detail the individual performance of BYBLOS, the speech recognition (SPREC) component.In the official scoring, conducted by NIST, BBN's HARC system produced a weighted SLS score of 43.7 on all 687 evaluable utterances in the test set. This was the lowest error achieved by any of the 7 systems evaluated.For the SPREC evaluation BBN's BYBLOS system achieved a word error rate of 6.2% on the same 687 utterances and 9.4% on the entire test set of 971 utterances. These results were significantly better than any other speech system evaluated.