Evaluation of Speech-to-Speech
Translation Systems
July 2005
John Aberdeen, The MITRE Corporation
Christine Doran, The MITRE Corporation
Beatrice Oshika, The MITRE Corporation
Sherri Condon, The MITRE Corporation
Lisa Harper, The MITRE Corporation
Jon Phillips, The MITRE Corporation
ABSTRACT
The DARPA program CAST funded the development of four two-way speech-to-speech
translation systems for four different language pairs across two domains.
We describe the evaluation methodology, metrics and lessons learned
from a noncomparative evaluation of the systems in one of these domains.
Because the goal of the systems was to provide translation support for
the performance goal-oriented tasks, the emphasis for assessment was
on "live" real-time interactions between English subject matter
experts and foreign language speakers engaged in realistic, unscripted
scenario-based interactions.
» Download Paper [PDF, 3.4MB]
Additional Search Keywords
N/A
|
