The MSIIA Experiment: Reducing Cognitive Load through Speech-Enabled Input
February 2002
Laurie Damianos, The MITRE Corporation
Dan Loehr, The MITRE Corporation
Carl Burke, The MITRE Corporation
Steve Hansen, The MITRE Corporation
Michael Viszmeg, The MITRE Corporation
ABSTRACT
We performed an exploratory study to examine the effects of speech-enabled input on an imagery analysis and annotation task. We added speech to an information fusion system to allow for hands-free annotation in order to examine the effect on EFFICIENCY, QUALITY, TASK SUCCESS, and USER SATISFACTION. We hypothesized that speech recognition could be a cognition-enabling technology by reducing the cognitive load of instrument manipulation and freeing up cognitive resources for the task at hand.
Despite the lack of confidence participants had for the accuracy and temporal precision of the speech-enabled input, each reported that speech made it easier and faster to annotate images. Several participants noted that the second modality was very effective in reducing the necessity to navigate controls and in allowing them to focus more on the task. Quantitative results indicate that people did identify images more efficiently and could potentially annotate images faster with speech. However, people did not annotate better with speech (PRECISION was lower, and RECALL was significantly lower). We attribute the lower RECALL/PRECISION scores to the lack of undo and editing capabilities and insufficient experience by naïve users in an unfamiliar domain.
This formative study has provided feedback for further development of the system augmented with speech-enabled input, as our results show that speech-enabled input may lead to improved performance of expert domain users on more complicated tasks.
Additional Search Keywords
augmented cognition, experiment, imagery annotation, multi-modality, speech interface
|
