Language Technology: A Survey of the State of the Art
Language Resources: Multimodal Language Resources
December 2002
Mark T. Maybury, The MITRE Corporation
ABSTRACT
This article provides an overview of research in multimodal language processing and associated resources. It defines multimodal processing, describes key challenges, identifies potential benefits, and outlines the major tasks, including multimodal input interpretation, multimodal output generation, and multimodal information access. The article exemplifies the state of the art in multimedia and multimodal processing, describes multimodal language resources and annotation, and finally presents a 2003-2006 roadmap that points the way to the future.
» Download Paper [PDF, 561KB]
Additional Search Keywords
multimedia, multimodal, resources, language, speech, gesture, gaze, audio, video, text, graphics
|
