Crossroads

Task Integration in Multimodal Speech Recognition Environments

Michael A. Grasso and Tim Finin

April 1, 1997

A model of complementary behavior has been proposed based on arguments that direct manipulation and speech recognition interfaces have reciprocal strengths and weaknesses. This suggests that user interface performance and acceptance may increase by adopting a multimodal approach that combines speech and direct manipulation. More theoretical work is needed in order to understand how to leverage this advantage. In this paper, a framework is presented to empirically evaluate the types of tasks that might benefit from such a multimodal interface.

BibTeX OWL Tweet Scholar

Tags: hci, medical informatics, speech

Type: Article

Volume: 3

Number: 3

Downloads: 2832 downloads

Google Scholar Citations: 10 citations