Multimodal Human-Computer Communication Systems, Techniques, and Experiments

This book constitutes the strictly reviewed post-workshop documentation of the First International Conference on Cooperative Multimodal Communication held in Eindhoven, The Netherlands, in 1995.
The volume presents an introductory survey and carefully re vised and updated full versions of three invited contributions and 14 papers selected for inclusion in the book after intensive reviewing. Among the issues addressed are intelligent multimedia retrieval, cooperative conversation, agent system communication, multimodal maps, multimodal plan presentation, multimodal user interfaces, multimodal dialog, and various systems for multimodal HCI.

Issues in multimodal human-computer communication.- Toward cooperative multimedia interaction.- Multimodal cooperation with the DenK system.- Synthesizing cooperative conversation.- Instructing animated agents: Viewing language in behavioral terms.- Modeling and processing of oral and tactile activities in the GEORAL system.- Multimodal maps: An agent-based approach.- Using cooperative agents to plan multimodal presentations.- Developing multimodal interfaces: A theoretical framework and guided propagation networks.- Cooperation between reactive 3D objects and a multimodal X Window kernel for CAD.- A multimedia interface for circuit board assembly.- Visual language parsing: If I had a hammer....- Anaphora in multimodal discourse.- Speakers' responses to requests for repetition in a multimedia language processing environment.- Object reference in task-oriented keyboard dialogues.- Referent identification requests in multi-modal dialogs.- Studies into full integration of language and action.- The role of multimodal communication in cooperation: The cases of air traffic control.