Cooperative Multimodal Communication

The chapters in this book are revised, updated, and edited versions of 13 selected papers from the Second International Conference on Cooperative Multimodal Communication (CMC 98), held in Tilburg, The Netherlands, in 1998.This wasthesecondconferencein a series,ofwhichthe ?rstonewasheld inEindhoven,TheNetherlands,in1995.Threeofthesepaperswerepresentedby invitedspeakers;thosebyDoniaScott(co-authoredwithRichardPower),Steven Feiner (co-authored with Michele Zhou), and Oliviero Stock (co-authored with Carlo Strapparava and Massimo Zancanaro). The other ten were among the submitted papers that were accepted by the CMC 98 program committee. The editors contributed an introductory chapter to set the stage for the rest of the book. We thank the programcommittee for their excellent and timely feedback to the authors of the submitted papers, and at a later stage for advising on the contents of this volume and for providing additional suggestions for improving theselectedcontributions.Theprogramcommittee consistedofNicholasAsher, NormannBadler,DonBouwhuis,HarryBunt,WalthervonHahn,DieterHuber, Hans Kamp, John Lee, Joseph Mariani, Jean-Claude Martin, Mark Maybury, PaulMcKevitt, RobNederpelt, KeesvanOverveld,RayPerrault,Donia Scott, Jan Treur, Wolfgang Wahlster, Bonnie Webber, Kent Wittenburg, and Henk Zeevat. WethanktheRoyalDutchAcademyofSciences(KNAW)andtheOrga- zationforCooperationamongUniversitiesinBrabant(SOBU)fortheirgrants that supported the conference.

Includes supplementary material: sn.pub/extras

Inhalt
Multimodal Cooperative Communication.- Multimodal Cooperative Communication.- 1: Multimodal Generation.- Generating Textual Diagrams and Diagrammatic Texts.- Pedro: Assessing Presentation Decodability on the Basis of Empirically Validated Models.- Improvise: Automated Generation of Animated Graphics for Coordinated Multimedia Presentations.- Multimodal Reference to Objects: An Empirical Approach.- 2: Multimodal Cooperation.- Augmenting and Executing SharedPlans for Multimodal Communication.- Cooperation and Flexibility in Multimodal Communication.- Communication and Manipulation Acts in a Collaborative Dialogue Model.- Relating Imperatives to Action.- 3: Multimodal Interpretation.- Interpretation of Gestures and Speech: A Practical Approach to Multimodal Communication.- Why Are Multimodal Systems so Difficult to Build? - About the Difference between Deictic Gestures and Direct Manipulation.- Multimodal Cooperative Resolution of Referential Expressions in the DenK System.- 4: Multimedia Platforms and Test Environments.- The IntelliMedia WorkBench-An Environment for Building Multimodal Systems.- A Unified Framework for Constructing Multimodal Experiments and Applications.