Modeling Communication with Robots and Virtual Humans

Two main types of embodied agents are playing an increasingly important role in cognitive interaction technology: virtual humans inhabiting simulated environments and humanoid robots inhabiting the real world. The need to develop an integrated perspective of embodiment in communication, establishing bridges between lower-level, sensorimotor functions and a range of higher-level, communicative functions involving language and bodily action has led to the exploration of how artificial agents can advance our understanding of key aspects of embodiment, cognition, and communication.

The 17 articles in this state-of-the-art survey address artificial intelligence research on communicative agents and also provide an interdisciplinary perspective from linguistics, behavioral research, theoretical biology, philosophy, communication psychology, and computational neuroscience. The topics include studies on human multimodal communication; the modeling of feedback signals, facial expression, eye contact, and deception; the recognition and comprehension of hand gestures and head movements; communication interfaces for humanoid robots; the evolution of cognition and language; emotion and social appraisal in nonverbal communication; dialogue models and methodologies; theory of mind and intentionality; complex systems, dynamic field theory, and connectionist modeling.

Klappentext

Embodied agents play an increasingly important role in cognitive interaction technology. The two main types of embodied agents are virtual humans inhabiting simulated environments and humanoid robots inhabiting the real world. So far research on embodied communicative agents has mainly explored their potential for practical applications. However, the design of communicative artificial agents can also be of great heuristic value for the scientific study of communication. It allows researchers to isolate, implement, and test essential properties of inter-agent communications in operational models. Modeling communication with robots and virtual humans thus involves the vision of using communicative machines as research tools. Artificial systems that reproduce certain aspects of natural, multimodal communication help to elucidate the internal mechanisms that give rise to different aspects of communication. In short, constructing embodied agents who are able to communicate may help us to understand the principles of human communication. As a comprehensive theme, "Embodied Communication in Humans and Machines" was taken up by an international research group hosted by Bielefeld University's Center for Interdisciplinary Research (ZiF - Zentrum für interdisziplinäre Forschung) from October 2005 through September 2006. The overarching goal of this research year was to develop an integrated perspective of embodiment in communication, establishing bridges between lower-level, sensorimotor functions and a range of higher-level, communicative functions involving language and bodily action. The present volume grew out of a workshop that took place during April 5-8, 2006 at the ZiF as a part of the research year on embodied communication.

Inhalt

From Annotated Multimodal Corpora to Simulated Human-Like Behaviors.- Modeling Embodied Feedback with Virtual Humans.- The Recognition and Comprehension of Hand Gestures - A Review and Research Agenda.- Modeling Facial Expression of Uncertainty in Conversational Animation.- The Evolution of Cognition - From First Order to Second Order Embodiment.- History and Current Researches on Building a Human Interface for Humanoid Robots.- Typological and Computational Investigations of Spatial Perspective.- Modeling Multimodal Communication as a Complex System.- Con-tact - On the Problem of the Absence of Eye Contact and Physical Contact in Virtual Interaction.- True Emotion vs. Social Intentions in Nonverbal Communication: Towards a Synthesis for Embodied Conversational Agents.- Facial Deception in Humans and ECAs.- Theory of Mind as a Theoretical Prerequisite to Model Communication with Virtual Humans.- Listening Heads.- Dynamic Field Theory and Embodied Communication.- 'I, Max' - Communicating with an Artificial Agent.- Talking to Virtual Humans: Dialogue Models and Methodologies for Embodied Conversational Agents.- Can't Get You Out of My Head: A Connectionist Model of Cyclic Rehearsal.