Affective Dialogue Systems

Human conversational partners are able, at least to a certain extent, to detect the speaker's or listener's emotional state and may attempt to respond to it accordingly. When instead one of the interlocutors is a computer a number of questions arise, such as the following: To what extent are dialogue systems able to simulate such behaviors? Can we learn the mechanisms of emotional be- viors from observing and analyzing the behavior of human speakers? How can emotionsbeautomaticallyrecognizedfromauser'smimics,gesturesandspeech? What possibilities does a dialogue system have to express emotions itself? And, very importantly, would emotional system behavior be desirable at all? Given the state of ongoing research into incorporating emotions in dialogue systems we found it timely to organize a Tutorial and Research Workshop on A?ectiveDialogueSystems(ADS2004)atKlosterIrseein GermanyduringJune 1416, 2004. After two successful ISCA Tutorial and Research Workshops on Multimodal Dialogue Systems at the same location in 1999 and 2002, we felt that a workshop focusing on the role of a?ect in dialogue would be a valuable continuation of the workshop series. Due to its interdisciplinary nature, the workshop attracted submissions from researchers with very di?erent backgrounds and from many di?erent research areas, working on, for example, dialogue processing, speech recognition, speech synthesis, embodied conversational agents, computer graphics, animation, user modelling, tutoring systems, cognitive systems, and human-computer inter- tion.

Includes supplementary material: sn.pub/extras

Inhalt
Emotion Recognition.- From Emotion to Interaction: Lessons from Real Human-Machine-Dialogues.- Emotions in Short Vowel Segments: Effects of the Glottal Flow as Reflected by the Normalized Amplitude Quotient.- Towards Real Life Applications in Emotion Recognition.- Emotion Recognition Using Bio-sensors: First Steps towards an Automatic System.- Neural Architecture for Temporal Emotion Classification.- Affective User Modeling.- Empathic Embodied Interfaces: Addressing Users' Affective State.- Cognitive-Model-Based Interpretation of Emotions in a Multi-modal Dialog System.- Affective Advice Giving Dialogs.- Emotional Databases, Annotation Schemes, and Tools.- A Categorical Annotation Scheme for Emotion in the Linguistic Content of Dialogue.- Data-Driven Tools for Designing Talking Heads Exploiting Emotional Attitudes.- Design of a Hungarian Emotional Database for Speech Analysis and Synthesis.- Affective Conversational Agents and Dialogue Simulation.- Emotion and Dialogue in the MRE Virtual Humans.- Coloring Multi-character Conversations through the Expression of Emotions.- Domain-Oriented Conversation with H.C. Andersen.- Simulating the Emotion Dynamics of a Multimodal Conversational Agent.- Design and First Tests of a Chatter.- Endowing Spoken Language Dialogue Systems with Emotional Intelligence.- Do You Want to Talk About It?.- Application of D-Script Model to Emotional Dialogue Simulation.- Synthesis of Emotional Speech and Facial Animations.- Modeling and Synthesizing Emotional Speech for Catalan Text-to-Speech Synthesis.- Dimensional Emotion Representation as a Basis for Speech Synthesis with Non-extreme Emotions.- Extra-Semantic Protocols; Input Requirements for the Synthesis of Dialogue Speech.- How (Not) to Add Laughter to Synthetic Speech.- Modifications ofSpeech Articulatory Characteristics in the Emotive Speech.- Expressive Animated Agents for Affective Dialogue Systems.- Affective Tutoring Systems.- Affective Feedback in a Tutoring System for Procedural Tasks.- Generating Socially Appropriate Tutorial Dialog.- Evaluation of Affective Dialogue Systems.- The Role of Affect and Sociality in the Agent-Based Collaborative Learning System.- Evaluation of Synthetic Faces: Human Recognition of Emotional Facial Displays.- How to Evaluate Models of User Affect?.- Preliminary Cross-Cultural Evaluation of Expressiveness in Synthetic Faces.- Demonstrations.- Conversational H.C. Andersen First Prototype Description.- Experiences with an Emotional Sales Agent.- A Freely Configurable, Multi-modal Sensor System for Affective Computing.- Gesture Synthesis in a Real-World ECA.