Computers in the Human Interaction Loop

Computers in the Human Interaction Loop (CHIL) explores a new look at human interfaces, where computers become participants among humans interacting with humans, as opposed to a rigid human-machine interaction dialog. To do so, computers must become perceptually aware and learn to provide services proactively and unobtrusively based on an implicit understanding of human needs.

The book integrates a wide range of research topics that represent key elements of this vision including audio-visual perceptual components for such environments; the design, implementation and analysis of novel proactive perceptive services supporting humans; the development of software architectures, ontologies and tools necessary for building such environments and services, as well as approaches for the evaluation of such technologies and services.

Divided into five parts: Introduction, Perceptual Technologies, Services, Software Infrastructure, and an Outlook Beyond, the book is based on research carried out by the CHIL Consortium (Computers in the Human Interaction Loop). Based on the premise that machines need to understand the human context and human activities better, the focus is on how machines need to recognize, understand, adapt to and learn from human interests, activities, goals and aspirations, rather than humans having to adapt to machines.

Those working in areas such as ambient intelligence, perceptual user interfaces, human-centred computing systems, and other areas of pervasive computing will find this a very valuable reference source.

Zusammenfassung

This book integrates a wide range of research topics related to and necessary for the development of proactive, smart, computers in the human interaction loop, including the development of audio-visual perceptual components for such environments; the design, implementation and analysis of novel proactive perceptive services supporting humans; the development of software architectures, ontologies and tools necessary for building such environments and services, as well as approaches for the evaluation of such technologies and services.

The book is based on a major European Integrated Project, CHLI (Computers in the Human Interaction Loop), and throws light on the paradigm shift in the area of HCI that rather than humans interactive directly with machines, computers should observe and understand human interaction, and support humans during their work and interaction in an implicit and proactive manner.

Inhalt

The CHIL Vision and Framework.- Computers in the Human Interaction Loop.- Perceptual Technologies.- Perceptual Technologies: Analyzing the Who, What, Where of Human Interaction.- Person Tracking.- Multimodal Person Identification.- Estimation of Head Pose.- Automatic Speech Recognition.- Acoustic Event Detection and Classification.- Language Technologies: Question Answering in Speech Transcripts.- Extracting Interaction Cues: Focus of Attention, Body Pose, and Gestures.- Emotion Recognition.- Activity Classification.- Situation Modeling.- Targeted Audio.- Multimodal Interaction Control.- Perceptual Component Evaluation and Data Collection.- Services.- User-Centered Design of CHIL Services: Introduction.- The Collaborative Workspace: A Co-located Tabletop Device to Support Meetings.- The Memory Jog Service.- The Connector Service: Representing Availability for Mobile Communication.- Relational Cockpit.- Automatic Relational Reporting to Support Group Dynamics.- The CHIL Reference Architecture.- The CHIL Reference Model Architecture for Multimodal Perceptual Systems.- Low-Level Distributed Data Transfer Layer: The ChilFlow Middleware.- Perceptual Component Data Models and APIs.- Situation Modeling Layer.- Ontological Modeling and Reasoning.- Building Scalable Services: The CHIL Agent Framework.- CHIL Integration Tools and Middleware.- Beyond CHIL.- Beyond CHIL.