This book explores robust multimodal cognitive load measurement with physiological and behavioural modalities, which involve the eye, Galvanic Skin Response, speech, language, pen input, mouse movement and multimodality fusions. Factors including stress, trust, and environmental factors such as illumination are discussed regarding their implications for cognitive load measurement. Furthermore, dynamic workload adjustment and real-time cognitive load measurement with data streaming are presented in order to make cognitive load measurement accessible by more widespread applications and users. Finally, application examples are reviewed demonstrating the feasibility of multimodal cognitive load measurement in practical applications. This is the first book of its kind to systematically introduce various computational methods for automatic and real-time cognitive load measurement and by doing so moves the practical application of cognitive load measurement from the domain of the computer scientist and psychologist to more general end-users, ready for widespread implementation.

Robust Multimodal Cognitive Load Measurement is intended for researchers and practitioners involved with cognitive load studies and communities within the computer, cognitive, and social sciences. The book will especially benefit researchers in areas like behaviour analysis, social analytics, human-computer interaction (HCI), intelligent information processing, and decision support systems.

Inhalt

Preface.- Part I: Preliminaries.- Introduction.- The State-of-The-Art.- Theoretical Aspects of Multimodal Cognitive Load Measures.- Part II: Physiological Measurement.- Eye Based Measures. Galvanic Skin Response Based Measures.- Part III: Behavioural Measurement.- Linguistic Feature Based Measures.- Speech Signal Based Measures.- Pen Input Based Measures.- Mouse Based Measures.- Part IV: Multimodal Measures and Affecting Factors.- Multimodal Measures and Data Fusion.- Emotion and Cognitive Load.- Stress and Cognitive Load.- Trust and Cognitive Load.- Part V: Making Cognitive Load Measurement Accessible.- Dynamic Cognitive Load Adjustments in A Feedback Loop.- Real-Time Cognitive Load Measurement: Data Streaming Approach.- Applications of Cognitive Load Measurement.- Part VI: Conclusions.- Cognitive Load Measurement in Perspectives.