Visual Perception for Manipulation and Imitation in Humanoid Robots

Dealing with visual perception in robots and its applications to manipulation and imitation, this monograph focuses on stereo-based methods and systems for object recognition and 6 DoF pose estimation as well as for marker-less human motion capture.

In recent yearswe haveseen considerableadvances in the development of - manoid robots, that is robots with an anthropomorphic design. Such robots should be capable of autonomously performing tasks for their human users in changing environments by adapting to these and to the circumstances at hand. To do so, they as well as any kind of autonomous robot need to have some way of understanding the world around them. We humans do so by our senses, both our far senses vision and hearing (smelling too) and our near senses touch and taste. Vision plays a special role in the way it simulta- ously tells us where and what in a direct way. It is therefore an accepted factthatto developautonomousrobots,humanoidornot,itisessentialto- clude competent systems for visual perception. Such systems should embody techniques from the ?eld of computer vision, in which sophisticated com- tational methods for extracting information from visual imagery have been developed over a number of decades. However, complete systems incorpor- ing such advanced techniques, while meeting the requirements of real-time processing and adaptivity to the complexity that even our everyday envir- ment displays, are scarce. The present volume takes an important step for ?lling this gap by presenting methods and a system for visual perception for a humanoid robot with speci?c applications to manipulation tasks and to how the robot can learn by imitating the human.

Recent research in Visual Perception for Manipulation and Imitation in Humanoid Robots

Inhalt
State of the Art in Object Recognition and Pose Estimation.- State of the Art in Human Motion Capture.- Fundamentals of Image Processing.- Guiding Principles.- Stereo-Based Object Recognition and Pose Estimation System.- Stereo-Based Markerless Human Motion Capture System.- Software and Interfaces.- Evaluation.- Conclusion.