The creation and consumption of content, especially visual content, is ingrained into our modern world. This book contains a collection of texts centered on the evaluation of image retrieval systems. To enable reproducible evaluation we must create standardized benchmarks and evaluation methodologies. The individual chapters in this book highlight major issues and challenges in evaluating image retrieval systems and describe various initiatives that provide researchers with the necessary evaluation resources. In particular they describe activities within ImageCLEF, an initiative to evaluate cross-language image retrieval systems which has been running as part of the Cross Language Evaluation Forum (CLEF) since 2003.

To this end, the editors collected contributions from a range of people: those involved directly with ImageCLEF, such as the organizers of specific image retrieval or annotation tasks; participants who have developed techniques to tackle the challenges set forth by the organizers; and people from industry and academia involved with image retrieval and evaluation generally.

Mostly written for researchers in academia and industry, the book stresses the importance of combing textual and visual information - a multimodal approach - for effective retrieval. It provides the reader with clear ideas about information retrieval and its evaluation in contexts and domains such as healthcare, robot vision, press photography, and the Web.

Contenu

Seven Years of Image Retrieval Evaluation.- Data Sets Created in ImageCLEF.- Creating Realistic Topics for Image Retrieval Evaluation.- Relevance Judgments for Image Retrieval Evaluation.- Performance Measures Used in Image Information Retrieval.- Fusion Techniques for Combining Textual and Visual Information Retrieval.- Track Reports.- Interactive Image Retrieval.- Photographic Image Retrieval.- The Wikipedia Image Retrieval Task.- The Robot Vision Task.- Object and Concept Recognition for Image Retrieval.- The Medical Image Classification Task.- The Medical Image Retrieval Task.- Participant reports.- Expansion and Re-ranking Approaches for Multimodal Image Retrieval using Text-based Methods.- Revisiting Sub-topic Retrieval in the ImageCLEF 2009 Photo Retrieval Task.- Knowledge Integration using Textual Information for Improving ImageCLEF Collections.- Leveraging Image, Text and Cross-media Similarities for Diversity-focused Multimedia Retrieval.- University of Amsterdam at the Visual Concept Detection and Annotation Tasks.- Intermedia Conceptual Indexing.- Conceptual Indexing Contribution to ImageCLEF Medical Retrieval Tasks.- Improving Early Precision in the ImageCLEF Medical Retrieval Task.- Lung Nodule Detection.- Medical Image Classification at Tel Aviv and Bar Ilan Universities.- Idiap on Medical Image Classification.- External views.- Press Association Images - Image Retrieval Challenges.- Image Retrieval in a Commercial Setting.- An Overview of Evaluation Campaigns in Multimedia Retrieval.