Resource Management for Big Data Platforms

Serving as a flagship driver towards advance research in the area of Big Data platforms and applications, this book provides a platform for the dissemination of advanced topics of theory, research efforts and analysis, and implementation oriented on methods, techniques and performance evaluation. In 23 chapters, several important formulations of the architecture design, optimization techniques, advanced analytics methods, biological, medical and social media applications are presented. These chapters discuss the research of members from the ICT COST Action IC1406 High-Performance Modelling and Simulation for Big Data Applications (cHiPSet). This volume is ideal as a reference for students, researchers and industry practitioners working in or interested in joining interdisciplinary works in the areas of intelligent decision systems using emergent distributed computing paradigms. It will also allow newcomers to grasp the key concerns and their potential solutions.

Provides a comprehensive overview of the development of RMS for big data platforms and applications, covering theory, methodologies, experimentation, and real-world applications Presents state-of-the-art solutions for issues of big data processing, resource and data management, fault tolerance, monitoring and controlling, and security Discusses the development of related programming models and technologies in information and communication, and how these help in formulating practical solutions for the topics covered Includes supplementary material: sn.pub/extras

Autorentext

Dr. Florin Pop is an Associate Professor in the Distributed Systems Laboratory of the Computer Science Department at the University Politehnica of Bucharest, Romania.

Dr. Joanna Koodziej is a Professor in the Department of Computer Science at Cracow University of Technology, Poland. Amongst her recent publications are the Springer titles Intelligent Agents in Data-intensive Computing and Evolutionary Based Solutions for Green Computing.

Dr. Beniamino Di Martino is a full Professor of Information Systems at the Second University of Naples, Italy. His publications include the Springer titles Cloud Portability and Interoperability and Smart Organizations and Smart Artifacts.

Klappentext

This book constitutes a flagship driver towards presenting and supporting advance research in the area of Big Data platforms and applications. Extracting valuable information from raw data is especially difficult considering the velocity of growing data from year to year and the fact that 80% of data is unstructured. In addition, data sources are heterogeneous (various sensors, users with different profiles, etc.) and are located in different situations or contexts. Successful contributions may range from advanced technologies, applications and innovative solutions to global optimization problems in scalable large-scale computing systems to development of methods, conceptual and theoretical models related to Big Data applications and massive data storage and processing. The book provides, in this sense, a platform for the dissemination of advanced topics of theory, research efforts and analysis and implementation for Big Data platforms and applications being oriented on methods, techniques and performance evaluation.

This book presents new ideas, analysis, implementations and evaluation of next-generation Big Data platforms and applications. In 23 chapters, several important formulations of the architecture design, optimization techniques, advanced analytics methods, biological, medical and social media applications are presented. These subjects represent the main objectives of ICT COST Action IC1406 High-Performance Modelling and Simulation for Big Data Applications (cHiPSet) and the research presented in these chapters was performed by joint collaboration of members from this action. This volume will serve as a reference for students, researchers and industry practitioners working in or interested in joining interdisciplinary works in the areas of intelligent decision systems using emergent distributed computing paradigms. It will also allow newcomers to grasp the key concerns and potential solutions for the selected topics.

Inhalt

Performance Modeling of Big Data Oriented Architectures .- Workflow Scheduling Techniques for Big Data Platforms.- Cloud Technologies: A New Level for Big Data Mining.- Agent Based High-Level Interaction Patterns for Modeling Individual and Collective Optimizations Problems.- Maximize Profit for Big Data Processing in Distributed Datacenters.- Energy and Power Efficiency in the Cloud.- Context Aware and Reinforcement Learning Based Load Balancing System for Green Clouds.- High-Performance Storage Support for Scientific Big Data Applications on the Cloud.- Information Fusion for Improving Decision-Making in Big Data Applications.- Load Balancing and Fault Tolerance Mechanisms for Scalable and Reliable Big Data Analytics.- Fault Tolerance in MapReduce: A Survey.- Big Data Security.- Big Biological Data Management.- Optimal Worksharing of DNA Sequence Analysis on Accelerated Platforms.- Feature Dimensionality Reduction for Mammographic Report Classification.- Parallel Algorithms for Multi-Relational Data Mining: Application to Life Science Problems.- Parallelization of Sparse Matrix Kernels for Big Data Applications.- Delivering Social Multimedia Content with Scalability.- A Java-Based Distributed Approach for Generating Large-Scale Social Network Graphs.- Predicting Video Virality on Twitter.- Big Data uses in Crowd Based Systems.- Evaluation of a Web CrowdSensing IoT Ecosystem Providing Big Data Analysis.- A Smart City Fighting Pollution by Efficiently Managing and Processing Big Data from Sensor Networks.