Performance Evaluation and Benchmarking

This book constitutes the refereed post-conference proceedings of the 12th TPC Technology Conference on Performance Evaluation and Benchmarking, TPCTC 2020, held in August 2020.The 8 papers presented were carefully reviewed and cover the following topics: testing ACID compliance in the LDBC social network benchmark; experimental performance evaluation of stream processing engines made easy; revisiting issues in benchmarking metric selection; performance evaluation for digital transformation; experimental comparison of relational and NoSQL document systems; a framework for supporting repetition and evaluation in the process of cloud-based DBMS performance benchmarking; benchmarking AI inference; a domain independent benchmark evolution model for the transaction processing performance council.

Inhalt

Towards Testing ACID Compliance in the LDBC Social Network Benchmark.- EXPOSE: Experimental Performance Evaluation of Stream Processing Engines Made Easy.- Revisiting Issues in Benchmarking Metric Selection.- Performance Evaluation for Digital Transformation.- Experimental Comparison of Relational and NoSQL Document Systems: the Case of Decision Support.- A Framework for Supporting Repetition and Evaluation in the Process of Cloud-based DBMS Performance Benchmarking.- Benchmarking AI Inference: Where we are in 2020.- A Domain Independent Benchmark Evolution Model for the Transaction Processing Performance Council.