This book summarizes the current hard problems in software testing as voiced by leading practitioners in the field. The problems were identified through a series of workshops, interviews, and surveys. Some of the problems are timeless, such as education and training, while others such as system security have recently emerged as increasingly important. The book also provides an overview of the current state of Testing as a Service (TaaS) based on an exploration of existing commercial offerings and a survey of academic research. TaaS is a relatively new development that offers software testers the elastic computing capabilities and generous storage capacity of the cloud on an as-needed basis. Some of the potential benefits of TaaS include automated provisioning of test execution environments and support for rapid feedback in agile development via continuous regression testing. The book includes a case study of a representative web application and three commercial TaaS tools to determine which hard problems in software testing are amenable to a TaaS solution. The findings suggest there remains a significant gap that must be addressed before TaaS can be fully embraced by the industry, particularly in the areas of tester education and training and a need for tools supporting more types of testing. The book includes a roadmap for enhancing TaaS to help bridge the gap between potential benefits and actual results. Table of Contents: Introduction / Hard Problems in Software Testing / Testing as a Service (TaaS) / Case Study and Gap Analysis / Summary / Appendix A: Hard Problems in Software Testing Survey / Appendix B: Google App Engine Code Examples / Appendix C: Sauce Labs Code Examples / References / Author Biographies

Autorentext

Scott Tilley is a Professor in the Department of Education and Interdisciplinary Studies at the Florida Institute of Technology, where he is Director of Computing Education. He is Chair of the Steering Committee for the IEEE Web Systems Evolution (WSE) series of events and a Past Chair of the ACM's Special Interest Group on Design of Communication (SIGDOC). He is an ACM Distinguished Lecturer. His current research focuses on software testing, cloud computing, and system migration. He writes the weekly "Technology Today" column for the Florida Today newspaper (Gannett). Brianna Floss is a software developer at Lockheed Martin. She previously worked in software testing at several companies. Early results from her research on software testing challenges and the capabilities and potential of Testing as a Service were presented at the IEEE 7th International Symposium on Service-Oriented System Engineering (SOSE 2013). She holds an MSE from the Florida Institute of Technology.