TY - GEN
T1 - Feedback-driven combinatorial test design and execution
AU - Segall, Itai
AU - Tzoref-Brill, Rachel
N1 - Publisher Copyright:
© Copyright 2015 by the Association for Computing Machinery, Inc.
PY - 2015/5/26
Y1 - 2015/5/26
N2 - This work introduces a novel approach for online design and execution of load tests on Cloud applications. Our approach utilizes a Combinatorial Test Design (CTD) engine in order to exercise combinations of levels of resource utilization on the target system's subcomponents. In order to cope with the unpredictability and uncontrollability of Cloud environments, and to align with agile and DevOps paradigms, it designs and executes tests in an iterative online fashion. During test execution, monitoring information is collected from the Cloud, and leveraged for driving and adjusting the subsequent test scenarios. In this work we introduce the overall approach and the algorithms behind it, and demonstrate it on an example setting consisting of three sub-components comprising a typical installation of a web blogging application.
AB - This work introduces a novel approach for online design and execution of load tests on Cloud applications. Our approach utilizes a Combinatorial Test Design (CTD) engine in order to exercise combinations of levels of resource utilization on the target system's subcomponents. In order to cope with the unpredictability and uncontrollability of Cloud environments, and to align with agile and DevOps paradigms, it designs and executes tests in an iterative online fashion. During test execution, monitoring information is collected from the Cloud, and leveraged for driving and adjusting the subsequent test scenarios. In this work we introduce the overall approach and the algorithms behind it, and demonstrate it on an example setting consisting of three sub-components comprising a typical installation of a web blogging application.
KW - Cloud
KW - Combinatorial test design
KW - Combinatorial testing
KW - DevOps
KW - Performance testing
UR - http://www.scopus.com/inward/record.url?scp=84960896015&partnerID=8YFLogxK
U2 - 10.1145/2757667.2757677
DO - 10.1145/2757667.2757677
M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???
AN - SCOPUS:84960896015
T3 - SYSTOR 2015 - Proceedings of the 8th ACM International Systems and Storage Conference
BT - SYSTOR 2015 - Proceedings of the 8th ACM International Systems and Storage Conference
PB - Association for Computing Machinery, Inc
T2 - 8th ACM International Systems and Storage Conference, SYSTOR 2015
Y2 - 26 May 2015 through 28 May 2015
ER -