Cost-aware Combinatorial Interaction Testing
  • FENS
  • Cost-aware Combinatorial Interaction Testing

You are here

The configuration spaces of modern software systems are often too large
to test exhaustively. Combinatorial interaction testing approaches,
such as covering arrays, systematically sample the configuration space
and test only the selected configurations. Traditional t-way covering
arrays aim to cover all t-way combinations of option settings in a
minimum number of configurations. By doing so, they assume that the
testing cost of a configuration is the same for all configurations. I
however argue that, in practice, the actual testing cost may differ
from one configuration to another and that accounting for these
differences can improve the cost-effectiveness of covering arrays. In
this talk, I will talk about a new novel combinatorial object, called a
cost-aware covering array where a t-way cost-aware covering array is a
t-way covering array that minimizes a given cost function. I will also
describe a framework for defining the cost function. Then I will
explain an algorithm I developed for a simple, yet important cost
scenario, where the results of empirical studies suggest that
cost-aware covering arrays can greatly reduce the actual cost of
testing compared to traditional covering arrays. Then I will conclude
by my future plans to develop algorithms to generate cost-aware
covering arrays for more general cost scenarios.

Gülşen Demiröz has received her B.S. and M.S. degrees in Computer Science from Bilkent University in 1995 and 1997. Then she has worked in various teams at Microsoft Corporation headquarters in Redmond, WA, USA: first as a Software Design Engineer in Windows Networking team (1997-1999), then as a Test Lead in the same team (1999-2001), then as a Software Design Engineer in Office Outlook team (2001-2006) and finally as a Development Lead in Microsoft Online Services team (2006-2008). She has been a part of big software releases of Microsoft such as Windows 2000, Office XP, Office 2007 and Microsoft Online Services. She has been an Instructor at Sabancı University since Fall 2008 teaching programming courses with C++ for undergraduates and with C#,ASP.NET for IT Master’s program. She has started her PhD studies in Fall 2011 also at Sabancı University with her thesis advisor Cemal Yılmaz. Her research area is software testing of highly configurable systems and combinatorial interaction testing.