Test-aware combinatorial interaction testing

Warning The system is temporarily closed to updates for reporting purpose.

Yılmaz, Cemal (2011) Test-aware combinatorial interaction testing. [Working Paper / Technical Report] Sabanci University ID:SU_FENS_2011/0005

[thumbnail of Working Paper] PDF (Working Paper)
WorkingPaper1.pdf

Download (270kB)

Abstract

Combinatorial interaction testing (CIT) approaches system- atically sample a given configuration space and select a set of configurations, in which each valid t-way option setting combination appears at least once. A battery of test cases are then executed in the selected configurations. Exist- ing CIT approaches, however, do not provide a system- atic way of handling test-specific inter-option constraints. Improper handling of such constraints, on the other hand, causes masking effects, which in turn causes testers to de- velop false confidence in their test processes, believing them have tested certain option setting combinations, when they in fact have not. In this work, to avoid the harmful conse- quences of masking effects caused by improper handling of test-specific constraints, we compute t-way test-aware cov- ering arrays. A t-way test-aware covering array is not just a set of configurations as is the case in traditional covering arrays, but a set of configurations, each of which is asso- ciated with a set of test cases. We furthermore present a set of empirical studies conducted by using two widely-used highly-configurable software systems as our subject applica- tions, demonstrating that test-specific constraints are likely to occur in practice and the proposed approach is a promis- ing and effective way of handling them.
Item Type: Working Paper / Technical Report
Subjects: Q Science > Q Science (General)
Divisions: Faculty of Engineering and Natural Sciences > Academic programs > Computer Science & Eng.
Faculty of Engineering and Natural Sciences
Depositing User: Cemal Yılmaz
Date Deposited: 21 Sep 2011 10:02
Last Modified: 26 Apr 2022 10:49
URI: https://research.sabanciuniv.edu/id/eprint/16910

Actions (login required)

View Item
View Item