Feedback driven adaptive combinatorial testing

Dumlu, Emine (2011) Feedback driven adaptive combinatorial testing. [Thesis]

[thumbnail of EmineDumlu_410853.pdf] PDF
EmineDumlu_410853.pdf

Download (547kB)

Abstract

The configuration spaces of modern software systems are too large to test exhaustively. Combinatorial interaction testing (CIT) approaches, such as covering arrays, systematically sample the configuration space and test only the selected configurations. The basic justification for CIT approaches is that they can cost-effectively exercise all system behaviors caused by the settings of t or fewer options. We conjecture, however, that in practice many such behaviors are not actually tested because of masking effects – failures that perturb execution so as to prevent some behaviors from being exercised. In this work we present a feedback-driven, adaptive, combinatorial testing approach aimed at detecting and working around masking effects. At each iteration we detect potential masking effects, isolate their likely causes, and then generate new covering arrays that allow previously masked combinations to be tested in the subsequent iteration. We empirically assess the effectiveness of the proposed approach on two large widely-used open source software systems. Our results suggest that masking effects do exist and that our approach provides a promising and effcient way to work around them.
Item Type: Thesis
Uncontrolled Keywords: Combinatorial testing. -- Adaptive testing. -- Covering arrays. -- Software quality assurance. -- Birleşimsel test etme. -- Uyarlamalı test etme. -- Örtme dizileri. -- Yazılım kalite güvencesi.
Subjects: T Technology > TK Electrical engineering. Electronics Nuclear engineering > TK7800-8360 Electronics > TK7885-7895 Computer engineering. Computer hardware
Divisions: Faculty of Engineering and Natural Sciences > Academic programs > Computer Science & Eng.
Faculty of Engineering and Natural Sciences
Depositing User: IC-Cataloging
Date Deposited: 05 Jul 2014 18:33
Last Modified: 26 Apr 2022 10:01
URI: https://research.sabanciuniv.edu/id/eprint/24303

Actions (login required)

View Item
View Item