Variable strength t-way test suite generator with constraints support

T-way testing (or interaction testing) is a common test planning method used to sample a complete or exhaustive test suite systematically.In t-way testing, it is assumed that interaction only occurs between t numbers of parameters (where t is the interaction strength). Therefore, all t-way strategie...

Full description

Bibliographic Details
Main Authors: Rozmie R. Othman, Norazlina Khamis, Kamal Z.Zamli
Format: Article
Language:English
English
Published: University of Malaya 2014
Subjects:
Online Access:https://eprints.ums.edu.my/id/eprint/30057/1/Variable%20strength%20t-way%20test%20suite%20generator%20with%20constraints%20support-Abstract.pdf
https://eprints.ums.edu.my/id/eprint/30057/2/Variable%20Strength%20T-Way%20Test%20Suite%20Generator%20with%20Constraints%20Support.pdf
_version_ 1825714289305976832
author Rozmie R. Othman
Norazlina Khamis
Kamal Z.Zamli
author_facet Rozmie R. Othman
Norazlina Khamis
Kamal Z.Zamli
author_sort Rozmie R. Othman
collection UMS
description T-way testing (or interaction testing) is a common test planning method used to sample a complete or exhaustive test suite systematically.In t-way testing, it is assumed that interaction only occurs between t numbers of parameters (where t is the interaction strength). Therefore, all t-way strategies generate the t-way test suite with the intention to cover every possible combination produces by the interacting parameters (or also known as tuples). However, for some systems under test (SUT), there are some combinations that are known to produce invalid outputs or even trigger unwanted errors. Additionally, there are also some known combinations that are impossible to occur due to requirements set to the system. As such, these combinations (termed constraints) have to be excluded from the final test suite. Whilemany t-way strategies have been proposed in literature for the past 20 years (e.g. GTWay, MIPOG, TConfig and TCG), only IPOG and PICT strategies have been known to support constraints in variable strength test suite generation. However, as t-way test suite generation process is an NP-hard problem, no single strategy can claim dominance over the others. Motivated by the challenges, this paper proposes a new strategy named General Variable Strength with Constraints (GVS_CONST) that support variable strength interaction with constraints consideration. Empirical evidence demonstrates that in most cases GVS_CONST outperforms other competing strategies in term of test suite size.
first_indexed 2024-03-06T03:09:35Z
format Article
id ums.eprints-30057
institution Universiti Malaysia Sabah
language English
English
last_indexed 2024-03-06T03:09:35Z
publishDate 2014
publisher University of Malaya
record_format dspace
spelling ums.eprints-300572021-07-23T04:03:44Z https://eprints.ums.edu.my/id/eprint/30057/ Variable strength t-way test suite generator with constraints support Rozmie R. Othman Norazlina Khamis Kamal Z.Zamli QA Mathematics T Technology (General) T-way testing (or interaction testing) is a common test planning method used to sample a complete or exhaustive test suite systematically.In t-way testing, it is assumed that interaction only occurs between t numbers of parameters (where t is the interaction strength). Therefore, all t-way strategies generate the t-way test suite with the intention to cover every possible combination produces by the interacting parameters (or also known as tuples). However, for some systems under test (SUT), there are some combinations that are known to produce invalid outputs or even trigger unwanted errors. Additionally, there are also some known combinations that are impossible to occur due to requirements set to the system. As such, these combinations (termed constraints) have to be excluded from the final test suite. Whilemany t-way strategies have been proposed in literature for the past 20 years (e.g. GTWay, MIPOG, TConfig and TCG), only IPOG and PICT strategies have been known to support constraints in variable strength test suite generation. However, as t-way test suite generation process is an NP-hard problem, no single strategy can claim dominance over the others. Motivated by the challenges, this paper proposes a new strategy named General Variable Strength with Constraints (GVS_CONST) that support variable strength interaction with constraints consideration. Empirical evidence demonstrates that in most cases GVS_CONST outperforms other competing strategies in term of test suite size. University of Malaya 2014 Article PeerReviewed text en https://eprints.ums.edu.my/id/eprint/30057/1/Variable%20strength%20t-way%20test%20suite%20generator%20with%20constraints%20support-Abstract.pdf text en https://eprints.ums.edu.my/id/eprint/30057/2/Variable%20Strength%20T-Way%20Test%20Suite%20Generator%20with%20Constraints%20Support.pdf Rozmie R. Othman and Norazlina Khamis and Kamal Z.Zamli (2014) Variable strength t-way test suite generator with constraints support. Malaysian Journal of Computer Science, 27 (3). pp. 204-217. ISSN 0127-9084 https://ejournal.um.edu.my/index.php/MJCS/article/view/6819/4493
spellingShingle QA Mathematics
T Technology (General)
Rozmie R. Othman
Norazlina Khamis
Kamal Z.Zamli
Variable strength t-way test suite generator with constraints support
title Variable strength t-way test suite generator with constraints support
title_full Variable strength t-way test suite generator with constraints support
title_fullStr Variable strength t-way test suite generator with constraints support
title_full_unstemmed Variable strength t-way test suite generator with constraints support
title_short Variable strength t-way test suite generator with constraints support
title_sort variable strength t way test suite generator with constraints support
topic QA Mathematics
T Technology (General)
url https://eprints.ums.edu.my/id/eprint/30057/1/Variable%20strength%20t-way%20test%20suite%20generator%20with%20constraints%20support-Abstract.pdf
https://eprints.ums.edu.my/id/eprint/30057/2/Variable%20Strength%20T-Way%20Test%20Suite%20Generator%20with%20Constraints%20Support.pdf
work_keys_str_mv AT rozmierothman variablestrengthtwaytestsuitegeneratorwithconstraintssupport
AT norazlinakhamis variablestrengthtwaytestsuitegeneratorwithconstraintssupport
AT kamalzzamli variablestrengthtwaytestsuitegeneratorwithconstraintssupport