Variable strength t-way test suite generator with constraints support
T-way testing (or interaction testing) is a common test planning method used to sample a complete or exhaustive test suite systematically.In t-way testing, it is assumed that interaction only occurs between t numbers of parameters (where t is the interaction strength). Therefore, all t-way strategie...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English English |
Published: |
University of Malaya
2014
|
Subjects: | |
Online Access: | https://eprints.ums.edu.my/id/eprint/30057/1/Variable%20strength%20t-way%20test%20suite%20generator%20with%20constraints%20support-Abstract.pdf https://eprints.ums.edu.my/id/eprint/30057/2/Variable%20Strength%20T-Way%20Test%20Suite%20Generator%20with%20Constraints%20Support.pdf |
_version_ | 1825714289305976832 |
---|---|
author | Rozmie R. Othman Norazlina Khamis Kamal Z.Zamli |
author_facet | Rozmie R. Othman Norazlina Khamis Kamal Z.Zamli |
author_sort | Rozmie R. Othman |
collection | UMS |
description | T-way testing (or interaction testing) is a common test planning method used to sample a complete or exhaustive test suite systematically.In t-way testing, it is assumed that interaction only occurs between t numbers of parameters (where t is the interaction strength). Therefore, all t-way strategies generate the t-way test suite with the intention to cover every possible combination produces by the interacting parameters (or also known as tuples). However, for some systems under test (SUT), there are some combinations that are known to produce invalid outputs or even trigger unwanted errors. Additionally, there are also some known combinations that are impossible to occur due to requirements set to the system. As such, these combinations (termed constraints) have to be excluded from the final test suite. Whilemany t-way strategies have been proposed in literature for the past 20 years (e.g. GTWay, MIPOG, TConfig and TCG), only IPOG and PICT strategies have been known to support constraints in variable strength test suite generation. However, as t-way test suite generation process is an NP-hard problem, no single strategy can claim dominance over the others. Motivated by the challenges, this paper proposes a new strategy named General Variable Strength with Constraints (GVS_CONST) that support variable strength interaction with constraints consideration. Empirical evidence demonstrates that in most cases GVS_CONST outperforms other competing strategies in term of test suite size. |
first_indexed | 2024-03-06T03:09:35Z |
format | Article |
id | ums.eprints-30057 |
institution | Universiti Malaysia Sabah |
language | English English |
last_indexed | 2024-03-06T03:09:35Z |
publishDate | 2014 |
publisher | University of Malaya |
record_format | dspace |
spelling | ums.eprints-300572021-07-23T04:03:44Z https://eprints.ums.edu.my/id/eprint/30057/ Variable strength t-way test suite generator with constraints support Rozmie R. Othman Norazlina Khamis Kamal Z.Zamli QA Mathematics T Technology (General) T-way testing (or interaction testing) is a common test planning method used to sample a complete or exhaustive test suite systematically.In t-way testing, it is assumed that interaction only occurs between t numbers of parameters (where t is the interaction strength). Therefore, all t-way strategies generate the t-way test suite with the intention to cover every possible combination produces by the interacting parameters (or also known as tuples). However, for some systems under test (SUT), there are some combinations that are known to produce invalid outputs or even trigger unwanted errors. Additionally, there are also some known combinations that are impossible to occur due to requirements set to the system. As such, these combinations (termed constraints) have to be excluded from the final test suite. Whilemany t-way strategies have been proposed in literature for the past 20 years (e.g. GTWay, MIPOG, TConfig and TCG), only IPOG and PICT strategies have been known to support constraints in variable strength test suite generation. However, as t-way test suite generation process is an NP-hard problem, no single strategy can claim dominance over the others. Motivated by the challenges, this paper proposes a new strategy named General Variable Strength with Constraints (GVS_CONST) that support variable strength interaction with constraints consideration. Empirical evidence demonstrates that in most cases GVS_CONST outperforms other competing strategies in term of test suite size. University of Malaya 2014 Article PeerReviewed text en https://eprints.ums.edu.my/id/eprint/30057/1/Variable%20strength%20t-way%20test%20suite%20generator%20with%20constraints%20support-Abstract.pdf text en https://eprints.ums.edu.my/id/eprint/30057/2/Variable%20Strength%20T-Way%20Test%20Suite%20Generator%20with%20Constraints%20Support.pdf Rozmie R. Othman and Norazlina Khamis and Kamal Z.Zamli (2014) Variable strength t-way test suite generator with constraints support. Malaysian Journal of Computer Science, 27 (3). pp. 204-217. ISSN 0127-9084 https://ejournal.um.edu.my/index.php/MJCS/article/view/6819/4493 |
spellingShingle | QA Mathematics T Technology (General) Rozmie R. Othman Norazlina Khamis Kamal Z.Zamli Variable strength t-way test suite generator with constraints support |
title | Variable strength t-way test suite generator with constraints support |
title_full | Variable strength t-way test suite generator with constraints support |
title_fullStr | Variable strength t-way test suite generator with constraints support |
title_full_unstemmed | Variable strength t-way test suite generator with constraints support |
title_short | Variable strength t-way test suite generator with constraints support |
title_sort | variable strength t way test suite generator with constraints support |
topic | QA Mathematics T Technology (General) |
url | https://eprints.ums.edu.my/id/eprint/30057/1/Variable%20strength%20t-way%20test%20suite%20generator%20with%20constraints%20support-Abstract.pdf https://eprints.ums.edu.my/id/eprint/30057/2/Variable%20Strength%20T-Way%20Test%20Suite%20Generator%20with%20Constraints%20Support.pdf |
work_keys_str_mv | AT rozmierothman variablestrengthtwaytestsuitegeneratorwithconstraintssupport AT norazlinakhamis variablestrengthtwaytestsuitegeneratorwithconstraintssupport AT kamalzzamli variablestrengthtwaytestsuitegeneratorwithconstraintssupport |