Augmenting a round-trip path test suite to cover all event-pairs for testing more diverse usage scenarios
Among State-Based Testing (SBT) strategies, the Round-Trip Path (RTP) strategy is known to generate the most cost-effective state-based test suite. However, some studies have pointed out that an RTP suite is not sufficient because it does not test enough realistic usage scenarios, which could lead t...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2023-06-01
|
| Series: | Journal of King Saud University: Computer and Information Sciences |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S1319157823001179 |
| _version_ | 1827917497785909248 |
|---|---|
| author | Seonyeol Lee Hyun-Jae Choi Heung-Seok Chae |
| author_facet | Seonyeol Lee Hyun-Jae Choi Heung-Seok Chae |
| author_sort | Seonyeol Lee |
| collection | DOAJ |
| description | Among State-Based Testing (SBT) strategies, the Round-Trip Path (RTP) strategy is known to generate the most cost-effective state-based test suite. However, some studies have pointed out that an RTP suite is not sufficient because it does not test enough realistic usage scenarios, which could lead to poor fault detection. We believe that the traversal algorithm of the RTP strategy, which omits certain event-pairs, is one of the main factors causing the problem. To address this issue, we propose two methods for augmenting an RTP suite to cover all event-pairs. Through three case studies, we confirmed that the RTP suites did not cover 30%, 56.67%, and 37% of all event-pairs, some of which were critical, such as (remove, add) in an ordered set, (brake, brake) in a cruise control system, and (stop, play) in a video cassette recorder. The augmented suites improved the effectiveness of the RTP suites by testing more usage scenarios that include the event-pairs, albeit at a slightly higher cost. Compared to the All Transition-Pair (ATP) suites, the augmented suites provide a more cost-effective improvement to an RTP suite, requiring a lower cost increase rate. We believe that the augmented suites could be cost-effective alternatives between an RTP suite and an ATP suite. |
| first_indexed | 2024-03-13T03:28:41Z |
| format | Article |
| id | doaj.art-b79aad1df936467b9367dcca1d6a9191 |
| institution | Directory Open Access Journal |
| issn | 1319-1578 |
| language | English |
| last_indexed | 2024-03-13T03:28:41Z |
| publishDate | 2023-06-01 |
| publisher | Elsevier |
| record_format | Article |
| series | Journal of King Saud University: Computer and Information Sciences |
| spelling | doaj.art-b79aad1df936467b9367dcca1d6a91912023-06-25T04:42:40ZengElsevierJournal of King Saud University: Computer and Information Sciences1319-15782023-06-01356101563Augmenting a round-trip path test suite to cover all event-pairs for testing more diverse usage scenariosSeonyeol Lee0Hyun-Jae Choi1Heung-Seok Chae2Dept. of Electrical & Computer Engineering, Pusan National University, Busan, South KoreaDept. of Electrical & Computer Engineering, Pusan National University, Busan, South KoreaCorresponding author at: 2, Busandaehak-ro 63beon-gil, Geumjeong-gu, Busan 46241, Republic of Korea.; Dept. of Electrical & Computer Engineering, Pusan National University, Busan, South KoreaAmong State-Based Testing (SBT) strategies, the Round-Trip Path (RTP) strategy is known to generate the most cost-effective state-based test suite. However, some studies have pointed out that an RTP suite is not sufficient because it does not test enough realistic usage scenarios, which could lead to poor fault detection. We believe that the traversal algorithm of the RTP strategy, which omits certain event-pairs, is one of the main factors causing the problem. To address this issue, we propose two methods for augmenting an RTP suite to cover all event-pairs. Through three case studies, we confirmed that the RTP suites did not cover 30%, 56.67%, and 37% of all event-pairs, some of which were critical, such as (remove, add) in an ordered set, (brake, brake) in a cruise control system, and (stop, play) in a video cassette recorder. The augmented suites improved the effectiveness of the RTP suites by testing more usage scenarios that include the event-pairs, albeit at a slightly higher cost. Compared to the All Transition-Pair (ATP) suites, the augmented suites provide a more cost-effective improvement to an RTP suite, requiring a lower cost increase rate. We believe that the augmented suites could be cost-effective alternatives between an RTP suite and an ATP suite.http://www.sciencedirect.com/science/article/pii/S1319157823001179State-Based TestingUML State MachineRound-Trip Path Test SuiteEvent-PairsUsage Scenario Testing |
| spellingShingle | Seonyeol Lee Hyun-Jae Choi Heung-Seok Chae Augmenting a round-trip path test suite to cover all event-pairs for testing more diverse usage scenarios Journal of King Saud University: Computer and Information Sciences State-Based Testing UML State Machine Round-Trip Path Test Suite Event-Pairs Usage Scenario Testing |
| title | Augmenting a round-trip path test suite to cover all event-pairs for testing more diverse usage scenarios |
| title_full | Augmenting a round-trip path test suite to cover all event-pairs for testing more diverse usage scenarios |
| title_fullStr | Augmenting a round-trip path test suite to cover all event-pairs for testing more diverse usage scenarios |
| title_full_unstemmed | Augmenting a round-trip path test suite to cover all event-pairs for testing more diverse usage scenarios |
| title_short | Augmenting a round-trip path test suite to cover all event-pairs for testing more diverse usage scenarios |
| title_sort | augmenting a round trip path test suite to cover all event pairs for testing more diverse usage scenarios |
| topic | State-Based Testing UML State Machine Round-Trip Path Test Suite Event-Pairs Usage Scenario Testing |
| url | http://www.sciencedirect.com/science/article/pii/S1319157823001179 |
| work_keys_str_mv | AT seonyeollee augmentingaroundtrippathtestsuitetocoveralleventpairsfortestingmorediverseusagescenarios AT hyunjaechoi augmentingaroundtrippathtestsuitetocoveralleventpairsfortestingmorediverseusagescenarios AT heungseokchae augmentingaroundtrippathtestsuitetocoveralleventpairsfortestingmorediverseusagescenarios |