Model-Based Ideal Testing of GUI Programs–Approach and Case Studies
Traditionally, software testing is aimed at showing the presence of faults. This paper proposes a novel approach to testing graphical user interfaces (GUI) for showing both the presence and absence of faults in the sense of ideal testing. The approach uses a positive testing concept to show that the...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2021-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9422704/ |
| _version_ | 1818949882376880128 |
|---|---|
| author | Onur Kilincceker Alper Silistre Fevzi Belli Moharram Challenger |
| author_facet | Onur Kilincceker Alper Silistre Fevzi Belli Moharram Challenger |
| author_sort | Onur Kilincceker |
| collection | DOAJ |
| description | Traditionally, software testing is aimed at showing the presence of faults. This paper proposes a novel approach to testing graphical user interfaces (GUI) for showing both the presence and absence of faults in the sense of ideal testing. The approach uses a positive testing concept to show that the GUI under consideration (GUC) does what the user expects; to the contrary, the negative testing concept shows that the GUC does not do anything that the user does not expect, building a holistic view. The first step of the approach models the GUC by a finite state machine (FSM) that enables the model-based generation of test cases. This is always possible as the GUIs are considered as strictly sequential processes. The next step converts the FSM to an equivalent regular expression (RE) that will be analyzed first to construct test selection criteria for excluding redundant test cases and construct test coverage criteria for terminating the positive test process. Both criteria enable us to assess the adequacy and efficiency of the positive tests performed. The negative tests will be realized by systematically mutating the FSM to model faults, the absence of which are to be shown. Those mutant FSMs will be handled and assessed in the same way as in positive testing. Two case studies illustrate and validate the approach; the experiments’ results will be analyzed to discuss the pros and cons of the techniques introduced. |
| first_indexed | 2024-12-20T09:09:45Z |
| format | Article |
| id | doaj.art-bf53b07f3aba42448cd597d61ba6ffe2 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-12-20T09:09:45Z |
| publishDate | 2021-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-bf53b07f3aba42448cd597d61ba6ffe22022-12-21T19:45:37ZengIEEEIEEE Access2169-35362021-01-019689666898410.1109/ACCESS.2021.30775189422704Model-Based Ideal Testing of GUI Programs–Approach and Case StudiesOnur Kilincceker0https://orcid.org/0000-0001-5996-4398Alper Silistre1https://orcid.org/0000-0002-2255-1036Fevzi Belli2https://orcid.org/0000-0002-8421-3497Moharram Challenger3https://orcid.org/0000-0002-5436-6070Department of Computer Science, Electrical Engineering and Mathematics, Paderborn University, Paderborn, GermanyInternational Computer Institute, Ege University, İzmir, TurkeyDepartment of Computer Science, Electrical Engineering and Mathematics, Paderborn University, Paderborn, GermanyDepartment of Computer Science, University of Antwerp and Flanders Make, Antwerp, BelgiumTraditionally, software testing is aimed at showing the presence of faults. This paper proposes a novel approach to testing graphical user interfaces (GUI) for showing both the presence and absence of faults in the sense of ideal testing. The approach uses a positive testing concept to show that the GUI under consideration (GUC) does what the user expects; to the contrary, the negative testing concept shows that the GUC does not do anything that the user does not expect, building a holistic view. The first step of the approach models the GUC by a finite state machine (FSM) that enables the model-based generation of test cases. This is always possible as the GUIs are considered as strictly sequential processes. The next step converts the FSM to an equivalent regular expression (RE) that will be analyzed first to construct test selection criteria for excluding redundant test cases and construct test coverage criteria for terminating the positive test process. Both criteria enable us to assess the adequacy and efficiency of the positive tests performed. The negative tests will be realized by systematically mutating the FSM to model faults, the absence of which are to be shown. Those mutant FSMs will be handled and assessed in the same way as in positive testing. Two case studies illustrate and validate the approach; the experiments’ results will be analyzed to discuss the pros and cons of the techniques introduced.https://ieeexplore.ieee.org/document/9422704/GUI testingholistic testingideal testingmodel-based testingmutation testingtest generation |
| spellingShingle | Onur Kilincceker Alper Silistre Fevzi Belli Moharram Challenger Model-Based Ideal Testing of GUI Programs–Approach and Case Studies IEEE Access GUI testing holistic testing ideal testing model-based testing mutation testing test generation |
| title | Model-Based Ideal Testing of GUI Programs–Approach and Case Studies |
| title_full | Model-Based Ideal Testing of GUI Programs–Approach and Case Studies |
| title_fullStr | Model-Based Ideal Testing of GUI Programs–Approach and Case Studies |
| title_full_unstemmed | Model-Based Ideal Testing of GUI Programs–Approach and Case Studies |
| title_short | Model-Based Ideal Testing of GUI Programs–Approach and Case Studies |
| title_sort | model based ideal testing of gui programs x2013 approach and case studies |
| topic | GUI testing holistic testing ideal testing model-based testing mutation testing test generation |
| url | https://ieeexplore.ieee.org/document/9422704/ |
| work_keys_str_mv | AT onurkilincceker modelbasedidealtestingofguiprogramsx2013approachandcasestudies AT alpersilistre modelbasedidealtestingofguiprogramsx2013approachandcasestudies AT fevzibelli modelbasedidealtestingofguiprogramsx2013approachandcasestudies AT moharramchallenger modelbasedidealtestingofguiprogramsx2013approachandcasestudies |