COMPARATIVE ANALYSIS OF AUTOMATION FUNCTIONAL TESTING TOOLS PERFORMANCE FOR PLAYSTORE APPS WITH DIA METHOD
The complexity of smartphone applications presents challenges for developers, who must ensure flawless functionality despite limitations such as budget and time constraints. Manual testing is time-consuming, prompting a shift towards automated testing methods to ensure efficiency and reliability. In...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Community Service Research Center (LPPM) STMIK Nusa Mandiri Jakarta
2024-03-01
|
| Series: | Techno Nusa Mandiri: Journal of Computing and Information Technology |
| Subjects: | |
| Online Access: | https://ejournal.nusamandiri.ac.id/index.php/techno/article/view/5363 |
| _version_ | 1827299524206395392 |
|---|---|
| author | Faizal Riza Berliyanto Berliyanto Aji Nurrohman Rachmat Setiabudi |
| author_facet | Faizal Riza Berliyanto Berliyanto Aji Nurrohman Rachmat Setiabudi |
| author_sort | Faizal Riza |
| collection | DOAJ |
| description | The complexity of smartphone applications presents challenges for developers, who must ensure flawless functionality despite limitations such as budget and time constraints. Manual testing is time-consuming, prompting a shift towards automated testing methods to ensure efficiency and reliability. In this context, researchers are evaluating the efficacy of three leading test automation frameworks—Robot Framework, Katalon Studio, and UI Path—against key performance parameters. Using the Distance to the Ideal Alternative (DIA) method on playstore apps. The main performance parameters used as a reference are automated testing progress and tools usability. Katalon Studio emerges as the top performer, securing the top rank with a remarkably close to the alternative ideal positive distance (Ri) value of 0.00001. UI Path occupies the second position with a Ri value of 0.00135, while Robot Framework trails behind with a Ri value of 0.00295. This research contributes to the understanding of the performance of different automation frameworks in the context of functional testing, providing valuable insights for developers and organizations seeking to optimize their testing processes. The findings underscore the significance of Katalon Studio's exceptional performance and highlight opportunities for improvement in UI Path and Robot Framework. Additionally, implementing a robust monitoring and evaluation framework is crucial for tracking the ongoing performance and optimizing the efficiency of these automation frameworks. |
| first_indexed | 2024-04-24T15:35:14Z |
| format | Article |
| id | doaj.art-63ea6e93184c49b18bb29224d23870f3 |
| institution | Directory Open Access Journal |
| issn | 1978-2136 2527-676X |
| language | English |
| last_indexed | 2024-04-24T15:35:14Z |
| publishDate | 2024-03-01 |
| publisher | Community Service Research Center (LPPM) STMIK Nusa Mandiri Jakarta |
| record_format | Article |
| series | Techno Nusa Mandiri: Journal of Computing and Information Technology |
| spelling | doaj.art-63ea6e93184c49b18bb29224d23870f32024-04-02T02:20:55ZengCommunity Service Research Center (LPPM) STMIK Nusa Mandiri JakartaTechno Nusa Mandiri: Journal of Computing and Information Technology1978-21362527-676X2024-03-0121191410.33480/techno.v21i1.53635363COMPARATIVE ANALYSIS OF AUTOMATION FUNCTIONAL TESTING TOOLS PERFORMANCE FOR PLAYSTORE APPS WITH DIA METHODFaizal Riza0Berliyanto Berliyanto1Aji Nurrohman2Rachmat Setiabudi3Institut Teknologi Budi UtomoInstitut Teknologi Budi UtomoInstitut Teknologi Budi UtomoInstitut Teknologi Budi UtomoThe complexity of smartphone applications presents challenges for developers, who must ensure flawless functionality despite limitations such as budget and time constraints. Manual testing is time-consuming, prompting a shift towards automated testing methods to ensure efficiency and reliability. In this context, researchers are evaluating the efficacy of three leading test automation frameworks—Robot Framework, Katalon Studio, and UI Path—against key performance parameters. Using the Distance to the Ideal Alternative (DIA) method on playstore apps. The main performance parameters used as a reference are automated testing progress and tools usability. Katalon Studio emerges as the top performer, securing the top rank with a remarkably close to the alternative ideal positive distance (Ri) value of 0.00001. UI Path occupies the second position with a Ri value of 0.00135, while Robot Framework trails behind with a Ri value of 0.00295. This research contributes to the understanding of the performance of different automation frameworks in the context of functional testing, providing valuable insights for developers and organizations seeking to optimize their testing processes. The findings underscore the significance of Katalon Studio's exceptional performance and highlight opportunities for improvement in UI Path and Robot Framework. Additionally, implementing a robust monitoring and evaluation framework is crucial for tracking the ongoing performance and optimizing the efficiency of these automation frameworks.https://ejournal.nusamandiri.ac.id/index.php/techno/article/view/5363automationdia methodplaystoretesting |
| spellingShingle | Faizal Riza Berliyanto Berliyanto Aji Nurrohman Rachmat Setiabudi COMPARATIVE ANALYSIS OF AUTOMATION FUNCTIONAL TESTING TOOLS PERFORMANCE FOR PLAYSTORE APPS WITH DIA METHOD Techno Nusa Mandiri: Journal of Computing and Information Technology automation dia method playstore testing |
| title | COMPARATIVE ANALYSIS OF AUTOMATION FUNCTIONAL TESTING TOOLS PERFORMANCE FOR PLAYSTORE APPS WITH DIA METHOD |
| title_full | COMPARATIVE ANALYSIS OF AUTOMATION FUNCTIONAL TESTING TOOLS PERFORMANCE FOR PLAYSTORE APPS WITH DIA METHOD |
| title_fullStr | COMPARATIVE ANALYSIS OF AUTOMATION FUNCTIONAL TESTING TOOLS PERFORMANCE FOR PLAYSTORE APPS WITH DIA METHOD |
| title_full_unstemmed | COMPARATIVE ANALYSIS OF AUTOMATION FUNCTIONAL TESTING TOOLS PERFORMANCE FOR PLAYSTORE APPS WITH DIA METHOD |
| title_short | COMPARATIVE ANALYSIS OF AUTOMATION FUNCTIONAL TESTING TOOLS PERFORMANCE FOR PLAYSTORE APPS WITH DIA METHOD |
| title_sort | comparative analysis of automation functional testing tools performance for playstore apps with dia method |
| topic | automation dia method playstore testing |
| url | https://ejournal.nusamandiri.ac.id/index.php/techno/article/view/5363 |
| work_keys_str_mv | AT faizalriza comparativeanalysisofautomationfunctionaltestingtoolsperformanceforplaystoreappswithdiamethod AT berliyantoberliyanto comparativeanalysisofautomationfunctionaltestingtoolsperformanceforplaystoreappswithdiamethod AT ajinurrohman comparativeanalysisofautomationfunctionaltestingtoolsperformanceforplaystoreappswithdiamethod AT rachmatsetiabudi comparativeanalysisofautomationfunctionaltestingtoolsperformanceforplaystoreappswithdiamethod |