ContextDrive: Towards a Functional Scenario-Based Testing Framework for Context-Aware Applications
Context-aware applications are emerging applications in the modern era of computing. These applications can determine and adapt to situational context to provide better user experience. Testing these applications is not straightforward. Constantly changing nature of context makes testing context-awa...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2021-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9444481/ |
| _version_ | 1818643912471871488 |
|---|---|
| author | Aamir Mehmood Mirza Muhammad Naeem Ahmed Khan Raja Asif Wagan Muhammad Bux Laghari Muhammad Ashraf Muhammad Akram Muhammad Bilal |
| author_facet | Aamir Mehmood Mirza Muhammad Naeem Ahmed Khan Raja Asif Wagan Muhammad Bux Laghari Muhammad Ashraf Muhammad Akram Muhammad Bilal |
| author_sort | Aamir Mehmood Mirza |
| collection | DOAJ |
| description | Context-aware applications are emerging applications in the modern era of computing. These applications can determine and adapt to situational context to provide better user experience. Testing these applications is not straightforward. Constantly changing nature of context makes testing context-aware application is a challenging task. To uncover a defect in context-aware application, a test engineer needs activity (sequence of actions) and context information (context data); this makes test case development a difficult task. Conventional test case development methodologies do not cater for context information. Besides, conventional applications have only one input source, but context-aware application must obtain data from many sources to infer the context. Yet another issue that these applications often face is the noisy data problem as input data collected from physical sensors could be noisy. Test adequacy criteria are used as test stoppage rule and define the quality of testing as well as for generating test suites. Test adequacy criteria is helpful to control the cost of testing as well as determining/establishing confidence in the software product quality. A number of test adequacy criteria exist for testing conventional applications, but the same is not true for context-aware applications. Defining test adequacy criteria and test coverage measures for context-aware applications warrants further research. Several techniques have been developed by researchers to generate and execute test cases for context-aware applications; however, end-to-end testing and result analysis of executed test cases still remains a grueling task for the test engineers. The aim of this study is to automate end-to-end functional testing, analysis of the generated test results as well as functional/requirement coverage assessment. Moreover, we also present a confidence assessment template for result analysis. Test engineers can use our proposed framework to assess the requirement coverage. Our proposed framework will reduce testing time, efforts and cost thus enabling test engineers to execute more testing cycles to attain higher degree of test coverage. |
| first_indexed | 2024-12-17T00:06:29Z |
| format | Article |
| id | doaj.art-df6da721bf9148ac9ef6fe4188aab1e2 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-12-17T00:06:29Z |
| publishDate | 2021-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-df6da721bf9148ac9ef6fe4188aab1e22022-12-21T22:10:57ZengIEEEIEEE Access2169-35362021-01-019804788049010.1109/ACCESS.2021.30848879444481ContextDrive: Towards a Functional Scenario-Based Testing Framework for Context-Aware ApplicationsAamir Mehmood Mirza0https://orcid.org/0000-0001-9660-8480Muhammad Naeem Ahmed Khan1Raja Asif Wagan2https://orcid.org/0000-0001-5012-4421Muhammad Bux Laghari3Muhammad Ashraf4https://orcid.org/0000-0001-8721-0921Muhammad Akram5https://orcid.org/0000-0003-1485-9804Muhammad Bilal6https://orcid.org/0000-0002-6156-3291Department of Computer Science, Faculty of Information and Communication Technology, Balochistan University of Information Technology, Engineering and Management Sciences, Quetta, PakistanIndependent Research Scholar, Islamabad, PakistanDepartment of Information Technology, Faculty of Information and Communication Technology, Balochistan University of Information Technology, Engineering and Management Sciences, Quetta, PakistanDepartment of Telecommunication Engineering, Faculty of Information and Communication Technology, Balochistan University of Information Technology, Engineering, and Management Sciences, Quetta, PakistanDepartment of Computer Engineering, Faculty of Information and Communication Technology, Balochistan University of Information Technology, Engineering and Management Sciences, Quetta, PakistanDepartment of Software Engineering, Faculty of Information and Communication Technology, Balochistan University of Information Technology, Engineering and Management Sciences, Quetta, PakistanDepartment of Telecommunication Engineering, Faculty of Information and Communication Technology, MAP Research Group, Balochistan University of Information Technology, Engineering and Management Sciences, Quetta, PakistanContext-aware applications are emerging applications in the modern era of computing. These applications can determine and adapt to situational context to provide better user experience. Testing these applications is not straightforward. Constantly changing nature of context makes testing context-aware application is a challenging task. To uncover a defect in context-aware application, a test engineer needs activity (sequence of actions) and context information (context data); this makes test case development a difficult task. Conventional test case development methodologies do not cater for context information. Besides, conventional applications have only one input source, but context-aware application must obtain data from many sources to infer the context. Yet another issue that these applications often face is the noisy data problem as input data collected from physical sensors could be noisy. Test adequacy criteria are used as test stoppage rule and define the quality of testing as well as for generating test suites. Test adequacy criteria is helpful to control the cost of testing as well as determining/establishing confidence in the software product quality. A number of test adequacy criteria exist for testing conventional applications, but the same is not true for context-aware applications. Defining test adequacy criteria and test coverage measures for context-aware applications warrants further research. Several techniques have been developed by researchers to generate and execute test cases for context-aware applications; however, end-to-end testing and result analysis of executed test cases still remains a grueling task for the test engineers. The aim of this study is to automate end-to-end functional testing, analysis of the generated test results as well as functional/requirement coverage assessment. Moreover, we also present a confidence assessment template for result analysis. Test engineers can use our proposed framework to assess the requirement coverage. Our proposed framework will reduce testing time, efforts and cost thus enabling test engineers to execute more testing cycles to attain higher degree of test coverage.https://ieeexplore.ieee.org/document/9444481/Automatic testingcontext awarenessend-to-end testingmodel based testingscenario-based testingsoftware quality |
| spellingShingle | Aamir Mehmood Mirza Muhammad Naeem Ahmed Khan Raja Asif Wagan Muhammad Bux Laghari Muhammad Ashraf Muhammad Akram Muhammad Bilal ContextDrive: Towards a Functional Scenario-Based Testing Framework for Context-Aware Applications IEEE Access Automatic testing context awareness end-to-end testing model based testing scenario-based testing software quality |
| title | ContextDrive: Towards a Functional Scenario-Based Testing Framework for Context-Aware Applications |
| title_full | ContextDrive: Towards a Functional Scenario-Based Testing Framework for Context-Aware Applications |
| title_fullStr | ContextDrive: Towards a Functional Scenario-Based Testing Framework for Context-Aware Applications |
| title_full_unstemmed | ContextDrive: Towards a Functional Scenario-Based Testing Framework for Context-Aware Applications |
| title_short | ContextDrive: Towards a Functional Scenario-Based Testing Framework for Context-Aware Applications |
| title_sort | contextdrive towards a functional scenario based testing framework for context aware applications |
| topic | Automatic testing context awareness end-to-end testing model based testing scenario-based testing software quality |
| url | https://ieeexplore.ieee.org/document/9444481/ |
| work_keys_str_mv | AT aamirmehmoodmirza contextdrivetowardsafunctionalscenariobasedtestingframeworkforcontextawareapplications AT muhammadnaeemahmedkhan contextdrivetowardsafunctionalscenariobasedtestingframeworkforcontextawareapplications AT rajaasifwagan contextdrivetowardsafunctionalscenariobasedtestingframeworkforcontextawareapplications AT muhammadbuxlaghari contextdrivetowardsafunctionalscenariobasedtestingframeworkforcontextawareapplications AT muhammadashraf contextdrivetowardsafunctionalscenariobasedtestingframeworkforcontextawareapplications AT muhammadakram contextdrivetowardsafunctionalscenariobasedtestingframeworkforcontextawareapplications AT muhammadbilal contextdrivetowardsafunctionalscenariobasedtestingframeworkforcontextawareapplications |