AdapTV: A Model-Based Test Adaptation Approach for End-to-End User Interface Testing of Smart TVs
We introduce a model-based feedback-driven test adaptation approach for end-to-end user interface testing of smart TVs. From the perspective of the TV software, the proposed approach is a non-intrusive and completely black-box approach, which operates by interpreting the screen images. Given a test...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10083126/ |
| _version_ | 1797852292275240960 |
|---|---|
| author | Mohammad Yusaf Azimi Celal Cagin Elgun Atil Firat Ferhat Erata Cemal Yilmaz |
| author_facet | Mohammad Yusaf Azimi Celal Cagin Elgun Atil Firat Ferhat Erata Cemal Yilmaz |
| author_sort | Mohammad Yusaf Azimi |
| collection | DOAJ |
| description | We introduce a model-based feedback-driven test adaptation approach for end-to-end user interface testing of smart TVs. From the perspective of the TV software, the proposed approach is a non-intrusive and completely black-box approach, which operates by interpreting the screen images. Given a test suite, which is known to work in an older version of the TV, and a new version of the TV, to which the test suite should be adapted, the proposed approach first automatically discovers user interface models for both the older and the new version of TV by opportunistically crawling the TVs. Then, each test case in the test suite is executed on the old version, and the path traversed by the test case in the respective UI model is found. Finally, a semantically equivalent path in the UI model discovered for the new version of the TV is determined and dynamically executed on the new version in a feedback-driven manner. We empirically evaluate the proposed approach in a setup that closely mimics the industrial setup used by a large consumer electronics company. While the proposed approach successfully adapted all the test cases, the alternative approaches used in the experiments could not adapt any of them. |
| first_indexed | 2024-04-09T19:30:36Z |
| format | Article |
| id | doaj.art-0da33b1ab47d45bba50b087aad020cda |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-04-09T19:30:36Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-0da33b1ab47d45bba50b087aad020cda2023-04-04T23:00:33ZengIEEEIEEE Access2169-35362023-01-0111320953211810.1109/ACCESS.2023.326274610083126AdapTV: A Model-Based Test Adaptation Approach for End-to-End User Interface Testing of Smart TVsMohammad Yusaf Azimi0https://orcid.org/0000-0002-7943-4666Celal Cagin Elgun1Atil Firat2Ferhat Erata3https://orcid.org/0000-0001-6305-4266Cemal Yilmaz4https://orcid.org/0000-0003-4124-2295Faculty of Engineering and Natural Sciences, Sabanci University, Istanbul, TurkeyÇayırova Central R&D Directorate, Arçelik, Istanbul, TurkeyÇayırova Central R&D Directorate, Arçelik, Istanbul, TurkeyDepartment of Computer Science, Yale University, New Haven, CT, USAFaculty of Engineering and Natural Sciences, Sabanci University, Istanbul, TurkeyWe introduce a model-based feedback-driven test adaptation approach for end-to-end user interface testing of smart TVs. From the perspective of the TV software, the proposed approach is a non-intrusive and completely black-box approach, which operates by interpreting the screen images. Given a test suite, which is known to work in an older version of the TV, and a new version of the TV, to which the test suite should be adapted, the proposed approach first automatically discovers user interface models for both the older and the new version of TV by opportunistically crawling the TVs. Then, each test case in the test suite is executed on the old version, and the path traversed by the test case in the respective UI model is found. Finally, a semantically equivalent path in the UI model discovered for the new version of the TV is determined and dynamically executed on the new version in a feedback-driven manner. We empirically evaluate the proposed approach in a setup that closely mimics the industrial setup used by a large consumer electronics company. While the proposed approach successfully adapted all the test cases, the alternative approaches used in the experiments could not adapt any of them.https://ieeexplore.ieee.org/document/10083126/Consumer electronics testingmodel-based testingsmart TV testingtest adaptation |
| spellingShingle | Mohammad Yusaf Azimi Celal Cagin Elgun Atil Firat Ferhat Erata Cemal Yilmaz AdapTV: A Model-Based Test Adaptation Approach for End-to-End User Interface Testing of Smart TVs IEEE Access Consumer electronics testing model-based testing smart TV testing test adaptation |
| title | AdapTV: A Model-Based Test Adaptation Approach for End-to-End User Interface Testing of Smart TVs |
| title_full | AdapTV: A Model-Based Test Adaptation Approach for End-to-End User Interface Testing of Smart TVs |
| title_fullStr | AdapTV: A Model-Based Test Adaptation Approach for End-to-End User Interface Testing of Smart TVs |
| title_full_unstemmed | AdapTV: A Model-Based Test Adaptation Approach for End-to-End User Interface Testing of Smart TVs |
| title_short | AdapTV: A Model-Based Test Adaptation Approach for End-to-End User Interface Testing of Smart TVs |
| title_sort | adaptv a model based test adaptation approach for end to end user interface testing of smart tvs |
| topic | Consumer electronics testing model-based testing smart TV testing test adaptation |
| url | https://ieeexplore.ieee.org/document/10083126/ |
| work_keys_str_mv | AT mohammadyusafazimi adaptvamodelbasedtestadaptationapproachforendtoenduserinterfacetestingofsmarttvs AT celalcaginelgun adaptvamodelbasedtestadaptationapproachforendtoenduserinterfacetestingofsmarttvs AT atilfirat adaptvamodelbasedtestadaptationapproachforendtoenduserinterfacetestingofsmarttvs AT ferhaterata adaptvamodelbasedtestadaptationapproachforendtoenduserinterfacetestingofsmarttvs AT cemalyilmaz adaptvamodelbasedtestadaptationapproachforendtoenduserinterfacetestingofsmarttvs |