Expert review on usefulness of an integrated checklist-based mobile usability evaluation framework
Previous mobile usability studies are only pertinent in the context of ergonomics, physical user interface, and mobility aspects. In addition, much of the previous mobile usability conception was built on desktop computing measurements, such as desktop and web application checklists, or scarcely add...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Bilingual Publishing Group
2023
|
| Online Access: | http://psasir.upm.edu.my/id/eprint/107838/1/64d1b50fb6a4d.pdf |
| _version_ | 1825939530555850752 |
|---|---|
| author | Zulzalil, Hazura Rahmat, Hazwani Abd Ghani, Abdul Azim Kamaruddin, Azrina |
| author_facet | Zulzalil, Hazura Rahmat, Hazwani Abd Ghani, Abdul Azim Kamaruddin, Azrina |
| author_sort | Zulzalil, Hazura |
| collection | UPM |
| description | Previous mobile usability studies are only pertinent in the context of ergonomics, physical user interface, and mobility aspects. In addition, much of the previous mobile usability conception was built on desktop computing measurements, such as desktop and web application checklists, or scarcely addressed the mobile user interface. Moreover, the studies focus mainly on interface features for desktop applications and do not reflect comprehensive mobile interface features such as navigation drawers and spinners. Therefore, conducting usability evaluation using conventional usability measurement would result in irrelevant results. In addition, the resulting works are tailored for usability testing, which requires highly skilled evaluators and usability specialists (e.g., usability testers and user experience designers), who are rarely integrated into a development team. The lack of expertise could lead to unreliable usability evaluations. This paper presents a review from industrial experts on a comprehensive and feasible usability evaluation framework developed in our previous work. The framework is dedicated to smartphone apps, which integrate evaluator skills and design concerns. However, there is no evidence of its usefulness in practice. Therefore, the usefulness of the framework measurement for evaluating apps' usability in the eyes of non-usability specialists is empirically assessed in this paper through an expert review. The expert review involved eleven industrial developers and was complemented by a semi-structured interview. The method is replicated in comparison with a framework from another study. The findings show that the formulated framework significantly outperformed the framework (p = 0.0286) from other studies with large effect sizes (r = 1.81) in terms of usefulness. |
| first_indexed | 2024-12-09T02:19:50Z |
| format | Article |
| id | upm.eprints-107838 |
| institution | Universiti Putra Malaysia |
| language | English |
| last_indexed | 2024-12-09T02:19:50Z |
| publishDate | 2023 |
| publisher | Bilingual Publishing Group |
| record_format | dspace |
| spelling | upm.eprints-1078382024-11-05T06:24:26Z http://psasir.upm.edu.my/id/eprint/107838/ Expert review on usefulness of an integrated checklist-based mobile usability evaluation framework Zulzalil, Hazura Rahmat, Hazwani Abd Ghani, Abdul Azim Kamaruddin, Azrina Previous mobile usability studies are only pertinent in the context of ergonomics, physical user interface, and mobility aspects. In addition, much of the previous mobile usability conception was built on desktop computing measurements, such as desktop and web application checklists, or scarcely addressed the mobile user interface. Moreover, the studies focus mainly on interface features for desktop applications and do not reflect comprehensive mobile interface features such as navigation drawers and spinners. Therefore, conducting usability evaluation using conventional usability measurement would result in irrelevant results. In addition, the resulting works are tailored for usability testing, which requires highly skilled evaluators and usability specialists (e.g., usability testers and user experience designers), who are rarely integrated into a development team. The lack of expertise could lead to unreliable usability evaluations. This paper presents a review from industrial experts on a comprehensive and feasible usability evaluation framework developed in our previous work. The framework is dedicated to smartphone apps, which integrate evaluator skills and design concerns. However, there is no evidence of its usefulness in practice. Therefore, the usefulness of the framework measurement for evaluating apps' usability in the eyes of non-usability specialists is empirically assessed in this paper through an expert review. The expert review involved eleven industrial developers and was complemented by a semi-structured interview. The method is replicated in comparison with a framework from another study. The findings show that the formulated framework significantly outperformed the framework (p = 0.0286) from other studies with large effect sizes (r = 1.81) in terms of usefulness. Bilingual Publishing Group 2023-07-31 Article PeerReviewed text en cc_by_nc_4 http://psasir.upm.edu.my/id/eprint/107838/1/64d1b50fb6a4d.pdf Zulzalil, Hazura and Rahmat, Hazwani and Abd Ghani, Abdul Azim and Kamaruddin, Azrina (2023) Expert review on usefulness of an integrated checklist-based mobile usability evaluation framework. Journal of Computer Science Research, 5 (3). pp. 57-73. ISSN 2630-5151 https://journals.bilpubgroup.com/index.php/jcsr/article/view/5816 10.30564/jcsr.v5i3.5816 |
| spellingShingle | Zulzalil, Hazura Rahmat, Hazwani Abd Ghani, Abdul Azim Kamaruddin, Azrina Expert review on usefulness of an integrated checklist-based mobile usability evaluation framework |
| title | Expert review on usefulness of an integrated checklist-based mobile usability evaluation framework |
| title_full | Expert review on usefulness of an integrated checklist-based mobile usability evaluation framework |
| title_fullStr | Expert review on usefulness of an integrated checklist-based mobile usability evaluation framework |
| title_full_unstemmed | Expert review on usefulness of an integrated checklist-based mobile usability evaluation framework |
| title_short | Expert review on usefulness of an integrated checklist-based mobile usability evaluation framework |
| title_sort | expert review on usefulness of an integrated checklist based mobile usability evaluation framework |
| url | http://psasir.upm.edu.my/id/eprint/107838/1/64d1b50fb6a4d.pdf |
| work_keys_str_mv | AT zulzalilhazura expertreviewonusefulnessofanintegratedchecklistbasedmobileusabilityevaluationframework AT rahmathazwani expertreviewonusefulnessofanintegratedchecklistbasedmobileusabilityevaluationframework AT abdghaniabdulazim expertreviewonusefulnessofanintegratedchecklistbasedmobileusabilityevaluationframework AT kamaruddinazrina expertreviewonusefulnessofanintegratedchecklistbasedmobileusabilityevaluationframework |