Advancing Sociotechnical-Pedagogical Heuristics for the Usability Evaluation of Online Courses for Adult Learners

Online courses often include interface designs that do not support a positive learner experience. Literature shows a variety of heuristics to detect issues of online courses. While heuristic-based inspection of usability is a dominant method for evaluating digital systems, these methods cannot be e...

Full description

Bibliographic Details
Main Authors: Isa Jahnke, Nathan Riedel, Kanupriya Singh, Joi Moore
Format: Article
Language:English
Published: Online Learning Consortium 2021-12-01
Series:Online Learning
Subjects:
Online Access:https://olj.onlinelearningconsortium.org/index.php/olj/article/view/2439
_version_ 1797326987076829184
author Isa Jahnke
Nathan Riedel
Kanupriya Singh
Joi Moore
author_facet Isa Jahnke
Nathan Riedel
Kanupriya Singh
Joi Moore
author_sort Isa Jahnke
collection DOAJ
description Online courses often include interface designs that do not support a positive learner experience. Literature shows a variety of heuristics to detect issues of online courses. While heuristic-based inspection of usability is a dominant method for evaluating digital systems, these methods cannot be easily transferred to online courses. To close this gap, we identified an initial set of social, technical, and pedagogical related items (STP) heuristics based on literature. Next, we analyzed this set using empirical data from two online courses. In total, we analyzed 195 problems with the goal to substantiate a final set of 14 STP heuristics. This new set allows for efficiently evaluating online courses by supporting evaluators and instructional designers in uncovering the most crucial issues and improving the learner experience. Finally, based on this work, we discuss a definition of learner experience for the emerging field of learner experience design and research.  
first_indexed 2024-03-08T06:32:03Z
format Article
id doaj.art-25ae24628b314a9a900de08ce0ce8923
institution Directory Open Access Journal
issn 2472-5749
2472-5730
language English
last_indexed 2024-03-08T06:32:03Z
publishDate 2021-12-01
publisher Online Learning Consortium
record_format Article
series Online Learning
spelling doaj.art-25ae24628b314a9a900de08ce0ce89232024-02-03T11:10:03ZengOnline Learning ConsortiumOnline Learning2472-57492472-57302021-12-0125410.24059/olj.v25i4.2439Advancing Sociotechnical-Pedagogical Heuristics for the Usability Evaluation of Online Courses for Adult LearnersIsa Jahnke0Nathan Riedel1Kanupriya Singh2Joi Moore3University of Missouri-ColumbiaUniversity of Missouri-ColumbiaUniversity of Missouri-ColumbiaUniversity of Missouri-Columbia Online courses often include interface designs that do not support a positive learner experience. Literature shows a variety of heuristics to detect issues of online courses. While heuristic-based inspection of usability is a dominant method for evaluating digital systems, these methods cannot be easily transferred to online courses. To close this gap, we identified an initial set of social, technical, and pedagogical related items (STP) heuristics based on literature. Next, we analyzed this set using empirical data from two online courses. In total, we analyzed 195 problems with the goal to substantiate a final set of 14 STP heuristics. This new set allows for efficiently evaluating online courses by supporting evaluators and instructional designers in uncovering the most crucial issues and improving the learner experience. Finally, based on this work, we discuss a definition of learner experience for the emerging field of learner experience design and research.   https://olj.onlinelearningconsortium.org/index.php/olj/article/view/2439Online CoursesEvaluationHeuristicsUsabilityOnline LearningAdults
spellingShingle Isa Jahnke
Nathan Riedel
Kanupriya Singh
Joi Moore
Advancing Sociotechnical-Pedagogical Heuristics for the Usability Evaluation of Online Courses for Adult Learners
Online Learning
Online Courses
Evaluation
Heuristics
Usability
Online Learning
Adults
title Advancing Sociotechnical-Pedagogical Heuristics for the Usability Evaluation of Online Courses for Adult Learners
title_full Advancing Sociotechnical-Pedagogical Heuristics for the Usability Evaluation of Online Courses for Adult Learners
title_fullStr Advancing Sociotechnical-Pedagogical Heuristics for the Usability Evaluation of Online Courses for Adult Learners
title_full_unstemmed Advancing Sociotechnical-Pedagogical Heuristics for the Usability Evaluation of Online Courses for Adult Learners
title_short Advancing Sociotechnical-Pedagogical Heuristics for the Usability Evaluation of Online Courses for Adult Learners
title_sort advancing sociotechnical pedagogical heuristics for the usability evaluation of online courses for adult learners
topic Online Courses
Evaluation
Heuristics
Usability
Online Learning
Adults
url https://olj.onlinelearningconsortium.org/index.php/olj/article/view/2439
work_keys_str_mv AT isajahnke advancingsociotechnicalpedagogicalheuristicsfortheusabilityevaluationofonlinecoursesforadultlearners
AT nathanriedel advancingsociotechnicalpedagogicalheuristicsfortheusabilityevaluationofonlinecoursesforadultlearners
AT kanupriyasingh advancingsociotechnicalpedagogicalheuristicsfortheusabilityevaluationofonlinecoursesforadultlearners
AT joimoore advancingsociotechnicalpedagogicalheuristicsfortheusabilityevaluationofonlinecoursesforadultlearners