THE METHOD (AND MADNESS) OF EVALUATING ONLINE DISCUSSIONS
In addressing how to evaluate online discussions, this paper will describe several concepts, tools, or frameworks that have been used in evaluations and discuss differences in approach based on instructor purpose, be it research, assessment, or learning. Then several common problems are described,...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Online Learning Consortium
2019-03-01
|
| Series: | Online Learning |
| Subjects: | |
| Online Access: | https://olj.onlinelearningconsortium.org/index.php/olj/article/view/1746 |
| _version_ | 1797328054135029760 |
|---|---|
| author | Katrina A. Meyer |
| author_facet | Katrina A. Meyer |
| author_sort | Katrina A. Meyer |
| collection | DOAJ |
| description |
In addressing how to evaluate online discussions, this paper will describe several concepts, tools, or frameworks that have been used in evaluations and discuss differences in approach based on instructor purpose, be it research, assessment, or learning. Then several common problems are described, including use of content analysis, identification of latent content, inadequate training of coders, lack of reliability, and choosing the correct unit of analysis. Two examples are provided of coding decisions made on portions of student discussions; these examples use two different frameworks to elucidate the process and its difficulties. Conclusions focus on the importance of following standard good research or assessment practice and preparing for a time-consuming and often frustrating coding process.
|
| first_indexed | 2024-03-08T06:46:21Z |
| format | Article |
| id | doaj.art-95d850d317bb48d286e09b9825a2e97c |
| institution | Directory Open Access Journal |
| issn | 2472-5749 2472-5730 |
| language | English |
| last_indexed | 2024-03-08T06:46:21Z |
| publishDate | 2019-03-01 |
| publisher | Online Learning Consortium |
| record_format | Article |
| series | Online Learning |
| spelling | doaj.art-95d850d317bb48d286e09b9825a2e97c2024-02-03T07:58:26ZengOnline Learning ConsortiumOnline Learning2472-57492472-57302019-03-0110410.24059/olj.v10i4.1746THE METHOD (AND MADNESS) OF EVALUATING ONLINE DISCUSSIONSKatrina A. Meyer In addressing how to evaluate online discussions, this paper will describe several concepts, tools, or frameworks that have been used in evaluations and discuss differences in approach based on instructor purpose, be it research, assessment, or learning. Then several common problems are described, including use of content analysis, identification of latent content, inadequate training of coders, lack of reliability, and choosing the correct unit of analysis. Two examples are provided of coding decisions made on portions of student discussions; these examples use two different frameworks to elucidate the process and its difficulties. Conclusions focus on the importance of following standard good research or assessment practice and preparing for a time-consuming and often frustrating coding process. https://olj.onlinelearningconsortium.org/index.php/olj/article/view/1746Online LearningEvaluation of Online DiscussionsMethodology |
| spellingShingle | Katrina A. Meyer THE METHOD (AND MADNESS) OF EVALUATING ONLINE DISCUSSIONS Online Learning Online Learning Evaluation of Online Discussions Methodology |
| title | THE METHOD (AND MADNESS) OF EVALUATING ONLINE DISCUSSIONS |
| title_full | THE METHOD (AND MADNESS) OF EVALUATING ONLINE DISCUSSIONS |
| title_fullStr | THE METHOD (AND MADNESS) OF EVALUATING ONLINE DISCUSSIONS |
| title_full_unstemmed | THE METHOD (AND MADNESS) OF EVALUATING ONLINE DISCUSSIONS |
| title_short | THE METHOD (AND MADNESS) OF EVALUATING ONLINE DISCUSSIONS |
| title_sort | method and madness of evaluating online discussions |
| topic | Online Learning Evaluation of Online Discussions Methodology |
| url | https://olj.onlinelearningconsortium.org/index.php/olj/article/view/1746 |
| work_keys_str_mv | AT katrinaameyer themethodandmadnessofevaluatingonlinediscussions AT katrinaameyer methodandmadnessofevaluatingonlinediscussions |