Assisting students' writing with computer-based concept map feedback: A validation study of the CohViz feedback system.
CohViz is a feedback system that provides students with concept maps as feedback on the cohesion of their writing. Although previous studies demonstrated the effectiveness of CohViz, the accuracy of CohViz remains unclear. Thus, we conducted two comprehensive validation studies to assess the accurac...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2020-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://doi.org/10.1371/journal.pone.0235209 |
| _version_ | 1831770705513938944 |
|---|---|
| author | Christian Burkhart Andreas Lachner Matthias Nückles |
| author_facet | Christian Burkhart Andreas Lachner Matthias Nückles |
| author_sort | Christian Burkhart |
| collection | DOAJ |
| description | CohViz is a feedback system that provides students with concept maps as feedback on the cohesion of their writing. Although previous studies demonstrated the effectiveness of CohViz, the accuracy of CohViz remains unclear. Thus, we conducted two comprehensive validation studies to assess the accuracy of CohViz in terms of its reliability and validity. In a reliability study, we compared the concept maps generated by CohViz with concept maps generated by four human expert raters based on a text corpus comprising students' explanatory texts (N = 100). Regarding the depiction of cohesion gaps, we obtained high accordance between the CohViz concept maps and the concept maps generated by the human expert raters. However, CohViz tended to overestimate the number of relations within the concept maps. In a validity study, we examined the validity of CohViz and compared central features of the CohViz concept maps with convergent linguistic features and divergent linguistic features based on a Wikipedia text corpus (N = 1020). We found medium to high agreement with the convergent cohesion features and low agreement with the divergent features. Together, these findings suggest that CohViz can be regarded as an accurate feedback system to provide feedback on the cohesion of students' writing. |
| first_indexed | 2024-12-22T07:45:17Z |
| format | Article |
| id | doaj.art-956789725685434ab691fe5ad7ea98ce |
| institution | Directory Open Access Journal |
| issn | 1932-6203 |
| language | English |
| last_indexed | 2024-12-22T07:45:17Z |
| publishDate | 2020-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj.art-956789725685434ab691fe5ad7ea98ce2022-12-21T18:33:39ZengPublic Library of Science (PLoS)PLoS ONE1932-62032020-01-01156e023520910.1371/journal.pone.0235209Assisting students' writing with computer-based concept map feedback: A validation study of the CohViz feedback system.Christian BurkhartAndreas LachnerMatthias NücklesCohViz is a feedback system that provides students with concept maps as feedback on the cohesion of their writing. Although previous studies demonstrated the effectiveness of CohViz, the accuracy of CohViz remains unclear. Thus, we conducted two comprehensive validation studies to assess the accuracy of CohViz in terms of its reliability and validity. In a reliability study, we compared the concept maps generated by CohViz with concept maps generated by four human expert raters based on a text corpus comprising students' explanatory texts (N = 100). Regarding the depiction of cohesion gaps, we obtained high accordance between the CohViz concept maps and the concept maps generated by the human expert raters. However, CohViz tended to overestimate the number of relations within the concept maps. In a validity study, we examined the validity of CohViz and compared central features of the CohViz concept maps with convergent linguistic features and divergent linguistic features based on a Wikipedia text corpus (N = 1020). We found medium to high agreement with the convergent cohesion features and low agreement with the divergent features. Together, these findings suggest that CohViz can be regarded as an accurate feedback system to provide feedback on the cohesion of students' writing.https://doi.org/10.1371/journal.pone.0235209 |
| spellingShingle | Christian Burkhart Andreas Lachner Matthias Nückles Assisting students' writing with computer-based concept map feedback: A validation study of the CohViz feedback system. PLoS ONE |
| title | Assisting students' writing with computer-based concept map feedback: A validation study of the CohViz feedback system. |
| title_full | Assisting students' writing with computer-based concept map feedback: A validation study of the CohViz feedback system. |
| title_fullStr | Assisting students' writing with computer-based concept map feedback: A validation study of the CohViz feedback system. |
| title_full_unstemmed | Assisting students' writing with computer-based concept map feedback: A validation study of the CohViz feedback system. |
| title_short | Assisting students' writing with computer-based concept map feedback: A validation study of the CohViz feedback system. |
| title_sort | assisting students writing with computer based concept map feedback a validation study of the cohviz feedback system |
| url | https://doi.org/10.1371/journal.pone.0235209 |
| work_keys_str_mv | AT christianburkhart assistingstudentswritingwithcomputerbasedconceptmapfeedbackavalidationstudyofthecohvizfeedbacksystem AT andreaslachner assistingstudentswritingwithcomputerbasedconceptmapfeedbackavalidationstudyofthecohvizfeedbacksystem AT matthiasnuckles assistingstudentswritingwithcomputerbasedconceptmapfeedbackavalidationstudyofthecohvizfeedbacksystem |