Evaluation of cognitive load and scoring procedures of concept map-based tests
Using concept map-based tests as assessment tools is one of the new assessment methods that can be an alternative for traditional assessment methods. So, the goal of the present study was evaluating cognitive load and scoring procedures of these tests. The research sample consisted of students of fo...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | fas |
| Published: |
Organization for educational research and planning
2020-12-01
|
| Series: | فصلنامه نوآوریهای آموزشی |
| Subjects: | |
| Online Access: | https://noavaryedu.oerp.ir/article_121550_e7628f7553f4ab6b45dbc4a9378958f3.pdf |
| _version_ | 1797689691293614080 |
|---|---|
| author | Sādegh Sayyādi Javād Mesrābādi Abolfazl Farid Rāmin Habibi Kaleibar |
| author_facet | Sādegh Sayyādi Javād Mesrābādi Abolfazl Farid Rāmin Habibi Kaleibar |
| author_sort | Sādegh Sayyādi |
| collection | DOAJ |
| description | Using concept map-based tests as assessment tools is one of the new assessment methods that can be an alternative for traditional assessment methods. So, the goal of the present study was evaluating cognitive load and scoring procedures of these tests. The research sample consisted of students of four biology classrooms from four different high schools (totally 109 students) who were selected via a multi-stage cluster sampling method. The research tools were a multiple-choice test (researcher-made), four concept map-based tests (researcher-made) and the NASA-TLX scale (Hart & Staveland, 1988). The study was done with some type of evaluation design. The statistical methods included Pearson's correlation coefficient, independent samples t-test and one-way ANOVA (Welch test and Games-Howell post hoc). Findings showed that construct-a-map tests imposed significantly more cognitive load on the subjects than fill-in-a-map tests. Also, relational, structural and similarity to expert map scoring procedures had acceptable and significant criterion validity, discriminant validity and reliability. All in all, relational, structural and similarity scoring procedures can be used appropriately for scoring the concept map-based tests. Also, using the fill-in-a-map tests can be an appropriate strategy to overcome the cognitive overload during the concept map-based tests. Thus, the results of the present research can be useful to design tests based on the cognitive rules and to bridge the gap between academic evaluation and cognitive sciences. |
| first_indexed | 2024-03-12T01:50:13Z |
| format | Article |
| id | doaj.art-49d917ac2202431c9700097069ddd1d6 |
| institution | Directory Open Access Journal |
| issn | 1735-1235 |
| language | fas |
| last_indexed | 2024-03-12T01:50:13Z |
| publishDate | 2020-12-01 |
| publisher | Organization for educational research and planning |
| record_format | Article |
| series | فصلنامه نوآوریهای آموزشی |
| spelling | doaj.art-49d917ac2202431c9700097069ddd1d62023-09-08T13:44:39ZfasOrganization for educational research and planningفصلنامه نوآوریهای آموزشی1735-12352020-12-011948511210.22034/jei.2020.121550121550Evaluation of cognitive load and scoring procedures of concept map-based testsSādegh Sayyādi0Javād Mesrābādi1Abolfazl Farid2Rāmin Habibi Kaleibar3PhD Candidate in Educational Psychology at Āzarbāijān Shahid Madani University(PhD), Āzarbāijān Shahid Madani University(PhD), Āzarbāijān Shahid Madani University(PhD), Āzarbāijān Shahid Madani UniversityUsing concept map-based tests as assessment tools is one of the new assessment methods that can be an alternative for traditional assessment methods. So, the goal of the present study was evaluating cognitive load and scoring procedures of these tests. The research sample consisted of students of four biology classrooms from four different high schools (totally 109 students) who were selected via a multi-stage cluster sampling method. The research tools were a multiple-choice test (researcher-made), four concept map-based tests (researcher-made) and the NASA-TLX scale (Hart & Staveland, 1988). The study was done with some type of evaluation design. The statistical methods included Pearson's correlation coefficient, independent samples t-test and one-way ANOVA (Welch test and Games-Howell post hoc). Findings showed that construct-a-map tests imposed significantly more cognitive load on the subjects than fill-in-a-map tests. Also, relational, structural and similarity to expert map scoring procedures had acceptable and significant criterion validity, discriminant validity and reliability. All in all, relational, structural and similarity scoring procedures can be used appropriately for scoring the concept map-based tests. Also, using the fill-in-a-map tests can be an appropriate strategy to overcome the cognitive overload during the concept map-based tests. Thus, the results of the present research can be useful to design tests based on the cognitive rules and to bridge the gap between academic evaluation and cognitive sciences.https://noavaryedu.oerp.ir/article_121550_e7628f7553f4ab6b45dbc4a9378958f3.pdfcognitive loadscoring proceduresconcept map- based tests |
| spellingShingle | Sādegh Sayyādi Javād Mesrābādi Abolfazl Farid Rāmin Habibi Kaleibar Evaluation of cognitive load and scoring procedures of concept map-based tests فصلنامه نوآوریهای آموزشی cognitive load scoring procedures concept map- based tests |
| title | Evaluation of cognitive load and scoring procedures of concept map-based tests |
| title_full | Evaluation of cognitive load and scoring procedures of concept map-based tests |
| title_fullStr | Evaluation of cognitive load and scoring procedures of concept map-based tests |
| title_full_unstemmed | Evaluation of cognitive load and scoring procedures of concept map-based tests |
| title_short | Evaluation of cognitive load and scoring procedures of concept map-based tests |
| title_sort | evaluation of cognitive load and scoring procedures of concept map based tests |
| topic | cognitive load scoring procedures concept map- based tests |
| url | https://noavaryedu.oerp.ir/article_121550_e7628f7553f4ab6b45dbc4a9378958f3.pdf |
| work_keys_str_mv | AT sadeghsayyadi evaluationofcognitiveloadandscoringproceduresofconceptmapbasedtests AT javadmesrabadi evaluationofcognitiveloadandscoringproceduresofconceptmapbasedtests AT abolfazlfarid evaluationofcognitiveloadandscoringproceduresofconceptmapbasedtests AT raminhabibikaleibar evaluationofcognitiveloadandscoringproceduresofconceptmapbasedtests |