A guideline-based approach to support the assessment of students’ ability to apply object-oriented concepts in source code
There are many approaches in assessing students’ ability in object-oriented (OO) programming, but little is known on how to assess their ability in applying OO fundamental concepts in their written source codes. One major problem with programming assessment relates to variation in marks given by dif...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English English |
| Published: |
UTM Press
2015
|
| Subjects: | |
| Online Access: | https://eprints.ums.edu.my/id/eprint/18642/1/ABSTRACT.pdf https://eprints.ums.edu.my/id/eprint/18642/2/FULL%20TEXT.pdf |
| _version_ | 1796909721886654464 |
|---|---|
| author | Norazlina Khamis Norhayati Daut |
| author_facet | Norazlina Khamis Norhayati Daut |
| author_sort | Norazlina Khamis |
| collection | UMS |
| description | There are many approaches in assessing students’ ability in object-oriented (OO) programming, but little is known on how to assess their ability in applying OO fundamental concepts in their written source codes. One major problem with programming assessment relates to variation in marks given by different assessors. Often, the grades given also does not gauge whether students know how to apply OO approaches. Thus, a new assessment approach is needed to fill these gap. The objective of this study is to construct and validate through expert consensus, a set of evaluation criteria for fundamental OO concepts together with the guidelines called GuideSCoRE, to help instructors assess students’ ability in applying OO concepts in their program source code. The evaluation criteria are derived from fundamental OO concepts found in Malaysian OO programming syllabuses and validated by a three-round Delphi approach. The proposed evaluation criteria were mapped with related OO design heuristics and OO design principles. A guideline (GuideSCoRE), constructed based on the Goal-Questions-Metrics approach together with the evaluation criteria is used by instructors when assessing students’ source codes. An inter-rater reliability analysis among six instructors found moderate agreement on assessment scores (κ values of mainly between 0.421 and 0.575) indicating that whilst the guidelines do not completely eliminate variations between raters, it help reduce their occurrences. |
| first_indexed | 2024-03-06T02:53:48Z |
| format | Article |
| id | ums.eprints-18642 |
| institution | Universiti Malaysia Sabah |
| language | English English |
| last_indexed | 2024-03-06T02:53:48Z |
| publishDate | 2015 |
| publisher | UTM Press |
| record_format | dspace |
| spelling | ums.eprints-186422024-01-31T07:02:00Z https://eprints.ums.edu.my/id/eprint/18642/ A guideline-based approach to support the assessment of students’ ability to apply object-oriented concepts in source code Norazlina Khamis Norhayati Daut QA Mathematics QA75.5-76.95 Electronic computers. Computer science There are many approaches in assessing students’ ability in object-oriented (OO) programming, but little is known on how to assess their ability in applying OO fundamental concepts in their written source codes. One major problem with programming assessment relates to variation in marks given by different assessors. Often, the grades given also does not gauge whether students know how to apply OO approaches. Thus, a new assessment approach is needed to fill these gap. The objective of this study is to construct and validate through expert consensus, a set of evaluation criteria for fundamental OO concepts together with the guidelines called GuideSCoRE, to help instructors assess students’ ability in applying OO concepts in their program source code. The evaluation criteria are derived from fundamental OO concepts found in Malaysian OO programming syllabuses and validated by a three-round Delphi approach. The proposed evaluation criteria were mapped with related OO design heuristics and OO design principles. A guideline (GuideSCoRE), constructed based on the Goal-Questions-Metrics approach together with the evaluation criteria is used by instructors when assessing students’ source codes. An inter-rater reliability analysis among six instructors found moderate agreement on assessment scores (κ values of mainly between 0.421 and 0.575) indicating that whilst the guidelines do not completely eliminate variations between raters, it help reduce their occurrences. UTM Press 2015 Article PeerReviewed text en https://eprints.ums.edu.my/id/eprint/18642/1/ABSTRACT.pdf text en https://eprints.ums.edu.my/id/eprint/18642/2/FULL%20TEXT.pdf Norazlina Khamis and Norhayati Daut (2015) A guideline-based approach to support the assessment of students’ ability to apply object-oriented concepts in source code. Jurnal Teknologi, 78 (2). pp. 1-8. ISSN 2180-3722 http://www.jurnalteknologi.utm.my/index.php/jurnalteknologi/article/view/4919 https://doi.org/10.11113/jt.v78.4919 |
| spellingShingle | QA Mathematics QA75.5-76.95 Electronic computers. Computer science Norazlina Khamis Norhayati Daut A guideline-based approach to support the assessment of students’ ability to apply object-oriented concepts in source code |
| title | A guideline-based approach to support the assessment of students’ ability to apply object-oriented concepts in source code |
| title_full | A guideline-based approach to support the assessment of students’ ability to apply object-oriented concepts in source code |
| title_fullStr | A guideline-based approach to support the assessment of students’ ability to apply object-oriented concepts in source code |
| title_full_unstemmed | A guideline-based approach to support the assessment of students’ ability to apply object-oriented concepts in source code |
| title_short | A guideline-based approach to support the assessment of students’ ability to apply object-oriented concepts in source code |
| title_sort | guideline based approach to support the assessment of students ability to apply object oriented concepts in source code |
| topic | QA Mathematics QA75.5-76.95 Electronic computers. Computer science |
| url | https://eprints.ums.edu.my/id/eprint/18642/1/ABSTRACT.pdf https://eprints.ums.edu.my/id/eprint/18642/2/FULL%20TEXT.pdf |
| work_keys_str_mv | AT norazlinakhamis aguidelinebasedapproachtosupporttheassessmentofstudentsabilitytoapplyobjectorientedconceptsinsourcecode AT norhayatidaut aguidelinebasedapproachtosupporttheassessmentofstudentsabilitytoapplyobjectorientedconceptsinsourcecode AT norazlinakhamis guidelinebasedapproachtosupporttheassessmentofstudentsabilitytoapplyobjectorientedconceptsinsourcecode AT norhayatidaut guidelinebasedapproachtosupporttheassessmentofstudentsabilitytoapplyobjectorientedconceptsinsourcecode |