The Development of an Automatic Test Assembly System for a Formative Assessment in Mastery Learning Instruction: Case of the SQL Mastery Course
The teaching method of mastery learning requires the lecturers to conduct their regular formative assessments so as to monitor each student’s learning progress. However, regularly preparing quality test forms for these assessments has caused a tremendous workload on the lecturers and has...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10238708/ |
| _version_ | 1797688514964357120 |
|---|---|
| author | Hung-Yi Chen Ying-Chieh Liu Xuan-Qi Liu Victoria Chiu |
| author_facet | Hung-Yi Chen Ying-Chieh Liu Xuan-Qi Liu Victoria Chiu |
| author_sort | Hung-Yi Chen |
| collection | DOAJ |
| description | The teaching method of mastery learning requires the lecturers to conduct their regular formative assessments so as to monitor each student’s learning progress. However, regularly preparing quality test forms for these assessments has caused a tremendous workload on the lecturers and has prevented them from effectively executing the master learning instruction. To resolve the problem, this study has built an automatic test assembly system with the automatic and manual test assembly functions for preparing fixed-length testing forms. Our system is implemented in a Structural Query Language (SQL) mastery course that helps students prepare for the ORACLE SQL Certification (OCE SQL) examination. OCE SQL is a program offered by the Oracle Corporation to validate and recognize the skills of professionals in the SQL programming. By applying the Hambleton and De Gruijter’s method, our system can automatically assemble items to a test form with a quality indication of the maximum probability of misclassifying mastery. Furthermore, our system can evaluate the prementioned probability for a manually assembled test form. The present study has also investigated the numeric methods for converting the domain cutoff score to the latent ability scale for items with heterogeneous parameters when applying the method. The empirical computing results showed that the secant method is superior to the bisection method for the conversion. This study contributes an automatic test assembly system to the engineering education practice so as to lighten the lecturers’ burden of preparing quality assessments and to further facilitate the execution of the regular formative assessments in the mastery learning instruction. |
| first_indexed | 2024-03-12T01:32:02Z |
| format | Article |
| id | doaj.art-361e4aaa13e0495eac995cf3417a1ff6 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-12T01:32:02Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-361e4aaa13e0495eac995cf3417a1ff62023-09-11T23:00:29ZengIEEEIEEE Access2169-35362023-01-0111959749598810.1109/ACCESS.2023.331161510238708The Development of an Automatic Test Assembly System for a Formative Assessment in Mastery Learning Instruction: Case of the SQL Mastery CourseHung-Yi Chen0https://orcid.org/0000-0002-4157-8963Ying-Chieh Liu1https://orcid.org/0000-0002-4319-8227Xuan-Qi Liu2Victoria Chiu3https://orcid.org/0000-0001-6652-6011Department of Information Management, Chaoyang University of Technology, Taichung, TaiwanDepartment of Information Management, National Chin-Yi University of Technology, Taichung, TaiwanDepartment of Information Management, Chaoyang University of Technology, Taichung, TaiwanDepartment of Accounting, Finance and Law, State University of New York at Oswego, Oswego, NY, USAThe teaching method of mastery learning requires the lecturers to conduct their regular formative assessments so as to monitor each student’s learning progress. However, regularly preparing quality test forms for these assessments has caused a tremendous workload on the lecturers and has prevented them from effectively executing the master learning instruction. To resolve the problem, this study has built an automatic test assembly system with the automatic and manual test assembly functions for preparing fixed-length testing forms. Our system is implemented in a Structural Query Language (SQL) mastery course that helps students prepare for the ORACLE SQL Certification (OCE SQL) examination. OCE SQL is a program offered by the Oracle Corporation to validate and recognize the skills of professionals in the SQL programming. By applying the Hambleton and De Gruijter’s method, our system can automatically assemble items to a test form with a quality indication of the maximum probability of misclassifying mastery. Furthermore, our system can evaluate the prementioned probability for a manually assembled test form. The present study has also investigated the numeric methods for converting the domain cutoff score to the latent ability scale for items with heterogeneous parameters when applying the method. The empirical computing results showed that the secant method is superior to the bisection method for the conversion. This study contributes an automatic test assembly system to the engineering education practice so as to lighten the lecturers’ burden of preparing quality assessments and to further facilitate the execution of the regular formative assessments in the mastery learning instruction.https://ieeexplore.ieee.org/document/10238708/Criterion-referenced testengineering educationformative assessmentmastery learning instructiontest assembly systemsSQL programmer |
| spellingShingle | Hung-Yi Chen Ying-Chieh Liu Xuan-Qi Liu Victoria Chiu The Development of an Automatic Test Assembly System for a Formative Assessment in Mastery Learning Instruction: Case of the SQL Mastery Course IEEE Access Criterion-referenced test engineering education formative assessment mastery learning instruction test assembly systems SQL programmer |
| title | The Development of an Automatic Test Assembly System for a Formative Assessment in Mastery Learning Instruction: Case of the SQL Mastery Course |
| title_full | The Development of an Automatic Test Assembly System for a Formative Assessment in Mastery Learning Instruction: Case of the SQL Mastery Course |
| title_fullStr | The Development of an Automatic Test Assembly System for a Formative Assessment in Mastery Learning Instruction: Case of the SQL Mastery Course |
| title_full_unstemmed | The Development of an Automatic Test Assembly System for a Formative Assessment in Mastery Learning Instruction: Case of the SQL Mastery Course |
| title_short | The Development of an Automatic Test Assembly System for a Formative Assessment in Mastery Learning Instruction: Case of the SQL Mastery Course |
| title_sort | development of an automatic test assembly system for a formative assessment in mastery learning instruction case of the sql mastery course |
| topic | Criterion-referenced test engineering education formative assessment mastery learning instruction test assembly systems SQL programmer |
| url | https://ieeexplore.ieee.org/document/10238708/ |
| work_keys_str_mv | AT hungyichen thedevelopmentofanautomatictestassemblysystemforaformativeassessmentinmasterylearninginstructioncaseofthesqlmasterycourse AT yingchiehliu thedevelopmentofanautomatictestassemblysystemforaformativeassessmentinmasterylearninginstructioncaseofthesqlmasterycourse AT xuanqiliu thedevelopmentofanautomatictestassemblysystemforaformativeassessmentinmasterylearninginstructioncaseofthesqlmasterycourse AT victoriachiu thedevelopmentofanautomatictestassemblysystemforaformativeassessmentinmasterylearninginstructioncaseofthesqlmasterycourse AT hungyichen developmentofanautomatictestassemblysystemforaformativeassessmentinmasterylearninginstructioncaseofthesqlmasterycourse AT yingchiehliu developmentofanautomatictestassemblysystemforaformativeassessmentinmasterylearninginstructioncaseofthesqlmasterycourse AT xuanqiliu developmentofanautomatictestassemblysystemforaformativeassessmentinmasterylearninginstructioncaseofthesqlmasterycourse AT victoriachiu developmentofanautomatictestassemblysystemforaformativeassessmentinmasterylearninginstructioncaseofthesqlmasterycourse |