Key Quality Factors in Digital Competence Assessment: A Validation Study from Teachers’ Perspective
The progressive shift from a transmissive to a competence-based approach emphasises the need to design new models and tools for competence assessment. In order to address this need, this study, firstly, introduces the assessment model for digital competence in primary and secondary schools developed...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-02-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/13/4/2450 |
| _version_ | 1827758815197528064 |
|---|---|
| author | Lourdes Guàrdia Marcelo Maina Federica Mancini Montserrat Martinez Melo |
| author_facet | Lourdes Guàrdia Marcelo Maina Federica Mancini Montserrat Martinez Melo |
| author_sort | Lourdes Guàrdia |
| collection | DOAJ |
| description | The progressive shift from a transmissive to a competence-based approach emphasises the need to design new models and tools for competence assessment. In order to address this need, this study, firstly, introduces the assessment model for digital competence in primary and secondary schools developed within the H2020 CRISS project. The Competence Assessment Model (CAM) (1) embraces the integration pedagogy approach in which competences are embedded within the curriculum and (2) provides competence assessment scenarios (CAS). Secondly, the study presents the results of the evaluation of its quality from the teachers’ perspective through an instrument designed on the basis of nine competence assessment quality criteria. The CAM was tested in a large-scale pilot study conducted in 535 primary and secondary schools across Europe. The outcomes show that the CAM mainly fulfills two out of the nine quality criteria: meaningfulness and authenticity. However, the exploratory factor analysis also reveals that all these quality criteria can be summarized into four key quality factors that more accurately describe how CAM is experienced in school teaching. Out of these, the most relevant is the (1) efficiency over time, student monitoring, support and evaluation. The three secondary factors identified are (2) fairness and cognitive complexity, (3) meaningfulness and authenticity and (4) reproducibility and transparency. The study provides a conceptual and methodological approach for the evaluation of Digital Competence in the school context. Most of all, it helps highlight four factors that, according to teaching staff, describe the quality of the proposed model when applied to daily teaching practices. |
| first_indexed | 2024-03-11T09:11:49Z |
| format | Article |
| id | doaj.art-3a8256d9e0cd4a45a644548cf6b42872 |
| institution | Directory Open Access Journal |
| issn | 2076-3417 |
| language | English |
| last_indexed | 2024-03-11T09:11:49Z |
| publishDate | 2023-02-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj.art-3a8256d9e0cd4a45a644548cf6b428722023-11-16T18:55:57ZengMDPI AGApplied Sciences2076-34172023-02-01134245010.3390/app13042450Key Quality Factors in Digital Competence Assessment: A Validation Study from Teachers’ PerspectiveLourdes Guàrdia0Marcelo Maina1Federica Mancini2Montserrat Martinez Melo3Faculty of Psychology and Education Sciences, Universitat Oberta Catalunya, 08018 Barcelona, SpainFaculty of Psychology and Education Sciences, Universitat Oberta Catalunya, 08018 Barcelona, SpainFaculty of Psychology and Education Sciences, Universitat Oberta Catalunya, 08018 Barcelona, SpainFaculty of Psychology and Education Sciences, Universitat Oberta Catalunya, 08018 Barcelona, SpainThe progressive shift from a transmissive to a competence-based approach emphasises the need to design new models and tools for competence assessment. In order to address this need, this study, firstly, introduces the assessment model for digital competence in primary and secondary schools developed within the H2020 CRISS project. The Competence Assessment Model (CAM) (1) embraces the integration pedagogy approach in which competences are embedded within the curriculum and (2) provides competence assessment scenarios (CAS). Secondly, the study presents the results of the evaluation of its quality from the teachers’ perspective through an instrument designed on the basis of nine competence assessment quality criteria. The CAM was tested in a large-scale pilot study conducted in 535 primary and secondary schools across Europe. The outcomes show that the CAM mainly fulfills two out of the nine quality criteria: meaningfulness and authenticity. However, the exploratory factor analysis also reveals that all these quality criteria can be summarized into four key quality factors that more accurately describe how CAM is experienced in school teaching. Out of these, the most relevant is the (1) efficiency over time, student monitoring, support and evaluation. The three secondary factors identified are (2) fairness and cognitive complexity, (3) meaningfulness and authenticity and (4) reproducibility and transparency. The study provides a conceptual and methodological approach for the evaluation of Digital Competence in the school context. Most of all, it helps highlight four factors that, according to teaching staff, describe the quality of the proposed model when applied to daily teaching practices.https://www.mdpi.com/2076-3417/13/4/2450competence-based assessmentprimary educationsecondary educationdigital competencequality criteria |
| spellingShingle | Lourdes Guàrdia Marcelo Maina Federica Mancini Montserrat Martinez Melo Key Quality Factors in Digital Competence Assessment: A Validation Study from Teachers’ Perspective Applied Sciences competence-based assessment primary education secondary education digital competence quality criteria |
| title | Key Quality Factors in Digital Competence Assessment: A Validation Study from Teachers’ Perspective |
| title_full | Key Quality Factors in Digital Competence Assessment: A Validation Study from Teachers’ Perspective |
| title_fullStr | Key Quality Factors in Digital Competence Assessment: A Validation Study from Teachers’ Perspective |
| title_full_unstemmed | Key Quality Factors in Digital Competence Assessment: A Validation Study from Teachers’ Perspective |
| title_short | Key Quality Factors in Digital Competence Assessment: A Validation Study from Teachers’ Perspective |
| title_sort | key quality factors in digital competence assessment a validation study from teachers perspective |
| topic | competence-based assessment primary education secondary education digital competence quality criteria |
| url | https://www.mdpi.com/2076-3417/13/4/2450 |
| work_keys_str_mv | AT lourdesguardia keyqualityfactorsindigitalcompetenceassessmentavalidationstudyfromteachersperspective AT marcelomaina keyqualityfactorsindigitalcompetenceassessmentavalidationstudyfromteachersperspective AT federicamancini keyqualityfactorsindigitalcompetenceassessmentavalidationstudyfromteachersperspective AT montserratmartinezmelo keyqualityfactorsindigitalcompetenceassessmentavalidationstudyfromteachersperspective |