Assessing Information and Communication Technology Competence of Students: Approaches, Tools, Validity and Reliability of Results
The study describes the Information and Communication Literacy Test (the ICL Test), an instrument to measure information and communication technology competence in middle school students (grades 7–9). An overview of the existing instruments proves that there are no other ICT competence assessment in...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
National Research University Higher School of Economics (HSE)
2017-12-01
|
| Series: | Вопросы образования |
| Subjects: | |
| Online Access: | https://vo.hse.ru/article/view/15591 |
| _version_ | 1811166537280651264 |
|---|---|
| author | Svetlana Avdeeva Maksim Rudnev Georgy Vasin Ksenia Tarasova Daria Panova |
| author_facet | Svetlana Avdeeva Maksim Rudnev Georgy Vasin Ksenia Tarasova Daria Panova |
| author_sort | Svetlana Avdeeva |
| collection | DOAJ |
| description | The study describes the Information and Communication Literacy Test (the ICL Test), an instrument to measure information and communication technology competence in middle school students (grades 7–9). An overview of the existing instruments proves that there are no other ICT competence assessment instruments applicable to Russian students today. The assessment was constructed using an innovative systematic approach (evidence-centered assessment design, ECD). The ICL Test results were calculated using Bayesian networks, which are more effective than the Item Response Theory in this case. The ICL Test revealed a high level of construct, content, convergent, divergent and face validity as well as good reliability. The instrument conforms to both Russian and international educational standards according to Webb’s criteria for alignment. The ICL Test results were used to assess ICT competence and identify the factors that influence its development in regions of Russia, Armenia and Belarus. The conclusion is that the ICL Test can be applied to both Russian and foreign education systems. |
| first_indexed | 2024-04-10T15:54:04Z |
| format | Article |
| id | doaj.art-ab9f815d5ef74720b7bffe5ab99299f3 |
| institution | Directory Open Access Journal |
| issn | 1814-9545 2412-4354 |
| language | English |
| last_indexed | 2024-04-10T15:54:04Z |
| publishDate | 2017-12-01 |
| publisher | National Research University Higher School of Economics (HSE) |
| record_format | Article |
| series | Вопросы образования |
| spelling | doaj.art-ab9f815d5ef74720b7bffe5ab99299f32023-02-10T15:53:27ZengNational Research University Higher School of Economics (HSE)Вопросы образования1814-95452412-43542017-12-01410413210.17323/1814-9545-2017-4-104-13215591Assessing Information and Communication Technology Competence of Students: Approaches, Tools, Validity and Reliability of ResultsSvetlana Avdeeva0Maksim Rudnev1Georgy Vasin2Ksenia Tarasova3Daria Panova4HSE University; National Training FoundationHSE UniversityNational Training FoundationHSE UniversityNational Training FoundationThe study describes the Information and Communication Literacy Test (the ICL Test), an instrument to measure information and communication technology competence in middle school students (grades 7–9). An overview of the existing instruments proves that there are no other ICT competence assessment instruments applicable to Russian students today. The assessment was constructed using an innovative systematic approach (evidence-centered assessment design, ECD). The ICL Test results were calculated using Bayesian networks, which are more effective than the Item Response Theory in this case. The ICL Test revealed a high level of construct, content, convergent, divergent and face validity as well as good reliability. The instrument conforms to both Russian and international educational standards according to Webb’s criteria for alignment. The ICL Test results were used to assess ICT competence and identify the factors that influence its development in regions of Russia, Armenia and Belarus. The conclusion is that the ICL Test can be applied to both Russian and foreign education systems.https://vo.hse.ru/article/view/15591testsvalidityinformation and communication technology competenceinformation and communication literacy testcompetencecompetence assessmentcross-disciplinary educational outcomes |
| spellingShingle | Svetlana Avdeeva Maksim Rudnev Georgy Vasin Ksenia Tarasova Daria Panova Assessing Information and Communication Technology Competence of Students: Approaches, Tools, Validity and Reliability of Results Вопросы образования tests validity information and communication technology competence information and communication literacy test competence competence assessment cross-disciplinary educational outcomes |
| title | Assessing Information and Communication Technology Competence of Students: Approaches, Tools, Validity and Reliability of Results |
| title_full | Assessing Information and Communication Technology Competence of Students: Approaches, Tools, Validity and Reliability of Results |
| title_fullStr | Assessing Information and Communication Technology Competence of Students: Approaches, Tools, Validity and Reliability of Results |
| title_full_unstemmed | Assessing Information and Communication Technology Competence of Students: Approaches, Tools, Validity and Reliability of Results |
| title_short | Assessing Information and Communication Technology Competence of Students: Approaches, Tools, Validity and Reliability of Results |
| title_sort | assessing information and communication technology competence of students approaches tools validity and reliability of results |
| topic | tests validity information and communication technology competence information and communication literacy test competence competence assessment cross-disciplinary educational outcomes |
| url | https://vo.hse.ru/article/view/15591 |
| work_keys_str_mv | AT svetlanaavdeeva assessinginformationandcommunicationtechnologycompetenceofstudentsapproachestoolsvalidityandreliabilityofresults AT maksimrudnev assessinginformationandcommunicationtechnologycompetenceofstudentsapproachestoolsvalidityandreliabilityofresults AT georgyvasin assessinginformationandcommunicationtechnologycompetenceofstudentsapproachestoolsvalidityandreliabilityofresults AT kseniatarasova assessinginformationandcommunicationtechnologycompetenceofstudentsapproachestoolsvalidityandreliabilityofresults AT dariapanova assessinginformationandcommunicationtechnologycompetenceofstudentsapproachestoolsvalidityandreliabilityofresults |