Definizione di una procedura di codifica delle domande aperte basata sui modelli delle indagini internazionali
Definition of a Coding Procedure of Open-ended Questions Based on the Models of International Studies The paper presents an in-depth study within the «Problem-solving and geographical skills» project funded by Sapienza University of Rome in 2011. The main research instrument consists of open-ended...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
LED Edizioni Universitarie
2014-12-01
|
| Series: | Journal of Educational, Cultural and Psychological Studies |
| Subjects: | |
| Online Access: | https://www.ledonline.it/index.php/ECPS-Journal/article/view/769 |
| _version_ | 1818155852618530816 |
|---|---|
| author | Giorgio Asquini |
| author_facet | Giorgio Asquini |
| author_sort | Giorgio Asquini |
| collection | DOAJ |
| description | Definition of a Coding Procedure of Open-ended Questions Based on the Models of International Studies
The paper presents an in-depth study within the «Problem-solving and geographical skills» project funded by Sapienza University of Rome in 2011. The main research instrument consists of open-ended items which was used as a basis for designing a coding procedure of student responses in order to maximise coding and coder control and reliability. Bearing in mind that when analyzing open answers, the margins of the assessor’s subjective interpretation are certainly greater than with classic structured items, the adoption of strict encoding and coding control procedures allows us to steer this type of semi-structured questions toward objectivity, thereby significantly reducing errors of interpretation. The main reference is the procedure used in the OECD-PISA for openended questions, but also the assessment of written tests established in the IEA study on «Written composition». The aim is to improve the quality of the dataset of the study, with the least possible burden on resources. The results confirmed the effectiveness of the procedure in terms of reliability of coding, with the estimation of a low-level error. It was also possible to provide timely feedback to each coder, thereby enabling an improvement in coding ability. |
| first_indexed | 2024-12-11T14:48:59Z |
| format | Article |
| id | doaj.art-e83bb2aa015b474788e6bdbf210b8f8d |
| institution | Directory Open Access Journal |
| issn | 2037-7932 2037-7924 |
| language | English |
| last_indexed | 2024-12-11T14:48:59Z |
| publishDate | 2014-12-01 |
| publisher | LED Edizioni Universitarie |
| record_format | Article |
| series | Journal of Educational, Cultural and Psychological Studies |
| spelling | doaj.art-e83bb2aa015b474788e6bdbf210b8f8d2022-12-22T01:01:33ZengLED Edizioni UniversitarieJournal of Educational, Cultural and Psychological Studies2037-79322037-79242014-12-0101046348310.7358/ecps-2014-010-asqu622Definizione di una procedura di codifica delle domande aperte basata sui modelli delle indagini internazionaliGiorgio Asquini0Sapienza Università di RomaDefinition of a Coding Procedure of Open-ended Questions Based on the Models of International Studies The paper presents an in-depth study within the «Problem-solving and geographical skills» project funded by Sapienza University of Rome in 2011. The main research instrument consists of open-ended items which was used as a basis for designing a coding procedure of student responses in order to maximise coding and coder control and reliability. Bearing in mind that when analyzing open answers, the margins of the assessor’s subjective interpretation are certainly greater than with classic structured items, the adoption of strict encoding and coding control procedures allows us to steer this type of semi-structured questions toward objectivity, thereby significantly reducing errors of interpretation. The main reference is the procedure used in the OECD-PISA for openended questions, but also the assessment of written tests established in the IEA study on «Written composition». The aim is to improve the quality of the dataset of the study, with the least possible burden on resources. The results confirmed the effectiveness of the procedure in terms of reliability of coding, with the estimation of a low-level error. It was also possible to provide timely feedback to each coder, thereby enabling an improvement in coding ability.https://www.ledonline.it/index.php/ECPS-Journal/article/view/769assessment, coding, open-ended items, problem-solving, reliability |
| spellingShingle | Giorgio Asquini Definizione di una procedura di codifica delle domande aperte basata sui modelli delle indagini internazionali Journal of Educational, Cultural and Psychological Studies assessment, coding, open-ended items, problem-solving, reliability |
| title | Definizione di una procedura di codifica delle domande aperte basata sui modelli delle indagini internazionali |
| title_full | Definizione di una procedura di codifica delle domande aperte basata sui modelli delle indagini internazionali |
| title_fullStr | Definizione di una procedura di codifica delle domande aperte basata sui modelli delle indagini internazionali |
| title_full_unstemmed | Definizione di una procedura di codifica delle domande aperte basata sui modelli delle indagini internazionali |
| title_short | Definizione di una procedura di codifica delle domande aperte basata sui modelli delle indagini internazionali |
| title_sort | definizione di una procedura di codifica delle domande aperte basata sui modelli delle indagini internazionali |
| topic | assessment, coding, open-ended items, problem-solving, reliability |
| url | https://www.ledonline.it/index.php/ECPS-Journal/article/view/769 |
| work_keys_str_mv | AT giorgioasquini definizionediunaproceduradicodificadelledomandeapertebasatasuimodellidelleindaginiinternazionali |