How to Abbreviate Questionnaires and Avoid the Sins?
Creating shortened versions of research tools is common and justified. Unfortunately, it is often performed without due methodological care and awareness of the consequences of such actions. Even though the errors committed during short form construction were collected by Smith and his collaborators...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
European Survey Research Association
2018-08-01
|
| Series: | Survey Research Methods |
| Subjects: | |
| Online Access: | https://ojs.ub.uni-konstanz.de/srm/article/view/7224 |
| _version_ | 1818042315148623872 |
|---|---|
| author | Paweł Kleka Emilia Soroko |
| author_facet | Paweł Kleka Emilia Soroko |
| author_sort | Paweł Kleka |
| collection | DOAJ |
| description | Creating shortened versions of research tools is common and justified. Unfortunately, it is often performed without due methodological care and awareness of the consequences of such actions. Even though the errors committed during short form construction were collected by Smith and his collaborators in 2000, it did not distinctly affect the practice. The mistakes made by researchers still come down to two main faults: assuming the transferability of validity and reliability between the full and shortened versions, and lowering the validity and reliability requirements for short forms. These two problems manifest as 9 sins committed during the construction of short forms. This article intends to present procedures which prevent these mistakes and ensure creating possibly the most reliable short version of a research tool and assessing the costs of a selected shortening method. To this end, the work determined a priori the expected length of the tool, the benefit of reduced questionnaire completion time in relation to the cost of reliability loss. Also, it estimated overlapping variance of the full and short version and classification accuracy of the new, short version. Since there are many statistical techniques of questionnaire shortening, an additional effect of this article is a comparison of the efficiency of shortening by means of three various techniques. The results show similarity between the method based on factor loadings and Cronbach’s α method, and a slight advantage over the two of a method based on difficulty and discriminatory power in the IRT paradigm. |
| first_indexed | 2024-12-10T08:44:22Z |
| format | Article |
| id | doaj.art-b55b8437bd284e5993654b7154ece4bd |
| institution | Directory Open Access Journal |
| issn | 1864-3361 |
| language | English |
| last_indexed | 2024-12-10T08:44:22Z |
| publishDate | 2018-08-01 |
| publisher | European Survey Research Association |
| record_format | Article |
| series | Survey Research Methods |
| spelling | doaj.art-b55b8437bd284e5993654b7154ece4bd2022-12-22T01:55:46ZengEuropean Survey Research AssociationSurvey Research Methods1864-33612018-08-0112210.18148/srm/2018.v12i2.7224How to Abbreviate Questionnaires and Avoid the Sins?Paweł Kleka0Emilia Soroko1Adam Mickiewicz University in PoznanAdami Mickiewicz University in PoznanCreating shortened versions of research tools is common and justified. Unfortunately, it is often performed without due methodological care and awareness of the consequences of such actions. Even though the errors committed during short form construction were collected by Smith and his collaborators in 2000, it did not distinctly affect the practice. The mistakes made by researchers still come down to two main faults: assuming the transferability of validity and reliability between the full and shortened versions, and lowering the validity and reliability requirements for short forms. These two problems manifest as 9 sins committed during the construction of short forms. This article intends to present procedures which prevent these mistakes and ensure creating possibly the most reliable short version of a research tool and assessing the costs of a selected shortening method. To this end, the work determined a priori the expected length of the tool, the benefit of reduced questionnaire completion time in relation to the cost of reliability loss. Also, it estimated overlapping variance of the full and short version and classification accuracy of the new, short version. Since there are many statistical techniques of questionnaire shortening, an additional effect of this article is a comparison of the efficiency of shortening by means of three various techniques. The results show similarity between the method based on factor loadings and Cronbach’s α method, and a slight advantage over the two of a method based on difficulty and discriminatory power in the IRT paradigm.https://ojs.ub.uni-konstanz.de/srm/article/view/7224shortening of testabbreviated versionreliability |
| spellingShingle | Paweł Kleka Emilia Soroko How to Abbreviate Questionnaires and Avoid the Sins? Survey Research Methods shortening of test abbreviated version reliability |
| title | How to Abbreviate Questionnaires and Avoid the Sins? |
| title_full | How to Abbreviate Questionnaires and Avoid the Sins? |
| title_fullStr | How to Abbreviate Questionnaires and Avoid the Sins? |
| title_full_unstemmed | How to Abbreviate Questionnaires and Avoid the Sins? |
| title_short | How to Abbreviate Questionnaires and Avoid the Sins? |
| title_sort | how to abbreviate questionnaires and avoid the sins |
| topic | shortening of test abbreviated version reliability |
| url | https://ojs.ub.uni-konstanz.de/srm/article/view/7224 |
| work_keys_str_mv | AT pawełkleka howtoabbreviatequestionnairesandavoidthesins AT emiliasoroko howtoabbreviatequestionnairesandavoidthesins |