A comparative performance analysis of the International Classification of Functioning, Disability and Health and the Item-Perspective Classification framework for classifying the content of patient reported outcome measures
Abstract Background Standardized coding of the content presented in patient reported outcome measures can be achieved using classification frameworks, and the resulting data can be used for ascertaining content validity or comparative analyses. The International Classification of Functioning (ICF) i...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2021-04-01
|
| Series: | Health and Quality of Life Outcomes |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s12955-021-01774-0 |
| _version_ | 1818451732158480384 |
|---|---|
| author | Derek Rosa Joy MacDermid Dorota Klubowicz |
| author_facet | Derek Rosa Joy MacDermid Dorota Klubowicz |
| author_sort | Derek Rosa |
| collection | DOAJ |
| description | Abstract Background Standardized coding of the content presented in patient reported outcome measures can be achieved using classification frameworks, and the resulting data can be used for ascertaining content validity or comparative analyses. The International Classification of Functioning (ICF) is a framework with a detailed conceptual structure that has been successfully utilized for such purposes through established coding procedures. The Item Perspective Classification (IPC) framework is a newly developed relational coding system that classifies the respondent perspective and conceptual domains addressed in items. The purpose of this study was to compare and describe the performance of these two frameworks when used alone, and in conjunction, for the generation of data pertaining to the content of patient reported outcome measures. Methods Six health-related quality of life questionnaires with a total of 159 items were classified by two raters using the Item Perspective Classification framework in conjunction with the International Classification of Functioning. Framework performance indicators included: classification capacity (percent of items amenable to successful classification), coding efficiency (number of codes required to classify items), and content overlap detection (percent of items sharing identical classification codes with at least one other item). Inter-rater reliability of item coding was determined using Krippendorff's alpha. Results Classification capacity of the IPC framework was 97%, coding efficiency 26, and content overlap detection was 95%; whereas respective values for the ICF were 68%, 114, and 58%. When used in conjunction values were 63%, 129, and 30%. Krippendorff's alpha exceeded 0.97 for all 3 classification indices. Conclusion Inter-rater agreement on classification data was excellent. The IPC framework provided a unique classification of the respondent’s judgment during item response and classified more items using fewer categories, indicated greater content overlap across items and was able to describe the relationship between multiple concepts presented within the context of a single item. The ICF provided a unique classification of item content relating to aspects of disability and generated more detailed and precise descriptions. A combined approach provided a rich description (detailed codes) with each framework providing complementary information. The benefits of this approach in instrument development and content validation require further investigation. |
| first_indexed | 2024-12-14T21:11:52Z |
| format | Article |
| id | doaj.art-b9c13d9c3c52462787979e871f936bbd |
| institution | Directory Open Access Journal |
| issn | 1477-7525 |
| language | English |
| last_indexed | 2024-12-14T21:11:52Z |
| publishDate | 2021-04-01 |
| publisher | BMC |
| record_format | Article |
| series | Health and Quality of Life Outcomes |
| spelling | doaj.art-b9c13d9c3c52462787979e871f936bbd2022-12-21T22:47:13ZengBMCHealth and Quality of Life Outcomes1477-75252021-04-0119111110.1186/s12955-021-01774-0A comparative performance analysis of the International Classification of Functioning, Disability and Health and the Item-Perspective Classification framework for classifying the content of patient reported outcome measuresDerek Rosa0Joy MacDermid1Dorota Klubowicz2Physical Therapy, Western UniversityPhysical Therapy, Western UniversityPhysical Therapy, Western UniversityAbstract Background Standardized coding of the content presented in patient reported outcome measures can be achieved using classification frameworks, and the resulting data can be used for ascertaining content validity or comparative analyses. The International Classification of Functioning (ICF) is a framework with a detailed conceptual structure that has been successfully utilized for such purposes through established coding procedures. The Item Perspective Classification (IPC) framework is a newly developed relational coding system that classifies the respondent perspective and conceptual domains addressed in items. The purpose of this study was to compare and describe the performance of these two frameworks when used alone, and in conjunction, for the generation of data pertaining to the content of patient reported outcome measures. Methods Six health-related quality of life questionnaires with a total of 159 items were classified by two raters using the Item Perspective Classification framework in conjunction with the International Classification of Functioning. Framework performance indicators included: classification capacity (percent of items amenable to successful classification), coding efficiency (number of codes required to classify items), and content overlap detection (percent of items sharing identical classification codes with at least one other item). Inter-rater reliability of item coding was determined using Krippendorff's alpha. Results Classification capacity of the IPC framework was 97%, coding efficiency 26, and content overlap detection was 95%; whereas respective values for the ICF were 68%, 114, and 58%. When used in conjunction values were 63%, 129, and 30%. Krippendorff's alpha exceeded 0.97 for all 3 classification indices. Conclusion Inter-rater agreement on classification data was excellent. The IPC framework provided a unique classification of the respondent’s judgment during item response and classified more items using fewer categories, indicated greater content overlap across items and was able to describe the relationship between multiple concepts presented within the context of a single item. The ICF provided a unique classification of item content relating to aspects of disability and generated more detailed and precise descriptions. A combined approach provided a rich description (detailed codes) with each framework providing complementary information. The benefits of this approach in instrument development and content validation require further investigation.https://doi.org/10.1186/s12955-021-01774-0ClassificationQuestionnairesOutcome assessment (health care)Health status indicatorsQuality of life |
| spellingShingle | Derek Rosa Joy MacDermid Dorota Klubowicz A comparative performance analysis of the International Classification of Functioning, Disability and Health and the Item-Perspective Classification framework for classifying the content of patient reported outcome measures Health and Quality of Life Outcomes Classification Questionnaires Outcome assessment (health care) Health status indicators Quality of life |
| title | A comparative performance analysis of the International Classification of Functioning, Disability and Health and the Item-Perspective Classification framework for classifying the content of patient reported outcome measures |
| title_full | A comparative performance analysis of the International Classification of Functioning, Disability and Health and the Item-Perspective Classification framework for classifying the content of patient reported outcome measures |
| title_fullStr | A comparative performance analysis of the International Classification of Functioning, Disability and Health and the Item-Perspective Classification framework for classifying the content of patient reported outcome measures |
| title_full_unstemmed | A comparative performance analysis of the International Classification of Functioning, Disability and Health and the Item-Perspective Classification framework for classifying the content of patient reported outcome measures |
| title_short | A comparative performance analysis of the International Classification of Functioning, Disability and Health and the Item-Perspective Classification framework for classifying the content of patient reported outcome measures |
| title_sort | comparative performance analysis of the international classification of functioning disability and health and the item perspective classification framework for classifying the content of patient reported outcome measures |
| topic | Classification Questionnaires Outcome assessment (health care) Health status indicators Quality of life |
| url | https://doi.org/10.1186/s12955-021-01774-0 |
| work_keys_str_mv | AT derekrosa acomparativeperformanceanalysisoftheinternationalclassificationoffunctioningdisabilityandhealthandtheitemperspectiveclassificationframeworkforclassifyingthecontentofpatientreportedoutcomemeasures AT joymacdermid acomparativeperformanceanalysisoftheinternationalclassificationoffunctioningdisabilityandhealthandtheitemperspectiveclassificationframeworkforclassifyingthecontentofpatientreportedoutcomemeasures AT dorotaklubowicz acomparativeperformanceanalysisoftheinternationalclassificationoffunctioningdisabilityandhealthandtheitemperspectiveclassificationframeworkforclassifyingthecontentofpatientreportedoutcomemeasures AT derekrosa comparativeperformanceanalysisoftheinternationalclassificationoffunctioningdisabilityandhealthandtheitemperspectiveclassificationframeworkforclassifyingthecontentofpatientreportedoutcomemeasures AT joymacdermid comparativeperformanceanalysisoftheinternationalclassificationoffunctioningdisabilityandhealthandtheitemperspectiveclassificationframeworkforclassifyingthecontentofpatientreportedoutcomemeasures AT dorotaklubowicz comparativeperformanceanalysisoftheinternationalclassificationoffunctioningdisabilityandhealthandtheitemperspectiveclassificationframeworkforclassifyingthecontentofpatientreportedoutcomemeasures |