Investigating sensitivity, specificity, and area under the curve of the Clinical COPD Questionnaire, COPD Assessment Test, and Modified Medical Research Council scale according to GOLD using St George's Respiratory Questionnaire cutoff 25 (and 20) as reference
Ioanna G Tsiligianni,1,2 Harma J Alma,1,2 Corina de Jong,1,2 Danijel Jelusic,3 Michael Wittmann,3 Michael Schuler,4 Konrad Schultz,3 Boudewijn J Kollen,1 Thys van der Molen,1,2 Janwillem WH Kocks1,2 1Department of General Practice, 2GRIAC Research Institute, University Medical Center Groningen, Uni...
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Dove Medical Press
2016-05-01
|
| Series: | International Journal of COPD |
| Subjects: | |
| Online Access: | https://www.dovepress.com/investigating-sensitivity-specificity-and-area-under-the-curve-of-the--peer-reviewed-article-COPD |
| _version_ | 1819237238214492160 |
|---|---|
| author | Tsiligianni IG Alma HJ de Jong C Jelusic D Wittmann M Schuler M Schultz K Kollen BJ van der Molen T Kocks JWH |
| author_facet | Tsiligianni IG Alma HJ de Jong C Jelusic D Wittmann M Schuler M Schultz K Kollen BJ van der Molen T Kocks JWH |
| author_sort | Tsiligianni IG |
| collection | DOAJ |
| description | Ioanna G Tsiligianni,1,2 Harma J Alma,1,2 Corina de Jong,1,2 Danijel Jelusic,3 Michael Wittmann,3 Michael Schuler,4 Konrad Schultz,3 Boudewijn J Kollen,1 Thys van der Molen,1,2 Janwillem WH Kocks1,2 1Department of General Practice, 2GRIAC Research Institute, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands; 3Klinik Bad Reichenhall, Center for Rehabilitation, Pulmonology and Orthopedics, Bad Reichenhall, 4Department of Medical Psychology, Psychotherapy and Rehabilitation Sciences, University of Würzburg, Würzburg, Germany Background: In the GOLD (Global initiative for chronic Obstructive Lung Disease) strategy document, the Clinical COPD Questionnaire (CCQ), COPD Assessment Test (CAT), or modified Medical Research Council (mMRC) scale are recommended for the assessment of symptoms using the cutoff points of CCQ ≥1, CAT ≥10, and mMRC scale ≥2 to indicate symptomatic patients. The current study investigates the criterion validity of the CCQ, CAT and mMRC scale based on a reference cutoff point of St George’s Respiratory Questionnaire (SGRQ) ≥25, as suggested by GOLD, following sensitivity and specificity analysis. In addition, areas under the curve (AUCs) of the CCQ, CAT, and mMRC scale were compared using two SGRQ cutoff points (≥25 and ≥20).Materials and methods: Two data sets were used: study A, 238 patients from a pulmonary rehabilitation program; and study B, 101 patients from primary care. Receiver-operating characteristic (ROC) curves were used to assess the correspondence between the recommended cutoff points of the questionnaires.Results: Sensitivity, specificity, and AUC scores for cutoff point SGRQ ≥25 were: study A, 0.99, 0.43, and 0.96 for CCQ ≥1, 0.92, 0.48, and 0.89 for CAT ≥10, and 0.68, 0.91, and 0.91 for mMRC ≥2; study B, 0.87, 0.77, and 0.9 for CCQ ≥1, 0.76, 0.73, and 0.82 for CAT ≥10, and 0.21, 1, and 0.81 for mMRC ≥2. Sensitivity, specificity, and AUC scores for cutoff point SGRQ ≥20 were: study A, 0.99, 0.73, and 0.99 for CCQ ≥1, 0.91, 0.73, and 0.94 for CAT ≥10, and 0.66, 0.95, and 0.94 for mMRC ≥2; study B, 0.8, 0.89, and 0.89 for CCQ ≥1, 0.69, 0.78, and 0.8 for CAT ≥10, and 0.18, 1, and 0.81 for mMRC ≥2.Conclusion: Based on data from these two different samples, this study showed that the suggested cutoff point for the SGRQ (≥25) did not seem to correspond well with the established cutoff points of the CCQ or CAT scales, resulting in low specificity levels. The correspondence with the mMRC scale seemed satisfactory, though not optimal. The SGRQ threshold of ≥20 corresponded slightly better than SGRQ ≥25, recently suggested by GOLD 2015, with the established cutoff points for the CCQ, CAT, and mMRC scale. Keywords: pulmonary disease, chronic obstructive, health status |
| first_indexed | 2024-12-23T13:17:09Z |
| format | Article |
| id | doaj.art-c3a229b9bc4648e5a608a0faedebc9d1 |
| institution | Directory Open Access Journal |
| issn | 1178-2005 |
| language | English |
| last_indexed | 2024-12-23T13:17:09Z |
| publishDate | 2016-05-01 |
| publisher | Dove Medical Press |
| record_format | Article |
| series | International Journal of COPD |
| spelling | doaj.art-c3a229b9bc4648e5a608a0faedebc9d12022-12-21T17:45:34ZengDove Medical PressInternational Journal of COPD1178-20052016-05-012016Issue 11045105226995Investigating sensitivity, specificity, and area under the curve of the Clinical COPD Questionnaire, COPD Assessment Test, and Modified Medical Research Council scale according to GOLD using St George's Respiratory Questionnaire cutoff 25 (and 20) as referenceTsiligianni IGAlma HJde Jong CJelusic DWittmann MSchuler MSchultz KKollen BJvan der Molen TKocks JWHIoanna G Tsiligianni,1,2 Harma J Alma,1,2 Corina de Jong,1,2 Danijel Jelusic,3 Michael Wittmann,3 Michael Schuler,4 Konrad Schultz,3 Boudewijn J Kollen,1 Thys van der Molen,1,2 Janwillem WH Kocks1,2 1Department of General Practice, 2GRIAC Research Institute, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands; 3Klinik Bad Reichenhall, Center for Rehabilitation, Pulmonology and Orthopedics, Bad Reichenhall, 4Department of Medical Psychology, Psychotherapy and Rehabilitation Sciences, University of Würzburg, Würzburg, Germany Background: In the GOLD (Global initiative for chronic Obstructive Lung Disease) strategy document, the Clinical COPD Questionnaire (CCQ), COPD Assessment Test (CAT), or modified Medical Research Council (mMRC) scale are recommended for the assessment of symptoms using the cutoff points of CCQ ≥1, CAT ≥10, and mMRC scale ≥2 to indicate symptomatic patients. The current study investigates the criterion validity of the CCQ, CAT and mMRC scale based on a reference cutoff point of St George’s Respiratory Questionnaire (SGRQ) ≥25, as suggested by GOLD, following sensitivity and specificity analysis. In addition, areas under the curve (AUCs) of the CCQ, CAT, and mMRC scale were compared using two SGRQ cutoff points (≥25 and ≥20).Materials and methods: Two data sets were used: study A, 238 patients from a pulmonary rehabilitation program; and study B, 101 patients from primary care. Receiver-operating characteristic (ROC) curves were used to assess the correspondence between the recommended cutoff points of the questionnaires.Results: Sensitivity, specificity, and AUC scores for cutoff point SGRQ ≥25 were: study A, 0.99, 0.43, and 0.96 for CCQ ≥1, 0.92, 0.48, and 0.89 for CAT ≥10, and 0.68, 0.91, and 0.91 for mMRC ≥2; study B, 0.87, 0.77, and 0.9 for CCQ ≥1, 0.76, 0.73, and 0.82 for CAT ≥10, and 0.21, 1, and 0.81 for mMRC ≥2. Sensitivity, specificity, and AUC scores for cutoff point SGRQ ≥20 were: study A, 0.99, 0.73, and 0.99 for CCQ ≥1, 0.91, 0.73, and 0.94 for CAT ≥10, and 0.66, 0.95, and 0.94 for mMRC ≥2; study B, 0.8, 0.89, and 0.89 for CCQ ≥1, 0.69, 0.78, and 0.8 for CAT ≥10, and 0.18, 1, and 0.81 for mMRC ≥2.Conclusion: Based on data from these two different samples, this study showed that the suggested cutoff point for the SGRQ (≥25) did not seem to correspond well with the established cutoff points of the CCQ or CAT scales, resulting in low specificity levels. The correspondence with the mMRC scale seemed satisfactory, though not optimal. The SGRQ threshold of ≥20 corresponded slightly better than SGRQ ≥25, recently suggested by GOLD 2015, with the established cutoff points for the CCQ, CAT, and mMRC scale. Keywords: pulmonary disease, chronic obstructive, health statushttps://www.dovepress.com/investigating-sensitivity-specificity-and-area-under-the-curve-of-the--peer-reviewed-article-COPDPulmonary diseaseChronic Obstructivehealth status |
| spellingShingle | Tsiligianni IG Alma HJ de Jong C Jelusic D Wittmann M Schuler M Schultz K Kollen BJ van der Molen T Kocks JWH Investigating sensitivity, specificity, and area under the curve of the Clinical COPD Questionnaire, COPD Assessment Test, and Modified Medical Research Council scale according to GOLD using St George's Respiratory Questionnaire cutoff 25 (and 20) as reference International Journal of COPD Pulmonary disease Chronic Obstructive health status |
| title | Investigating sensitivity, specificity, and area under the curve of the Clinical COPD Questionnaire, COPD Assessment Test, and Modified Medical Research Council scale according to GOLD using St George's Respiratory Questionnaire cutoff 25 (and 20) as reference |
| title_full | Investigating sensitivity, specificity, and area under the curve of the Clinical COPD Questionnaire, COPD Assessment Test, and Modified Medical Research Council scale according to GOLD using St George's Respiratory Questionnaire cutoff 25 (and 20) as reference |
| title_fullStr | Investigating sensitivity, specificity, and area under the curve of the Clinical COPD Questionnaire, COPD Assessment Test, and Modified Medical Research Council scale according to GOLD using St George's Respiratory Questionnaire cutoff 25 (and 20) as reference |
| title_full_unstemmed | Investigating sensitivity, specificity, and area under the curve of the Clinical COPD Questionnaire, COPD Assessment Test, and Modified Medical Research Council scale according to GOLD using St George's Respiratory Questionnaire cutoff 25 (and 20) as reference |
| title_short | Investigating sensitivity, specificity, and area under the curve of the Clinical COPD Questionnaire, COPD Assessment Test, and Modified Medical Research Council scale according to GOLD using St George's Respiratory Questionnaire cutoff 25 (and 20) as reference |
| title_sort | investigating sensitivity specificity and area under the curve of the clinical copd questionnaire copd assessment test and modified medical research council scale according to gold using st george 39 s respiratory questionnaire cutoff 25 and 20 as reference |
| topic | Pulmonary disease Chronic Obstructive health status |
| url | https://www.dovepress.com/investigating-sensitivity-specificity-and-area-under-the-curve-of-the--peer-reviewed-article-COPD |
| work_keys_str_mv | AT tsiligianniig investigatingsensitivityspecificityandareaunderthecurveoftheclinicalcopdquestionnairecopdassessmenttestandmodifiedmedicalresearchcouncilscaleaccordingtogoldusingstgeorge39srespiratoryquestionnairecutoff25and20asreference AT almahj investigatingsensitivityspecificityandareaunderthecurveoftheclinicalcopdquestionnairecopdassessmenttestandmodifiedmedicalresearchcouncilscaleaccordingtogoldusingstgeorge39srespiratoryquestionnairecutoff25and20asreference AT dejongc investigatingsensitivityspecificityandareaunderthecurveoftheclinicalcopdquestionnairecopdassessmenttestandmodifiedmedicalresearchcouncilscaleaccordingtogoldusingstgeorge39srespiratoryquestionnairecutoff25and20asreference AT jelusicd investigatingsensitivityspecificityandareaunderthecurveoftheclinicalcopdquestionnairecopdassessmenttestandmodifiedmedicalresearchcouncilscaleaccordingtogoldusingstgeorge39srespiratoryquestionnairecutoff25and20asreference AT wittmannm investigatingsensitivityspecificityandareaunderthecurveoftheclinicalcopdquestionnairecopdassessmenttestandmodifiedmedicalresearchcouncilscaleaccordingtogoldusingstgeorge39srespiratoryquestionnairecutoff25and20asreference AT schulerm investigatingsensitivityspecificityandareaunderthecurveoftheclinicalcopdquestionnairecopdassessmenttestandmodifiedmedicalresearchcouncilscaleaccordingtogoldusingstgeorge39srespiratoryquestionnairecutoff25and20asreference AT schultzk investigatingsensitivityspecificityandareaunderthecurveoftheclinicalcopdquestionnairecopdassessmenttestandmodifiedmedicalresearchcouncilscaleaccordingtogoldusingstgeorge39srespiratoryquestionnairecutoff25and20asreference AT kollenbj investigatingsensitivityspecificityandareaunderthecurveoftheclinicalcopdquestionnairecopdassessmenttestandmodifiedmedicalresearchcouncilscaleaccordingtogoldusingstgeorge39srespiratoryquestionnairecutoff25and20asreference AT vandermolent investigatingsensitivityspecificityandareaunderthecurveoftheclinicalcopdquestionnairecopdassessmenttestandmodifiedmedicalresearchcouncilscaleaccordingtogoldusingstgeorge39srespiratoryquestionnairecutoff25and20asreference AT kocksjwh investigatingsensitivityspecificityandareaunderthecurveoftheclinicalcopdquestionnairecopdassessmenttestandmodifiedmedicalresearchcouncilscaleaccordingtogoldusingstgeorge39srespiratoryquestionnairecutoff25and20asreference |