Development and validation of an administrative data algorithm to identify adults who have endoscopic sinus surgery for chronic rhinosinusitis
Abstract Background This was a diagnostic accuracy study to develop an algorithm based on administrative database codes that identifies patients with Chronic Rhinosinusitis (CRS) who have endoscopic sinus surgery (ESS). Methods From January 1st, 2011 to December 31st, 2012, a chart review was perfor...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2017-05-01
|
| Series: | Journal of Otolaryngology - Head and Neck Surgery |
| Subjects: | |
| Online Access: | http://link.springer.com/article/10.1186/s40463-017-0216-0 |
| _version_ | 1797965342500192256 |
|---|---|
| author | Kristian I. Macdonald Shaun J. Kilty Carl van Walraven |
| author_facet | Kristian I. Macdonald Shaun J. Kilty Carl van Walraven |
| author_sort | Kristian I. Macdonald |
| collection | DOAJ |
| description | Abstract Background This was a diagnostic accuracy study to develop an algorithm based on administrative database codes that identifies patients with Chronic Rhinosinusitis (CRS) who have endoscopic sinus surgery (ESS). Methods From January 1st, 2011 to December 31st, 2012, a chart review was performed for all hospital-identified ESS surgical encounters. The reference standard was developed as follows: cases were assigned to encounters in which ESS was performed for Otolaryngologist-diagnosed CRS; all other chart review encounters, and all other hospital surgical encounters during the timeframe were controls. Algorithm development was based on International Classification of Diseases, version 10 (ICD-10) diagnostic codes and Canadian Classification of Health Interventions (CCI) procedural codes. Internal model validation was performed with a similar chart review for all model-identified cases and 200 randomly selected controls during the following year. Results During the study period, 347 cases and 185,007 controls were identified. The predictive model assigned cases to all encounters that contained at least one CRS ICD-10 diagnostic code and at least one ESS CCI procedural code. Compared to the reference standard, the algorithm was very accurate: sensitivity 96.0% (95%CI 93.2–97.7), specificity 100% (95% CI 99.9–100), and positive predictive value 95.4% (95%CI 92.5–97.3). Internal validation using chart review for the following year revealed similar accuracy: sensitivity 98.9% (95%CI 95.8–99.8), specificity 97.1% (95%CI 93.4–98.8), and positive predictive value 96.9% (95%CI 93.0–99.8). Conclusion A simple model based on administrative database codes accurately identified ESS-CRS encounters. This model can be used in population-based cohorts to study longitudinal outcomes for the ESS-CRS population. |
| first_indexed | 2024-04-11T01:58:29Z |
| format | Article |
| id | doaj.art-6f6ed48e825c4db8816459a707f8d0af |
| institution | Directory Open Access Journal |
| issn | 1916-0216 |
| language | English |
| last_indexed | 2024-04-11T01:58:29Z |
| publishDate | 2017-05-01 |
| publisher | BMC |
| record_format | Article |
| series | Journal of Otolaryngology - Head and Neck Surgery |
| spelling | doaj.art-6f6ed48e825c4db8816459a707f8d0af2023-01-03T04:47:54ZengBMCJournal of Otolaryngology - Head and Neck Surgery1916-02162017-05-014611810.1186/s40463-017-0216-0Development and validation of an administrative data algorithm to identify adults who have endoscopic sinus surgery for chronic rhinosinusitisKristian I. Macdonald0Shaun J. Kilty1Carl van Walraven2MD FRCSC, Department of Otolaryngology – Head & Neck Surgery, University of OttawaMD FRCSC, Department of Otolaryngology – Head & Neck Surgery, University of OttawaMD MSc FRCPC, Department of Medicine, Ottawa Hospital Research Institute, University of OttawaAbstract Background This was a diagnostic accuracy study to develop an algorithm based on administrative database codes that identifies patients with Chronic Rhinosinusitis (CRS) who have endoscopic sinus surgery (ESS). Methods From January 1st, 2011 to December 31st, 2012, a chart review was performed for all hospital-identified ESS surgical encounters. The reference standard was developed as follows: cases were assigned to encounters in which ESS was performed for Otolaryngologist-diagnosed CRS; all other chart review encounters, and all other hospital surgical encounters during the timeframe were controls. Algorithm development was based on International Classification of Diseases, version 10 (ICD-10) diagnostic codes and Canadian Classification of Health Interventions (CCI) procedural codes. Internal model validation was performed with a similar chart review for all model-identified cases and 200 randomly selected controls during the following year. Results During the study period, 347 cases and 185,007 controls were identified. The predictive model assigned cases to all encounters that contained at least one CRS ICD-10 diagnostic code and at least one ESS CCI procedural code. Compared to the reference standard, the algorithm was very accurate: sensitivity 96.0% (95%CI 93.2–97.7), specificity 100% (95% CI 99.9–100), and positive predictive value 95.4% (95%CI 92.5–97.3). Internal validation using chart review for the following year revealed similar accuracy: sensitivity 98.9% (95%CI 95.8–99.8), specificity 97.1% (95%CI 93.4–98.8), and positive predictive value 96.9% (95%CI 93.0–99.8). Conclusion A simple model based on administrative database codes accurately identified ESS-CRS encounters. This model can be used in population-based cohorts to study longitudinal outcomes for the ESS-CRS population.http://link.springer.com/article/10.1186/s40463-017-0216-0Chronic rhinosinusitisAdministrative database researchEndoscopic sinus surgeryDiagnostic codes |
| spellingShingle | Kristian I. Macdonald Shaun J. Kilty Carl van Walraven Development and validation of an administrative data algorithm to identify adults who have endoscopic sinus surgery for chronic rhinosinusitis Journal of Otolaryngology - Head and Neck Surgery Chronic rhinosinusitis Administrative database research Endoscopic sinus surgery Diagnostic codes |
| title | Development and validation of an administrative data algorithm to identify adults who have endoscopic sinus surgery for chronic rhinosinusitis |
| title_full | Development and validation of an administrative data algorithm to identify adults who have endoscopic sinus surgery for chronic rhinosinusitis |
| title_fullStr | Development and validation of an administrative data algorithm to identify adults who have endoscopic sinus surgery for chronic rhinosinusitis |
| title_full_unstemmed | Development and validation of an administrative data algorithm to identify adults who have endoscopic sinus surgery for chronic rhinosinusitis |
| title_short | Development and validation of an administrative data algorithm to identify adults who have endoscopic sinus surgery for chronic rhinosinusitis |
| title_sort | development and validation of an administrative data algorithm to identify adults who have endoscopic sinus surgery for chronic rhinosinusitis |
| topic | Chronic rhinosinusitis Administrative database research Endoscopic sinus surgery Diagnostic codes |
| url | http://link.springer.com/article/10.1186/s40463-017-0216-0 |
| work_keys_str_mv | AT kristianimacdonald developmentandvalidationofanadministrativedataalgorithmtoidentifyadultswhohaveendoscopicsinussurgeryforchronicrhinosinusitis AT shaunjkilty developmentandvalidationofanadministrativedataalgorithmtoidentifyadultswhohaveendoscopicsinussurgeryforchronicrhinosinusitis AT carlvanwalraven developmentandvalidationofanadministrativedataalgorithmtoidentifyadultswhohaveendoscopicsinussurgeryforchronicrhinosinusitis |