Standardized approach to extract candidate outcomes from literature for a standard outcome set: a case- and simulation study
Abstract Aims Standard outcome sets enable the value-based evaluation of health care delivery. Whereas the attainment of expert opinion has been structured using methods such as the modified-Delphi process, standardized guidelines for extraction of candidate outcomes from literature are lacking. As...
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2023-11-01
|
| Series: | BMC Medical Research Methodology |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s12874-023-02052-x |
| _version_ | 1797630175940182016 |
|---|---|
| author | KM Veen A Joseph F Sossi P Blancarte Jaber E Lansac E Das-Gupta S Aktaa JJM Takkenberg |
| author_facet | KM Veen A Joseph F Sossi P Blancarte Jaber E Lansac E Das-Gupta S Aktaa JJM Takkenberg |
| author_sort | KM Veen |
| collection | DOAJ |
| description | Abstract Aims Standard outcome sets enable the value-based evaluation of health care delivery. Whereas the attainment of expert opinion has been structured using methods such as the modified-Delphi process, standardized guidelines for extraction of candidate outcomes from literature are lacking. As such, we aimed to describe an approach to obtain a comprehensive list of candidate outcomes for potential inclusion in standard outcome sets. Methods This study describes an iterative saturation approach, using randomly selected batches from a systematic literature search to develop a long list of candidate outcomes to evaluate healthcare. This approach can be preceded with an optional benchmark review of relevant registries and Clinical Practice Guidelines and data visualization techniques (e.g. as a WordCloud) to potentially decrease the number of iterations. The development of the International Consortium of Health Outcome Measures Heart valve disease set is used to illustrate the approach. Batch cutoff choices of the iterative saturation approach were validated using data of 1000 simulated cases. Results Simulation showed that on average 98% (range 92–100%) saturation is reached using a 100-article batch initially, with 25 articles in the subsequent batches. On average 4.7 repeating rounds (range 1–9) of 25 new articles were necessary to achieve saturation if no outcomes are first identified from a benchmark review or a data visualization. Conclusion In this paper a standardized approach is proposed to identify relevant candidate outcomes for a standard outcome set. This approach creates a balance between comprehensiveness and feasibility in conducting literature reviews for the identification of candidate outcomes. |
| first_indexed | 2024-03-11T11:03:21Z |
| format | Article |
| id | doaj.art-85be9eeafa2240efa37bfa781a8ff519 |
| institution | Directory Open Access Journal |
| issn | 1471-2288 |
| language | English |
| last_indexed | 2024-03-11T11:03:21Z |
| publishDate | 2023-11-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Medical Research Methodology |
| spelling | doaj.art-85be9eeafa2240efa37bfa781a8ff5192023-11-12T12:21:29ZengBMCBMC Medical Research Methodology1471-22882023-11-012311810.1186/s12874-023-02052-xStandardized approach to extract candidate outcomes from literature for a standard outcome set: a case- and simulation studyKM Veen0A Joseph1F Sossi2P Blancarte Jaber3E Lansac4E Das-Gupta5S Aktaa6JJM Takkenberg7Department of cardiothoracic surgery, Erasmus MCInternational consortium of Health Outcome MeasurementInternational consortium of Health Outcome MeasurementInternational consortium of Health Outcome MeasurementDepartment of Cardiac Pathology, Pitié-Salpêtrière HospitalInternational consortium of Health Outcome MeasurementDepartment of Cardiology, Leeds Teaching Hospitals NHS TrustDepartment of cardiothoracic surgery, Erasmus MCAbstract Aims Standard outcome sets enable the value-based evaluation of health care delivery. Whereas the attainment of expert opinion has been structured using methods such as the modified-Delphi process, standardized guidelines for extraction of candidate outcomes from literature are lacking. As such, we aimed to describe an approach to obtain a comprehensive list of candidate outcomes for potential inclusion in standard outcome sets. Methods This study describes an iterative saturation approach, using randomly selected batches from a systematic literature search to develop a long list of candidate outcomes to evaluate healthcare. This approach can be preceded with an optional benchmark review of relevant registries and Clinical Practice Guidelines and data visualization techniques (e.g. as a WordCloud) to potentially decrease the number of iterations. The development of the International Consortium of Health Outcome Measures Heart valve disease set is used to illustrate the approach. Batch cutoff choices of the iterative saturation approach were validated using data of 1000 simulated cases. Results Simulation showed that on average 98% (range 92–100%) saturation is reached using a 100-article batch initially, with 25 articles in the subsequent batches. On average 4.7 repeating rounds (range 1–9) of 25 new articles were necessary to achieve saturation if no outcomes are first identified from a benchmark review or a data visualization. Conclusion In this paper a standardized approach is proposed to identify relevant candidate outcomes for a standard outcome set. This approach creates a balance between comprehensiveness and feasibility in conducting literature reviews for the identification of candidate outcomes.https://doi.org/10.1186/s12874-023-02052-xMethodologyOutcome measuresCardiovascular diseaseSystematic reviewPROM |
| spellingShingle | KM Veen A Joseph F Sossi P Blancarte Jaber E Lansac E Das-Gupta S Aktaa JJM Takkenberg Standardized approach to extract candidate outcomes from literature for a standard outcome set: a case- and simulation study BMC Medical Research Methodology Methodology Outcome measures Cardiovascular disease Systematic review PROM |
| title | Standardized approach to extract candidate outcomes from literature for a standard outcome set: a case- and simulation study |
| title_full | Standardized approach to extract candidate outcomes from literature for a standard outcome set: a case- and simulation study |
| title_fullStr | Standardized approach to extract candidate outcomes from literature for a standard outcome set: a case- and simulation study |
| title_full_unstemmed | Standardized approach to extract candidate outcomes from literature for a standard outcome set: a case- and simulation study |
| title_short | Standardized approach to extract candidate outcomes from literature for a standard outcome set: a case- and simulation study |
| title_sort | standardized approach to extract candidate outcomes from literature for a standard outcome set a case and simulation study |
| topic | Methodology Outcome measures Cardiovascular disease Systematic review PROM |
| url | https://doi.org/10.1186/s12874-023-02052-x |
| work_keys_str_mv | AT kmveen standardizedapproachtoextractcandidateoutcomesfromliteratureforastandardoutcomesetacaseandsimulationstudy AT ajoseph standardizedapproachtoextractcandidateoutcomesfromliteratureforastandardoutcomesetacaseandsimulationstudy AT fsossi standardizedapproachtoextractcandidateoutcomesfromliteratureforastandardoutcomesetacaseandsimulationstudy AT pblancartejaber standardizedapproachtoextractcandidateoutcomesfromliteratureforastandardoutcomesetacaseandsimulationstudy AT elansac standardizedapproachtoextractcandidateoutcomesfromliteratureforastandardoutcomesetacaseandsimulationstudy AT edasgupta standardizedapproachtoextractcandidateoutcomesfromliteratureforastandardoutcomesetacaseandsimulationstudy AT saktaa standardizedapproachtoextractcandidateoutcomesfromliteratureforastandardoutcomesetacaseandsimulationstudy AT jjmtakkenberg standardizedapproachtoextractcandidateoutcomesfromliteratureforastandardoutcomesetacaseandsimulationstudy |