Metrics and Evaluation Tools for Patient Engagement in Healthcare Organization- and System-Level Decision-Making: A Systematic Review
Background Patient, public, consumer, and community (P2C2) engagement in organization-, community-, and systemlevel healthcare decision-making is increasing globally, but its formal evaluation remains challenging. To define a taxonomy of possible P2C2 engagement metrics and compare existing evaluat...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Kerman University of Medical Sciences
2018-10-01
|
| Series: | International Journal of Health Policy and Management |
| Subjects: | |
| Online Access: | http://www.ijhpm.com/article_3499_1967130d0349e7ae5eae493fe3321750.pdf |
| _version_ | 1818297779537051648 |
|---|---|
| author | Vadim Dukhanin Rachel Topazian Matthew DeCamp |
| author_facet | Vadim Dukhanin Rachel Topazian Matthew DeCamp |
| author_sort | Vadim Dukhanin |
| collection | DOAJ |
| description | Background
Patient, public, consumer, and community (P2C2) engagement in organization-, community-, and systemlevel healthcare decision-making is increasing globally, but its formal evaluation remains challenging. To define a taxonomy of possible P2C2 engagement metrics and compare existing evaluation tools against this taxonomy, we conducted a systematic review.
Methods
A broad search strategy was developed for English language publications available from January 1962 through April 2015 in PubMed, Embase, Sociological Abstracts, PsycINFO, EconLit, and the gray literature. A publication was excluded if: (1) the setting was not healthcare delivery (ie, we excluded non-health sectors, such as urban planning; research settings; and public health settings not involving clinical care delivery); (2) the P2C2 engagement was episodic; or (3) the concept of evaluation or possible evaluation metrics were absent. To be included as an evaluation tool, publications had to contain an evaluative instrument that could be employed with minimal modification by a healthcare organization.
Results
A total of 199 out of 3953 publications met exclusion and inclusion criteria. These were qualitatively analyzed using inductive content analysis to create a comprehensive taxonomy of 116 possible metrics for evaluating P2C2 engagement. 44 outcome metrics were grouped into three domains (internal, external, and aggregate outcomes) that included six subdomains: impact on engagement participants, impact on services provided by the healthcare organization, impact on the organization itself, influence on the broader public, influence on population health, and engagement cost-effectiveness. The 72 process metrics formed four domains (direct process metrics; surrogate process metrics; aggregate process metrics; and preconditions for engagement) that comprised sixteen subdomains. We identified 23 potential tools for evaluating P2C2 engagement. The identified tools were published between 1973-2015 and varied in their coverage of the taxonomy, methodology used (qualitative, quantitative, or mixed), and intended evaluators (organizational leaders, P2C2 participants, external evaluators, or some combination). Parts of the metric taxonomy were absent from all tools.
Conclusions
By comprehensively mapping potential outcome and process metrics as well as existing P2C2 engagement tools, this review supports high-quality P2C2 engagement globally by informing the selection of existing evaluation tools and identifying gaps where new tools are needed. |
| first_indexed | 2024-12-13T04:24:51Z |
| format | Article |
| id | doaj.art-9ebada15e60146168a146c67f5eb51fb |
| institution | Directory Open Access Journal |
| issn | 2322-5939 2322-5939 |
| language | English |
| last_indexed | 2024-12-13T04:24:51Z |
| publishDate | 2018-10-01 |
| publisher | Kerman University of Medical Sciences |
| record_format | Article |
| series | International Journal of Health Policy and Management |
| spelling | doaj.art-9ebada15e60146168a146c67f5eb51fb2022-12-21T23:59:42ZengKerman University of Medical SciencesInternational Journal of Health Policy and Management2322-59392322-59392018-10-0171088990310.15171/IJHPM.2018.43Metrics and Evaluation Tools for Patient Engagement in Healthcare Organization- and System-Level Decision-Making: A Systematic ReviewVadim Dukhanin0Rachel Topazian1Matthew DeCamp2Department of Health Policy and Management, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USANational Journal, Washington, DC, USAJohns Hopkins Berman Institute of Bioethics, Baltimore, MD, USABackground Patient, public, consumer, and community (P2C2) engagement in organization-, community-, and systemlevel healthcare decision-making is increasing globally, but its formal evaluation remains challenging. To define a taxonomy of possible P2C2 engagement metrics and compare existing evaluation tools against this taxonomy, we conducted a systematic review. Methods A broad search strategy was developed for English language publications available from January 1962 through April 2015 in PubMed, Embase, Sociological Abstracts, PsycINFO, EconLit, and the gray literature. A publication was excluded if: (1) the setting was not healthcare delivery (ie, we excluded non-health sectors, such as urban planning; research settings; and public health settings not involving clinical care delivery); (2) the P2C2 engagement was episodic; or (3) the concept of evaluation or possible evaluation metrics were absent. To be included as an evaluation tool, publications had to contain an evaluative instrument that could be employed with minimal modification by a healthcare organization. Results A total of 199 out of 3953 publications met exclusion and inclusion criteria. These were qualitatively analyzed using inductive content analysis to create a comprehensive taxonomy of 116 possible metrics for evaluating P2C2 engagement. 44 outcome metrics were grouped into three domains (internal, external, and aggregate outcomes) that included six subdomains: impact on engagement participants, impact on services provided by the healthcare organization, impact on the organization itself, influence on the broader public, influence on population health, and engagement cost-effectiveness. The 72 process metrics formed four domains (direct process metrics; surrogate process metrics; aggregate process metrics; and preconditions for engagement) that comprised sixteen subdomains. We identified 23 potential tools for evaluating P2C2 engagement. The identified tools were published between 1973-2015 and varied in their coverage of the taxonomy, methodology used (qualitative, quantitative, or mixed), and intended evaluators (organizational leaders, P2C2 participants, external evaluators, or some combination). Parts of the metric taxonomy were absent from all tools. Conclusions By comprehensively mapping potential outcome and process metrics as well as existing P2C2 engagement tools, this review supports high-quality P2C2 engagement globally by informing the selection of existing evaluation tools and identifying gaps where new tools are needed.http://www.ijhpm.com/article_3499_1967130d0349e7ae5eae493fe3321750.pdfPatient EngagementPatient ParticipationHealth SystemsHealth PlanningOrganizational Decision-Making |
| spellingShingle | Vadim Dukhanin Rachel Topazian Matthew DeCamp Metrics and Evaluation Tools for Patient Engagement in Healthcare Organization- and System-Level Decision-Making: A Systematic Review International Journal of Health Policy and Management Patient Engagement Patient Participation Health Systems Health Planning Organizational Decision-Making |
| title | Metrics and Evaluation Tools for Patient Engagement in Healthcare Organization- and System-Level Decision-Making: A Systematic Review |
| title_full | Metrics and Evaluation Tools for Patient Engagement in Healthcare Organization- and System-Level Decision-Making: A Systematic Review |
| title_fullStr | Metrics and Evaluation Tools for Patient Engagement in Healthcare Organization- and System-Level Decision-Making: A Systematic Review |
| title_full_unstemmed | Metrics and Evaluation Tools for Patient Engagement in Healthcare Organization- and System-Level Decision-Making: A Systematic Review |
| title_short | Metrics and Evaluation Tools for Patient Engagement in Healthcare Organization- and System-Level Decision-Making: A Systematic Review |
| title_sort | metrics and evaluation tools for patient engagement in healthcare organization and system level decision making a systematic review |
| topic | Patient Engagement Patient Participation Health Systems Health Planning Organizational Decision-Making |
| url | http://www.ijhpm.com/article_3499_1967130d0349e7ae5eae493fe3321750.pdf |
| work_keys_str_mv | AT vadimdukhanin metricsandevaluationtoolsforpatientengagementinhealthcareorganizationandsystemleveldecisionmakingasystematicreview AT racheltopazian metricsandevaluationtoolsforpatientengagementinhealthcareorganizationandsystemleveldecisionmakingasystematicreview AT matthewdecamp metricsandevaluationtoolsforpatientengagementinhealthcareorganizationandsystemleveldecisionmakingasystematicreview |