74 Development and content validation of a tool to assess quality of primary care practice

OBJECTIVES/GOALS: Primary care practices struggle to identify which combination of care structures and processes need to be implemented to improve practice performance and subsequently, patient outcomes. The goal of this study is to develop and validate a tool to assess care structures and processes...

Full description

Bibliographic Details
Main Authors: Carolyn A. Berry, Lorraine Kwok, Margaret Paul, Stephanie L. Albert, Saul Blecker, Donna Shelley
Format: Article
Language:English
Published: Cambridge University Press 2023-04-01
Series:Journal of Clinical and Translational Science
Online Access:https://www.cambridge.org/core/product/identifier/S2059866123001589/type/journal_article
_version_ 1797840471560552448
author Carolyn A. Berry
Lorraine Kwok
Margaret Paul
Stephanie L. Albert
Saul Blecker
Donna Shelley
author_facet Carolyn A. Berry
Lorraine Kwok
Margaret Paul
Stephanie L. Albert
Saul Blecker
Donna Shelley
author_sort Carolyn A. Berry
collection DOAJ
description OBJECTIVES/GOALS: Primary care practices struggle to identify which combination of care structures and processes need to be implemented to improve practice performance and subsequently, patient outcomes. The goal of this study is to develop and validate a tool to assess care structures and processes that are associated with better quality and patient outcomes. METHODS/STUDY POPULATION: Data from a scoping review, Delphi study, and qualitative interviews with high-performing primary care practices contributed to the development and content validation of the Tool for Advancing Practice Performance (TAPP). From these sources we identified 314 items representing care structures (e.g., care team makeup, use of electronic health records) and processes (e.g., care coordination, panel management). We developed criteria for deleting and rescuing items and received input from our expert panel to refine the pool of items. We eliminated items that were redundant and lacked clarity/specificity. The tool was further modified based on feedback from cognitive interviewing and pilot testing with practice managers, quality improvement leaders, and physicians from primary care practices. RESULTS/ANTICIPATED RESULTS: The pool of 314 items was winnowed to 188 after applying criteria for deleting and rescuing items. During the expert review, 70 items were eliminated and 8 new items were added, resulting in a working tool of 126 items. We conducted eight cognitive interviews with the 126-item tool and received feedback on the content, item structure, and language, which led to the elimination of 13 items that were poorly or incorrectly understood by respondents. We also modified the language of 23 items for clarity. After cognitive interviewing, the resulting tool comprised 113 items. Fifteen practices piloted the tool and no additional items were eliminated. We modified the instructions for completing the tool and resolved technical issues related to online administration. DISCUSSION/SIGNIFICANCE: TAPP is a novel tool for assessing care structures and processes that are associated with better quality and patient outcomes in primary care settings. The tool can be used by researchers and primary care clinicians to identify areas for improvement in practice performance and patient outcomes related to chronic disease prevention and management.
first_indexed 2024-04-09T16:15:52Z
format Article
id doaj.art-4dbd6852a4464939ae704659b2d18f1c
institution Directory Open Access Journal
issn 2059-8661
language English
last_indexed 2024-04-09T16:15:52Z
publishDate 2023-04-01
publisher Cambridge University Press
record_format Article
series Journal of Clinical and Translational Science
spelling doaj.art-4dbd6852a4464939ae704659b2d18f1c2023-04-24T05:55:54ZengCambridge University PressJournal of Clinical and Translational Science2059-86612023-04-017202010.1017/cts.2023.15874 Development and content validation of a tool to assess quality of primary care practiceCarolyn A. Berry0Lorraine Kwok1Margaret Paul2Stephanie L. Albert3Saul Blecker4Donna Shelley5New York University Grossman School of MedicineNew York University Grossman School of MedicineNew York University Grossman School of MedicineNew York University Grossman School of MedicineNew York University Grossman School of MedicineNew York University Grossman School of MedicineOBJECTIVES/GOALS: Primary care practices struggle to identify which combination of care structures and processes need to be implemented to improve practice performance and subsequently, patient outcomes. The goal of this study is to develop and validate a tool to assess care structures and processes that are associated with better quality and patient outcomes. METHODS/STUDY POPULATION: Data from a scoping review, Delphi study, and qualitative interviews with high-performing primary care practices contributed to the development and content validation of the Tool for Advancing Practice Performance (TAPP). From these sources we identified 314 items representing care structures (e.g., care team makeup, use of electronic health records) and processes (e.g., care coordination, panel management). We developed criteria for deleting and rescuing items and received input from our expert panel to refine the pool of items. We eliminated items that were redundant and lacked clarity/specificity. The tool was further modified based on feedback from cognitive interviewing and pilot testing with practice managers, quality improvement leaders, and physicians from primary care practices. RESULTS/ANTICIPATED RESULTS: The pool of 314 items was winnowed to 188 after applying criteria for deleting and rescuing items. During the expert review, 70 items were eliminated and 8 new items were added, resulting in a working tool of 126 items. We conducted eight cognitive interviews with the 126-item tool and received feedback on the content, item structure, and language, which led to the elimination of 13 items that were poorly or incorrectly understood by respondents. We also modified the language of 23 items for clarity. After cognitive interviewing, the resulting tool comprised 113 items. Fifteen practices piloted the tool and no additional items were eliminated. We modified the instructions for completing the tool and resolved technical issues related to online administration. DISCUSSION/SIGNIFICANCE: TAPP is a novel tool for assessing care structures and processes that are associated with better quality and patient outcomes in primary care settings. The tool can be used by researchers and primary care clinicians to identify areas for improvement in practice performance and patient outcomes related to chronic disease prevention and management.https://www.cambridge.org/core/product/identifier/S2059866123001589/type/journal_article
spellingShingle Carolyn A. Berry
Lorraine Kwok
Margaret Paul
Stephanie L. Albert
Saul Blecker
Donna Shelley
74 Development and content validation of a tool to assess quality of primary care practice
Journal of Clinical and Translational Science
title 74 Development and content validation of a tool to assess quality of primary care practice
title_full 74 Development and content validation of a tool to assess quality of primary care practice
title_fullStr 74 Development and content validation of a tool to assess quality of primary care practice
title_full_unstemmed 74 Development and content validation of a tool to assess quality of primary care practice
title_short 74 Development and content validation of a tool to assess quality of primary care practice
title_sort 74 development and content validation of a tool to assess quality of primary care practice
url https://www.cambridge.org/core/product/identifier/S2059866123001589/type/journal_article
work_keys_str_mv AT carolynaberry 74developmentandcontentvalidationofatooltoassessqualityofprimarycarepractice
AT lorrainekwok 74developmentandcontentvalidationofatooltoassessqualityofprimarycarepractice
AT margaretpaul 74developmentandcontentvalidationofatooltoassessqualityofprimarycarepractice
AT stephanielalbert 74developmentandcontentvalidationofatooltoassessqualityofprimarycarepractice
AT saulblecker 74developmentandcontentvalidationofatooltoassessqualityofprimarycarepractice
AT donnashelley 74developmentandcontentvalidationofatooltoassessqualityofprimarycarepractice