A key performance indicators redefinition initiative at a school of pharmacy using a modified Delphi consensus technique
Objective: The Outcomes and Assessment Committee at the Virginia Commonwealth University School of Pharmacy was tasked with refining the school’s key performance indicators (KPIs) to improve programmatic assessment by focusing on the most important measures. Methods: Initially, 56 KPIs were tracked...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Centro de Investigaciones y Publicaciones Farmaceuticas
2020-12-01
|
| Series: | Pharmacy Practice |
| Subjects: | |
| Online Access: | https://www.pharmacypractice.org/journal/index.php/pp/article/view/2120 |
| _version_ | 1818934513265278976 |
|---|---|
| author | Teresa M. Salgado Taylor N. Reynolds Laura M. Frankart David A. Holdford Joseph T. DiPiro |
| author_facet | Teresa M. Salgado Taylor N. Reynolds Laura M. Frankart David A. Holdford Joseph T. DiPiro |
| author_sort | Teresa M. Salgado |
| collection | DOAJ |
| description | Objective: The Outcomes and Assessment Committee at the Virginia Commonwealth University School of Pharmacy was tasked with refining the school’s key performance indicators (KPIs) to improve programmatic assessment by focusing on the most important measures.
Methods: Initially, 56 KPIs were tracked, nine of which were university mandated, divided into 10 modules: admissions, community outreach, continuing education, diversity, faculty experience and success, fundraising, graduate program, research and scholarship, staff experience and success, and student experience and success. Using a three-round Delphi consensus technique, KPIs were reviewed by faculty and staff. Each participant responded whether they considered each KPI to be essential or not essential for school quality assessment and improvement. Consensus for the first, second, and third rounds was defined as ≥90%, ≥80%, and ≥75% agreement, respectively.
Results: Of 109 faculty and staff invited, 49 participated in the first round, 51 in the second, and 42 in the third. At the end of the third round, accumulated consensus was achieved for 35 out of 88 (39.8%) KPIs that were considered essential and 3 out of 88 (3.4%) that were considered non-essential. Consensus percentage per module was: 15.4% (2/13) admissions, 28.6% (2/7) community outreach, 33.3% (3/9) continuing education, 27.3% (3/11) diversity, 62.5% (5/8) faculty experience and success, 55.6% (5/9) fundraising, 40% (4/10) graduate program, 33.3% (3/9) research and scholarship, 57.1% (4/7) staff experience and success, and 66.7% (4/6) student experience and success.
Conclusions: Ultimately, 35 KPIs achieved consensus as essential to measure achievement of benchmarks for the school, which totals 44 KPIs, including nine university mandated KPIs. The process facilitated faculty and staff involvement in KPI selection and achieved improved focus for programmatic assessment. |
| first_indexed | 2024-12-20T05:05:28Z |
| format | Article |
| id | doaj.art-e834ed0b4cc64ea0bc58db90c404f044 |
| institution | Directory Open Access Journal |
| issn | 1885-642X 1886-3655 |
| language | English |
| last_indexed | 2024-12-20T05:05:28Z |
| publishDate | 2020-12-01 |
| publisher | Centro de Investigaciones y Publicaciones Farmaceuticas |
| record_format | Article |
| series | Pharmacy Practice |
| spelling | doaj.art-e834ed0b4cc64ea0bc58db90c404f0442022-12-21T19:52:24ZengCentro de Investigaciones y Publicaciones FarmaceuticasPharmacy Practice1885-642X1886-36552020-12-01184212010.18549/PharmPract.2020.4.2120A key performance indicators redefinition initiative at a school of pharmacy using a modified Delphi consensus techniqueTeresa M. Salgado https://orcid.org/0000-0003-2708-7145Taylor N. Reynolds https://orcid.org/0000-0003-3330-7781Laura M. Frankart https://orcid.org/0000-0002-7337-0323David A. Holdford https://orcid.org/0000-0001-7661-9326Joseph T. DiPiro https://orcid.org/0000-0002-5442-0129Objective: The Outcomes and Assessment Committee at the Virginia Commonwealth University School of Pharmacy was tasked with refining the school’s key performance indicators (KPIs) to improve programmatic assessment by focusing on the most important measures. Methods: Initially, 56 KPIs were tracked, nine of which were university mandated, divided into 10 modules: admissions, community outreach, continuing education, diversity, faculty experience and success, fundraising, graduate program, research and scholarship, staff experience and success, and student experience and success. Using a three-round Delphi consensus technique, KPIs were reviewed by faculty and staff. Each participant responded whether they considered each KPI to be essential or not essential for school quality assessment and improvement. Consensus for the first, second, and third rounds was defined as ≥90%, ≥80%, and ≥75% agreement, respectively. Results: Of 109 faculty and staff invited, 49 participated in the first round, 51 in the second, and 42 in the third. At the end of the third round, accumulated consensus was achieved for 35 out of 88 (39.8%) KPIs that were considered essential and 3 out of 88 (3.4%) that were considered non-essential. Consensus percentage per module was: 15.4% (2/13) admissions, 28.6% (2/7) community outreach, 33.3% (3/9) continuing education, 27.3% (3/11) diversity, 62.5% (5/8) faculty experience and success, 55.6% (5/9) fundraising, 40% (4/10) graduate program, 33.3% (3/9) research and scholarship, 57.1% (4/7) staff experience and success, and 66.7% (4/6) student experience and success. Conclusions: Ultimately, 35 KPIs achieved consensus as essential to measure achievement of benchmarks for the school, which totals 44 KPIs, including nine university mandated KPIs. The process facilitated faculty and staff involvement in KPI selection and achieved improved focus for programmatic assessment.https://www.pharmacypractice.org/journal/index.php/pp/article/view/2120faculty pharmacyschools pharmacyacademic performanceeducation pharmacyprogram evaluationquality improvementdelphi techniqueunited states |
| spellingShingle | Teresa M. Salgado Taylor N. Reynolds Laura M. Frankart David A. Holdford Joseph T. DiPiro A key performance indicators redefinition initiative at a school of pharmacy using a modified Delphi consensus technique Pharmacy Practice faculty pharmacy schools pharmacy academic performance education pharmacy program evaluation quality improvement delphi technique united states |
| title | A key performance indicators redefinition initiative at a school of pharmacy using a modified Delphi consensus technique |
| title_full | A key performance indicators redefinition initiative at a school of pharmacy using a modified Delphi consensus technique |
| title_fullStr | A key performance indicators redefinition initiative at a school of pharmacy using a modified Delphi consensus technique |
| title_full_unstemmed | A key performance indicators redefinition initiative at a school of pharmacy using a modified Delphi consensus technique |
| title_short | A key performance indicators redefinition initiative at a school of pharmacy using a modified Delphi consensus technique |
| title_sort | key performance indicators redefinition initiative at a school of pharmacy using a modified delphi consensus technique |
| topic | faculty pharmacy schools pharmacy academic performance education pharmacy program evaluation quality improvement delphi technique united states |
| url | https://www.pharmacypractice.org/journal/index.php/pp/article/view/2120 |
| work_keys_str_mv | AT teresamsalgado akeyperformanceindicatorsredefinitioninitiativeataschoolofpharmacyusingamodifieddelphiconsensustechnique AT taylornreynolds akeyperformanceindicatorsredefinitioninitiativeataschoolofpharmacyusingamodifieddelphiconsensustechnique AT lauramfrankart akeyperformanceindicatorsredefinitioninitiativeataschoolofpharmacyusingamodifieddelphiconsensustechnique AT davidaholdford akeyperformanceindicatorsredefinitioninitiativeataschoolofpharmacyusingamodifieddelphiconsensustechnique AT josephtdipiro akeyperformanceindicatorsredefinitioninitiativeataschoolofpharmacyusingamodifieddelphiconsensustechnique AT teresamsalgado keyperformanceindicatorsredefinitioninitiativeataschoolofpharmacyusingamodifieddelphiconsensustechnique AT taylornreynolds keyperformanceindicatorsredefinitioninitiativeataschoolofpharmacyusingamodifieddelphiconsensustechnique AT lauramfrankart keyperformanceindicatorsredefinitioninitiativeataschoolofpharmacyusingamodifieddelphiconsensustechnique AT davidaholdford keyperformanceindicatorsredefinitioninitiativeataschoolofpharmacyusingamodifieddelphiconsensustechnique AT josephtdipiro keyperformanceindicatorsredefinitioninitiativeataschoolofpharmacyusingamodifieddelphiconsensustechnique |