Three years of quality assurance data assessing the performance of over 4000 grant peer review contributions to the Canadian Institutes of Health Research Project Grant Competition
The Canadian Institutes of Health Research (CIHR) commenced a Quality Assurance Program in 2019 to monitor the quality of peer review in its Project Grant Competition Peer Review Committees. Our primary aim was to describe the performance of CIHR grant peer reviewers, based on the assessments made b...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Canadian Science Publishing
2023-01-01
|
| Series: | FACETS |
| Subjects: | |
| Online Access: | https://facetsjournal.com/doi/10.1139/facets-2022-0175 |
| _version_ | 1797752302478557184 |
|---|---|
| author | Clare L. Ardern Nadia Martino Sammy Nag Robyn Tamblyn David Moher Adrian Mota Karim M. Khan |
| author_facet | Clare L. Ardern Nadia Martino Sammy Nag Robyn Tamblyn David Moher Adrian Mota Karim M. Khan |
| author_sort | Clare L. Ardern |
| collection | DOAJ |
| description | The Canadian Institutes of Health Research (CIHR) commenced a Quality Assurance Program in 2019 to monitor the quality of peer review in its Project Grant Competition Peer Review Committees. Our primary aim was to describe the performance of CIHR grant peer reviewers, based on the assessments made by CIHR peer review leaders during the first 3 years of the Research Quality Assurance Program. All Peer Review Committee Chairs and (or) Scientific Officers who led peer review for CIHR in 2019, 2020, and 2021 completed Reviewer Quality Feedback forms immediately following Peer Review Committee meetings. The form assessed Performance, Future potential, Review quality, Participation, and Responsiveness. We summarised and descriptively synthesised data from assessments conducted after each of the four grant competitions. The performance of peer reviewers on 4438 occasions was rated by Chairs and Scientific Officers. Approximately one in three peer reviewers submitted outstanding reviews or discussed additional applications and one in 10 demonstrated potential as a future Peer Review Committee leader. At most, one in 20 peer reviewers was considered to have not performed adequately with respect to review quality, participation, or responsiveness. There is a need for more research on the processes involved in allocating research grant funding. |
| first_indexed | 2024-03-12T17:01:20Z |
| format | Article |
| id | doaj.art-e85aeb25f9d347c380e8995206c15d77 |
| institution | Directory Open Access Journal |
| issn | 2371-1671 |
| language | English |
| last_indexed | 2024-03-12T17:01:20Z |
| publishDate | 2023-01-01 |
| publisher | Canadian Science Publishing |
| record_format | Article |
| series | FACETS |
| spelling | doaj.art-e85aeb25f9d347c380e8995206c15d772023-08-07T13:00:35ZengCanadian Science PublishingFACETS2371-16712023-01-01811410.1139/facets-2022-0175Three years of quality assurance data assessing the performance of over 4000 grant peer review contributions to the Canadian Institutes of Health Research Project Grant CompetitionClare L. Ardern0Nadia Martino1Sammy Nag2Robyn Tamblyn3David Moher4Adrian Mota5Karim M. Khan6Department of Family Practice, University of British Columbia, Vancouver, BC, CanadaCanadian Institutes of Health Research, Ottawa, ON, CanadaCanadian Institutes of Health Research, Ottawa, ON, CanadaDepartment of Medicine and Department of Epidemiology and Biostatistics, McGill University, Montreal, QC, CanadaCentre for Journalology, Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, ON, CanadaCanadian Institutes of Health Research, Ottawa, ON, CanadaDepartment of Family Practice, University of British Columbia, Vancouver, BC, CanadaThe Canadian Institutes of Health Research (CIHR) commenced a Quality Assurance Program in 2019 to monitor the quality of peer review in its Project Grant Competition Peer Review Committees. Our primary aim was to describe the performance of CIHR grant peer reviewers, based on the assessments made by CIHR peer review leaders during the first 3 years of the Research Quality Assurance Program. All Peer Review Committee Chairs and (or) Scientific Officers who led peer review for CIHR in 2019, 2020, and 2021 completed Reviewer Quality Feedback forms immediately following Peer Review Committee meetings. The form assessed Performance, Future potential, Review quality, Participation, and Responsiveness. We summarised and descriptively synthesised data from assessments conducted after each of the four grant competitions. The performance of peer reviewers on 4438 occasions was rated by Chairs and Scientific Officers. Approximately one in three peer reviewers submitted outstanding reviews or discussed additional applications and one in 10 demonstrated potential as a future Peer Review Committee leader. At most, one in 20 peer reviewers was considered to have not performed adequately with respect to review quality, participation, or responsiveness. There is a need for more research on the processes involved in allocating research grant funding.https://facetsjournal.com/doi/10.1139/facets-2022-0175peer reviewresearch integrityresearch grantfundingdecisions in research fundingresearch personnel |
| spellingShingle | Clare L. Ardern Nadia Martino Sammy Nag Robyn Tamblyn David Moher Adrian Mota Karim M. Khan Three years of quality assurance data assessing the performance of over 4000 grant peer review contributions to the Canadian Institutes of Health Research Project Grant Competition FACETS peer review research integrity research grant funding decisions in research funding research personnel |
| title | Three years of quality assurance data assessing the performance of over 4000 grant peer review contributions to the Canadian Institutes of Health Research Project Grant Competition |
| title_full | Three years of quality assurance data assessing the performance of over 4000 grant peer review contributions to the Canadian Institutes of Health Research Project Grant Competition |
| title_fullStr | Three years of quality assurance data assessing the performance of over 4000 grant peer review contributions to the Canadian Institutes of Health Research Project Grant Competition |
| title_full_unstemmed | Three years of quality assurance data assessing the performance of over 4000 grant peer review contributions to the Canadian Institutes of Health Research Project Grant Competition |
| title_short | Three years of quality assurance data assessing the performance of over 4000 grant peer review contributions to the Canadian Institutes of Health Research Project Grant Competition |
| title_sort | three years of quality assurance data assessing the performance of over 4000 grant peer review contributions to the canadian institutes of health research project grant competition |
| topic | peer review research integrity research grant funding decisions in research funding research personnel |
| url | https://facetsjournal.com/doi/10.1139/facets-2022-0175 |
| work_keys_str_mv | AT clarelardern threeyearsofqualityassurancedataassessingtheperformanceofover4000grantpeerreviewcontributionstothecanadianinstitutesofhealthresearchprojectgrantcompetition AT nadiamartino threeyearsofqualityassurancedataassessingtheperformanceofover4000grantpeerreviewcontributionstothecanadianinstitutesofhealthresearchprojectgrantcompetition AT sammynag threeyearsofqualityassurancedataassessingtheperformanceofover4000grantpeerreviewcontributionstothecanadianinstitutesofhealthresearchprojectgrantcompetition AT robyntamblyn threeyearsofqualityassurancedataassessingtheperformanceofover4000grantpeerreviewcontributionstothecanadianinstitutesofhealthresearchprojectgrantcompetition AT davidmoher threeyearsofqualityassurancedataassessingtheperformanceofover4000grantpeerreviewcontributionstothecanadianinstitutesofhealthresearchprojectgrantcompetition AT adrianmota threeyearsofqualityassurancedataassessingtheperformanceofover4000grantpeerreviewcontributionstothecanadianinstitutesofhealthresearchprojectgrantcompetition AT karimmkhan threeyearsofqualityassurancedataassessingtheperformanceofover4000grantpeerreviewcontributionstothecanadianinstitutesofhealthresearchprojectgrantcompetition |