Data Management Plan Requirements for Campus Grant Competitions: Opportunities for Research Data Services Assessment and Outreach
Objective: To examine the effects of research data services (RDS) on the quality of data management plans (DMPs) required for a campus-level faculty grant competition, as well as to explore opportunities that the local DMP requirement presented for RDS outreach. Methods: Nine reviewers each score...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
UMass Chan Medical School, Lamar Soutter Library
2016-04-01
|
| Series: | Journal of eScience Librarianship |
| Subjects: | |
| Online Access: | http://escholarship.umassmed.edu/jeslib/vol5/iss1/1/ |
| _version_ | 1797967885477347328 |
|---|---|
| author | Andrew M. Johnson Shelley Knuth |
| author_facet | Andrew M. Johnson Shelley Knuth |
| author_sort | Andrew M. Johnson |
| collection | DOAJ |
| description | Objective: To examine the effects of research data services (RDS) on the quality of data management plans (DMPs) required for a campus-level faculty grant competition, as well as to explore opportunities that the local DMP requirement presented for RDS outreach.
Methods: Nine reviewers each scored a randomly assigned portion of DMPs from 82 competition proposals. Each DMP was scored by three reviewers, and the three scores were averaged together to obtain the final score. Interrater reliability was measured using intraclass correlation. Unpaired t-tests were used to compare mean DMP scores for faculty who utilized RDS services with those who did not. Unpaired t-tests were also used to compare mean DMP scores for proposals that were funded with proposals that were not funded. One-way ANOVA was used to compare mean DMP scores among proposals from six broad disciplinary categories.
Results: Analyses showed that RDS consultations had a statistically significant effect on DMP scores. Differences between DMP scores for funded versus unfunded proposals and among disciplinary categories were not significant. The DMP requirement also provided a number of both expected and unexpected outreach opportunities for RDS services.
Conclusions: Requiring DMPs for campus grant competitions can provide important assessment and outreach opportunities for research data services. While these results might not be generalizable to DMP review processes at federal funding agencies, they do suggest the importance, at any level, of developing a shared understanding of what constitutes a high quality DMP among grant applicants, grant reviewers, and RDS providers. |
| first_indexed | 2024-04-11T02:38:19Z |
| format | Article |
| id | doaj.art-e11a83336a554e809c208742eb5b6801 |
| institution | Directory Open Access Journal |
| issn | 2161-3974 |
| language | English |
| last_indexed | 2024-04-11T02:38:19Z |
| publishDate | 2016-04-01 |
| publisher | UMass Chan Medical School, Lamar Soutter Library |
| record_format | Article |
| series | Journal of eScience Librarianship |
| spelling | doaj.art-e11a83336a554e809c208742eb5b68012023-01-02T19:38:32ZengUMass Chan Medical School, Lamar Soutter LibraryJournal of eScience Librarianship2161-39742016-04-0151e108910.7191/jeslib.2016.1089Data Management Plan Requirements for Campus Grant Competitions: Opportunities for Research Data Services Assessment and OutreachAndrew M. Johnson0Shelley Knuth1University of Colorado BoulderUniversity of Colorado BoulderObjective: To examine the effects of research data services (RDS) on the quality of data management plans (DMPs) required for a campus-level faculty grant competition, as well as to explore opportunities that the local DMP requirement presented for RDS outreach. Methods: Nine reviewers each scored a randomly assigned portion of DMPs from 82 competition proposals. Each DMP was scored by three reviewers, and the three scores were averaged together to obtain the final score. Interrater reliability was measured using intraclass correlation. Unpaired t-tests were used to compare mean DMP scores for faculty who utilized RDS services with those who did not. Unpaired t-tests were also used to compare mean DMP scores for proposals that were funded with proposals that were not funded. One-way ANOVA was used to compare mean DMP scores among proposals from six broad disciplinary categories. Results: Analyses showed that RDS consultations had a statistically significant effect on DMP scores. Differences between DMP scores for funded versus unfunded proposals and among disciplinary categories were not significant. The DMP requirement also provided a number of both expected and unexpected outreach opportunities for RDS services. Conclusions: Requiring DMPs for campus grant competitions can provide important assessment and outreach opportunities for research data services. While these results might not be generalizable to DMP review processes at federal funding agencies, they do suggest the importance, at any level, of developing a shared understanding of what constitutes a high quality DMP among grant applicants, grant reviewers, and RDS providers.http://escholarship.umassmed.edu/jeslib/vol5/iss1/1/data management plansresearch data servicescampus grant competitions |
| spellingShingle | Andrew M. Johnson Shelley Knuth Data Management Plan Requirements for Campus Grant Competitions: Opportunities for Research Data Services Assessment and Outreach Journal of eScience Librarianship data management plans research data services campus grant competitions |
| title | Data Management Plan Requirements for Campus Grant Competitions: Opportunities for Research Data Services Assessment and Outreach |
| title_full | Data Management Plan Requirements for Campus Grant Competitions: Opportunities for Research Data Services Assessment and Outreach |
| title_fullStr | Data Management Plan Requirements for Campus Grant Competitions: Opportunities for Research Data Services Assessment and Outreach |
| title_full_unstemmed | Data Management Plan Requirements for Campus Grant Competitions: Opportunities for Research Data Services Assessment and Outreach |
| title_short | Data Management Plan Requirements for Campus Grant Competitions: Opportunities for Research Data Services Assessment and Outreach |
| title_sort | data management plan requirements for campus grant competitions opportunities for research data services assessment and outreach |
| topic | data management plans research data services campus grant competitions |
| url | http://escholarship.umassmed.edu/jeslib/vol5/iss1/1/ |
| work_keys_str_mv | AT andrewmjohnson datamanagementplanrequirementsforcampusgrantcompetitionsopportunitiesforresearchdataservicesassessmentandoutreach AT shelleyknuth datamanagementplanrequirementsforcampusgrantcompetitionsopportunitiesforresearchdataservicesassessmentandoutreach |