Evaluation of medical research performance – position paper of the Association of the Scientific Medical Societies in Germany (AWMF)
[english] Objective: The evaluation of medical research performance is a key prerequisite for the systematic advancement of medical faculties, research foci, academic departments, and individual scientists’ careers. However, it is often based on vaguely defined aims and questionable methods and can...
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | deu |
| Published: |
German Medical Science GMS Publishing House
2014-06-01
|
| Series: | GMS German Medical Science |
| Online Access: | http://www.egms.de/static/en/journals/gms/2014-12/000196.shtml |
| _version_ | 1818354947380477952 |
|---|---|
| author | Herrmann-Lingen, Christoph Brunner, Edgar Hildenbrand, Sibylle Loew, Thomas H. Raupach, Tobias Spies, Claudia Treede, Rolf-Detlef Vahl, Christian-Friedrich Wenz, Hans-Jürgen |
| author_facet | Herrmann-Lingen, Christoph Brunner, Edgar Hildenbrand, Sibylle Loew, Thomas H. Raupach, Tobias Spies, Claudia Treede, Rolf-Detlef Vahl, Christian-Friedrich Wenz, Hans-Jürgen |
| author_sort | Herrmann-Lingen, Christoph |
| collection | DOAJ |
| description | [english] Objective: The evaluation of medical research performance is a key prerequisite for the systematic advancement of medical faculties, research foci, academic departments, and individual scientists’ careers. However, it is often based on vaguely defined aims and questionable methods and can thereby lead to unwanted regulatory effects. The current paper aims at defining the position of German academic medicine toward the aims, methods, and consequences of its evaluation. Methods: During the Berlin Forum of the Association of the Scientific Societies in Germany (AWMF) held on 18 October 2013, international experts presented data on methods for evaluating medical research performance. Subsequent discussions among representatives of relevant scientific organizations and within three ad-hoc writing groups led to a first draft of this article. Further discussions within the AWMF Committee for Evaluation of Performance in Research and Teaching and the AWMF Executive Board resulted in the final consented version presented here.Results: The AWMF recommends modifications to the current system of evaluating medical research performance. Evaluations should follow clearly defined and communicated aims and consist of both summative and formative components. Informed peer reviews are valuable but feasible in longer time intervals only. They can be complemented by objective indicators. However, the Journal Impact Factor is not an appropriate measure for evaluating individual publications or their authors. The scientific “impact” rather requires multidimensional evaluation. Indicators of potential relevance in this context may include, e.g., normalized citation rates of scientific publications, other forms of reception by the scientific community and the public, and activities in scientific organizations, research synthesis and science communication. In addition, differentiated recommendations are made for evaluating the acquisition of third-party funds and the promotion of junior scientists.Conclusions: With the explicit recommendations presented in the current position paper, the AWMF suggests enhancements to the practice of evaluating medical research performance by faculties, ministries and research funding organizations. |
| first_indexed | 2024-12-13T19:33:31Z |
| format | Article |
| id | doaj.art-bb47662661cc4df6af19b7a07d7acdb4 |
| institution | Directory Open Access Journal |
| issn | 1612-3174 |
| language | deu |
| last_indexed | 2024-12-13T19:33:31Z |
| publishDate | 2014-06-01 |
| publisher | German Medical Science GMS Publishing House |
| record_format | Article |
| series | GMS German Medical Science |
| spelling | doaj.art-bb47662661cc4df6af19b7a07d7acdb42022-12-21T23:33:53ZdeuGerman Medical Science GMS Publishing HouseGMS German Medical Science1612-31742014-06-0112Doc1110.3205/000196Evaluation of medical research performance – position paper of the Association of the Scientific Medical Societies in Germany (AWMF)Herrmann-Lingen, Christoph0Brunner, Edgar1Hildenbrand, Sibylle2Loew, Thomas H.3Raupach, Tobias4Spies, Claudia5Treede, Rolf-Detlef6Vahl, Christian-Friedrich7Wenz, Hans-Jürgen8Department of Psychosomatic Medicine and Psychotherapy, University of Göttingen Medical Center, Göttingen, GermanyInstitute for Medical Statistics, University of Göttingen Medical Center, Göttingen, GermanyInstitute of Occupational and Social Medicine and Health Services Research, University Hospital of Tübingen, Tübingen, GermanyDepartment of Psychosomatics, University Hospital of Regensburg, Regensburg, GermanyDepartment of Cardiology and Pneumology, University of Göttingen Medical Center, Göttingen, GermanyDepartment for Anesthesiology and Surgical Intensive Care, Charité Berlin, Berlin, GermanyCBTM Neurophysiology, Medical Faculty Mannheim of Heidelberg University, Mannheim, GermanyDepartment of Cardiothoracic and Vascular Surgery, University of Mainz Medical Center, Mainz, GermanyClinic of Prosthodontics, Propaedeutics and Dental Materials, Christian-Albrechts-University Kiel, Kiel, Germany[english] Objective: The evaluation of medical research performance is a key prerequisite for the systematic advancement of medical faculties, research foci, academic departments, and individual scientists’ careers. However, it is often based on vaguely defined aims and questionable methods and can thereby lead to unwanted regulatory effects. The current paper aims at defining the position of German academic medicine toward the aims, methods, and consequences of its evaluation. Methods: During the Berlin Forum of the Association of the Scientific Societies in Germany (AWMF) held on 18 October 2013, international experts presented data on methods for evaluating medical research performance. Subsequent discussions among representatives of relevant scientific organizations and within three ad-hoc writing groups led to a first draft of this article. Further discussions within the AWMF Committee for Evaluation of Performance in Research and Teaching and the AWMF Executive Board resulted in the final consented version presented here.Results: The AWMF recommends modifications to the current system of evaluating medical research performance. Evaluations should follow clearly defined and communicated aims and consist of both summative and formative components. Informed peer reviews are valuable but feasible in longer time intervals only. They can be complemented by objective indicators. However, the Journal Impact Factor is not an appropriate measure for evaluating individual publications or their authors. The scientific “impact” rather requires multidimensional evaluation. Indicators of potential relevance in this context may include, e.g., normalized citation rates of scientific publications, other forms of reception by the scientific community and the public, and activities in scientific organizations, research synthesis and science communication. In addition, differentiated recommendations are made for evaluating the acquisition of third-party funds and the promotion of junior scientists.Conclusions: With the explicit recommendations presented in the current position paper, the AWMF suggests enhancements to the practice of evaluating medical research performance by faculties, ministries and research funding organizations.http://www.egms.de/static/en/journals/gms/2014-12/000196.shtml |
| spellingShingle | Herrmann-Lingen, Christoph Brunner, Edgar Hildenbrand, Sibylle Loew, Thomas H. Raupach, Tobias Spies, Claudia Treede, Rolf-Detlef Vahl, Christian-Friedrich Wenz, Hans-Jürgen Evaluation of medical research performance – position paper of the Association of the Scientific Medical Societies in Germany (AWMF) GMS German Medical Science |
| title | Evaluation of medical research performance – position paper of the Association of the Scientific Medical Societies in Germany (AWMF) |
| title_full | Evaluation of medical research performance – position paper of the Association of the Scientific Medical Societies in Germany (AWMF) |
| title_fullStr | Evaluation of medical research performance – position paper of the Association of the Scientific Medical Societies in Germany (AWMF) |
| title_full_unstemmed | Evaluation of medical research performance – position paper of the Association of the Scientific Medical Societies in Germany (AWMF) |
| title_short | Evaluation of medical research performance – position paper of the Association of the Scientific Medical Societies in Germany (AWMF) |
| title_sort | evaluation of medical research performance position paper of the association of the scientific medical societies in germany awmf |
| url | http://www.egms.de/static/en/journals/gms/2014-12/000196.shtml |
| work_keys_str_mv | AT herrmannlingenchristoph evaluationofmedicalresearchperformancepositionpaperoftheassociationofthescientificmedicalsocietiesingermanyawmf AT brunneredgar evaluationofmedicalresearchperformancepositionpaperoftheassociationofthescientificmedicalsocietiesingermanyawmf AT hildenbrandsibylle evaluationofmedicalresearchperformancepositionpaperoftheassociationofthescientificmedicalsocietiesingermanyawmf AT loewthomash evaluationofmedicalresearchperformancepositionpaperoftheassociationofthescientificmedicalsocietiesingermanyawmf AT raupachtobias evaluationofmedicalresearchperformancepositionpaperoftheassociationofthescientificmedicalsocietiesingermanyawmf AT spiesclaudia evaluationofmedicalresearchperformancepositionpaperoftheassociationofthescientificmedicalsocietiesingermanyawmf AT treederolfdetlef evaluationofmedicalresearchperformancepositionpaperoftheassociationofthescientificmedicalsocietiesingermanyawmf AT vahlchristianfriedrich evaluationofmedicalresearchperformancepositionpaperoftheassociationofthescientificmedicalsocietiesingermanyawmf AT wenzhansjurgen evaluationofmedicalresearchperformancepositionpaperoftheassociationofthescientificmedicalsocietiesingermanyawmf |