Predicting Research Productivity in International Evaluation Journals across Countries

Background: Progress in evaluation research depends on the continuous generation of scholarly knowledge and its dissemination in the community. One way of disseminating findings is to publish in scientific journals and researchers, institutions, and even whole countries are assessed by their output...

Full description

Bibliographic Details
Main Authors: Christoph E. Mueller, Hansjoerg Gaus, Ingo Konradt
Format: Article
Language:English
Published: The Evaluation Center at Western Michigan University 2016-10-01
Series:Journal of MultiDisciplinary Evaluation
Online Access:https://journals.sfu.ca/jmde/index.php/jmde_1/article/view/459
_version_ 1797812665308938240
author Christoph E. Mueller
Hansjoerg Gaus
Ingo Konradt
author_facet Christoph E. Mueller
Hansjoerg Gaus
Ingo Konradt
author_sort Christoph E. Mueller
collection DOAJ
description Background: Progress in evaluation research depends on the continuous generation of scholarly knowledge and its dissemination in the community. One way of disseminating findings is to publish in scientific journals and researchers, institutions, and even whole countries are assessed by their output in these journals. Particularly with regard to countries, there is an uneven distribution of research productivity in evaluation journals. A viable model for predicting countries’ research output in international evaluation journals, however, has not yet been developed.   Purpose: The purpose of this study was to develop and test a model for the prediction of countries’ research output in international evaluation journals by predictors from the research, economic, and social/political system.   Setting: NA   Intervention: NA   Research Design: A cross-sectional design was used for predicting research output in evaluation journals across countries.   Data Collection and Analysis: Our sample consists of 65 countries that made contributions to ten international peer-reviewed evaluation journals. We collected data for the period from 2009 to 2013 and predicted the number of authorships across countries by using boosted regression trees, a machine learning procedure.   Findings: Our model provided accurate predictions of countries’ research output. Research productivity in the social sciences had the strongest effect, followed by economic prosperity, control of corruption, and age of evaluation society. The model was generalizable to another period of time with only marginal loss in predictive accuracy.
first_indexed 2024-03-13T07:41:52Z
format Article
id doaj.art-7f4c08fe0cdd45aabaa1c88d5590c21d
institution Directory Open Access Journal
issn 1556-8180
language English
last_indexed 2024-03-13T07:41:52Z
publishDate 2016-10-01
publisher The Evaluation Center at Western Michigan University
record_format Article
series Journal of MultiDisciplinary Evaluation
spelling doaj.art-7f4c08fe0cdd45aabaa1c88d5590c21d2023-06-03T06:57:55ZengThe Evaluation Center at Western Michigan UniversityJournal of MultiDisciplinary Evaluation1556-81802016-10-01122710.56645/jmde.v12i27.459Predicting Research Productivity in International Evaluation Journals across CountriesChristoph E. Mueller0Hansjoerg Gaus1Ingo Konradt2Saarland University, Center for Evaluation (CEval)Saarland University, Center for Evaluation (CEval)Institute for Employment Research Rhineland-Palatinate-Saarland Background: Progress in evaluation research depends on the continuous generation of scholarly knowledge and its dissemination in the community. One way of disseminating findings is to publish in scientific journals and researchers, institutions, and even whole countries are assessed by their output in these journals. Particularly with regard to countries, there is an uneven distribution of research productivity in evaluation journals. A viable model for predicting countries’ research output in international evaluation journals, however, has not yet been developed.   Purpose: The purpose of this study was to develop and test a model for the prediction of countries’ research output in international evaluation journals by predictors from the research, economic, and social/political system.   Setting: NA   Intervention: NA   Research Design: A cross-sectional design was used for predicting research output in evaluation journals across countries.   Data Collection and Analysis: Our sample consists of 65 countries that made contributions to ten international peer-reviewed evaluation journals. We collected data for the period from 2009 to 2013 and predicted the number of authorships across countries by using boosted regression trees, a machine learning procedure.   Findings: Our model provided accurate predictions of countries’ research output. Research productivity in the social sciences had the strongest effect, followed by economic prosperity, control of corruption, and age of evaluation society. The model was generalizable to another period of time with only marginal loss in predictive accuracy. https://journals.sfu.ca/jmde/index.php/jmde_1/article/view/459
spellingShingle Christoph E. Mueller
Hansjoerg Gaus
Ingo Konradt
Predicting Research Productivity in International Evaluation Journals across Countries
Journal of MultiDisciplinary Evaluation
title Predicting Research Productivity in International Evaluation Journals across Countries
title_full Predicting Research Productivity in International Evaluation Journals across Countries
title_fullStr Predicting Research Productivity in International Evaluation Journals across Countries
title_full_unstemmed Predicting Research Productivity in International Evaluation Journals across Countries
title_short Predicting Research Productivity in International Evaluation Journals across Countries
title_sort predicting research productivity in international evaluation journals across countries
url https://journals.sfu.ca/jmde/index.php/jmde_1/article/view/459
work_keys_str_mv AT christophemueller predictingresearchproductivityininternationalevaluationjournalsacrosscountries
AT hansjoerggaus predictingresearchproductivityininternationalevaluationjournalsacrosscountries
AT ingokonradt predictingresearchproductivityininternationalevaluationjournalsacrosscountries