Why Government and Non-Governmental Policies and Projects Fail Despite ‘Evaluations’: An Indicator to Measure whether Evaluation Systems Incorporate the Rules of Good Governance

Background: While much has been written in the evaluation literature on the theory of evaluations and on specific cases, there is still no comprehensive and easy to use indicator that can be used to hold organizations to the principles of effective evaluation, to score their quality in several areas...

Full description

Bibliographic Details
Main Author: David H. Lempert
Format: Article
Language:English
Published: The Evaluation Center at Western Michigan University 2010-02-01
Series:Journal of MultiDisciplinary Evaluation
Subjects:
Online Access:http://survey.ate.wmich.edu/jmde/index.php/jmde_1/article/view/243
_version_ 1797725838122156032
author David H. Lempert
author_facet David H. Lempert
author_sort David H. Lempert
collection DOAJ
description Background: While much has been written in the evaluation literature on the theory of evaluations and on specific cases, there is still no comprehensive and easy to use indicator that can be used to hold organizations to the principles of effective evaluation, to score their quality in several areas, and to offer an immediate diagnostic for improvements. Purpose: The article offers an easy-to-use indicator for measuring whether organizational evaluation policies for government and non-governmental organization spending actually protect the public interest in line with good governance and management principles or whether they serve, instead, to protect bureaucracies and hide wrongdoing under the cover of an “outside” evaluation. Setting: The primary focus of the piece is on international development evaluations but the author shows how the same indicator and model can be used for other government agencies as well as businesses, with modifications. Intervention: The article examines failures of evaluation systems in light of the principles for quality and shows how an indicator can be used to measure and prevent those failures. Research Design: The piece defines the principles of evaluation systems and accountability using both the frameworks of international agencies, themselves, and professional texts, places them in a model framework for effective evaluations, and then turns this framework into a set of questions to derive an indicator. Data Collection and Analysis: The article offers a sample detailed test of the indicator using the United Nations Development Programme (UNDP) as a case study. Several other organizations of different types are also tested briefly to yield a variety of results on the quality of their evaluation systems. Findings: Use of this indicator on several organizations including those of the UN system, the EC, U.S.A.I.D., reveals that a number of governmental agencies and contractors (and particularly in the field of international development) are actually failing to protect the public interest and are using evaluation processes as tools to cover up abuses and mistakes and to advocate or advertise for more funding.
first_indexed 2024-03-12T10:36:58Z
format Article
id doaj.art-c89402d4612e4c2a932f0497352ec7a1
institution Directory Open Access Journal
issn 1556-8180
language English
last_indexed 2024-03-12T10:36:58Z
publishDate 2010-02-01
publisher The Evaluation Center at Western Michigan University
record_format Article
series Journal of MultiDisciplinary Evaluation
spelling doaj.art-c89402d4612e4c2a932f0497352ec7a12023-09-02T08:40:20ZengThe Evaluation Center at Western Michigan UniversityJournal of MultiDisciplinary Evaluation1556-81802010-02-0161358108Why Government and Non-Governmental Policies and Projects Fail Despite ‘Evaluations’: An Indicator to Measure whether Evaluation Systems Incorporate the Rules of Good GovernanceDavid H. LempertBackground: While much has been written in the evaluation literature on the theory of evaluations and on specific cases, there is still no comprehensive and easy to use indicator that can be used to hold organizations to the principles of effective evaluation, to score their quality in several areas, and to offer an immediate diagnostic for improvements. Purpose: The article offers an easy-to-use indicator for measuring whether organizational evaluation policies for government and non-governmental organization spending actually protect the public interest in line with good governance and management principles or whether they serve, instead, to protect bureaucracies and hide wrongdoing under the cover of an “outside” evaluation. Setting: The primary focus of the piece is on international development evaluations but the author shows how the same indicator and model can be used for other government agencies as well as businesses, with modifications. Intervention: The article examines failures of evaluation systems in light of the principles for quality and shows how an indicator can be used to measure and prevent those failures. Research Design: The piece defines the principles of evaluation systems and accountability using both the frameworks of international agencies, themselves, and professional texts, places them in a model framework for effective evaluations, and then turns this framework into a set of questions to derive an indicator. Data Collection and Analysis: The article offers a sample detailed test of the indicator using the United Nations Development Programme (UNDP) as a case study. Several other organizations of different types are also tested briefly to yield a variety of results on the quality of their evaluation systems. Findings: Use of this indicator on several organizations including those of the UN system, the EC, U.S.A.I.D., reveals that a number of governmental agencies and contractors (and particularly in the field of international development) are actually failing to protect the public interest and are using evaluation processes as tools to cover up abuses and mistakes and to advocate or advertise for more funding.http://survey.ate.wmich.edu/jmde/index.php/jmde_1/article/view/243evaluationinternational developmenttransparencyaccountabilitymonitoringgovernance
spellingShingle David H. Lempert
Why Government and Non-Governmental Policies and Projects Fail Despite ‘Evaluations’: An Indicator to Measure whether Evaluation Systems Incorporate the Rules of Good Governance
Journal of MultiDisciplinary Evaluation
evaluation
international development
transparency
accountability
monitoring
governance
title Why Government and Non-Governmental Policies and Projects Fail Despite ‘Evaluations’: An Indicator to Measure whether Evaluation Systems Incorporate the Rules of Good Governance
title_full Why Government and Non-Governmental Policies and Projects Fail Despite ‘Evaluations’: An Indicator to Measure whether Evaluation Systems Incorporate the Rules of Good Governance
title_fullStr Why Government and Non-Governmental Policies and Projects Fail Despite ‘Evaluations’: An Indicator to Measure whether Evaluation Systems Incorporate the Rules of Good Governance
title_full_unstemmed Why Government and Non-Governmental Policies and Projects Fail Despite ‘Evaluations’: An Indicator to Measure whether Evaluation Systems Incorporate the Rules of Good Governance
title_short Why Government and Non-Governmental Policies and Projects Fail Despite ‘Evaluations’: An Indicator to Measure whether Evaluation Systems Incorporate the Rules of Good Governance
title_sort why government and non governmental policies and projects fail despite evaluations an indicator to measure whether evaluation systems incorporate the rules of good governance
topic evaluation
international development
transparency
accountability
monitoring
governance
url http://survey.ate.wmich.edu/jmde/index.php/jmde_1/article/view/243
work_keys_str_mv AT davidhlempert whygovernmentandnongovernmentalpoliciesandprojectsfaildespiteevaluationsanindicatortomeasurewhetherevaluationsystemsincorporatetherulesofgoodgovernance