Four Methodological Guidelines to Evaluate the Research Impact of Co-produced Climate Services

As climate change impacts unfold across the globe, growing attention is paid toward producing climate services that support adaptation decision-making. Academia, funding agencies, and decision-makers generally agree that stakeholder engagement in co-producing knowledge is key to ensure effective dec...

Full description

Bibliographic Details
Main Authors: Mathilda Englund, Karin André, Åsa Gerger Swartling, Jenny Iao-Jörgensen
Format: Article
Language:English
Published: Frontiers Media S.A. 2022-07-01
Series:Frontiers in Climate
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/fclim.2022.909422/full
_version_ 1828331089323622400
author Mathilda Englund
Karin André
Åsa Gerger Swartling
Jenny Iao-Jörgensen
author_facet Mathilda Englund
Karin André
Åsa Gerger Swartling
Jenny Iao-Jörgensen
author_sort Mathilda Englund
collection DOAJ
description As climate change impacts unfold across the globe, growing attention is paid toward producing climate services that support adaptation decision-making. Academia, funding agencies, and decision-makers generally agree that stakeholder engagement in co-producing knowledge is key to ensure effective decision support. However, co-production processes remain challenging to evaluate, given their many intangible effects, long time horizons, and inherent complexity. Moreover, how such evaluation should look like is understudied. In this paper, we therefore propose four methodological guidelines designed to evaluate co-produced climate services: (i) engaging in adaptive learning by applying developmental evaluation practices, (ii) building and refining a theory of change, (iii) involving stakeholders using participatory evaluation methods, and (iv) combining different data collection methods that incorporate visual products. These methodological guidelines offset previously identified evaluation challenges and shortcomings, and can be used to help stakeholders rethink research impact evaluation through their complementary properties to identify complex change pathways, external factors, intangible effects, and unexpected outcomes.
first_indexed 2024-04-13T20:47:09Z
format Article
id doaj.art-53bf73707b5940aa8057cd1b011c199a
institution Directory Open Access Journal
issn 2624-9553
language English
last_indexed 2024-04-13T20:47:09Z
publishDate 2022-07-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Climate
spelling doaj.art-53bf73707b5940aa8057cd1b011c199a2022-12-22T02:30:38ZengFrontiers Media S.A.Frontiers in Climate2624-95532022-07-01410.3389/fclim.2022.909422909422Four Methodological Guidelines to Evaluate the Research Impact of Co-produced Climate ServicesMathilda Englund0Karin André1Åsa Gerger Swartling2Jenny Iao-Jörgensen3Stockholm Environment Institute, Stockholm, SwedenStockholm Environment Institute, Stockholm, SwedenStockholm Environment Institute, Stockholm, SwedenDivision of Risk Management and Societal Safety, Faculty of Engineering, Lund University, Lund, SwedenAs climate change impacts unfold across the globe, growing attention is paid toward producing climate services that support adaptation decision-making. Academia, funding agencies, and decision-makers generally agree that stakeholder engagement in co-producing knowledge is key to ensure effective decision support. However, co-production processes remain challenging to evaluate, given their many intangible effects, long time horizons, and inherent complexity. Moreover, how such evaluation should look like is understudied. In this paper, we therefore propose four methodological guidelines designed to evaluate co-produced climate services: (i) engaging in adaptive learning by applying developmental evaluation practices, (ii) building and refining a theory of change, (iii) involving stakeholders using participatory evaluation methods, and (iv) combining different data collection methods that incorporate visual products. These methodological guidelines offset previously identified evaluation challenges and shortcomings, and can be used to help stakeholders rethink research impact evaluation through their complementary properties to identify complex change pathways, external factors, intangible effects, and unexpected outcomes.https://www.frontiersin.org/articles/10.3389/fclim.2022.909422/fullclimate adaptationclimate servicesdecision supportknowledge co-productiontransdisciplinary researchparticipatory research
spellingShingle Mathilda Englund
Karin André
Åsa Gerger Swartling
Jenny Iao-Jörgensen
Four Methodological Guidelines to Evaluate the Research Impact of Co-produced Climate Services
Frontiers in Climate
climate adaptation
climate services
decision support
knowledge co-production
transdisciplinary research
participatory research
title Four Methodological Guidelines to Evaluate the Research Impact of Co-produced Climate Services
title_full Four Methodological Guidelines to Evaluate the Research Impact of Co-produced Climate Services
title_fullStr Four Methodological Guidelines to Evaluate the Research Impact of Co-produced Climate Services
title_full_unstemmed Four Methodological Guidelines to Evaluate the Research Impact of Co-produced Climate Services
title_short Four Methodological Guidelines to Evaluate the Research Impact of Co-produced Climate Services
title_sort four methodological guidelines to evaluate the research impact of co produced climate services
topic climate adaptation
climate services
decision support
knowledge co-production
transdisciplinary research
participatory research
url https://www.frontiersin.org/articles/10.3389/fclim.2022.909422/full
work_keys_str_mv AT mathildaenglund fourmethodologicalguidelinestoevaluatetheresearchimpactofcoproducedclimateservices
AT karinandre fourmethodologicalguidelinestoevaluatetheresearchimpactofcoproducedclimateservices
AT asagergerswartling fourmethodologicalguidelinestoevaluatetheresearchimpactofcoproducedclimateservices
AT jennyiaojorgensen fourmethodologicalguidelinestoevaluatetheresearchimpactofcoproducedclimateservices