Use of Scenario-Based Nominal Group Techniques to Evaluate System Functions: Examples from the USA & Sweden

The nominal group technique (NGT) was developed in the 1970s as a structured brainstorming and multi-stage consensus-building process to solicit feedback from a group of stakeholders on a given topic. The approach was intended as an evaluation method to provide semi-quantitative rank-ordered feedbac...

Full description

Bibliographic Details
Main Authors: Rachael Piltch-Loeb, Anna Ekström, Rachel Neilsen
Format: Article
Language:English
Published: MDPI AG 2021-04-01
Series:Proceedings
Subjects:
Online Access:https://www.mdpi.com/2504-3900/77/1/5
_version_ 1797536360173666304
author Rachael Piltch-Loeb
Anna Ekström
Rachel Neilsen
author_facet Rachael Piltch-Loeb
Anna Ekström
Rachel Neilsen
author_sort Rachael Piltch-Loeb
collection DOAJ
description The nominal group technique (NGT) was developed in the 1970s as a structured brainstorming and multi-stage consensus-building process to solicit feedback from a group of stakeholders on a given topic. The approach was intended as an evaluation method to provide semi-quantitative rank-ordered feedback from group participants. This lecture presents a variation of this technique created by the Harvard team, namely “scenario-based NGT”. The format proposed includes elements of tabletop exercises (scenario with a timeline and discussion phase) as well as elements of traditional NGTs (silent brainstorming and ranking). The technique we developed was based on a case-study approach (“scenario”) which we then tested in two countries (USA and Sweden) with existing P/CVE initiatives at different stages of development. We conducted scenario-based NGT sessions in both locations and then systematically analyzed the results using iterative qualitative coding based on a common framework. Results were analyzed to achieve consensus on the most common system-level challenges and system-level functions, necessary to overcome those challenges, in each location.
first_indexed 2024-03-10T11:59:35Z
format Article
id doaj.art-156598abfd574610a1e162c09b27c2fa
institution Directory Open Access Journal
issn 2504-3900
language English
last_indexed 2024-03-10T11:59:35Z
publishDate 2021-04-01
publisher MDPI AG
record_format Article
series Proceedings
spelling doaj.art-156598abfd574610a1e162c09b27c2fa2023-11-21T17:02:11ZengMDPI AGProceedings2504-39002021-04-01771510.3390/proceedings2021077005Use of Scenario-Based Nominal Group Techniques to Evaluate System Functions: Examples from the USA & SwedenRachael Piltch-Loeb0Anna Ekström1Rachel Neilsen2Community Safety Branch, Emergency Preparedness Research Evaluation & Practice (EPREP) Program, Harvard T.H. Chan School of Public Health, 90 Smith Street, Boston, MA 02115, USASwedish Contingency Agency, Institute for Future Studies, P.O. Box 591, 101 31 Stockholm, SwedenColorado Resilience Collaborative, University of Denver, Denver, CO 80208, USAThe nominal group technique (NGT) was developed in the 1970s as a structured brainstorming and multi-stage consensus-building process to solicit feedback from a group of stakeholders on a given topic. The approach was intended as an evaluation method to provide semi-quantitative rank-ordered feedback from group participants. This lecture presents a variation of this technique created by the Harvard team, namely “scenario-based NGT”. The format proposed includes elements of tabletop exercises (scenario with a timeline and discussion phase) as well as elements of traditional NGTs (silent brainstorming and ranking). The technique we developed was based on a case-study approach (“scenario”) which we then tested in two countries (USA and Sweden) with existing P/CVE initiatives at different stages of development. We conducted scenario-based NGT sessions in both locations and then systematically analyzed the results using iterative qualitative coding based on a common framework. Results were analyzed to achieve consensus on the most common system-level challenges and system-level functions, necessary to overcome those challenges, in each location.https://www.mdpi.com/2504-3900/77/1/5system-level evaluationscenario-based nominal group techniquecountering violent extremismpreventing targeted violencemixed methods
spellingShingle Rachael Piltch-Loeb
Anna Ekström
Rachel Neilsen
Use of Scenario-Based Nominal Group Techniques to Evaluate System Functions: Examples from the USA & Sweden
Proceedings
system-level evaluation
scenario-based nominal group technique
countering violent extremism
preventing targeted violence
mixed methods
title Use of Scenario-Based Nominal Group Techniques to Evaluate System Functions: Examples from the USA & Sweden
title_full Use of Scenario-Based Nominal Group Techniques to Evaluate System Functions: Examples from the USA & Sweden
title_fullStr Use of Scenario-Based Nominal Group Techniques to Evaluate System Functions: Examples from the USA & Sweden
title_full_unstemmed Use of Scenario-Based Nominal Group Techniques to Evaluate System Functions: Examples from the USA & Sweden
title_short Use of Scenario-Based Nominal Group Techniques to Evaluate System Functions: Examples from the USA & Sweden
title_sort use of scenario based nominal group techniques to evaluate system functions examples from the usa sweden
topic system-level evaluation
scenario-based nominal group technique
countering violent extremism
preventing targeted violence
mixed methods
url https://www.mdpi.com/2504-3900/77/1/5
work_keys_str_mv AT rachaelpiltchloeb useofscenariobasednominalgrouptechniquestoevaluatesystemfunctionsexamplesfromtheusasweden
AT annaekstrom useofscenariobasednominalgrouptechniquestoevaluatesystemfunctionsexamplesfromtheusasweden
AT rachelneilsen useofscenariobasednominalgrouptechniquestoevaluatesystemfunctionsexamplesfromtheusasweden