Evaluating digital health interventions: key questions and approaches

Digital health interventions have enormous potential as scalable tools to improve health and healthcare delivery by improving effectiveness, efficiency, accessibility, safety, and personalization. Achieving these improvements requires a cumulative knowledge base to inform development and deployment...

Full description

Bibliographic Details
Main Authors: Murray, E, Hekler, E, Andersson, G, Collins, L, Doherty, A, Hollis, C, Rivera, D, West, R, Wyatt, J
Format: Journal article
Language:English
Published: Elsevier 2016
_version_ 1797090855119486976
author Murray, E
Hekler, E
Andersson, G
Collins, L
Doherty, A
Hollis, C
Rivera, D
West, R
Wyatt, J
author_facet Murray, E
Hekler, E
Andersson, G
Collins, L
Doherty, A
Hollis, C
Rivera, D
West, R
Wyatt, J
author_sort Murray, E
collection OXFORD
description Digital health interventions have enormous potential as scalable tools to improve health and healthcare delivery by improving effectiveness, efficiency, accessibility, safety, and personalization. Achieving these improvements requires a cumulative knowledge base to inform development and deployment of digital health interventions. However, evaluations of digital health interventions present special challenges. This paper aims to examine these challenges and outline an evaluation strategy in terms of the research questions needed to appraise such interventions. As they are at the intersection of biomedical, behavioral, computing, and engineering research, methods drawn from all of these disciplines are required. Relevant research questions include defining the problem and the likely benefit of the digital health intervention, which in turn requires establishing the likely reach and uptake of the intervention, the causal model describing how the intervention will achieve its intended benefit, key components, and how they interact with one another, and estimating overall benefit in terms of effectiveness, cost effectiveness, and harms. Although RCTs are important for evaluation of effectiveness and cost effectiveness, they are best undertaken only when: (1) the intervention and its delivery package are stable; (2) these can be implemented with high fidelity; and (3) there is a reasonable likelihood that the overall benefits will be clinically meaningful (improved outcomes or equivalent outcomes at lower cost). Broadening the portfolio of research questions and evaluation methods will help with developing the necessary knowledge base to inform decisions on policy, practice, and research.
first_indexed 2024-03-07T03:24:41Z
format Journal article
id oxford-uuid:b8a30e15-0a88-4c28-9009-1ba459829cca
institution University of Oxford
language English
last_indexed 2024-03-07T03:24:41Z
publishDate 2016
publisher Elsevier
record_format dspace
spelling oxford-uuid:b8a30e15-0a88-4c28-9009-1ba459829cca2022-03-27T04:57:17ZEvaluating digital health interventions: key questions and approachesJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:b8a30e15-0a88-4c28-9009-1ba459829ccaEnglishSymplectic Elements at OxfordElsevier2016Murray, EHekler, EAndersson, GCollins, LDoherty, AHollis, CRivera, DWest, RWyatt, JDigital health interventions have enormous potential as scalable tools to improve health and healthcare delivery by improving effectiveness, efficiency, accessibility, safety, and personalization. Achieving these improvements requires a cumulative knowledge base to inform development and deployment of digital health interventions. However, evaluations of digital health interventions present special challenges. This paper aims to examine these challenges and outline an evaluation strategy in terms of the research questions needed to appraise such interventions. As they are at the intersection of biomedical, behavioral, computing, and engineering research, methods drawn from all of these disciplines are required. Relevant research questions include defining the problem and the likely benefit of the digital health intervention, which in turn requires establishing the likely reach and uptake of the intervention, the causal model describing how the intervention will achieve its intended benefit, key components, and how they interact with one another, and estimating overall benefit in terms of effectiveness, cost effectiveness, and harms. Although RCTs are important for evaluation of effectiveness and cost effectiveness, they are best undertaken only when: (1) the intervention and its delivery package are stable; (2) these can be implemented with high fidelity; and (3) there is a reasonable likelihood that the overall benefits will be clinically meaningful (improved outcomes or equivalent outcomes at lower cost). Broadening the portfolio of research questions and evaluation methods will help with developing the necessary knowledge base to inform decisions on policy, practice, and research.
spellingShingle Murray, E
Hekler, E
Andersson, G
Collins, L
Doherty, A
Hollis, C
Rivera, D
West, R
Wyatt, J
Evaluating digital health interventions: key questions and approaches
title Evaluating digital health interventions: key questions and approaches
title_full Evaluating digital health interventions: key questions and approaches
title_fullStr Evaluating digital health interventions: key questions and approaches
title_full_unstemmed Evaluating digital health interventions: key questions and approaches
title_short Evaluating digital health interventions: key questions and approaches
title_sort evaluating digital health interventions key questions and approaches
work_keys_str_mv AT murraye evaluatingdigitalhealthinterventionskeyquestionsandapproaches
AT heklere evaluatingdigitalhealthinterventionskeyquestionsandapproaches
AT anderssong evaluatingdigitalhealthinterventionskeyquestionsandapproaches
AT collinsl evaluatingdigitalhealthinterventionskeyquestionsandapproaches
AT dohertya evaluatingdigitalhealthinterventionskeyquestionsandapproaches
AT hollisc evaluatingdigitalhealthinterventionskeyquestionsandapproaches
AT riverad evaluatingdigitalhealthinterventionskeyquestionsandapproaches
AT westr evaluatingdigitalhealthinterventionskeyquestionsandapproaches
AT wyattj evaluatingdigitalhealthinterventionskeyquestionsandapproaches