A Synthesis of Algorithms for Multi-Jurisdiction Research in Canada.

Objectives Validation of algorithms to identify health conditions (e.g., diabetes) or service use (e.g., high-cost users) in administrative data is time-consuming and expensive. Many algorithms are only assessed in a single jurisdiction, which may limit generalizability. Our study described the cha...

Full description

Bibliographic Details
Main Authors: Lisa Lix, Viktoriya Vasylkiv, Olawale Ayilara, Lindsey Dahl, Allison Poppel, Saeed Al-Azazi
Format: Article
Language:English
Published: Swansea University 2022-08-01
Series:International Journal of Population Data Science
Subjects:
Online Access:https://ijpds.org/article/view/1911
_version_ 1797430657688797184
author Lisa Lix
Viktoriya Vasylkiv
Olawale Ayilara
Lindsey Dahl
Allison Poppel
Saeed Al-Azazi
author_facet Lisa Lix
Viktoriya Vasylkiv
Olawale Ayilara
Lindsey Dahl
Allison Poppel
Saeed Al-Azazi
author_sort Lisa Lix
collection DOAJ
description Objectives Validation of algorithms to identify health conditions (e.g., diabetes) or service use (e.g., high-cost users) in administrative data is time-consuming and expensive. Many algorithms are only assessed in a single jurisdiction, which may limit generalizability. Our study described the characteristics of multi-jurisdiction algorithms from a Canadian algorithm repository. Approach We summarized algorithms captured in the open-access Algorithms Inventory developed by Health Data Research Network (HDRN) Canada. This inventory contains published algorithms identified through a series of systematic reviews of peer-reviewed research. Algorithms included in the inventory were validated or assessed for feasibility of implementation in two or more provinces/territories; they encompass measures of population health, health service use, and determinants of health. Descriptive statistics were used to characterize the study data on such features as year and discipline of the study journal, algorithm topic area, jurisdictions included in the study, validation source data, and algorithm elements (i.e., diagnosis codes). Results The HDRN Canada Algorithms Inventory currently contains 166 algorithms from 63 published articles. The majority of articles were published in 2010 or later (89%) and more than half (56%) of the articles were found in journals with a clinical focus. Feasibility studies (79%) were conducted more often than validation studies (21%). Most algorithms used data from the provinces of British Columbia, Manitoba, Ontario, and Nova Scotia. The majority of algorithms (72%) measured population health concepts, such as chronic physical health conditions (63%; e.g., hypertension) and mental health conditions (14%; e.g., depression). Algorithms about the determinants of health (17%) mostly focused on measures of socioeconomic status (37%) derived from census data. Multi-jurisdiction algorithms about health service use were least common (11%). Conclusion This synthesis revealed few Canadian multi-jurisdiction validation studies have been conducted and not all provinces/territories are equally represented. New validation studies, particularly about health service use and determinants of health, will increase the consistency and accuracy of Canadian research. Reusing published algorithms from this inventory will facilitate research reproducibility.
first_indexed 2024-03-09T09:30:44Z
format Article
id doaj.art-3389932e4923444c82fdbb504f3e293d
institution Directory Open Access Journal
issn 2399-4908
language English
last_indexed 2024-03-09T09:30:44Z
publishDate 2022-08-01
publisher Swansea University
record_format Article
series International Journal of Population Data Science
spelling doaj.art-3389932e4923444c82fdbb504f3e293d2023-12-02T03:51:49ZengSwansea UniversityInternational Journal of Population Data Science2399-49082022-08-017310.23889/ijpds.v7i3.1911A Synthesis of Algorithms for Multi-Jurisdiction Research in Canada.Lisa Lix0Viktoriya Vasylkiv1Olawale Ayilara2Lindsey Dahl3Allison Poppel4Saeed Al-Azazi5University of ManitobaUniversity of ManitobaUniversity of ManitobaUniversity of ManitobaUniversity of ManitobaUniversity of Manitoba Objectives Validation of algorithms to identify health conditions (e.g., diabetes) or service use (e.g., high-cost users) in administrative data is time-consuming and expensive. Many algorithms are only assessed in a single jurisdiction, which may limit generalizability. Our study described the characteristics of multi-jurisdiction algorithms from a Canadian algorithm repository. Approach We summarized algorithms captured in the open-access Algorithms Inventory developed by Health Data Research Network (HDRN) Canada. This inventory contains published algorithms identified through a series of systematic reviews of peer-reviewed research. Algorithms included in the inventory were validated or assessed for feasibility of implementation in two or more provinces/territories; they encompass measures of population health, health service use, and determinants of health. Descriptive statistics were used to characterize the study data on such features as year and discipline of the study journal, algorithm topic area, jurisdictions included in the study, validation source data, and algorithm elements (i.e., diagnosis codes). Results The HDRN Canada Algorithms Inventory currently contains 166 algorithms from 63 published articles. The majority of articles were published in 2010 or later (89%) and more than half (56%) of the articles were found in journals with a clinical focus. Feasibility studies (79%) were conducted more often than validation studies (21%). Most algorithms used data from the provinces of British Columbia, Manitoba, Ontario, and Nova Scotia. The majority of algorithms (72%) measured population health concepts, such as chronic physical health conditions (63%; e.g., hypertension) and mental health conditions (14%; e.g., depression). Algorithms about the determinants of health (17%) mostly focused on measures of socioeconomic status (37%) derived from census data. Multi-jurisdiction algorithms about health service use were least common (11%). Conclusion This synthesis revealed few Canadian multi-jurisdiction validation studies have been conducted and not all provinces/territories are equally represented. New validation studies, particularly about health service use and determinants of health, will increase the consistency and accuracy of Canadian research. Reusing published algorithms from this inventory will facilitate research reproducibility. https://ijpds.org/article/view/1911Case definitionsInventoryHealth Data Research Network CanadaSystematic review
spellingShingle Lisa Lix
Viktoriya Vasylkiv
Olawale Ayilara
Lindsey Dahl
Allison Poppel
Saeed Al-Azazi
A Synthesis of Algorithms for Multi-Jurisdiction Research in Canada.
International Journal of Population Data Science
Case definitions
Inventory
Health Data Research Network Canada
Systematic review
title A Synthesis of Algorithms for Multi-Jurisdiction Research in Canada.
title_full A Synthesis of Algorithms for Multi-Jurisdiction Research in Canada.
title_fullStr A Synthesis of Algorithms for Multi-Jurisdiction Research in Canada.
title_full_unstemmed A Synthesis of Algorithms for Multi-Jurisdiction Research in Canada.
title_short A Synthesis of Algorithms for Multi-Jurisdiction Research in Canada.
title_sort synthesis of algorithms for multi jurisdiction research in canada
topic Case definitions
Inventory
Health Data Research Network Canada
Systematic review
url https://ijpds.org/article/view/1911
work_keys_str_mv AT lisalix asynthesisofalgorithmsformultijurisdictionresearchincanada
AT viktoriyavasylkiv asynthesisofalgorithmsformultijurisdictionresearchincanada
AT olawaleayilara asynthesisofalgorithmsformultijurisdictionresearchincanada
AT lindseydahl asynthesisofalgorithmsformultijurisdictionresearchincanada
AT allisonpoppel asynthesisofalgorithmsformultijurisdictionresearchincanada
AT saeedalazazi asynthesisofalgorithmsformultijurisdictionresearchincanada
AT lisalix synthesisofalgorithmsformultijurisdictionresearchincanada
AT viktoriyavasylkiv synthesisofalgorithmsformultijurisdictionresearchincanada
AT olawaleayilara synthesisofalgorithmsformultijurisdictionresearchincanada
AT lindseydahl synthesisofalgorithmsformultijurisdictionresearchincanada
AT allisonpoppel synthesisofalgorithmsformultijurisdictionresearchincanada
AT saeedalazazi synthesisofalgorithmsformultijurisdictionresearchincanada