Development and validation of manually modified and supervised machine learning clinical assessment algorithms for malaria in Nigerian children

It is currently estimated that 67% of malaria deaths occur in children under-five years (WHO, 2020). To improve the identification of children at clinical risk for malaria, the WHO developed community (iCCM) and clinic-based (IMCI) protocols for frontline health workers using paper-based forms or di...

Full description

Bibliographic Details
Main Authors: McLaughlin, M, Pellé, KG, Scarpino, SV, Giwa, A, Mount-Finette, E, Haidar, N, Adamu, F, Ravi, N, Thompson, A, Heath, B, Dittrich, S, Finette, B
Format: Journal article
Language:English
Published: Frontiers Media 2022
_version_ 1797069604186488832
author McLaughlin, M
Pellé, KG
Scarpino, SV
Giwa, A
Mount-Finette, E
Haidar, N
Adamu, F
Ravi, N
Thompson, A
Heath, B
Dittrich, S
Finette, B
author_facet McLaughlin, M
Pellé, KG
Scarpino, SV
Giwa, A
Mount-Finette, E
Haidar, N
Adamu, F
Ravi, N
Thompson, A
Heath, B
Dittrich, S
Finette, B
author_sort McLaughlin, M
collection OXFORD
description It is currently estimated that 67% of malaria deaths occur in children under-five years (WHO, 2020). To improve the identification of children at clinical risk for malaria, the WHO developed community (iCCM) and clinic-based (IMCI) protocols for frontline health workers using paper-based forms or digital mobile health (mHealth) platforms. To investigate improving the accuracy of these point-of-care clinical risk assessment protocols for malaria in febrile children, we embedded a malaria rapid diagnostic test (mRDT) workflow into THINKMD's (IMCI) mHealth clinical risk assessment platform. This allowed us to perform a comparative analysis of THINKMD-generated malaria risk assessments with mRDT truth data to guide modification of THINKMD algorithms, as well as develop new supervised machine learning (ML) malaria risk algorithms. We utilized paired clinical data and malaria risk assessments acquired from over 555 children presenting to five health clinics in Kano, Nigeria to train ML algorithms to identify malaria cases using symptom and location data, as well as confirmatory mRDT results. Supervised ML random forest algorithms were generated using 80% of our field-based data as the ML training set and 20% to test our new ML logic. New ML-based malaria algorithms showed an increased sensitivity and specificity of 60 and 79%, and PPV and NPV of 76 and 65%, respectively over THINKD initial IMCI-based algorithms. These results demonstrate that combining mRDT "truth" data with digital mHealth platform clinical assessments and clinical data can improve identification of children with malaria/non-malaria attributable febrile illnesses.
first_indexed 2024-03-06T22:26:55Z
format Journal article
id oxford-uuid:56f83481-44ba-4486-8e64-c56b48cd0b0d
institution University of Oxford
language English
last_indexed 2024-03-06T22:26:55Z
publishDate 2022
publisher Frontiers Media
record_format dspace
spelling oxford-uuid:56f83481-44ba-4486-8e64-c56b48cd0b0d2022-03-26T16:53:45ZDevelopment and validation of manually modified and supervised machine learning clinical assessment algorithms for malaria in Nigerian childrenJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:56f83481-44ba-4486-8e64-c56b48cd0b0dEnglishSymplectic ElementsFrontiers Media2022McLaughlin, MPellé, KGScarpino, SVGiwa, AMount-Finette, EHaidar, NAdamu, FRavi, NThompson, AHeath, BDittrich, SFinette, BIt is currently estimated that 67% of malaria deaths occur in children under-five years (WHO, 2020). To improve the identification of children at clinical risk for malaria, the WHO developed community (iCCM) and clinic-based (IMCI) protocols for frontline health workers using paper-based forms or digital mobile health (mHealth) platforms. To investigate improving the accuracy of these point-of-care clinical risk assessment protocols for malaria in febrile children, we embedded a malaria rapid diagnostic test (mRDT) workflow into THINKMD's (IMCI) mHealth clinical risk assessment platform. This allowed us to perform a comparative analysis of THINKMD-generated malaria risk assessments with mRDT truth data to guide modification of THINKMD algorithms, as well as develop new supervised machine learning (ML) malaria risk algorithms. We utilized paired clinical data and malaria risk assessments acquired from over 555 children presenting to five health clinics in Kano, Nigeria to train ML algorithms to identify malaria cases using symptom and location data, as well as confirmatory mRDT results. Supervised ML random forest algorithms were generated using 80% of our field-based data as the ML training set and 20% to test our new ML logic. New ML-based malaria algorithms showed an increased sensitivity and specificity of 60 and 79%, and PPV and NPV of 76 and 65%, respectively over THINKD initial IMCI-based algorithms. These results demonstrate that combining mRDT "truth" data with digital mHealth platform clinical assessments and clinical data can improve identification of children with malaria/non-malaria attributable febrile illnesses.
spellingShingle McLaughlin, M
Pellé, KG
Scarpino, SV
Giwa, A
Mount-Finette, E
Haidar, N
Adamu, F
Ravi, N
Thompson, A
Heath, B
Dittrich, S
Finette, B
Development and validation of manually modified and supervised machine learning clinical assessment algorithms for malaria in Nigerian children
title Development and validation of manually modified and supervised machine learning clinical assessment algorithms for malaria in Nigerian children
title_full Development and validation of manually modified and supervised machine learning clinical assessment algorithms for malaria in Nigerian children
title_fullStr Development and validation of manually modified and supervised machine learning clinical assessment algorithms for malaria in Nigerian children
title_full_unstemmed Development and validation of manually modified and supervised machine learning clinical assessment algorithms for malaria in Nigerian children
title_short Development and validation of manually modified and supervised machine learning clinical assessment algorithms for malaria in Nigerian children
title_sort development and validation of manually modified and supervised machine learning clinical assessment algorithms for malaria in nigerian children
work_keys_str_mv AT mclaughlinm developmentandvalidationofmanuallymodifiedandsupervisedmachinelearningclinicalassessmentalgorithmsformalariainnigerianchildren
AT pellekg developmentandvalidationofmanuallymodifiedandsupervisedmachinelearningclinicalassessmentalgorithmsformalariainnigerianchildren
AT scarpinosv developmentandvalidationofmanuallymodifiedandsupervisedmachinelearningclinicalassessmentalgorithmsformalariainnigerianchildren
AT giwaa developmentandvalidationofmanuallymodifiedandsupervisedmachinelearningclinicalassessmentalgorithmsformalariainnigerianchildren
AT mountfinettee developmentandvalidationofmanuallymodifiedandsupervisedmachinelearningclinicalassessmentalgorithmsformalariainnigerianchildren
AT haidarn developmentandvalidationofmanuallymodifiedandsupervisedmachinelearningclinicalassessmentalgorithmsformalariainnigerianchildren
AT adamuf developmentandvalidationofmanuallymodifiedandsupervisedmachinelearningclinicalassessmentalgorithmsformalariainnigerianchildren
AT ravin developmentandvalidationofmanuallymodifiedandsupervisedmachinelearningclinicalassessmentalgorithmsformalariainnigerianchildren
AT thompsona developmentandvalidationofmanuallymodifiedandsupervisedmachinelearningclinicalassessmentalgorithmsformalariainnigerianchildren
AT heathb developmentandvalidationofmanuallymodifiedandsupervisedmachinelearningclinicalassessmentalgorithmsformalariainnigerianchildren
AT dittrichs developmentandvalidationofmanuallymodifiedandsupervisedmachinelearningclinicalassessmentalgorithmsformalariainnigerianchildren
AT finetteb developmentandvalidationofmanuallymodifiedandsupervisedmachinelearningclinicalassessmentalgorithmsformalariainnigerianchildren