Evaluating the Performance of an Outbreak- Detection Algorithms using Semi-Synthetic Approach: Cumulative Sum Algorithm
Background & Objectives: Timely response to emerging diseases and outbreaks are a major public health and health systems priority. There are few published studies that evaluate the performance of cumulative sum (CUSUM) on identical data using semi- synthetic simulation approach. This study was u...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | fas |
| Published: |
Tehran University of Medical Sciences
2013-10-01
|
| Series: | مجله اپیدمیولوژی ایران |
| Subjects: | |
| Online Access: | http://irje.tums.ac.ir/browse.php?a_code=A-10-25-5028&slc_lang=en&sid=1 |
| _version_ | 1818398240354074624 |
|---|---|
| author | M Karami H Soori Y Mehrabi AA Haghdoost MM Gouya N Esmailnasab |
| author_facet | M Karami H Soori Y Mehrabi AA Haghdoost MM Gouya N Esmailnasab |
| author_sort | M Karami |
| collection | DOAJ |
| description | Background & Objectives: Timely response to emerging diseases and outbreaks are a major public health and health systems priority. There are few published studies that evaluate the performance of cumulative sum (CUSUM) on identical data using semi- synthetic simulation approach. This study was undertaken to determine the performance of the CUSUM in timely detection of 831 days of simulated outbreaks.
Methods: We evaluated the performances of the CUSUM as an outbreak detection method on simulated outbreaks injected to daily counts of suspected cases of measles as baseline data in Iran between 21 March 2008 till 20 March 2011. Data obtained from the Iranian national surveillance system. The performance of algorithms was evaluated using sensitivity, false alarm rate, likelihood ratios and Area under the Receiver Operating Characteristic (ROC) curve.
Results: Generally the sensitivity of the CUSUM algorithm in detecting simulated outbreaks was 50%
(95% CI: 47- 54). The corresponding values are disaggregated according to outbreak size, shape and duration. The CUSUM algorithm detected the half of outbreaks after 13.84 days on average. Conclusion: We concluded that CUSUM algorithm performed good in detection of large outbreaks with short periods and poorly in detecting long period outbreaks, particularly those simulated outbreaks that did not begin with a surge of cases. |
| first_indexed | 2024-12-14T07:01:38Z |
| format | Article |
| id | doaj.art-23f38e0fc1824b20a2d6b58d58f8796c |
| institution | Directory Open Access Journal |
| issn | 1735-7489 2228-7507 |
| language | fas |
| last_indexed | 2024-12-14T07:01:38Z |
| publishDate | 2013-10-01 |
| publisher | Tehran University of Medical Sciences |
| record_format | Article |
| series | مجله اپیدمیولوژی ایران |
| spelling | doaj.art-23f38e0fc1824b20a2d6b58d58f8796c2022-12-21T23:12:24ZfasTehran University of Medical Sciencesمجله اپیدمیولوژی ایران1735-74892228-75072013-10-01922938Evaluating the Performance of an Outbreak- Detection Algorithms using Semi-Synthetic Approach: Cumulative Sum AlgorithmM Karami0H Soori1Y Mehrabi2AA Haghdoost3MM Gouya4N Esmailnasab5 Assistant Professor of Epidemiology, Research Center for Modeling of Noncommunicable Diseasesand Department of Biostatistics & Epidemiology, School of Public Health, Hamadan University of Medical Sciences, Hamadan, Iran Professor of Epidemiology, Safety Promotion and Injury Prevention Research Center, Faculty of Public Health, Shahid Beheshti University of Medical Sciences, Tehran, Iran Professor of Biostatistics, Faculty of Public Health, Shahid Beheshti University of Medical Sciences, Tehran, Iran Professor of Epidemiology and Biostatistics, Research Centre of Modeling in Health, Institute of futures studies in health, Kerman University of Medical Sciences, Kerman, Iran Director General, Center for Disease Control, Ministry of Health & Medical Education, Tehran, Iran Associate Professor of Epidemiology, Department of Epidemiology and Biostatistics, Kurdistan University of Medical Sciences, Kurdistan, Iran Background & Objectives: Timely response to emerging diseases and outbreaks are a major public health and health systems priority. There are few published studies that evaluate the performance of cumulative sum (CUSUM) on identical data using semi- synthetic simulation approach. This study was undertaken to determine the performance of the CUSUM in timely detection of 831 days of simulated outbreaks. Methods: We evaluated the performances of the CUSUM as an outbreak detection method on simulated outbreaks injected to daily counts of suspected cases of measles as baseline data in Iran between 21 March 2008 till 20 March 2011. Data obtained from the Iranian national surveillance system. The performance of algorithms was evaluated using sensitivity, false alarm rate, likelihood ratios and Area under the Receiver Operating Characteristic (ROC) curve. Results: Generally the sensitivity of the CUSUM algorithm in detecting simulated outbreaks was 50% (95% CI: 47- 54). The corresponding values are disaggregated according to outbreak size, shape and duration. The CUSUM algorithm detected the half of outbreaks after 13.84 days on average. Conclusion: We concluded that CUSUM algorithm performed good in detection of large outbreaks with short periods and poorly in detecting long period outbreaks, particularly those simulated outbreaks that did not begin with a surge of cases.http://irje.tums.ac.ir/browse.php?a_code=A-10-25-5028&slc_lang=en&sid=1Surveillance System Measles Outbreak Detection Method CUSUM Semi-synthetic Simulation Iran |
| spellingShingle | M Karami H Soori Y Mehrabi AA Haghdoost MM Gouya N Esmailnasab Evaluating the Performance of an Outbreak- Detection Algorithms using Semi-Synthetic Approach: Cumulative Sum Algorithm مجله اپیدمیولوژی ایران Surveillance System Measles Outbreak Detection Method CUSUM Semi-synthetic Simulation Iran |
| title | Evaluating the Performance of an Outbreak- Detection Algorithms using Semi-Synthetic Approach: Cumulative Sum Algorithm |
| title_full | Evaluating the Performance of an Outbreak- Detection Algorithms using Semi-Synthetic Approach: Cumulative Sum Algorithm |
| title_fullStr | Evaluating the Performance of an Outbreak- Detection Algorithms using Semi-Synthetic Approach: Cumulative Sum Algorithm |
| title_full_unstemmed | Evaluating the Performance of an Outbreak- Detection Algorithms using Semi-Synthetic Approach: Cumulative Sum Algorithm |
| title_short | Evaluating the Performance of an Outbreak- Detection Algorithms using Semi-Synthetic Approach: Cumulative Sum Algorithm |
| title_sort | evaluating the performance of an outbreak detection algorithms using semi synthetic approach cumulative sum algorithm |
| topic | Surveillance System Measles Outbreak Detection Method CUSUM Semi-synthetic Simulation Iran |
| url | http://irje.tums.ac.ir/browse.php?a_code=A-10-25-5028&slc_lang=en&sid=1 |
| work_keys_str_mv | AT mkarami evaluatingtheperformanceofanoutbreakdetectionalgorithmsusingsemisyntheticapproachcumulativesumalgorithm AT hsoori evaluatingtheperformanceofanoutbreakdetectionalgorithmsusingsemisyntheticapproachcumulativesumalgorithm AT ymehrabi evaluatingtheperformanceofanoutbreakdetectionalgorithmsusingsemisyntheticapproachcumulativesumalgorithm AT aahaghdoost evaluatingtheperformanceofanoutbreakdetectionalgorithmsusingsemisyntheticapproachcumulativesumalgorithm AT mmgouya evaluatingtheperformanceofanoutbreakdetectionalgorithmsusingsemisyntheticapproachcumulativesumalgorithm AT nesmailnasab evaluatingtheperformanceofanoutbreakdetectionalgorithmsusingsemisyntheticapproachcumulativesumalgorithm |