An Evaluation Framework for Comparing Epidemic Intelligence Systems
In the context of Epidemic Intelligence, many Event-Based Surveillance (EBS) systems have been proposed in the literature to promote the early identification and characterization of potential health threats from online sources of any nature. Each EBS system has its own surveillance definitions and p...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10082884/ |
| _version_ | 1797852290311258112 |
|---|---|
| author | Nejat Arinik Roberto Interdonato Mathieu Roche Maguelonne Teisseire |
| author_facet | Nejat Arinik Roberto Interdonato Mathieu Roche Maguelonne Teisseire |
| author_sort | Nejat Arinik |
| collection | DOAJ |
| description | In the context of Epidemic Intelligence, many Event-Based Surveillance (EBS) systems have been proposed in the literature to promote the early identification and characterization of potential health threats from online sources of any nature. Each EBS system has its own surveillance definitions and priorities, therefore this makes the task of selecting the most appropriate EBS system for a given situation a challenge for end-users. In this work, we propose a new evaluation framework to address this issue. It first transforms the raw input epidemiological event data into a set of normalized events with multi-granularity, then conducts a descriptive retrospective analysis based on four evaluation objectives: spatial, temporal, thematic and source analysis. We illustrate its relevance by applying it to an Avian Influenza dataset collected by a selection of EBS systems, and show how our framework allows identifying their strengths and drawbacks in terms of epidemic surveillance. |
| first_indexed | 2024-04-09T19:30:34Z |
| format | Article |
| id | doaj.art-06a760290c314a428eeac7acdc91a13b |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-04-09T19:30:34Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-06a760290c314a428eeac7acdc91a13b2023-04-04T23:00:35ZengIEEEIEEE Access2169-35362023-01-0111318803190110.1109/ACCESS.2023.326246210082884An Evaluation Framework for Comparing Epidemic Intelligence SystemsNejat Arinik0https://orcid.org/0000-0001-5080-4320Roberto Interdonato1https://orcid.org/0000-0002-0536-6277Mathieu Roche2https://orcid.org/0000-0003-3272-8568Maguelonne Teisseire3https://orcid.org/0000-0001-9313-6414INRAE, Montpellier, FranceCIRAD, Montpellier, FranceCIRAD, Montpellier, FranceINRAE, Montpellier, FranceIn the context of Epidemic Intelligence, many Event-Based Surveillance (EBS) systems have been proposed in the literature to promote the early identification and characterization of potential health threats from online sources of any nature. Each EBS system has its own surveillance definitions and priorities, therefore this makes the task of selecting the most appropriate EBS system for a given situation a challenge for end-users. In this work, we propose a new evaluation framework to address this issue. It first transforms the raw input epidemiological event data into a set of normalized events with multi-granularity, then conducts a descriptive retrospective analysis based on four evaluation objectives: spatial, temporal, thematic and source analysis. We illustrate its relevance by applying it to an Avian Influenza dataset collected by a selection of EBS systems, and show how our framework allows identifying their strengths and drawbacks in terms of epidemic surveillance.https://ieeexplore.ieee.org/document/10082884/Epidemic intelligenceevent-based surveillanceretrospective analysis |
| spellingShingle | Nejat Arinik Roberto Interdonato Mathieu Roche Maguelonne Teisseire An Evaluation Framework for Comparing Epidemic Intelligence Systems IEEE Access Epidemic intelligence event-based surveillance retrospective analysis |
| title | An Evaluation Framework for Comparing Epidemic Intelligence Systems |
| title_full | An Evaluation Framework for Comparing Epidemic Intelligence Systems |
| title_fullStr | An Evaluation Framework for Comparing Epidemic Intelligence Systems |
| title_full_unstemmed | An Evaluation Framework for Comparing Epidemic Intelligence Systems |
| title_short | An Evaluation Framework for Comparing Epidemic Intelligence Systems |
| title_sort | evaluation framework for comparing epidemic intelligence systems |
| topic | Epidemic intelligence event-based surveillance retrospective analysis |
| url | https://ieeexplore.ieee.org/document/10082884/ |
| work_keys_str_mv | AT nejatarinik anevaluationframeworkforcomparingepidemicintelligencesystems AT robertointerdonato anevaluationframeworkforcomparingepidemicintelligencesystems AT mathieuroche anevaluationframeworkforcomparingepidemicintelligencesystems AT maguelonneteisseire anevaluationframeworkforcomparingepidemicintelligencesystems AT nejatarinik evaluationframeworkforcomparingepidemicintelligencesystems AT robertointerdonato evaluationframeworkforcomparingepidemicintelligencesystems AT mathieuroche evaluationframeworkforcomparingepidemicintelligencesystems AT maguelonneteisseire evaluationframeworkforcomparingepidemicintelligencesystems |