Validation of population-based disease simulation models: a review of concepts and methods
<p>Abstract</p> <p>Background</p> <p>Computer simulation models are used increasingly to support public health research and policy, but questions about their quality persist. The purpose of this article is to review the principles and methods for validation of populatio...
| Main Authors: | , , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2010-11-01
|
| Series: | BMC Public Health |
| Online Access: | http://www.biomedcentral.com/1471-2458/10/710 |
| _version_ | 1811281216757825536 |
|---|---|
| author | Sharif Behnam Harper Samuel Abrahamowicz Michal Oderkirk Jillian Flanagan William M Buckeridge David L Manuel Douglas G Finès Philippe Kopec Jacek A Okhmatovskaia Anya Sayre Eric C Rahman M Mushfiqur Wolfson Michael C |
| author_facet | Sharif Behnam Harper Samuel Abrahamowicz Michal Oderkirk Jillian Flanagan William M Buckeridge David L Manuel Douglas G Finès Philippe Kopec Jacek A Okhmatovskaia Anya Sayre Eric C Rahman M Mushfiqur Wolfson Michael C |
| author_sort | Sharif Behnam |
| collection | DOAJ |
| description | <p>Abstract</p> <p>Background</p> <p>Computer simulation models are used increasingly to support public health research and policy, but questions about their quality persist. The purpose of this article is to review the principles and methods for validation of population-based disease simulation models.</p> <p>Methods</p> <p>We developed a comprehensive framework for validating population-based chronic disease simulation models and used this framework in a review of published model validation guidelines. Based on the review, we formulated a set of recommendations for gathering evidence of model credibility.</p> <p>Results</p> <p>Evidence of model credibility derives from examining: 1) the process of model development, 2) the performance of a model, and 3) the quality of decisions based on the model. Many important issues in model validation are insufficiently addressed by current guidelines. These issues include a detailed evaluation of different data sources, graphical representation of models, computer programming, model calibration, between-model comparisons, sensitivity analysis, and predictive validity. The role of external data in model validation depends on the purpose of the model (e.g., decision analysis versus prediction). More research is needed on the methods of comparing the quality of decisions based on different models.</p> <p>Conclusion</p> <p>As the role of simulation modeling in population health is increasing and models are becoming more complex, there is a need for further improvements in model validation methodology and common standards for evaluating model credibility.</p> |
| first_indexed | 2024-04-13T01:28:34Z |
| format | Article |
| id | doaj.art-3c9adc3c76a5421b83e82b988cd0a7cc |
| institution | Directory Open Access Journal |
| issn | 1471-2458 |
| language | English |
| last_indexed | 2024-04-13T01:28:34Z |
| publishDate | 2010-11-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Public Health |
| spelling | doaj.art-3c9adc3c76a5421b83e82b988cd0a7cc2022-12-22T03:08:34ZengBMCBMC Public Health1471-24582010-11-0110171010.1186/1471-2458-10-710Validation of population-based disease simulation models: a review of concepts and methodsSharif BehnamHarper SamuelAbrahamowicz MichalOderkirk JillianFlanagan William MBuckeridge David LManuel Douglas GFinès PhilippeKopec Jacek AOkhmatovskaia AnyaSayre Eric CRahman M MushfiqurWolfson Michael C<p>Abstract</p> <p>Background</p> <p>Computer simulation models are used increasingly to support public health research and policy, but questions about their quality persist. The purpose of this article is to review the principles and methods for validation of population-based disease simulation models.</p> <p>Methods</p> <p>We developed a comprehensive framework for validating population-based chronic disease simulation models and used this framework in a review of published model validation guidelines. Based on the review, we formulated a set of recommendations for gathering evidence of model credibility.</p> <p>Results</p> <p>Evidence of model credibility derives from examining: 1) the process of model development, 2) the performance of a model, and 3) the quality of decisions based on the model. Many important issues in model validation are insufficiently addressed by current guidelines. These issues include a detailed evaluation of different data sources, graphical representation of models, computer programming, model calibration, between-model comparisons, sensitivity analysis, and predictive validity. The role of external data in model validation depends on the purpose of the model (e.g., decision analysis versus prediction). More research is needed on the methods of comparing the quality of decisions based on different models.</p> <p>Conclusion</p> <p>As the role of simulation modeling in population health is increasing and models are becoming more complex, there is a need for further improvements in model validation methodology and common standards for evaluating model credibility.</p>http://www.biomedcentral.com/1471-2458/10/710 |
| spellingShingle | Sharif Behnam Harper Samuel Abrahamowicz Michal Oderkirk Jillian Flanagan William M Buckeridge David L Manuel Douglas G Finès Philippe Kopec Jacek A Okhmatovskaia Anya Sayre Eric C Rahman M Mushfiqur Wolfson Michael C Validation of population-based disease simulation models: a review of concepts and methods BMC Public Health |
| title | Validation of population-based disease simulation models: a review of concepts and methods |
| title_full | Validation of population-based disease simulation models: a review of concepts and methods |
| title_fullStr | Validation of population-based disease simulation models: a review of concepts and methods |
| title_full_unstemmed | Validation of population-based disease simulation models: a review of concepts and methods |
| title_short | Validation of population-based disease simulation models: a review of concepts and methods |
| title_sort | validation of population based disease simulation models a review of concepts and methods |
| url | http://www.biomedcentral.com/1471-2458/10/710 |
| work_keys_str_mv | AT sharifbehnam validationofpopulationbaseddiseasesimulationmodelsareviewofconceptsandmethods AT harpersamuel validationofpopulationbaseddiseasesimulationmodelsareviewofconceptsandmethods AT abrahamowiczmichal validationofpopulationbaseddiseasesimulationmodelsareviewofconceptsandmethods AT oderkirkjillian validationofpopulationbaseddiseasesimulationmodelsareviewofconceptsandmethods AT flanaganwilliamm validationofpopulationbaseddiseasesimulationmodelsareviewofconceptsandmethods AT buckeridgedavidl validationofpopulationbaseddiseasesimulationmodelsareviewofconceptsandmethods AT manueldouglasg validationofpopulationbaseddiseasesimulationmodelsareviewofconceptsandmethods AT finesphilippe validationofpopulationbaseddiseasesimulationmodelsareviewofconceptsandmethods AT kopecjaceka validationofpopulationbaseddiseasesimulationmodelsareviewofconceptsandmethods AT okhmatovskaiaanya validationofpopulationbaseddiseasesimulationmodelsareviewofconceptsandmethods AT sayreericc validationofpopulationbaseddiseasesimulationmodelsareviewofconceptsandmethods AT rahmanmmushfiqur validationofpopulationbaseddiseasesimulationmodelsareviewofconceptsandmethods AT wolfsonmichaelc validationofpopulationbaseddiseasesimulationmodelsareviewofconceptsandmethods |