A systematic review of statistical methods used to test for reliability of medical instruments measuring continuous variables
Objective(s): Reliability measures precision or the extent to which test results can be replicated. This is the first ever systematic review to identify statistical methods used to measure reliability of equipment measuring continuous variables. This studyalso aims to highlight the inappropriate sta...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
2013
|
| Subjects: | |
| Online Access: | http://eprints.um.edu.my/9840/1/PMC3758037.pdf |
| _version_ | 1825719771924004864 |
|---|---|
| author | Zaki, R. Bulgiba, A. Nordin, N. Ismail, N.A. |
| author_facet | Zaki, R. Bulgiba, A. Nordin, N. Ismail, N.A. |
| author_sort | Zaki, R. |
| collection | UM |
| description | Objective(s): Reliability measures precision or the extent to which test results can be replicated. This is the first ever systematic review to identify statistical methods used to measure reliability of equipment measuring continuous variables. This studyalso aims to highlight the inappropriate statistical method used in the reliability analysis and its implication in the medical practice. Materials and Methods: In 2010, five electronic databases were searched between 2007 and 2009 to look for reliability studies. A total of 5,795 titles were initially identified. Only 282 titles were potentially related, and finally 42 fitted the inclusion criteria. Results: The Intra-class Correlation Coefficient (ICC) is the most popular method with 25 (60) studies having used this method followed by the comparing means (8 or 19). Out of 25 studies using the ICC, only 7 (28) reported the confidence intervals and types of ICC used. Most studies (71) also tested the agreement of instruments. Conclusion: This study finds that the Intra-class Correlation Coefficient is the most popular method used to assess the reliability of medical instruments measuring continuous outcomes. There are also inappropriate applications and interpretations of statistical methods in some studies. It is important for medical researchers to be aware of this issue, and be able to correctly perform analysis in reliability studies. |
| first_indexed | 2024-03-06T05:24:51Z |
| format | Article |
| id | um.eprints-9840 |
| institution | Universiti Malaya |
| language | English |
| last_indexed | 2024-03-06T05:24:51Z |
| publishDate | 2013 |
| record_format | dspace |
| spelling | um.eprints-98402014-04-15T08:07:41Z http://eprints.um.edu.my/9840/ A systematic review of statistical methods used to test for reliability of medical instruments measuring continuous variables Zaki, R. Bulgiba, A. Nordin, N. Ismail, N.A. R Medicine Objective(s): Reliability measures precision or the extent to which test results can be replicated. This is the first ever systematic review to identify statistical methods used to measure reliability of equipment measuring continuous variables. This studyalso aims to highlight the inappropriate statistical method used in the reliability analysis and its implication in the medical practice. Materials and Methods: In 2010, five electronic databases were searched between 2007 and 2009 to look for reliability studies. A total of 5,795 titles were initially identified. Only 282 titles were potentially related, and finally 42 fitted the inclusion criteria. Results: The Intra-class Correlation Coefficient (ICC) is the most popular method with 25 (60) studies having used this method followed by the comparing means (8 or 19). Out of 25 studies using the ICC, only 7 (28) reported the confidence intervals and types of ICC used. Most studies (71) also tested the agreement of instruments. Conclusion: This study finds that the Intra-class Correlation Coefficient is the most popular method used to assess the reliability of medical instruments measuring continuous outcomes. There are also inappropriate applications and interpretations of statistical methods in some studies. It is important for medical researchers to be aware of this issue, and be able to correctly perform analysis in reliability studies. 2013 Article PeerReviewed application/pdf en http://eprints.um.edu.my/9840/1/PMC3758037.pdf Zaki, R. and Bulgiba, A. and Nordin, N. and Ismail, N.A. (2013) A systematic review of statistical methods used to test for reliability of medical instruments measuring continuous variables. Iranian Journal of Basic Medical Sciences, 16 (6). pp. 803-807. ISSN 2008-3866, http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3758037/ |
| spellingShingle | R Medicine Zaki, R. Bulgiba, A. Nordin, N. Ismail, N.A. A systematic review of statistical methods used to test for reliability of medical instruments measuring continuous variables |
| title | A systematic review of statistical methods used to test for reliability of medical instruments measuring continuous variables |
| title_full | A systematic review of statistical methods used to test for reliability of medical instruments measuring continuous variables |
| title_fullStr | A systematic review of statistical methods used to test for reliability of medical instruments measuring continuous variables |
| title_full_unstemmed | A systematic review of statistical methods used to test for reliability of medical instruments measuring continuous variables |
| title_short | A systematic review of statistical methods used to test for reliability of medical instruments measuring continuous variables |
| title_sort | systematic review of statistical methods used to test for reliability of medical instruments measuring continuous variables |
| topic | R Medicine |
| url | http://eprints.um.edu.my/9840/1/PMC3758037.pdf |
| work_keys_str_mv | AT zakir asystematicreviewofstatisticalmethodsusedtotestforreliabilityofmedicalinstrumentsmeasuringcontinuousvariables AT bulgibaa asystematicreviewofstatisticalmethodsusedtotestforreliabilityofmedicalinstrumentsmeasuringcontinuousvariables AT nordinn asystematicreviewofstatisticalmethodsusedtotestforreliabilityofmedicalinstrumentsmeasuringcontinuousvariables AT ismailna asystematicreviewofstatisticalmethodsusedtotestforreliabilityofmedicalinstrumentsmeasuringcontinuousvariables AT zakir systematicreviewofstatisticalmethodsusedtotestforreliabilityofmedicalinstrumentsmeasuringcontinuousvariables AT bulgibaa systematicreviewofstatisticalmethodsusedtotestforreliabilityofmedicalinstrumentsmeasuringcontinuousvariables AT nordinn systematicreviewofstatisticalmethodsusedtotestforreliabilityofmedicalinstrumentsmeasuringcontinuousvariables AT ismailna systematicreviewofstatisticalmethodsusedtotestforreliabilityofmedicalinstrumentsmeasuringcontinuousvariables |