What is the proper way to apply the multiple comparison test?
Multiple comparisons tests (MCTs) are performed several times on the mean of experimental conditions. When the null hypothesis is rejected in a validation, MCTs are performed when certain experimental conditions have a statistically significant mean difference or there is a specific aspect between t...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Korean Society of Anesthesiologists
2018-10-01
|
| Series: | Korean Journal of Anesthesiology |
| Subjects: | |
| Online Access: | http://ekja.org/upload/pdf/kja-d-18-00242.pdf |
| _version_ | 1818405939496091648 |
|---|---|
| author | Sangseok Lee Dong Kyu Lee |
| author_facet | Sangseok Lee Dong Kyu Lee |
| author_sort | Sangseok Lee |
| collection | DOAJ |
| description | Multiple comparisons tests (MCTs) are performed several times on the mean of experimental conditions. When the null hypothesis is rejected in a validation, MCTs are performed when certain experimental conditions have a statistically significant mean difference or there is a specific aspect between the group means. A problem occurs if the error rate increases while multiple hypothesis tests are performed simultaneously. Consequently, in an MCT, it is necessary to control the error rate to an appropriate level. In this paper, we discuss how to test multiple hypotheses simultaneously while limiting type I error rate, which is caused by α inflation. To choose the appropriate test, we must maintain the balance between statistical power and type I error rate. If the test is too conservative, a type I error is not likely to occur. However, concurrently, the test may have insufficient power resulted in increased probability of type II error occurrence. Most researchers may hope to find the best way of adjusting the type I error rate to discriminate the real differences between observed data without wasting too much statistical power. It is expected that this paper will help researchers understand the differences between MCTs and apply them appropriately. |
| first_indexed | 2024-12-14T09:04:01Z |
| format | Article |
| id | doaj.art-cda538d50e2c46929c29939408af9251 |
| institution | Directory Open Access Journal |
| issn | 2005-6419 2005-7563 |
| language | English |
| last_indexed | 2024-12-14T09:04:01Z |
| publishDate | 2018-10-01 |
| publisher | Korean Society of Anesthesiologists |
| record_format | Article |
| series | Korean Journal of Anesthesiology |
| spelling | doaj.art-cda538d50e2c46929c29939408af92512022-12-21T23:08:45ZengKorean Society of AnesthesiologistsKorean Journal of Anesthesiology2005-64192005-75632018-10-0171535336010.4097/kja.d.18.002428476What is the proper way to apply the multiple comparison test?Sangseok Lee0Dong Kyu Lee1 Department of Anesthesiology and Pain Medicine, Sanggye Paik Hospital, Inje University College of Medicine, Seoul, Korea Department of Anesthesiology and Pain Medicine, Guro Hospital, Korea University School of Medicine, Seoul, KoreaMultiple comparisons tests (MCTs) are performed several times on the mean of experimental conditions. When the null hypothesis is rejected in a validation, MCTs are performed when certain experimental conditions have a statistically significant mean difference or there is a specific aspect between the group means. A problem occurs if the error rate increases while multiple hypothesis tests are performed simultaneously. Consequently, in an MCT, it is necessary to control the error rate to an appropriate level. In this paper, we discuss how to test multiple hypotheses simultaneously while limiting type I error rate, which is caused by α inflation. To choose the appropriate test, we must maintain the balance between statistical power and type I error rate. If the test is too conservative, a type I error is not likely to occur. However, concurrently, the test may have insufficient power resulted in increased probability of type II error occurrence. Most researchers may hope to find the best way of adjusting the type I error rate to discriminate the real differences between observed data without wasting too much statistical power. It is expected that this paper will help researchers understand the differences between MCTs and apply them appropriately.http://ekja.org/upload/pdf/kja-d-18-00242.pdfalpha inflationanalysis of variancebonferronidunnettmultiple comparisonschefféstatisticstukeytype i errortype ii error |
| spellingShingle | Sangseok Lee Dong Kyu Lee What is the proper way to apply the multiple comparison test? Korean Journal of Anesthesiology alpha inflation analysis of variance bonferroni dunnett multiple comparison scheffé statistics tukey type i error type ii error |
| title | What is the proper way to apply the multiple comparison test? |
| title_full | What is the proper way to apply the multiple comparison test? |
| title_fullStr | What is the proper way to apply the multiple comparison test? |
| title_full_unstemmed | What is the proper way to apply the multiple comparison test? |
| title_short | What is the proper way to apply the multiple comparison test? |
| title_sort | what is the proper way to apply the multiple comparison test |
| topic | alpha inflation analysis of variance bonferroni dunnett multiple comparison scheffé statistics tukey type i error type ii error |
| url | http://ekja.org/upload/pdf/kja-d-18-00242.pdf |
| work_keys_str_mv | AT sangseoklee whatistheproperwaytoapplythemultiplecomparisontest AT dongkyulee whatistheproperwaytoapplythemultiplecomparisontest |