Leading the field: Fortune favors the bold in Thurstonian choice models
Schools with the highest average student performance are often the smallest schools; localities with the highest rates of some cancers are frequently small; and the effects observed in clinical trials are likely to be largest for the smallest numbers of subjects. Informal explanations of this “small...
| Main Authors: | , , |
|---|---|
| Other Authors: | |
| Format: | Article |
| Language: | English |
| Published: |
Bernoulli Society for Mathematical Statistics and Probability
2020
|
| Online Access: | https://hdl.handle.net/1721.1/128465 |
| _version_ | 1826204217160761344 |
|---|---|
| author | Evans, Steven N. Rivest, Ronald L Stark, Philip B. |
| author2 | Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science |
| author_facet | Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Evans, Steven N. Rivest, Ronald L Stark, Philip B. |
| author_sort | Evans, Steven N. |
| collection | MIT |
| description | Schools with the highest average student performance are often the smallest schools; localities with the highest rates of some cancers are frequently small; and the effects observed in clinical trials are likely to be largest for the smallest numbers of subjects. Informal explanations of this “small-schools phenomenon” point to the fact that the sample means of smaller samples have higher variances. But this cannot be a complete explanation: If we draw two samples from a diffuse distribution that is symmetric about some point, then the chance that the smaller sample has larger mean is 50%. A particular consequence of results proved below is that if one draws three or more samples of different sizes from the same normal distribution, then the sample mean of the smallest sample is most likely to be highest, the sample mean of the second smallest sample is second most likely to be highest, and so on; this is true even though for any pair of samples, each one of the pair is equally likely to have the larger sample mean. The same effect explains why heteroscedasticity can result in misleadingly small nominal p-values in nonparametric tests of association. Our conclusions are relevant to certain stochastic choice models, including the following generalization of Thurstone’s Law of Comparative Judgment. There are n items. Item i is preferred to item j if Z i < Z j , where Z is a random n-vector of preference scores. Suppose P{Z i = Z j } = 0 for i = j, so there are no ties. Item k is the favorite if Z k < min i = k Z i . Let p i denote the chance that item i is the favorite. We characterize a large class of distributions for Z for which p 1 > p 2 > · · · > pn. Our results are most surprising when P{Z i < Z j } = P{Z i > Z j } = 12 for i = j, so neither of any two items is likely to be preferred over the other in a pairwise comparison. Then, under suitable assumptions, p 1 > p 2 > · · · > p n when the variability of Z i decreases with i in an appropriate sense. Our conclusions echo the proverb “Fortune favors the bold”. |
| first_indexed | 2024-09-23T12:50:44Z |
| format | Article |
| id | mit-1721.1/128465 |
| institution | Massachusetts Institute of Technology |
| language | English |
| last_indexed | 2024-09-23T12:50:44Z |
| publishDate | 2020 |
| publisher | Bernoulli Society for Mathematical Statistics and Probability |
| record_format | dspace |
| spelling | mit-1721.1/1284652022-09-28T10:24:55Z Leading the field: Fortune favors the bold in Thurstonian choice models Evans, Steven N. Rivest, Ronald L Stark, Philip B. Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Schools with the highest average student performance are often the smallest schools; localities with the highest rates of some cancers are frequently small; and the effects observed in clinical trials are likely to be largest for the smallest numbers of subjects. Informal explanations of this “small-schools phenomenon” point to the fact that the sample means of smaller samples have higher variances. But this cannot be a complete explanation: If we draw two samples from a diffuse distribution that is symmetric about some point, then the chance that the smaller sample has larger mean is 50%. A particular consequence of results proved below is that if one draws three or more samples of different sizes from the same normal distribution, then the sample mean of the smallest sample is most likely to be highest, the sample mean of the second smallest sample is second most likely to be highest, and so on; this is true even though for any pair of samples, each one of the pair is equally likely to have the larger sample mean. The same effect explains why heteroscedasticity can result in misleadingly small nominal p-values in nonparametric tests of association. Our conclusions are relevant to certain stochastic choice models, including the following generalization of Thurstone’s Law of Comparative Judgment. There are n items. Item i is preferred to item j if Z i < Z j , where Z is a random n-vector of preference scores. Suppose P{Z i = Z j } = 0 for i = j, so there are no ties. Item k is the favorite if Z k < min i = k Z i . Let p i denote the chance that item i is the favorite. We characterize a large class of distributions for Z for which p 1 > p 2 > · · · > pn. Our results are most surprising when P{Z i < Z j } = P{Z i > Z j } = 12 for i = j, so neither of any two items is likely to be preferred over the other in a pairwise comparison. Then, under suitable assumptions, p 1 > p 2 > · · · > p n when the variability of Z i decreases with i in an appropriate sense. Our conclusions echo the proverb “Fortune favors the bold”. NSF (Grant CCF- 0939370) 2020-11-12T21:12:38Z 2020-11-12T21:12:38Z 2019-02 2016-12 2019-07-03T13:10:18Z Article http://purl.org/eprint/type/JournalArticle 1350-7265 https://hdl.handle.net/1721.1/128465 Evans, Steven N. et al. "Leading the field: Fortune favors the bold in Thurstonian choice models." Bernoulli 25, 1 (February 2019): 26-46. © 2019 ISI/BS en http://dx.doi.org/10.3150/17-bej930 Bernoulli Creative Commons Attribution-Noncommercial-Share Alike http://creativecommons.org/licenses/by-nc-sa/4.0/ application/pdf Bernoulli Society for Mathematical Statistics and Probability arXiv |
| spellingShingle | Evans, Steven N. Rivest, Ronald L Stark, Philip B. Leading the field: Fortune favors the bold in Thurstonian choice models |
| title | Leading the field: Fortune favors the bold in Thurstonian choice models |
| title_full | Leading the field: Fortune favors the bold in Thurstonian choice models |
| title_fullStr | Leading the field: Fortune favors the bold in Thurstonian choice models |
| title_full_unstemmed | Leading the field: Fortune favors the bold in Thurstonian choice models |
| title_short | Leading the field: Fortune favors the bold in Thurstonian choice models |
| title_sort | leading the field fortune favors the bold in thurstonian choice models |
| url | https://hdl.handle.net/1721.1/128465 |
| work_keys_str_mv | AT evansstevenn leadingthefieldfortunefavorstheboldinthurstonianchoicemodels AT rivestronaldl leadingthefieldfortunefavorstheboldinthurstonianchoicemodels AT starkphilipb leadingthefieldfortunefavorstheboldinthurstonianchoicemodels |