Nonparametric Predictive Inference for Reproducibility of Two Basic Tests Based on Order Statistics

Reproducibility of statistical hypothesis tests is an issue of major importance in applied statistics: if the test were repeated, would the same overall conclusion be reached, that is rejection or non-rejection of the null hypothesis? Nonparametric predictive inference (NPI) provides a natural fram...

Full description

Bibliographic Details
Main Authors: Frank P.A. Coolen, Hana N. Alqifari
Format: Article
Language:English
Published: Instituto Nacional de Estatística | Statistics Portugal 2018-04-01
Series:Revstat Statistical Journal
Subjects:
Online Access:https://revstat.ine.pt/index.php/REVSTAT/article/view/237
Description
Summary:Reproducibility of statistical hypothesis tests is an issue of major importance in applied statistics: if the test were repeated, would the same overall conclusion be reached, that is rejection or non-rejection of the null hypothesis? Nonparametric predictive inference (NPI) provides a natural framework for such inferences, as its explicitly predictive nature fits well with the core problem formulation of a repeat of the test in the future. NPI is a frequentist statistics method using relatively few assumptions, made possible by the use of lower and upper probabilities. For inference on reproducibility of statistical tests, NPI provides lower and upper reproducibility probabilities (RP). In this paper, the NPI-RP method is presented for two basic tests using order statistics, namely a test for a specific value for a population quantile and a precedence test for comparison of data from two populations, as typically used for experiments involving lifetime data if one wishes to conclude before all observations are available.
ISSN:1645-6726
2183-0371