Reconciling Bayesian and Frequentist Tests: the Imprecise Counterpart
[edit]
Proceedings of the Tenth International Symposium on Imprecise Probability: Theories and Applications, PMLR 62:97108, 2017.
Abstract
Imprecise Dirichlet Processbased tests (IDPtests, for short) have been recently introduced in the literature. They overcome the problem of deciding how to select a single prior in Bayesian hypothesis testing, in the absence of prior information. They make use of a “nearignorance” model, that behaves a priori as a vacuous model for some basic inferences, but it provides nonvacuous posterior inferences. We perform empirical studies regarding the behavior of IDPtests for the particular case of Wilcoxon rank sum test. We show that the upper and lower posterior probabilities can be expressed as tail probabilities based on the value of the $U$ statistic. We construct an imprecise frequentistbased test that reproduces the same decision rule as the the IDP test. It considers a neighbourhood around the $U$statistic value. If all the values in the neighbourhood belong to the rejection zone (resp. to the acceptance region), the null hypothesis is rejected (resp. accepted). Otherwise, the judgement is suspended.
Related Material


