Draft:Universal Hypothesis Testing

Special setting of hypothesis testing From Wikipedia, the free encyclopedia

In statistics, universal hypothesis testing is a special case of binary simple hypothesis testing. The universal problem is to distinguish between a simple null hypothesis , and the most general composite alternative , using independent and identically distributed samples from . The setting is sometimes referred to as goodness of fit testing, or one-sample testing.


A simple binary hypothesis testing problem involves distinguishing between and , using samples . In the traditional setting of hypothesis testing are known apriori. A composite version of this problem involves sets of probability distributions , and asks to distinguish between and . In contrast, the universal setting corresponds to the special case of composite hypothesis testing, where the null hypothesis is simple, and the alternative hypothesis is the set of all distributions other than , . For example, someone might want to know if a particular coin was fair, i.e. or not, i.e. , where denote the coin coming up heads or tails.

The asymptotics of universal hypothesis testing were first discussed in Hoeffding's work on optimal tests for multinomial distributions[1]. There have been many subsequent works on the topic[2][3][4] in many directions. While Hoeffding's initial results were restricted to distributions with finite supports, later results developed solutions for continuous distributions using extensions of the Kullback-Leibler Divergence[5], or kernel methods[6][7].

References

Related Articles

Wikiwand AI