Watanabe–Akaike information criterion
From HandWiki
In statistics, the widely applicable information criterion (WAIC), also known as Watanabe–Akaike information criterion, is the generalized version of the Akaike information criterion (AIC) onto singular statistical models.[1] Widely applicable Bayesian information criterion (WBIC) is the generalized version of Bayesian information criterion (BIC) onto singular statistical models.[2]
WBIC is the average log likelihood function over the posterior distribution with the inverse temperature > 1/log n where n is the sample size.[2]
Both WAIC and WBIC can be numerically calculated without any information about a true distribution.
See also
- Akaike information criterion
- Bayesian information criterion
- Deviance information criterion
- Hannan–Quinn information criterion
References
- ↑ Watanabe, Sumio (2010). "Asymptotic Equivalence of Bayes Cross Validation and Widely Applicable Information Criterion in Singular Learning Theory". Journal of Machine Learning Research 11: 3571–3594.
- ↑ 2.0 2.1 Watanabe, Sumio (2013). "A Widely Applicable Bayesian Information Criterion". Journal of Machine Learning Research 14: 867–897. http://www.jmlr.org/papers/volume14/watanabe13a/watanabe13a.pdf.
 |  |
