A weakly informative default prior distribution for logistic and other regression models
Columbia University · City University of New York
Abstract
We propose a new prior distribution for classical (nonhierarchical) logistic regression models, constructed by first scaling all nonbinary variables to have mean 0 and standard deviation 0.5, and then placing independent Student-t prior distributions on the coefficients. As a default choice, we recommend the Cauchy distribution with center 0 and scale 2.5, which in the simplest setting is a longer-tailed version of the distribution attained by assuming one-half additional success and one-half additional failure in a logistic regression. Cross-validation on a corpus of datasets shows the Cauchy class of prior distributions to outperform existing implementations of Gaussian and Laplace priors. We recommend this…
Citation impact
- FWCI
- 15.47
- Percentile
- 100%
- References
- 42
Authors
4- AGAndrew GelmanCorresponding
Columbia University, City University of New York
- AJAleks Jakulin
City University of New York, Columbia University
- MGMaria Grazia Pittau
City University of New York, Columbia University
- YSYu-Sung Su
City University of New York, Columbia University
Topics & keywords
- Cauchy distribution
- Logistic regression
- Logistic distribution
- Gaussian
- Quantile
- Imputation (statistics)
- Standard deviation
- Covariate