articleThe Annals of Applied StatisticsDec 1, 2008BRONZE OA

A weakly informative default prior distribution for logistic and other regression models

AGAndrew GelmanAJAleks JakulinMGMaria Grazia PittauYSYu-Sung Su

Columbia University · City University of New York

Indexed inarxivcrossref

Abstract

We propose a new prior distribution for classical (nonhierarchical) logistic regression models, constructed by first scaling all nonbinary variables to have mean 0 and standard deviation 0.5, and then placing independent Student-t prior distributions on the coefficients. As a default choice, we recommend the Cauchy distribution with center 0 and scale 2.5, which in the simplest setting is a longer-tailed version of the distribution attained by assuming one-half additional success and one-half additional failure in a logistic regression. Cross-validation on a corpus of datasets shows the Cauchy class of prior distributions to outperform existing implementations of Gaussian and Laplace priors. We recommend this…

Citation impact

1,773
total citations
FWCI
15.47
Percentile
100%
References
42
Citations per year

Authors

4
  • AG
    Andrew GelmanCorresponding

    Columbia University, City University of New York

  • AJ
    Aleks Jakulin

    City University of New York, Columbia University

  • MG
    Maria Grazia Pittau

    City University of New York, Columbia University

  • YS
    Yu-Sung Su

    City University of New York, Columbia University

Topics & keywords

Keywords
  • Cauchy distribution
  • Logistic regression
  • Logistic distribution
  • Gaussian
  • Quantile
  • Imputation (statistics)
  • Standard deviation
  • Covariate
No related works found for this paper.

Funding