Partial least squares discriminant analysis: taking the magic away
University of Bristol · Gloucestershire Hospitals NHS Foundation Trust
Abstract
Partial least squares discriminant analysis (PLS‐DA) has been available for nearly 20 years yet is poorly understood by most users. By simple examples, it is shown graphically and algebraically that for two equal class sizes, PLS‐DA using one partial least squares (PLS) component provides equivalent classification results to Euclidean distance to centroids, and by using all nonzero components to linear discriminant analysis. Extensions where there are unequal class sizes and more than two classes are discussed including common pitfalls and dilemmas. Finally, the problems of overfitting and PLS scores plots are discussed. It is concluded that for classification purposes, PLS‐DA has no significant advantages…
Citation impact
- FWCI
- 31.84
- Percentile
- 100%
- References
- 15
Authors
2Topics & keywords
- Partial least squares regression
- Linear discriminant analysis
- Overfitting
- Pattern recognition (psychology)
- Artificial intelligence
- Mathematics
- Statistics
- Class (philosophy)
- Reduced inequalities