Abstract
Partial least squares regression (PLSR) is a method of finding a reliable predictor of the response variable when there are more regressors than observations. It does so by eliciting a small number of components from the regressors that are inherently informative about the response. Quantile regression (QR) estimates the quantiles of the response distribution by regression functions of the covariates, and so gives a fuller description of the response than does the usual regression for the mean value of the response. We extend QR to partial quantile regression (PQR) when there are more regressors than observations. For each percentile the method provides a low dimensional approximation to the joint distribution of the covariates and response with a given coverage probability and which, under further linearity assumptions, estimates the corresponding quantile of the conditional distribution. The methodology parallels the procedure for PLSR using a quantile covariance that is appropriate for predicting a quantile rather than the usual covariance which is appropriate for predicting a mean value. The analysis suggests a new measure of risk associated with the quantile regressions. Examples are given that illustrate the methodology and the benefits accrued, based on simulated data and the analysis of spectrometer data.
Similar content being viewed by others
References
Andersen C and Rinnan A (2002). Distribution of water in fresh cod. Lebensm. Wiss. U.Technol 35: 687–696
Christensen R (1991). Linear models for multivariate, time series and spatial data. Springer, New York
Dodge Y and Jureckova J (2000). Adaptive regression. Springer, New York
Frank I and Friedman J (1993). A statistical view of some chemometrics regression tools. Technometrics 35: 109–135
Hastie T, Tibshirani R and Friedman J (2001). Elements of statistical learning. Springer, New York
Helland I (1988). On the structure of partial least squares regression. Commun Stat Simulation Comput 17: 581–607
Helland IS (2001). Some theoretical aspects of partial least squares regression. Chem Intell Laboratory Syst 58: 97–107
Hubert M and Vanden Branden K (2003). Robust methods for partial least squares regression. J Chemometrics 17: 537–549
Hwang J and Nettleton D (2003). Principal components regression with data-chosen components. Technometrics 45: 70–79
Koenker R and Bassett G (1978). Regression quantiles. Econometrica 46: 33–50
Koenker R and Machado J (1999). Goodness of fit and related inference processes for quantile regression. J Am Stat Assoc 94: 1296–1310
Longley J (1967). An appraisal of least-squares programs from the point of view of the user. J Am Stat Assoc 62: 819–841
Martens H and Martens M (2000). Multivariate analysis of quality. Wiley, New York
Martens H and Naes T (1989). Multivariate calibration. Wiley, Chichester
Portnoy S and Koenker R (1997). The gaussian hare and the laplacian tortoise: computability of squared-error vs.~absolute-error estimators, with discussion. Stat Sci 12: 279–300
Whittaker J (1990). Graphical models in applied multivariate statistics. Wiley, Chichester
Whittle P (1983). Prediction and regulation by linear least-square methods. University of Minnesota Press, Minneapolis
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Dodge, Y., Whittaker, J. Partial quantile regression. Metrika 70, 35–57 (2009). https://doi.org/10.1007/s00184-008-0177-4
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00184-008-0177-4