Information Geometric Perspective of Modal Linear Regression
Modal linear regression (MLR) is a standard method for modeling the conditional mode of a response variable using a linear combination of explanatory variables. It is effective when dealing with response variables with an asymmetric, multi-modal distribution. Because of the nonparametric nature of MLR, it is difficult to construct a statistical model manifold in the sense of information geometry. In this work, a model manifold is constructed using observations instead of explicit parametric models. We also propose a method for constructing a data manifold based on an empirical distribution. The em algorithm, which is a geometric formulation of the EM algorithm, of MLR is shown to be equivalent to the conventional EM algorithm of MLR.
KeywordsModal linear regression Information geometry EM algorithm
- 2.Amari, S., Nagaoka, H.: Methods of Information Geometry. American Mathematical Society (2000)Google Scholar
- 4.Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum likelihood from incomplete data via the EM algorithm. J. Royal Stat. Soc. Ser. B, 1–38 (1977)Google Scholar
- 5.Hampel, F.R., Ronchetti, E.M., Rousseeuw, P.J., Stahel, W.A.: Robust Statistics - The Approach Based on Influence Functions. Wiley (1986)Google Scholar
- 6.Huber, P.J., Ronchetti, E.M.: Robust Statistics. Wiley (2011)Google Scholar