As Good as GOLD: Gram–Schmidt Orthogonalization by Another Name
Generalized orthogonal linear derivative (GOLD) estimates were proposed to correct a problem of correlated estimation errors in generalized local linear approximation (GLLA). This paper shows that GOLD estimates are related to GLLA estimates by the Gram–Schmidt orthogonalization process. Analytical work suggests that GLLA estimates are derivatives of an approximating polynomial and GOLD estimates are linear combinations of these derivatives. A series of simulation studies then further investigates and tests the analytical properties derived. The first study shows that when approximating or smoothing noisy data, GLLA outperforms GOLD, but when interpolating noisy data GOLD outperforms GLLA. The second study shows that when data are not noisy, GLLA always outperforms GOLD in terms of derivative estimation. Thus, when data can be smoothed or are not noisy, GLLA is preferred whereas when they cannot then GOLD is preferred. The last studies show situations where GOLD can produce biased estimates. In spite of these possible shortcomings of GOLD to produce accurate and unbiased estimates, GOLD may still provide adequate or improved model estimation because of its orthogonal error structure. However, GOLD should not be used purely for derivative estimation because the error covariance structure is irrelevant in this case. Future research should attempt to find orthogonal polynomial derivative estimators that produce accurate and unbiased derivatives with an orthogonal error structure.
Keywordsderivative estimation orthogonalization polynomial approximation latent differential equations dynamical systems
The author is grateful to Joseph L. Rodgers for helpful comments on earlier drafts of this article, and to the reviewers and associate editor for their invaluable feedback.
- Boker, S. M., Deboeck, P. R., Edler, C., & Keel, P. K. (2009). Generalized local linear approximation of derivatives from time series. In S.-M. Chow, E. Ferrer, & F. Hsieh (Eds.), Statistical methods for modeling human dynamics: An interdisciplinary dialogue. Boca Raton, FL: Taylor and Francis.Google Scholar
- Boker, S. M., Montpetit, M. A., Hunter, M. D., & Bergeman, C. S. (2010). Modeling resilience with diffrential equations. In P. C. M. Molenaar & K. Newell (Eds.), Individual pathways of change: Statistical models for analyzing learning and development (pp. 183–206). Washington, DC: American Psychological Association. doi: 10.1037/12140-011.CrossRefGoogle Scholar
- Boker, S. M., Neale, M. C., & Rausch, J. (2004). Latent differential equation modeling with multivariate multi-occassion indicators. In K. van Montfort, H. Oud, & A. Satorra (Eds.), Recent developments on structural equation models: Theory and applications (pp. 151–174). Dordrecht: Kluwer Academic Publishers. doi: 10.1007/978-1-4020-1958-6_9.CrossRefGoogle Scholar
- Lay, D. C. (2003). Linear algebra and its applications (3rd ed.). Boston, MA: Addison Wesley.Google Scholar
- Leon, S. J. (2006). Linear algebra with applications (7th ed.). Upper Saddle River, NJ: Prentice Hall.Google Scholar
- Whitney, H. (1936). Differentiable manifolds. The Annals of Mathematics, 37(3), 645–680. Retrieved from http://www.jstor.org/stable/1968482.
- Whittaker, E. T., & Robinson, G. (1924). The calculus of observations: A treatise on numerical mathematics (vol. 36) (No. 9). London.Google Scholar
- Zentall, S. R., Boker, S. M., & Braungart-Rieker, J. M. (2006, June). Mother-infant synchrony: A dynamical systems approach. In Proceedings of the Fifth International Conference on Development and Learning.Google Scholar
- Zheng, Y., Wiebe, R. P., Cleveland, H. H., Molenaar, P. C., & Harris, K. S. (2013). An idiographic examination of day-to-day patterns of substance use craving, negative affect, and tobacco use among young adults in recovery. Multivariate Behavioral Research, 48(2), 241–266. doi: 10.1080/00273171.2013.763012.CrossRefPubMedPubMedCentralGoogle Scholar