Abstract
This chapter introduces functional data analysis (FDA) and selective topics in FDA, including functional principal component analysis (FPCA) and functional linear regression (FLR), with real data applications using a software package, which is publicly available. The methods in this chapter are based on local polynomial regression, a basic and important smoothing technique in nonparametric and semiparametric statistics. The approaches included in this chapter are not limited to the analysis of dense functional data but can also be used for the analysis of sparse functional/longitudinal data.
In Sect. 4.1, we introduce FDA with some interesting examples of functional data and briefly describe FPCA and FLR. Section 4.2 details FPCA, one of the most important topics and tools in FDA. Topics such as the estimation of mean and covariance functions using nonparametric smoothing, choosing the number of principal components (PC) using subjective and objective methods, and prediction of trajectories are included and illustrated using a publicly available bike-sharing data set. Section 4.3 presents FLR based on FPCA described in Sect. 4.2. FLR is a generalization of traditional linear regression to the case of functional data. It is a powerful tool to model the relationship between functional/scalar response and functional predictors. This section is also illustrated using the same bike-sharing data set. We focus on the case when both response and predictor are functions in this section, but we mentioned other types of FLR topics in Sect. 4.4. Section 4.4 presents a short overview of other selected topics and software packages in FDA. These topics are either about functional data with more complex features than the simple and basic ones included in the previous two sections or about other statistical estimation and inference not covered before. The statistical software packages used in this chapter are written in Matlab and may be appropriate for the analysis of some basic types of functional data but not for others. Section 4.4 described other software packages written in different languages, such as R, and those packages have the flexibility to analyze various problems in functional data and different types of functional data.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ramsay, J.O., Silverman, B.W.: Functional Data Analysis. Springer, Berlin (2005)
Xu, Y., Qiu, Y., Schnable, J.C.: Functional Modeling of Plant Growth Dynamics. The Plant Phenome Journal 1(1), 1–10 (2018)
Xu, Y., Li, Y., Nettleton, D.: Nested hierarchical functional data modeling and inference for the analysis of functional plant phenotypes. J. Am. Stat. Assoc. 113(522), 593–606 (2018)
Yao, F., Müller, H.-G., Wang, J.-L.: Functional data analysis for sparse longitudinal data. J. Am. Stat. Assoc. 100(470), 577–590 (2005)
Fan, J.: Local Polynomial Modelling and Its Applications: Monographs on Statistics and Applied Probability, vol. 66. Routledge, London (2018)
Rice, J.A., Silverman, B.W.: Estimating the mean and covariance structure nonparametrically when the data are curves. J. R. Stat. Soc. Ser. B (Methodol.) 53(1), 233–243 (1991)
Yao, F., Lee, T.C.: Penalized spline models for functional principal component analysis. J. R. Stat. Soc. Ser. B (Stat Methodol.) 68(1), 3–25 (2006)
Li, Y., Wang, N., Carroll, R.J.: Selecting the number of principal components in functional data. J. Am. Stat. Assoc. 108(504), 1284–1294 (2013)
Yao, F., Müller, H.-G., Wang, J.-L.: Functional linear regression analysis for longitudinal data. Ann. Stat. 33(6), 2873–2903 (2005)
Wang, J.-L., Chiou, J.-M., Müller, H.-G.: Functional data analysis. Annu. Rev. Stat. Appl. 3, 257–295 (2016)
Hall, P., Müller, H.-G., Wang, J.-L.: Properties of principal component methods for functional and longitudinal data analysis. Ann. Stat. 34(3), 1493–1517 (2006)
Hall, P., Vial, C.: Assessing the finite dimensionality of functional data. J. R. Stat. Soc. Ser. B (Stat Methodol.) 68(4), 689–705 (2006)
Li, Y., Hsing, T.: Uniform convergence rates for nonparametric regression and principal component analysis in functional/longitudinal data. Ann. Stat. 38(6), 3321–3351 (2010)
Li, Y., Hsing, T.: Deciding the dimension of effective dimension reduction space for functional and high-dimensional data. Ann. Stat. 38(5), 3028–3062 (2010)
Zhang, X., Wang, J.-L.: From sparse to dense functional data and beyond. Ann. Stat. 44(5), 2281–2321 (2016)
Liu, B., Müller, H.-G.: Estimating derivatives for samples of sparsely observed functions, with application to online auction dynamics. J. Am. Stat. Assoc. 104(486), 704–717 (2009)
Dai, X., Müller, H.-G., Tao, W.: Derivative principal component analysis for representing the time dynamics of longitudinal and functional data. arXiv preprint arXiv:1707.04360 (2017)
Morris, J.S.: Functional regression. Annual Review of Statistics and Its Application 2, 321–359 (2015)
Zhang, J.-T.: Analysis of Variance for Functional Data. Chapman and Hall/CRC, New York (2013)
Song, F.S., Montabon, F., Xu, Y.: The impact of national culture on corporate adoption of environmental management practices and their effectiveness. Int. J. Prod. Econ. 205, 313–328 (2018)
Di, C.-Z., Crainiceanu, C.M., Caffo, B.S., Punjabi, N.M.: Multilevel functional principal component analysis. Ann. Appl. Stat. 3(1), 458 (2009)
Sawant, P., Billor, N., Shin, H.: Functional outlier detection with robust functional principal component analysis. Comput. Stat. 27(1), 83–102 (2012)
She, Y., Li, S., Wu, D.: Robust orthogonal complement principal component analysis. J. Am. Stat. Assoc. 111(514), 763–771 (2016)
Cao, G., Yang, L., Todem, D.: Simultaneous inference for the mean function based on dense functional data. Journal of Nonparametric Statistics 24(2), 359–377 (2012)
Cao, G., Wang, L., Li, Y., Yang, L.: Oracle-efficient confidence envelopes for covariance functions in dense functional data. Stat. Sin., 26, 359–383 (2016)
Müller, H.-G.: Functional modelling and classification of longitudinal data. Scand. J. Stat. 32(2), 223–240 (2005)
James, G.M., Hastie, T.J.: Functional linear discriminant analysis for irregularly sampled curves. J. R. Stat. Soc. Ser. B (Stat Methodol.) 63(3), 533–550 (2001)
Chiou, J.-M., Chen, Y.-T., Yang, Y.-F.: Multivariate functional principal component analysis: A normalization approach. Stat. Sin. 24, 1571–1596 (2014)
Wong, R.K., Li, Y., Zhu, Z.: Partially linear functional additive models for multivariate functional data. J. Am. Stat. Assoc. 114(525), 406–418 (2019)
Luo, R., Qi, X.: Function-on-function linear regression by signal compression. J. Am. Stat. Assoc. 112(518), 690–705 (2017)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Section Editor information
Rights and permissions
Copyright information
© 2023 Springer-Verlag London Ltd., part of Springer Nature
About this chapter
Cite this chapter
Xu, Y. (2023). Functional Data Analysis. In: Pham, H. (eds) Springer Handbook of Engineering Statistics. Springer Handbooks. Springer, London. https://doi.org/10.1007/978-1-4471-7503-2_4
Download citation
DOI: https://doi.org/10.1007/978-1-4471-7503-2_4
Published:
Publisher Name: Springer, London
Print ISBN: 978-1-4471-7502-5
Online ISBN: 978-1-4471-7503-2
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)