Skip to main content

Functional Data Analysis

  • Chapter
  • First Online:
Springer Handbook of Engineering Statistics

Part of the book series: Springer Handbooks ((SHB))

  • 2031 Accesses

Abstract

This chapter introduces functional data analysis (FDA) and selective topics in FDA, including functional principal component analysis (FPCA) and functional linear regression (FLR), with real data applications using a software package, which is publicly available. The methods in this chapter are based on local polynomial regression, a basic and important smoothing technique in nonparametric and semiparametric statistics. The approaches included in this chapter are not limited to the analysis of dense functional data but can also be used for the analysis of sparse functional/longitudinal data.

In Sect. 4.1, we introduce FDA with some interesting examples of functional data and briefly describe FPCA and FLR. Section 4.2 details FPCA, one of the most important topics and tools in FDA. Topics such as the estimation of mean and covariance functions using nonparametric smoothing, choosing the number of principal components (PC) using subjective and objective methods, and prediction of trajectories are included and illustrated using a publicly available bike-sharing data set. Section 4.3 presents FLR based on FPCA described in Sect. 4.2. FLR is a generalization of traditional linear regression to the case of functional data. It is a powerful tool to model the relationship between functional/scalar response and functional predictors. This section is also illustrated using the same bike-sharing data set. We focus on the case when both response and predictor are functions in this section, but we mentioned other types of FLR topics in Sect. 4.4. Section 4.4 presents a short overview of other selected topics and software packages in FDA. These topics are either about functional data with more complex features than the simple and basic ones included in the previous two sections or about other statistical estimation and inference not covered before. The statistical software packages used in this chapter are written in Matlab and may be appropriate for the analysis of some basic types of functional data but not for others. Section 4.4 described other software packages written in different languages, such as R, and those packages have the flexibility to analyze various problems in functional data and different types of functional data.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 309.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 399.00
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ramsay, J.O., Silverman, B.W.: Functional Data Analysis. Springer, Berlin (2005)

    Book  MATH  Google Scholar 

  2. Xu, Y., Qiu, Y., Schnable, J.C.: Functional Modeling of Plant Growth Dynamics. The Plant Phenome Journal 1(1), 1–10 (2018)

    Article  Google Scholar 

  3. Xu, Y., Li, Y., Nettleton, D.: Nested hierarchical functional data modeling and inference for the analysis of functional plant phenotypes. J. Am. Stat. Assoc. 113(522), 593–606 (2018)

    Article  MathSciNet  MATH  Google Scholar 

  4. Yao, F., Müller, H.-G., Wang, J.-L.: Functional data analysis for sparse longitudinal data. J. Am. Stat. Assoc. 100(470), 577–590 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  5. Fan, J.: Local Polynomial Modelling and Its Applications: Monographs on Statistics and Applied Probability, vol. 66. Routledge, London (2018)

    Book  Google Scholar 

  6. Rice, J.A., Silverman, B.W.: Estimating the mean and covariance structure nonparametrically when the data are curves. J. R. Stat. Soc. Ser. B (Methodol.) 53(1), 233–243 (1991)

    Google Scholar 

  7. Yao, F., Lee, T.C.: Penalized spline models for functional principal component analysis. J. R. Stat. Soc. Ser. B (Stat Methodol.) 68(1), 3–25 (2006)

    Google Scholar 

  8. Li, Y., Wang, N., Carroll, R.J.: Selecting the number of principal components in functional data. J. Am. Stat. Assoc. 108(504), 1284–1294 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  9. Yao, F., Müller, H.-G., Wang, J.-L.: Functional linear regression analysis for longitudinal data. Ann. Stat. 33(6), 2873–2903 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  10. Wang, J.-L., Chiou, J.-M., Müller, H.-G.: Functional data analysis. Annu. Rev. Stat. Appl. 3, 257–295 (2016)

    Article  Google Scholar 

  11. Hall, P., Müller, H.-G., Wang, J.-L.: Properties of principal component methods for functional and longitudinal data analysis. Ann. Stat. 34(3), 1493–1517 (2006)

    Article  MathSciNet  MATH  Google Scholar 

  12. Hall, P., Vial, C.: Assessing the finite dimensionality of functional data. J. R. Stat. Soc. Ser. B (Stat Methodol.) 68(4), 689–705 (2006)

    Google Scholar 

  13. Li, Y., Hsing, T.: Uniform convergence rates for nonparametric regression and principal component analysis in functional/longitudinal data. Ann. Stat. 38(6), 3321–3351 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  14. Li, Y., Hsing, T.: Deciding the dimension of effective dimension reduction space for functional and high-dimensional data. Ann. Stat. 38(5), 3028–3062 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  15. Zhang, X., Wang, J.-L.: From sparse to dense functional data and beyond. Ann. Stat. 44(5), 2281–2321 (2016)

    Article  MathSciNet  MATH  Google Scholar 

  16. Liu, B., Müller, H.-G.: Estimating derivatives for samples of sparsely observed functions, with application to online auction dynamics. J. Am. Stat. Assoc. 104(486), 704–717 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  17. Dai, X., Müller, H.-G., Tao, W.: Derivative principal component analysis for representing the time dynamics of longitudinal and functional data. arXiv preprint arXiv:1707.04360 (2017)

    Google Scholar 

  18. Morris, J.S.: Functional regression. Annual Review of Statistics and Its Application 2, 321–359 (2015)

    Article  Google Scholar 

  19. Zhang, J.-T.: Analysis of Variance for Functional Data. Chapman and Hall/CRC, New York (2013)

    Book  Google Scholar 

  20. Song, F.S., Montabon, F., Xu, Y.: The impact of national culture on corporate adoption of environmental management practices and their effectiveness. Int. J. Prod. Econ. 205, 313–328 (2018)

    Article  Google Scholar 

  21. Di, C.-Z., Crainiceanu, C.M., Caffo, B.S., Punjabi, N.M.: Multilevel functional principal component analysis. Ann. Appl. Stat. 3(1), 458 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  22. Sawant, P., Billor, N., Shin, H.: Functional outlier detection with robust functional principal component analysis. Comput. Stat. 27(1), 83–102 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  23. She, Y., Li, S., Wu, D.: Robust orthogonal complement principal component analysis. J. Am. Stat. Assoc. 111(514), 763–771 (2016)

    Article  MathSciNet  Google Scholar 

  24. Cao, G., Yang, L., Todem, D.: Simultaneous inference for the mean function based on dense functional data. Journal of Nonparametric Statistics 24(2), 359–377 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  25. Cao, G., Wang, L., Li, Y., Yang, L.: Oracle-efficient confidence envelopes for covariance functions in dense functional data. Stat. Sin., 26, 359–383 (2016)

    MathSciNet  MATH  Google Scholar 

  26. Müller, H.-G.: Functional modelling and classification of longitudinal data. Scand. J. Stat. 32(2), 223–240 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  27. James, G.M., Hastie, T.J.: Functional linear discriminant analysis for irregularly sampled curves. J. R. Stat. Soc. Ser. B (Stat Methodol.) 63(3), 533–550 (2001)

    Google Scholar 

  28. Chiou, J.-M., Chen, Y.-T., Yang, Y.-F.: Multivariate functional principal component analysis: A normalization approach. Stat. Sin. 24, 1571–1596 (2014)

    MathSciNet  MATH  Google Scholar 

  29. Wong, R.K., Li, Y., Zhu, Z.: Partially linear functional additive models for multivariate functional data. J. Am. Stat. Assoc. 114(525), 406–418 (2019)

    Article  MathSciNet  MATH  Google Scholar 

  30. Luo, R., Qi, X.: Function-on-function linear regression by signal compression. J. Am. Stat. Assoc. 112(518), 690–705 (2017)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Section Editor information

Rights and permissions

Reprints and permissions

Copyright information

© 2023 Springer-Verlag London Ltd., part of Springer Nature

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Xu, Y. (2023). Functional Data Analysis. In: Pham, H. (eds) Springer Handbook of Engineering Statistics. Springer Handbooks. Springer, London. https://doi.org/10.1007/978-1-4471-7503-2_4

Download citation

Publish with us

Policies and ethics