Skip to main content
SpringerLink
Log in

Functional Concurrent Linear Regression Model for Spatial Images

  • Published:
Journal of Agricultural, Biological, and Environmental Statistics Aims and scope Submit manuscript

Abstract

Motivated by a problem in describing forest nitrogen cycling, in this paper we explore regression models for spatial images. Specifically, we present a functional concurrent linear model with varying coefficients for two-dimensional spatial images. To address overparameterization issues, the parameter surfaces in this model are transformed into the wavelet domain and a sparse representation is found by using a large-scale l 1 constrained least squares algorithm. Once the sparse representation is identified, an inverse wavelet transform is applied to obtain the estimated parameter surfaces. The optimal penalization term in the objective function is determined using the Bayesian Information Criterion (BIC) and we introduce measures of model quality. Our model is versatile and can be applied to both single and multiple replicate cases.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Addison, N. (2002), The Illustrated Wavelet Transform Handbook, London: Taylor & Francis.

    Book  MATH  Google Scholar 

  • Anselin, L., and Florax, R. J. G. M. (eds.) (1995), New Directions in Spatial Econometrics, Berlin: Springer.

    MATH  Google Scholar 

  • Bell, B. S., and Broemeling, L. (2000), “A Bayesian Analysis for Spatial Processes With Application to Disease Mapping,” Statistics in Medicine, 19, 957–974.

    Article  Google Scholar 

  • Besag, J. (1974), “Spatial Interaction and the Statistical Analysis of Lattice Systems (with discussion),” Journal of the Royal Statistical Society. Series B, Statistical Methodology, 36, 192–236.

    MathSciNet  MATH  Google Scholar 

  • Besag, J., and Kooperberg, C. (1995), “On Conditional and Intrinsic Autoregression,” Biometrika, 82, 733–746.

    MathSciNet  MATH  Google Scholar 

  • Candocia, F. M., and Principe, J. C. (1999), “Superresolution of Images Based on Local Correlations,” IEEE Transactions on Neural Networks, 10, 372–380.

    Article  Google Scholar 

  • Cressie, N. (1993), Statistics for Spatial Data, New York: Wiley-Interscience.

    Google Scholar 

  • Donoho, D. L., and Johnstone, J. M. (1994), “Ideal Spatial Adaptation by Wavelet Shrinkage,” Biometrika, 81, 425–455.

    Article  MathSciNet  MATH  Google Scholar 

  • Donoho, D. L., Johnstone, I. M., Kerkyacharian, G., and Picard, D. (1995), “Wavelet Shrinkage: Asymptopia?” Journal of the Royal Statistical Society. Series B, Statistical Methodology, 57, 301–369.

    MathSciNet  MATH  Google Scholar 

  • Efron, B., Hastie, T., Johnstone, I., and Tibshirani, R. (2004), “Least Angle Regression,” The Annals of Statistics, 32, 494–499.

    MathSciNet  Google Scholar 

  • Elad, M., Matalon, B., and Zibulevsky, M. (2006), “Image Denoising with Shrinkage and Redundant Representations,” June 17–22, 2006, CVPR.

  • Eshleman, K., Morgan, R., Webb, J., Deviney, F., and Galloway, J. (1998), “Temporal Patterns of Nitrogen Leakage From Mid-Appalachian Forested Watersheds: Role of Insect Defoliation,” Water Resources Research, 34, 2005–2016.

    Article  Google Scholar 

  • Eubank, R., Huang, C., Maldonado, Y. M., and Buchanan, R. (2004), “Smoothing Spline Estimation in Varying-Coefficient Models,” Journal of the Royal Statistical Society. Series B, Statistical Methodology, 66, 653–667.

    Article  MathSciNet  MATH  Google Scholar 

  • Fan, J., and Li, R. (2001), “Variable Selection via Nonconcave Penalized Likelihood and Its Oracle Properties,” Journal of the American Statistical Association, 96, 1348–1360.

    Article  MathSciNet  MATH  Google Scholar 

  • Faraway, J. J. (2000), “Modeling Reaching Motions Using Functional Regression Analysis,” in Digital Human Modeling for Design and Engineering, Conference and Exposition, Dearborn, Michigan.

  • Fodor, I. K. (2002), “A Survey of Dimension Reduction Techniques,” Technical report, US DOE Office of Scientific and Technical Information.

  • Foster, J., and Townsend, P. (2002), “Mapping Forest Composition in the Central Appalachians Using AVIRIS: Effects of Topography and Phenology,” in Proceedings of the Eleventh JPL Airborne Earth Science Workshop, ed. R. O. Green, Pasadena, CA: Jet Propulsion Laboratory.

    Google Scholar 

  • Gelfand, A., and Vounatson, P. (2003), “Proper Multivariate Conditional Autoregressive Models for Spatial Data Analysis,” Biostatistics, 4, 11–25.

    Article  MATH  Google Scholar 

  • Gelfand, A. E., Kim, H.-J., Sirmans, C., and Banerjee, S. (2003), “Spatial Modeling With Spatially Varying Coefficient Processes,” Journal of the American Statistical Association, 98, 387–396.

    Article  MathSciNet  MATH  Google Scholar 

  • Goutis, C. (1998), “Second-Derivative Functional Regression With Applications to Near Infrared Spectroscopy,” Journal of the Royal Statistical Society. Series B, Statistical Methodology, 60, 103–114.

    Article  MathSciNet  MATH  Google Scholar 

  • Hastie, T., Buja, A., and Tibshirani, R. (1995), “Penalized Discriminant Analysis,” The Annals of Statistics, 33, 73–102.

    Article  MathSciNet  Google Scholar 

  • Hastie, T., and Tibshirani, R. (1993), “Varying-Coefficient Models,” Journal of the Royal Statistical Society. Series B, Statistical Methodology, 55, 757–796.

    MathSciNet  MATH  Google Scholar 

  • Hastie, T., Tibshirani, R., and Friedman, J. (2001), The Elements of Statistical Learning, Berlin: Springer.

    MATH  Google Scholar 

  • Houston, D., and Valentine, H. (1977), “Comparing and Predicting Forest Stand Susceptibility to Gypsy Moth,” Canadian Journal of Forest Research, 7, 447–461.

    Article  Google Scholar 

  • Kaufman, C. G., and Sain, S. R. (2007), “Bayesian Functional ANOVA Modeling Using Gaussian Process Prior Distributions,” Preprint.

  • Kim, S.-J., Koh, K., Lustig, M., Boyd, S. P., and Gorinevsky, D. (2007), “An Interior-Point Method for Large-Scale l 1-Regularized Least Squares,” IEEE Journal on Selected Topics in Signal Processing, 1, 606–617.

    Article  Google Scholar 

  • Kleiner, K., and Montgomery, M. (1994), “Forest Stand Susceptibility to the Gypsy-Moth (Lepidoptera, Lymantriidae)—Species and Site Effects on Foliage Quality to Larvae,” Environmental Entomology, 23, 699–711.

    Google Scholar 

  • Kyung, M., Gill, J., Ghosh, M., and Casella, G. (2009), “Penalized Regression, Standard Errors, and Bayesian Lassos,” Online Manuscript.

  • Lovett, G. M., Christenson, L. M., Groffman, P. M., Jones, C. G., Hart, J. E., and Mitchell, M. J. (2002), “Insect Defoliation and Nitrogen Cycling in Forests,” Bioscience, 52, 335–341.

    Article  Google Scholar 

  • Mallat, S. G., and Zhang, Z. (1993), “Matching Pursuits with Time-Frequency Dictionaries,” IEEE Transactions on Signal Processing, 41, 3397–3415. See also IEEE Transactions on Acoustics, Speech, and Signal Processing.

    Article  MATH  Google Scholar 

  • McNeil, B., de Beurs, K., Eshleman, K., Foster, J., and Townsend, P. (2007), “Maintenance of Ecosystem Nitrogen Limitation by Ephemeral Forest Disturbance: An Assessment Using Modis, Hyperion, and Landsat ETM,” Geophysical Research Letters, 34, 73–102.

    Article  Google Scholar 

  • Netravali, A. N., and Haskell, B. G. (1995), Digital Pictures: Representation, Compression and Standards (2nd ed.), New York: Plenum.

    Google Scholar 

  • Osborne, M. R., Presnell, B., and Turlach, B. A. (2000), “On the LASSO and Its Dual,” Journal of Computational and Graphical Statistics, 9, 319–337.

    Article  MathSciNet  Google Scholar 

  • Pati, Y. C., Rezaiifar, R., and Krishnaprasad, P. S. (1993), “Orthogonal Matching Pursuit: Recursive Function Approximation With Applications to Wavelet Decomposition,” in Conference Record of The Twenty-Seventh Asilomar Conference on Signals, Systems and Computers, Vol. 1, pp. 40–44.

    Google Scholar 

  • Pötscher, B. M., and Leeb, H. (2007), “On the Distribution of Penalized Maximum Likelihood Estimators: The LASSO, SCAD, and Thresholding,” MPRA Paper 5615, University Library of Munich, Germany, URL http://ideas.repec.org/p/pra/mprapa/5615.html.

  • Ramsay, J., and Silverman, B. (2005), Functional Data Analysis (2nd ed.), Berlin: Springer.

    Google Scholar 

  • Ratcliffe, S., Leader, L., and Heller, G. (2002), “Functional Data Analysis With Application to Periodically Stimulated Foetal Heart Rate Data. I: Functional Regression,” Statistics in Medicine, 21, 1103–1114.

    Article  Google Scholar 

  • Smith, M., and Fahrmeir, L. (2007), “Spatial Bayesian Variable Selection With Application to Functional Magnetic Resonance Imaging,” Journal of the American Statistical Association, 102, 417–431.

    Article  MathSciNet  MATH  Google Scholar 

  • Stern, H., and Cressie, N. (2000), “Posterior Predictive Model Checks for Disease Mapping Models,” Statistics in Medicine, 19, 2377–2397.

    Article  Google Scholar 

  • Tibshirani, R. (1996), “Regression Shrinkage and Selection via the LASSO,” The Annals of Statistics, 58, 267–288.

    MathSciNet  MATH  Google Scholar 

  • Townsend, P. A., Eshleman, K. N., and Welcker, C. (2004), “Remote Sensing of Gypsy Moth Defoliation to Assess Variations in Stream Nitrogen Concentrations,” Ecological Applications, 14, 504–516.

    Article  Google Scholar 

  • Tropp, J. A., and Gilbert, A. C. (2007), “Signal Recovery From Random Measurements via Orthogonal Matching Pursuit,” IEEE Transactions on Information Theory, 53, 4655–4666.

    Article  MathSciNet  Google Scholar 

  • Unser, M., Aldroubi, A., and Eden, M. (1991), “Fast b-Spline Transforms for Continuous Image Representation and Interpolation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 13, 277–285.

    Article  Google Scholar 

  • Wahba, G., and Cressie, N. (1990), “Comments on Cressie and reply to Wahba,” American Statistician, 44, 255–258.

    Google Scholar 

  • Walker, J. S. (1999), A Primer on Wavelets and Their Scientific Applications, Boca Raton: CRC Press.

    Book  MATH  Google Scholar 

  • Wall, M. M. (2004), “A Close Look at the Spatial Structure Implied by the Car and Sar Models,” Journal of Statistical Planning and Inference, 121.

  • West, M., Harrison, P., and Migon, H. (1985), “Dynamic Generalized Linear Models and Bayesian Forecasting,” Journal of the American Statistical Association, 80, 73–83.

    Article  MathSciNet  MATH  Google Scholar 

  • Yamanishi, Y., and Tanaka, Y. (2003), “Geographically Weighted Functional Multiple Regression Analysis: A Numerical Investigation,” Journal of the Japanese Society of Computational Statistics, 15, 307–317.

    MathSciNet  Google Scholar 

  • Zou, H. (2006), “The Adaptive LASSO and Its Oracle Properties,” Journal of the American Statistical Association, 101, 1418–1429.

    Article  MathSciNet  MATH  Google Scholar 

  • Zou, H., Hastie, T., and Tibshirani, R. (2007), “On the Degrees of Freedom of the LASSO,” The Annals of Statistics, 35, 2173–2192.

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Statistical and Applied Mathematical Sciences Institute, 19 T.W. Alexander Drive, Research Triangle Park, NC, 27709-4006, USA

    Jun Zhang

  2. Department of Statistics, University of Wisconsin-Madison, Madison, WI, 53706, USA

    Murray K. Clayton

  3. Department of Forest and Wildlife Ecology, University of Wisconsin-Madison, Madison, WI, 53706, USA

    Philip A. Townsend

Authors
  1. Jun Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Murray K. Clayton
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Philip A. Townsend
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jun Zhang.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Zhang, J., Clayton, M.K. & Townsend, P.A. Functional Concurrent Linear Regression Model for Spatial Images. JABES 16, 105–130 (2011). https://doi.org/10.1007/s13253-010-0047-1

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13253-010-0047-1

Key Words

Search

Navigation