Functional Concurrent Linear Regression Model for Spatial Images

  • Jun ZhangEmail author
  • Murray K. Clayton
  • Philip A. Townsend


Motivated by a problem in describing forest nitrogen cycling, in this paper we explore regression models for spatial images. Specifically, we present a functional concurrent linear model with varying coefficients for two-dimensional spatial images. To address overparameterization issues, the parameter surfaces in this model are transformed into the wavelet domain and a sparse representation is found by using a large-scale l 1 constrained least squares algorithm. Once the sparse representation is identified, an inverse wavelet transform is applied to obtain the estimated parameter surfaces. The optimal penalization term in the objective function is determined using the Bayesian Information Criterion (BIC) and we introduce measures of model quality. Our model is versatile and can be applied to both single and multiple replicate cases.

Key Words

Dimension reduction LASSO Regression models for spatial images Remote sensing Satellite images Wavelet expansion 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Addison, N. (2002), The Illustrated Wavelet Transform Handbook, London: Taylor & Francis. zbMATHCrossRefGoogle Scholar
  2. Anselin, L., and Florax, R. J. G. M. (eds.) (1995), New Directions in Spatial Econometrics, Berlin: Springer. zbMATHGoogle Scholar
  3. Bell, B. S., and Broemeling, L. (2000), “A Bayesian Analysis for Spatial Processes With Application to Disease Mapping,” Statistics in Medicine, 19, 957–974. CrossRefGoogle Scholar
  4. Besag, J. (1974), “Spatial Interaction and the Statistical Analysis of Lattice Systems (with discussion),” Journal of the Royal Statistical Society. Series B, Statistical Methodology, 36, 192–236. MathSciNetzbMATHGoogle Scholar
  5. Besag, J., and Kooperberg, C. (1995), “On Conditional and Intrinsic Autoregression,” Biometrika, 82, 733–746. MathSciNetzbMATHGoogle Scholar
  6. Candocia, F. M., and Principe, J. C. (1999), “Superresolution of Images Based on Local Correlations,” IEEE Transactions on Neural Networks, 10, 372–380. CrossRefGoogle Scholar
  7. Cressie, N. (1993), Statistics for Spatial Data, New York: Wiley-Interscience. Google Scholar
  8. Donoho, D. L., and Johnstone, J. M. (1994), “Ideal Spatial Adaptation by Wavelet Shrinkage,” Biometrika, 81, 425–455. MathSciNetzbMATHCrossRefGoogle Scholar
  9. Donoho, D. L., Johnstone, I. M., Kerkyacharian, G., and Picard, D. (1995), “Wavelet Shrinkage: Asymptopia?” Journal of the Royal Statistical Society. Series B, Statistical Methodology, 57, 301–369. MathSciNetzbMATHGoogle Scholar
  10. Efron, B., Hastie, T., Johnstone, I., and Tibshirani, R. (2004), “Least Angle Regression,” The Annals of Statistics, 32, 494–499. MathSciNetGoogle Scholar
  11. Elad, M., Matalon, B., and Zibulevsky, M. (2006), “Image Denoising with Shrinkage and Redundant Representations,” June 17–22, 2006, CVPR. Google Scholar
  12. Eshleman, K., Morgan, R., Webb, J., Deviney, F., and Galloway, J. (1998), “Temporal Patterns of Nitrogen Leakage From Mid-Appalachian Forested Watersheds: Role of Insect Defoliation,” Water Resources Research, 34, 2005–2016. CrossRefGoogle Scholar
  13. Eubank, R., Huang, C., Maldonado, Y. M., and Buchanan, R. (2004), “Smoothing Spline Estimation in Varying-Coefficient Models,” Journal of the Royal Statistical Society. Series B, Statistical Methodology, 66, 653–667. MathSciNetzbMATHCrossRefGoogle Scholar
  14. Fan, J., and Li, R. (2001), “Variable Selection via Nonconcave Penalized Likelihood and Its Oracle Properties,” Journal of the American Statistical Association, 96, 1348–1360. MathSciNetzbMATHCrossRefGoogle Scholar
  15. Faraway, J. J. (2000), “Modeling Reaching Motions Using Functional Regression Analysis,” in Digital Human Modeling for Design and Engineering, Conference and Exposition, Dearborn, Michigan. Google Scholar
  16. Fodor, I. K. (2002), “A Survey of Dimension Reduction Techniques,” Technical report, US DOE Office of Scientific and Technical Information. Google Scholar
  17. Foster, J., and Townsend, P. (2002), “Mapping Forest Composition in the Central Appalachians Using AVIRIS: Effects of Topography and Phenology,” in Proceedings of the Eleventh JPL Airborne Earth Science Workshop, ed. R. O. Green, Pasadena, CA: Jet Propulsion Laboratory. Google Scholar
  18. Gelfand, A., and Vounatson, P. (2003), “Proper Multivariate Conditional Autoregressive Models for Spatial Data Analysis,” Biostatistics, 4, 11–25. zbMATHCrossRefGoogle Scholar
  19. Gelfand, A. E., Kim, H.-J., Sirmans, C., and Banerjee, S. (2003), “Spatial Modeling With Spatially Varying Coefficient Processes,” Journal of the American Statistical Association, 98, 387–396. MathSciNetzbMATHCrossRefGoogle Scholar
  20. Goutis, C. (1998), “Second-Derivative Functional Regression With Applications to Near Infrared Spectroscopy,” Journal of the Royal Statistical Society. Series B, Statistical Methodology, 60, 103–114. MathSciNetzbMATHCrossRefGoogle Scholar
  21. Hastie, T., Buja, A., and Tibshirani, R. (1995), “Penalized Discriminant Analysis,” The Annals of Statistics, 33, 73–102. MathSciNetCrossRefGoogle Scholar
  22. Hastie, T., and Tibshirani, R. (1993), “Varying-Coefficient Models,” Journal of the Royal Statistical Society. Series B, Statistical Methodology, 55, 757–796. MathSciNetzbMATHGoogle Scholar
  23. Hastie, T., Tibshirani, R., and Friedman, J. (2001), The Elements of Statistical Learning, Berlin: Springer. zbMATHGoogle Scholar
  24. Houston, D., and Valentine, H. (1977), “Comparing and Predicting Forest Stand Susceptibility to Gypsy Moth,” Canadian Journal of Forest Research, 7, 447–461. CrossRefGoogle Scholar
  25. Kaufman, C. G., and Sain, S. R. (2007), “Bayesian Functional ANOVA Modeling Using Gaussian Process Prior Distributions,” Preprint. Google Scholar
  26. Kim, S.-J., Koh, K., Lustig, M., Boyd, S. P., and Gorinevsky, D. (2007), “An Interior-Point Method for Large-Scale l 1-Regularized Least Squares,” IEEE Journal on Selected Topics in Signal Processing, 1, 606–617. CrossRefGoogle Scholar
  27. Kleiner, K., and Montgomery, M. (1994), “Forest Stand Susceptibility to the Gypsy-Moth (Lepidoptera, Lymantriidae)—Species and Site Effects on Foliage Quality to Larvae,” Environmental Entomology, 23, 699–711. Google Scholar
  28. Kyung, M., Gill, J., Ghosh, M., and Casella, G. (2009), “Penalized Regression, Standard Errors, and Bayesian Lassos,” Online Manuscript. Google Scholar
  29. Lovett, G. M., Christenson, L. M., Groffman, P. M., Jones, C. G., Hart, J. E., and Mitchell, M. J. (2002), “Insect Defoliation and Nitrogen Cycling in Forests,” Bioscience, 52, 335–341. CrossRefGoogle Scholar
  30. Mallat, S. G., and Zhang, Z. (1993), “Matching Pursuits with Time-Frequency Dictionaries,” IEEE Transactions on Signal Processing, 41, 3397–3415. See also IEEE Transactions on Acoustics, Speech, and Signal Processing. zbMATHCrossRefGoogle Scholar
  31. McNeil, B., de Beurs, K., Eshleman, K., Foster, J., and Townsend, P. (2007), “Maintenance of Ecosystem Nitrogen Limitation by Ephemeral Forest Disturbance: An Assessment Using Modis, Hyperion, and Landsat ETM,” Geophysical Research Letters, 34, 73–102. CrossRefGoogle Scholar
  32. Netravali, A. N., and Haskell, B. G. (1995), Digital Pictures: Representation, Compression and Standards (2nd ed.), New York: Plenum. Google Scholar
  33. Osborne, M. R., Presnell, B., and Turlach, B. A. (2000), “On the LASSO and Its Dual,” Journal of Computational and Graphical Statistics, 9, 319–337. MathSciNetCrossRefGoogle Scholar
  34. Pati, Y. C., Rezaiifar, R., and Krishnaprasad, P. S. (1993), “Orthogonal Matching Pursuit: Recursive Function Approximation With Applications to Wavelet Decomposition,” in Conference Record of The Twenty-Seventh Asilomar Conference on Signals, Systems and Computers, Vol. 1, pp. 40–44. Google Scholar
  35. Pötscher, B. M., and Leeb, H. (2007), “On the Distribution of Penalized Maximum Likelihood Estimators: The LASSO, SCAD, and Thresholding,” MPRA Paper 5615, University Library of Munich, Germany, URL
  36. Ramsay, J., and Silverman, B. (2005), Functional Data Analysis (2nd ed.), Berlin: Springer. Google Scholar
  37. Ratcliffe, S., Leader, L., and Heller, G. (2002), “Functional Data Analysis With Application to Periodically Stimulated Foetal Heart Rate Data. I: Functional Regression,” Statistics in Medicine, 21, 1103–1114. CrossRefGoogle Scholar
  38. Smith, M., and Fahrmeir, L. (2007), “Spatial Bayesian Variable Selection With Application to Functional Magnetic Resonance Imaging,” Journal of the American Statistical Association, 102, 417–431. MathSciNetzbMATHCrossRefGoogle Scholar
  39. Stern, H., and Cressie, N. (2000), “Posterior Predictive Model Checks for Disease Mapping Models,” Statistics in Medicine, 19, 2377–2397. CrossRefGoogle Scholar
  40. Tibshirani, R. (1996), “Regression Shrinkage and Selection via the LASSO,” The Annals of Statistics, 58, 267–288. MathSciNetzbMATHGoogle Scholar
  41. Townsend, P. A., Eshleman, K. N., and Welcker, C. (2004), “Remote Sensing of Gypsy Moth Defoliation to Assess Variations in Stream Nitrogen Concentrations,” Ecological Applications, 14, 504–516. CrossRefGoogle Scholar
  42. Tropp, J. A., and Gilbert, A. C. (2007), “Signal Recovery From Random Measurements via Orthogonal Matching Pursuit,” IEEE Transactions on Information Theory, 53, 4655–4666. MathSciNetCrossRefGoogle Scholar
  43. Unser, M., Aldroubi, A., and Eden, M. (1991), “Fast b-Spline Transforms for Continuous Image Representation and Interpolation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 13, 277–285. CrossRefGoogle Scholar
  44. Wahba, G., and Cressie, N. (1990), “Comments on Cressie and reply to Wahba,” American Statistician, 44, 255–258. Google Scholar
  45. Walker, J. S. (1999), A Primer on Wavelets and Their Scientific Applications, Boca Raton: CRC Press. zbMATHCrossRefGoogle Scholar
  46. Wall, M. M. (2004), “A Close Look at the Spatial Structure Implied by the Car and Sar Models,” Journal of Statistical Planning and Inference, 121. Google Scholar
  47. West, M., Harrison, P., and Migon, H. (1985), “Dynamic Generalized Linear Models and Bayesian Forecasting,” Journal of the American Statistical Association, 80, 73–83. MathSciNetzbMATHCrossRefGoogle Scholar
  48. Yamanishi, Y., and Tanaka, Y. (2003), “Geographically Weighted Functional Multiple Regression Analysis: A Numerical Investigation,” Journal of the Japanese Society of Computational Statistics, 15, 307–317. MathSciNetGoogle Scholar
  49. Zou, H. (2006), “The Adaptive LASSO and Its Oracle Properties,” Journal of the American Statistical Association, 101, 1418–1429. MathSciNetzbMATHCrossRefGoogle Scholar
  50. Zou, H., Hastie, T., and Tibshirani, R. (2007), “On the Degrees of Freedom of the LASSO,” The Annals of Statistics, 35, 2173–2192. MathSciNetzbMATHCrossRefGoogle Scholar

Copyright information

© International Biometric Society 2010

Authors and Affiliations

  • Jun Zhang
    • 1
    Email author
  • Murray K. Clayton
    • 2
  • Philip A. Townsend
    • 3
  1. 1.Statistical and Applied Mathematical Sciences InstituteResearch Triangle ParkUSA
  2. 2.Department of StatisticsUniversity of Wisconsin-MadisonMadisonUSA
  3. 3.Department of Forest and Wildlife EcologyUniversity of Wisconsin-MadisonMadisonUSA

Personalised recommendations