Skip to main content
Log in

A novel dynamic interpolation method based on both temporal and spatial correlations

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Missing data are very common in environmental monitoring activities. Traditional interpolation methods often view the problem from either spatial or temporal perspective and do not make good use of valuable related information, thereby leading to low prediction accuracy. Although many hybrid spatiotemporal interpolation methods combine temporal interpolation methods with spatial interpolation methods and show superiority over other single temporal or spatial interpolation methods, they do not finely treat each missing value in terms of its specific features. In this paper, two dynamic spatiotemporal interpolation (DST) methods, coarse-grained DST (CGDST) and fine-grained DST (FGDST) are proposed by using both temporal and spatial interpolation results. Different from other hybrid spatiotemporal interpolation methods, they create differences in the contribution of temporal and spatial interpolation results and assign them with different weights. Both CGDST and FGDST treat each missing value differently and fill it by considering the reliability of both temporal and spatial interpolation results in terms of the lengths of its column gap and row gap. CGDST treats each missing value in a continuous missing area equally and all missing values have the same lengths of column and row gaps. FGDST goes beyond CGDST and treats each missing value differently based on its temporal distance to the nearest real observed values in both forward and backward directions. To demonstrate their superiority, the experimental datasets were generated randomly to simulate missing values in real life. The results of the extensive experiments showed that FGDST improved by 2.44% \(\sim \) 8.21% in terms of symmetric mean absolute percentage error (SMAPE) compared with the best baseline method. Compared with CGDST, the improvements of FGDST range from 1.05% to 2.87% in terms of SMAPE. Moreover, their superiority is more obvious if there are more continuous missing values in the temporal dimension.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Zhang Y, Zhang T, Li H (2021) Application of laser-induced breakdown spectroscopy (libs) in environmental monitoring. Spectrochim Acta B At Spectrosc 181:106218

    Article  Google Scholar 

  2. Kamalanandhini M, Annadurai R (2021) Assessment of five meteorological indices for monitoring the drought condition in chengalpattu district, tamilnadu, india. Materials Today: Proceedings 46:3699–3703. International Conference on Materials, Manufacturing and Mechanical Engineering for Sustainable Developments-2020 (ICMSD 2020)

    Google Scholar 

  3. Campos PMD, Esteves AF, Leitão AA, Pires JCM (2021) Design of air quality monitoring network of luanda, angola: Urban air pollution assessment. Atmospheric Pollution Research 12(8):101128

    Article  Google Scholar 

  4. Dsouza VL, Dsouza SF, Sarosh M, Kukkilaya S, Chilimbi V, Fernandes SR (2021) Remotely controlled boat for water quality monitoring and sampling. Materials Today: Proceedings

  5. Bychkov S, Dolgal A, Simanov A (2021) Interpretation of Gravity Monitoring Data on Geotechnical Impact on the Geological Environment. Pure Appl Geophys 178(1):107–121

    Article  Google Scholar 

  6. Trevathan J, Schmidtke S, Read W, Sharp T, Sattar A (2021) An iot general-purpose sensor board for enabling remote aquatic environmental monitoring. Internet of Things 16:100429

    Article  Google Scholar 

  7. Shah J, Mishra B (2020) Iot-enabled low power environment monitoring system for prediction of pm2.5. Pervasive and Mobile Computing 67:101175

    Article  Google Scholar 

  8. Dhamu V N, Banga I, Paul A, Ganguly A, Bhide A, Telang C, Muthukumar S, Prasad S (2021) Combinatorial sensors: An integrated approach to lifestyle management and environmental surveillance. In: Reference Module in Biomedical Sciences. Elsevier

  9. Yi Z (2020) Discriminative dimensionality reduction for sensor drift compensation in electronic nose: A robust, low-rank, and sparse representation method. Expert Syst Appl 148:113238

    Article  Google Scholar 

  10. Shi Q, Dai W, Santerre R, Liu N (2020) A Modified Spatiotemporal Mixed-Effects Model for Interpolating Missing Values in Spatiotemporal Observation Data Series. Math Probl Eng 2020:1–15

    Google Scholar 

  11. Terry WR, Lee JB, Kumar A (1986) Time series analysis in acid rain modeling: Evaluation of filling missing values by linear interpolation. Atmospheric Environment (1967) 20(10):1941–1943. First International Conference on Atmospheric Sciences and Applications to Air Quality Part II

    Article  Google Scholar 

  12. Li K, Ding J, Chen Z (2020) Multi-point measurement stations and adjustment methods for mapping air temperatures of wuhan city, china. Build Environ 177:106910

    Article  Google Scholar 

  13. Maleika W (2020) Inverse distance weighting method optimization in the process of digital terrain model creation based on data collected from a multibeam echosounder. Appl Geomatics 22(7):397–407

    Article  Google Scholar 

  14. Indirawati S M, Pandia S, Mawengkang H, Hasan W (2017) Inverse distance weighted method and environmental health risks of plumbum pollution in drinking water in belawan coastal area. Adv Sci Lett 23(4):3339–3343

    Article  Google Scholar 

  15. Kayikçi ET, Kazanci SZ (2016) Comparison of regression-based and combined versions of inverse distance weighted methods for spatial interpolation of daily mean temperature data. Arab J Geosci 9:10

    Google Scholar 

  16. Rojas-Gonzalez S, Van Nieuwenhuyse I (2020) A survey on kriging-based infill algorithms for multiobjective simulation optimization. Comput Oper Res 116:104869

    Article  MathSciNet  MATH  Google Scholar 

  17. Li Y, Wang L (2014) Research of spatiotemporal interpolation algorithm based on time series. Comput Sci 41(6A):414–424

    Google Scholar 

  18. Bo C, Shi Z, Zhao J (2021) Novel spatial and temporal interpolation algorithms based on extended field intensity model with applications for sparse aqi. Multimedia Tools and Applications

  19. Ioannidis VN, Romero D, Giannakis GB (2018) Inference of spatio-temporal functions over graphs via multikernel kriged kalman filtering. IEEE Trans Signal Process 66(12):3228–3239

    Article  MathSciNet  MATH  Google Scholar 

  20. Wei J, Huang W, Li Z, Xue W, Peng Y, Sun L, Cribb M (2019) Estimating 1-km-resolution pm2.5 concentrations across china using the space-time random forest approach. Remote Sens Environ 231:111221

    Article  Google Scholar 

  21. Hu H, Hu Z, Zhong K, Xu J, Zhang F, Zhao Y, Wu P (2019) Satellite-based high-resolution mapping of ground-level pm2.5 concentrations over east china using a spatiotemporal regression kriging model. Science of The Total Environment 672:479–490

    Article  Google Scholar 

  22. Jiang T, Chen B, Nie Z, Ren Z, Xu B, Tang S (2021) Estimation of hourly full-coverage pm2.5 concentrations at 1-km resolution in china using a two-stage random forest model. Atmos Res 248:105146

    Article  Google Scholar 

  23. Peng S (2010) Developments of spatio-temporal interpolation methods for meteorological elements. Master’s Thesis, Central South University

  24. Cheng S, Peng P, Lu F (2020) A lightweight ensemble spatiotemporal interpolation model for geospatial data. Int J Geogr Inf Sci 34:1–24

    Article  Google Scholar 

  25. Tong W, Li L, Zhou X, Hamilton A, Zhang K (2019) Deep learning pm2.5 concentrations with bidirectional lstm rnn. Air Quality, Atmosphere & Health 12:411–423

    Article  Google Scholar 

  26. Feng Y, Xiang Y (2008) Mitigation of spectral mis-registration effects in imaging spectrometers via cubic spline interpolation. Opt Express 16(20):15366–15374

    Article  Google Scholar 

  27. Baldi A, Bertolino F (2015) Experimental analysis of the errors due to polynomial interpolation in digital image correlation. Strain 51(3):248–263

    Article  Google Scholar 

  28. Sun X (2005) Spatio-temporal process visualization for marine hydrological scale data. Master’s Thesis, Wuhan University

  29. Schumann AH (1998) Thiessen polygonthiessen polygon. Springer Netherlands, Dordrecht, pp 648–649

    Google Scholar 

  30. Bartier P M, Keller CP (1996) Multivariate interpolation to incorporate thematic surface data using inverse distance weighting (idw). Comput Geosci 22(7):795–799

    Article  Google Scholar 

  31. Webster R, Oliver MA (2007) Geostatistics for environmental scientists. John Wiley & Sons, Ltd

  32. Nalder I A, Wein R W (1998) Spatial interpolation of climatic normals: test of a new method in the canadian boreal forest. Agric Forest Meteorol 92(4):211–225

    Article  Google Scholar 

  33. Oliver MA, Webster R (1990) Kriging: a method of interpolation for geographical information systems. Int J Geogr Inf Syst 4(3):313–332

    Article  Google Scholar 

  34. Bărbulescu A, Şerban C, Indrecan M-L (2021) Computing the beta parameter in idw interpolation by using a genetic algorithm. Water, 13(6),

  35. Srivastava PK, Pandey PC, Petropoulos GP, Kourgialas NN, Pandey V, Singh U (2019) Gis and remote sensing aided information for soil moisture estimation: A comparative study of interpolation techniques. Resources, 8(2)

  36. Hongxia W, Xiaoni L, Zhengchao R, Jingqiong W, Dongrong P, Jianjie H (2012) Spatial interpolation of precipitation - a case of gansu province. Grassland and turf 32(5):12–16

    Google Scholar 

  37. Ahmad AY, Saleh IA, Balakrishnan P, Al-Ghouti MA (2021) Comparison gis-based interpolation methods for mapping groundwater quality in the state of qatar. Groundwater for Sustainable Development 13:100573

    Article  Google Scholar 

  38. Chen H, Fan L, Wu W, Liu H-B (2017) Comparison of spatial interpolation methods for soil moisture and its application for monitoring drought. Environmental Monitoring and Assessment 189(10):525

    Article  Google Scholar 

  39. Bayen AM, Siauw T (2015) Chapter 14 - interpolation. In: Bayen AM, Siauw T (eds) An Introduction to MATLAB®;programming and numerical methods for engineers. Academic Press, Boston, pp 211–223

  40. Goovaerts P (2000) Geostatistical approaches for incorporating elevation into the spatial interpolation of rainfall. J Hydrol 228(1):113–129

    Article  Google Scholar 

  41. Hudson G, Wackernagel H (1994) Mapping temperature using kriging with external drift: Theory and an example from scotland. Int J Climatol 14(1):77–91

    Article  Google Scholar 

  42. Bertino L, Evensen G, Wackernagel H (2002) Combining geostatistics and kalman filtering for data assimilation in an estuarine system. Inverse Methods, pp 1–23

  43. Martínez WA, Melo CE, Melo OO (2017) Median polish kriging for space-time analysis of precipitation. Spatial Statistics 19:1–20

    Article  MathSciNet  Google Scholar 

  44. Xiao L, Christakos G, He J, Lang Y (2020) Space-time ground-level pm2.5 distribution at the yangtze river delta: A comparison of kriging, lur, and combined bme-lur techniques. Journal of Environmental Informatics 36:33–42

    Google Scholar 

  45. Zou Wy, Yin Sq, Wang Wt (2021) Spatial interpolation of the extreme hourly precipitation at different return levels in the haihe river basin. J Hydrol 598:126273

    Article  Google Scholar 

  46. Wackernagel H (2003) Ordinary kriging. Springer, Berlin, Heidelberg, pp 79–88

    Google Scholar 

  47. Güler M (2014) A comparison of different interpolation methods using the geographical information system for the production of reference evapotranspiration maps in turkey. J Meteorol Soc Jpn 92:227–240

    Article  Google Scholar 

  48. Wang X (2021) Historical data of air quality in China. https://quotsoft.net/air/, Accessed April 5, 2021

  49. PyKrige (2021) Kriging toolkit for python. https://geostat-framework.readthedocs.io/projects/pykrige/en/latest/index.html, Accessed May 15, 2021

  50. Inc. Facebook (2021) An open source machine learning framework that accelerates the path from research prototyping to production deployment. https://pytorch.org/, Accessed July 15, 2021

  51. Tobler WR (1970) A computer movie simulating urban growth in the detroit region. Econ Geogr 46(sup1):234–240

    Article  Google Scholar 

Download references

Acknowledgements

This work is supported by the blue point distributed intelligent computing project of China University IUR Innovation Fund (Project No. 2021LDA12003), Natural Science Foundation of Gansu Province, China (Project No. 21JR7RA460), National College Students Innovation and Entrepreneurship Training Program (Project No. 202110730090) and National Natural Science Foundation of China (Project No. 61702240).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Zhili Zhao.

Ethics declarations

Conflict of Interests

The authors declare that they have no conflicts of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Shiping Gao and Dongjie He are contributed equally to this work.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gao, S., He, D., Zhang, Z. et al. A novel dynamic interpolation method based on both temporal and spatial correlations. Appl Intell 53, 5100–5125 (2023). https://doi.org/10.1007/s10489-022-03815-7

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-022-03815-7

Keywords

Navigation