Skip to main content
SpringerLink
Log in

Data Ingestion and Analysis Framework for Geoscience Data

  • Conference paper
  • First Online:
Recent Innovations in Computing (ICRIC 2020)

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 701))

Included in the following conference series:

Abstract

Big earth data analytics is an emerging field since environmental sciences are probably going to profit by its different systems supporting the handling of the enormous measure of earth observation data, gained and produced through perceptions. It additionally benefits by giving enormous stockpiling and registering capacities. Be that as it may, big earth data analytics requires explicitly planned instruments to show specificities as far as significance of the geospatial data, intricacy of handling, and wide heterogeneity of information models and arrangements [1]. Data ingestion and analysis framework for geoscience data is the study and implementation of extracting data on the system and processing it for change detection and to increase the interoperability with the help of analytical frameworks which aims at facilitating the understanding of the data in a systematic manner. In this paper, we address the challenges and opportunities in the climate data through the climate data toolbox for MATLAB [2] and how it can be beneficial to resolve various climate-change-related analytical difficulties.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Baumann, P., et al.: Big data analytics for earth sciences: the earth server approach. Int. J. Digi. Earth 9, 1–27 (2015). https://doi.org/10.1080/17538947.2014.1003106

    Article  Google Scholar 

  2. https://www.mathworks.com/matlabcentral/fileexchange/70338-climate-data-toolbox-for-matlab

  3. Russom, P.: Big data analytics. Big Data Analytics, 38

    Google Scholar 

  4. Verma, J.P., Agrawal, S., Patel, B., Patel, A.: Big data analytics: challenges and applications for text, audio, video, and social media data, international journal on soft computing. Arti. Intel. Appl. (IJSCAI) 5(1), 41–51 (2016). https://doi.org/10.5121/ijscai.2016.5105

    Article  Google Scholar 

  5. Tsai, C.-W., et al.: Big data analytics: a survey. J. Big Data 2(1), 21. https://doi.org/10.1186/s40537-015-0030-3

  6. Trends in Big Data Analytics. J. Parallel Distrib. Comput. 74(7):2561–2573. https://doi.org/10.1016/j.jpdc.2014.01.003

  7. Agrawal, S., Patel, A.: A study on graph storage database of Nosql. Int. J. Soft Comput. Artif. Int. Appl. (IJSCAI) 5(1), 33–39 (2016). https://doi.org/10.5121/ijscai.2016.5104. URL http://aircconline.com/ijscai/V5N1/5116ijscai04.pdf

  8. Masani, K.I., Oza, P., Agrawal, S.: Predictive maintenance and monitoring of industrial machine using machine learning. Scalable Comput. Pract. Experience 20(4), 663–668 (2019)

    Article  Google Scholar 

  9. Schnase, J.L., et al.: Big data challenges in climate science, 11. Data ingestion: the first step to a sound data strategy. stitch resource. Stitch https://www.stitchdata.com/resources/data-ingestion/. Accessed 6 Nov 2019

  10. Schnase, J.L., et al.: Big data challenges in climate science, 11. Data Ingestion: the first step to a sound data strategy stitch resource. https://www.stitchdata.com/resources/data-ingestion/. Accessed 6 Nov 2019

  11. (PDF) Big data analytics framework for improved decision making. https://www.researchgate.net/publication/273818434_Big_Data_Analytics_Framework_for_Improved_Decision_Making. Accessed 6 Nov 2019

  12. Yang, C., et al.: Utilizing cloud computing to address big geospatial data challenges. Comput. Environ. Urban Syst. Geospatial Cloud Comput. Big Data 61, 120–128 (2017). https://doi.org/10.1016/j.compenvurbsys.2016.10.010

    Article  Google Scholar 

  13. Giachetta, R.: A framework for processing large scale geospatial and remote sensing data in mapreduce environment. Comput. Graph. 49, 37–46 (2015). https://doi.org/10.1016/j.cag.2015.03.003

    Article  Google Scholar 

  14. Merritt, P., et al.: Big earth data: a comprehensive analysis of visualization analytics issues. Big Earth Data 2(4), 321–350 (2018). https://doi.org/10.1080/20964471.2019.1576260

    Article  Google Scholar 

  15. Lee, J.-G., Kang, M.: Geospatial big data: challenges and opportunities. Big Data Res. 2(2), 74–81 (2015). https://doi.org/10.1016/j.bdr.2015.01.003

    Article  Google Scholar 

  16. Yu, J., Wu, J., Sarwat, M.: GeoSpark: a cluster computing framework for processing large-scale spatial data. In: Proceedings of the 23rd SIGSPATIAL International Conference on Advances In Geographic Information Systems, SIGSPATIAL’15, pp. 1–4. Association for Computing Machinery, Eattle, Washington (2015). https://doi.org/10.1145/2820783.2820860

  17. Desai, K., Devulapalli, V., Agrawal, S., Kathiria, P.: Patel, A.: Web crawler: review of different types of web crawler, its issues, applications and research opportunities. Int. J. Adv. Res. Comput. Sci. 8(3) (2017)

    Google Scholar 

  18. Agrawal, S., Verma, J.P., Mahidhariya, B., Patel, N., Patel, A.: Survey on mongodb: an open-source document database. Int. J. Adv. Res. Eng. Technol. 1(2), 4 (2015)

    Google Scholar 

  19. Yadav, S., Verma, J., Agrawal, S.: SUTRON: IoT-based industrial/home security and automation system to compete the smarter world. Int. J. Appl. Res. Inf. Technol. Comput. 8(2), 193–198 (2017)

    Article  Google Scholar 

  20. Desai, R., Gandhi, A., Agrawal, S., Kathiria, P., Oza, P.: Iot-based home automation with smart fan and ac using nodemcu. In: Proceedings of ICRIC 2019, Springer, 2020, pp. 197–207

    Google Scholar 

  21. Agrawal, S., Patel, A.: Clustering algorithm for community detection in complex network: a comprehensive review. Recent Adv. Comput. Sci. Commun. 13(1), 1–8 (2020). https://doi.org/10.2174/2213275912666190710183635. http://www.eurekaselect.com/node/173402/article

  22. Agrawal, S.S., Patel, A.: CSG cluster: A collaborative similarity based graph clustering for community detection in complex networks. Int. J. Eng. Adv. Technol. 8(5), 1682–1687 (2019)

    Google Scholar 

  23. The Climate Data Toolbox for MATLAB—Greene—2019—Geochemistry, Geophysics, Geosystems—Wiley Online Library. https://agupubs.onlinelibrary.wiley.com/doi/abs/10.1029/2019GC008392. Accessed 29 Feb 2020

Download references

Author information

Authors and Affiliations

  1. CE Department, Institute of Technology, Nirma University, Ahmedabad, India

    Niti Shah, Smita Agrawal & Parita Oza

Authors
  1. Niti Shah
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Smita Agrawal
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Parita Oza
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Niti Shah .

Editor information

Editors and Affiliations

  1. Department of Computer Science & Engineering, ABES Engineering College, Ghaziabad, Uttar Pradesh, India

    Pradeep Kumar Singh

  2. Central University of Jammu, Jammu and Kashmir, India

    Yashwant Singh

  3. Department of Electrical Engineering, Indian Institute of Technology Patna, Patna, Bihar, India

    Maheshkumar H. Kolekar

  4. Department of Management Sciences, Indian Institute of Technology Delhi, New Delhi, Delhi, India

    Arpan Kumar Kar

  5. Department of Computer Engineering, National Institute of Technology Kurukshetra, Kurukshetra, Haryana, India

    Jitender Kumar Chhabra

  6. Department of Computer Science and Information Technology, Kwantlen Polytechnic University, Surrey, BC, Canada

    Abhijit Sen

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Shah, N., Agrawal, S., Oza, P. (2021). Data Ingestion and Analysis Framework for Geoscience Data. In: Singh, P.K., Singh, Y., Kolekar, M.H., Kar, A.K., Chhabra, J.K., Sen, A. (eds) Recent Innovations in Computing. ICRIC 2020. Lecture Notes in Electrical Engineering, vol 701. Springer, Singapore. https://doi.org/10.1007/978-981-15-8297-4_65

Download citation

  • DOI: https://doi.org/10.1007/978-981-15-8297-4_65

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-15-8296-7

  • Online ISBN: 978-981-15-8297-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation