Skip to main content
SpringerLink
Log in

Big Data in Smart Ecosystems: Trends, Challenges and Future Prospectus

  • Chapter
  • First Online:
Intelligent Multimedia Signal Processing for Smart Ecosystems

  • 132 Accesses

Abstract

Technology is transmuting the world. The rapid use of mobile devices and explosion of social media has given rise to the storm that is engulfing the world with data. Due to independent and excessive use of technology, the speed at which data is growing exceeds Moore’s Law. However, there are highly beneficial values hidden in such copious amount of complex data called as big data. Conventional techniques and platforms are ineffectual in analysing and storing the big data. However, storage of the big data is the first practical step for big data analytics. The literature available so far does not include an in-depth analysis of the storage platforms available. Nowadays, NoSQL databases, In-Memory and Cloud databases are some of the industry standards in terms of offering big data storage solutions. This chapter presents an overview of big data and its characteristics and provides insights into its framework and platforms. It surveys applications of big data analytics in various areas such as Smart city, Intelligent Transport system, Smart grids, and smart healthcare. Furthermore, technologies for storage, analysis, and security of big data are also covered. Lastly, this chapter discusses various challenges associated in handling big data.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. World Population Clock: 8 Billion People (LIVE, 2023) – Worldometer, https://www.worldometers.info/world-population/, last accessed 2023/03/04

  2. Daily social media usage worldwide | Statista, https://www.statista.com/statistics/433871/daily-social-media-usage-worldwide/, last accessed 2021/10/06

  3. Number of mobile devices worldwide 2020–2025 | Statista, https://www.statista.com/statistics/245501/multiple-mobile-device-ownership-worldwide/, last accessed 2023/03/04

  4. Saleem S, Mehrotra M (2021) Data analytics and mining: platforms for real-time applications. In Data driven decision making using analytics. pp 61–80

    Google Scholar 

  5. Gandomi A, Haider M (2015) Beyond the hype: Big data concepts, methods, and analytics. Int J Inf Manag 35:137–144. https://doi.org/10.1016/j.ijinfomgt.2014.10.007

    Article  Google Scholar 

  6. Levin N, Salek RM, Steinbeck C (2016) From databases to big data. Metab Phenotyping Pers Public Healthc:317–331. https://doi.org/10.1016/B978-0-12-800344-2.00011-2

  7. Laney D (2001) 3D data management: controlling data volume, velocity and variety. META Gr Res note 6:1

    Google Scholar 

  8. IBM (2013) Analytics: the real-world use of big data How innovative enterprises in the midmarket extract value from uncertain data

    Google Scholar 

  9. Number of social media users 2025 | Statista, https://www.statista.com/statistics/278414/number-of-worldwide-social-network-users/, last accessed 2021/05/30

  10. Global Social Media Stats — DataReportal – Global Digital Insights, https://datareportal.com/social-media-users, last accessed 2021/10/06

  11. Tsikala Vafea M, Atalla E, Georgakas J, Shehadeh F, Mylona EK, Kalligeros M, Mylonakis E (2020) Emerging technologies for use in the study, diagnosis, and treatment of patients with COVID-19. Cell Mol Bioeng 13:249–257. https://doi.org/10.1007/s12195-020-00629-w

    Article  Google Scholar 

  12. Sun Z (2018) 10 Bigs: Big data and its ten big characteristics. Manag Perspect Intell Big Data Anal:1–14

    Google Scholar 

  13. Sindhu K, Kumar DSR (2014) Influence of risk perception of investors on investment decisions: an empirical analysis. J Financ Bank Manag 2:15–25

    Google Scholar 

  14. Kumar A, Tyagi AK, Tyagi SK (2014) Data mining: various issues and challenges for future a short discussion on data mining issues for future work. Int J Emerg Technol Adv Eng 4:1–8

    Google Scholar 

  15. Hurrah NN, Loan NA, Parah SA, Sheikh JA, Muhammad K, de Macedo ARL, de Albuquerque VHC (2021) INDFORG: industrial forgery detection using automatic rotation angle detection and correction. IEEE Trans Industr Inform 17:3630–3639. https://doi.org/10.1109/TII.2020.3014158

    Article  Google Scholar 

  16. Abaker I, Hashem T, Yaqoob I, Badrul N, Mokhtar S, Gani A, Ullah S (2015) The rise of “ big data ” on cloud computing: review and open research issues. Inf Syst 47:98–115. https://doi.org/10.1016/j.is.2014.07.006

    Article  Google Scholar 

  17. Zhou H, Sun G, Fu S, Fan X, Jiang W, Hu S, Li N (2020) A distributed approach of big data mining for financial fraud detection in a supply chain. Comput Mater Continua 64:1091–1105

    Article  Google Scholar 

  18. Qader WA, Ameen MM, Ahmed BI (2020) Big data characteristics, architecture, technologies and applications. J Comput Sci 16:817–824. https://doi.org/10.3844/JCSSP.2020.817.824

    Article  Google Scholar 

  19. Lee KH, Lee YJ, Choi H, Chung YD, Moon B (2011) Parallel data processing with MapReduce: a survey. SIGMOD Rec 40:11–20. https://doi.org/10.1145/2094114.2094118

    Article  Google Scholar 

  20. Xianya J, Mo H, Haifeng L (2019) Stock classification prediction based on spark. Procedia Comput Sci 162:243–250. https://doi.org/10.1016/j.procs.2019.11.281

    Article  Google Scholar 

  21. Shvachko K, Kuang H, Radia S, Chansler R (2010) The Hadoop distributed file system, pp 1–10

    Google Scholar 

  22. Splunk | The Key to Enterprise Resilience, https://www.splunk.com/, last accessed 2023/03/05

  23. Apache Cassandra | Apache Cassandra Documentation, https://cassandra.apache.org/_/index.html, last accessed 2023/03/05

  24. Rouf N, Malik MB, Arif T, Sharma S, Singh S, Aich S, Kim H-C (2021) Stock market prediction using machine learning techniques: a decade survey on methodologies, recent developments, and future directions. Electronics 10(21):2717

    Article  Google Scholar 

  25. Rouf N, Malik MB, Arif T (2021) A regression based approach to predict the Indian stock market trend amid COVID-19. In: 2021 3rd International Conference on Advances in Computing, Communication Control and Networking (ICAC3N). pp 2014–2020

    Google Scholar 

  26. Al Nuaimi E, Al Neyadi H, Mohamed N, Al-Jaroodi J (2015) Applications of big data to smart cities. J Internet Serv Appl 6:1–15

    Article  Google Scholar 

  27. Zhu L, Yu FR, Wang Y, Ning B, Tang T (2018) Big data analytics in intelligent transportation systems: a survey. IEEE Trans Intell Transp Syst 20:383–398

    Article  Google Scholar 

  28. Montoya-Torres JR, Moreno S, Guerrero WJ, Mejía G (2021) Big data analytics and intelligent transportation systems. IFAC-PapersOnLine 54:216–220

    Article  Google Scholar 

  29. Abberley L, Gould N, Crockett K, Cheng J (2017) Modelling road congestion using ontologies for big data analytics in smart cities. In: 2017 international smart cities conference (ISC2). IEEE, pp 1–6

    Google Scholar 

  30. Rizwan P, Suresh K, Babu MR (2016) Real-time smart traffic management system for smart cities by using Internet of Things and big data. In: 2016 international conference on emerging technological trends (ICETT). IEEE, pp 1–7

    Google Scholar 

  31. Sharif A, Li J, Khalil M, Kumar R, Sharif MI, Sharif A (2017) Internet of things—smart traffic management system for smart cities using big data analytics. In: 2017 14th international computer conference on wavelet active media technology and information processing (ICCWAMTIP). IEEE, pp 281–284

    Google Scholar 

  32. Zhang Y, Huang T, Bompard EF (2018) Big data analytics in smart grids: a review. Energy inform 1:1–24

    Article  Google Scholar 

  33. Hashemi F, Mohammadi M, Kargarian A (2017) Islanding detection method for microgrid based on extracted features from differential transient rate of change of frequency. IET Gener Transm Distrib 11:891–904

    Article  Google Scholar 

  34. Alam MR, Muttaqi KM, Bouzerdoum A (2017) Evaluating the effectiveness of a machine learning approach based on response time and reliability for islanding detection of distributed generation. IET Renew power Gener 11:1392–1400

    Article  Google Scholar 

  35. Saleem S, Mehrotra M (2022) Emergent use of artificial intelligence and social media for disaster management. In: International conference on data science and applications, pp 195–210. https://doi.org/10.1007/978-981-16-5348-3_15

  36. Sun H, Wang Z, Wang J, Huang Z, Carrington N, Liao J (2016) Data-driven power outage detection by social sensors. IEEE Trans Smart Grid 7:2516–2524

    Article  Google Scholar 

  37. Hurrah NN, Parah SA, Sheikh JA, Al-Turjman F, Muhammad K (2019) Secure data transmission framework for confidentiality in IoTs. Ad Hoc Netw 95:101989

    Article  Google Scholar 

  38. Parah SA, Rashid M, Vijaykumar V (2022) Artificial intelligence for innovative healthcare informatics, Springer, ISBN: 978-3-030-96568-6

    Google Scholar 

  39. Hurrah NN, Parah SA, Sheikh JA (2020) Embedding in medical images: an efficient scheme for authentication and tamper localization. Multimed Tools Appl 79:21441–21470

    Article  Google Scholar 

  40. Afzal I, Parah SA, Hurrah NN, Song OY (2020) Secure patient data transmission on resource constrained platform. Multimed Tools Appl. https://doi.org/10.1007/s11042-020-09139-3

  41. Parsa S, Parah SA, Bhat GM, Khan M (2021) A security management framework for big data in smart healthcare. Big Data Research 25:100225

    Article  Google Scholar 

  42. Ahad F, Parah SA, Sheikh JA, Bhat GM (2015) On the realization of robust watermarking system for medical images. In: 2015 annual IEEE India conference (INDICON), New Delhi, India, pp 1–5, https://doi.org/10.1109/INDICON.2015.7443363

  43. Kaur A, Rashid M, Bashir AK, Parah SA (2022) Detection of breast cancer masses in mammogram images with watershed segmentation and machine learning approach BT – artificial intelligence for innovative healthcare informatics. Presented at the https://doi.org/10.1007/978-3-030-96569-3_2

  44. Hossain MS, Muhammad G (2017) Emotion-aware connected healthcare big data towards 5G. IEEE Internet Things J 5:2399–2406

    Article  Google Scholar 

  45. Rouf N, Bashir Malik M, Sharma S, Ra I-H, Singh S, Meena A (2022) Impact of healthcare on stock market volatility and its predictive solution using improved neural network. Comput Intell Neurosci 2022:7097044. https://doi.org/10.1155/2022/7097044

    Article  Google Scholar 

  46. Li B, Wang M, Zhao Y, Pu G, Zhu H, Song F (2015) Modeling and verifying Google file system. In: 2015 IEEE 16th international symposium on high assurance systems engineering. IEEE, pp 207–214

    Chapter  Google Scholar 

  47. Yadranjiaghdam B, Pool N, Tabrizi N (2016) A survey on real-time big data analytics: applications and tools. In: 2016 international conference on computational science and computational intelligence (CSCI). IEEE, pp 404–409

    Google Scholar 

  48. Hurrah NN, Khan E, Khan U (2023) CADEN: cellular automata and DNA based secure framework for privacy preserving in IoT based healthcare. J Ambient Intell Humaniz Comput 14:2631–2643. https://doi.org/10.1007/s12652-022-04510-8

    Article  Google Scholar 

  49. Parah SA, Sheikh JA, Bhat GM (2014) A secure and efficient spatial domain data hiding technique based on pixel adjustment. Am J Eng Technol Res 14(2):33

    Google Scholar 

  50. Parah SA, Sheikh JA, Loan NA, Ahad F, Bhat GM (2018) Utilizing neighborhood coefficient correlation: a new image watermarking technique robust to singular and hybrid attacks. Multidim Syst Sign Process 29:1095–1117

    Article  MathSciNet  MATH  Google Scholar 

  51. Rashid M, Singh H, Goyal V, Parah SA, Wani AR (2021) Big data based hybrid machine learning model for improving performance of medical Internet of Things data in healthcare systems. In: Healthcare paradigms in the internet of things ecosystem. Academic Press, pp 47–62

    Chapter  Google Scholar 

  52. Hurrah NN, Parah SA, Sheikh JA (2019) A secure medical image watermarking technique for e-healthcare applications. In: Handbook of multimedia information security: techniques and applications, pp 119–141

    Chapter  Google Scholar 

  53. Rawat D B, Chaudhary V, Doku R (2020) Blockchain technology: emerging applications and use cases for secure and trustworthy smart systems. J Cybersecur Priv 1:4–18

    Article  Google Scholar 

  54. Bhardwaj A, Narayan Y, Vanraj P, Dutta M (2015) Sentiment analysis for Indian stock market prediction using sensex and nifty. Procedia Comput Sci 70:85–91

    Article  Google Scholar 

  55. Malomo OO, Rawat DB, Garuba M (2018) Next-generation cybersecurity through a blockchain-enabled federated cloud framework. J Supercomput 74:5099–5126

    Article  Google Scholar 

  56. Hurrah NN, Loan NA, Parah SA, Sheikh JA (2017) A transform domain based robust color image watermarking scheme for single and dual attacks. In: 2017 fourth international conference on image information processing (ICIIP). IEEE, pp 1–5

    Google Scholar 

  57. Rotună C, Gheorghiță A, Zamfiroiu A, Smada Anagrama D (2019) Smart city ecosystem using blockchain technology. Inform Econ 23:41–50

    Google Scholar 

  58. Jabbar R, Dhib E, ben Said A, Krichen M, Fetais N, Zaidan E, Barkaoui K (2022) Blockchain technology for intelligent transportation systems: a systematic literature review. IEEE Access

    Google Scholar 

  59. Qi J, Hahn A, Lu X, Wang J, Liu C (2016) Cybersecurity for distributed energy resources and smart inverters. IET Cyber-Phys Syst Theory Appl 1:28–39

    Article  Google Scholar 

  60. Parah SA, Sheikh JA, Ahad F, Bhat GM (2018) High capacity and secure electronic patient record (EPR) embedding in color images for IoT driven healthcare systems. In: Internet of things and big data analytics toward next-generation intelligence. Springer, Cham, pp 409–437

    Chapter  Google Scholar 

  61. Rouf N, Malik MB, Arif T (2021) Predicting the stock market trend: an ensemble approach using impactful exploratory data analysis. In: International conference on information, communication and computing technology. Springer, pp 223–234

    Chapter  Google Scholar 

  62. Ramasamy A, Chowdhury S (2020) Big data quality dimensions: a systematic literature review. JISTEM-J Inf Syst Technol Manag. Springer

    Google Scholar 

  63. Kadadi A, Agrawal R, Nyamful C, Atiq R (2014) Challenges of data integration and interoperability in big data. In: 2014 IEEE international conference on big data (big data). IEEE, pp 38–40

    Chapter  Google Scholar 

  64. Naeem M, Jamal T, Diaz-Martinez J, Butt SA, Montesano N, Tariq MI, De-la-Hoz-Franco E, De-La-Hoz-Valdiris E (2022) Trends and future perspective challenges in big data. In: Advances in intelligent data analysis and applications: proceeding of the sixth Euro-China conference on intelligent data analysis and applications. Springer, Singapore, pp 309–325

    Chapter  Google Scholar 

  65. Balachandran BM, Prasad S (2017) Challenges and benefits of deploying big data analytics in the cloud for business intelligence. In: Procedia Computer Science, pp 1112–1122

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Sciences, Baba Ghulam Shah Badshah University, Rajouri, India

    Nusrat Rouf & Majid Bashir Malik

  2. Department of Computer Science, Jamia Millia Islamia, New Delhi, India

    Saima Saleem

  3. Department of Computer Science, Chaudhary Charan Singh University, Meerat, India

    Khalid Bashir Dar

Authors
  1. Nusrat Rouf
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Saima Saleem
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Majid Bashir Malik
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Khalid Bashir Dar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nusrat Rouf .

Editor information

Editors and Affiliations

  1. Department of Electronics and Instrumentation, University of Kashmir, Srinagar, Jammu and Kashmir, India

    Shabir A. Parah

  2. Aligarh Muslim University, Aligarh, India

    Nasir N. Hurrah

  3. Department of Electronics Engineering, Aligarh Muslim University, AMU Aligarh, India

    Ekram Khan

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Rouf, N., Saleem, S., Malik, M.B., Dar, K.B. (2023). Big Data in Smart Ecosystems: Trends, Challenges and Future Prospectus. In: Parah, S.A., Hurrah, N.N., Khan, E. (eds) Intelligent Multimedia Signal Processing for Smart Ecosystems. Springer, Cham. https://doi.org/10.1007/978-3-031-34873-0_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-34873-0_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-34872-3

  • Online ISBN: 978-3-031-34873-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation