Skip to main content
SpringerLink
Log in

Real-time data processing scheme using big data analytics in internet of things based smart transportation environment

  • Original Research
  • Published:
Journal of Ambient Intelligence and Humanized Computing Aims and scope Submit manuscript

Abstract

In recent times, a massive amount of smart devices or objects are connected that enhances the scale of the digital world. These smart objects are referred as “things” or physical devices that have the potential to sense the real-world physical objects, collect the data, and network with others. The objects are connected through the internet, which crafts the terminology of Internet of Things (IoT). IoT has been developed and become the center of consideration due to the novelty of embedded device and a rapid enhancement in its number. This increase is resulting in the creative applications of smart environments. Smart transportation is a central stake for the quality of life of citizens in smart environment. Smart transportation involves the use of devices and sensors in the control system of vehicle; for example navigation system of cars, traffic signal management system, number recognition system and speed monitoring system. In this research article, we propose architecture for smart transportation system using Big Data analytics, in order to achieve real time processing and facilitate a friendly communication in the environment of IoT based smart transportation. The proposed architecture is a 3-phase scheme which is responsible for the organization and management of Big Data, real-time processing of Big Data and service management. The proposed architecture is a generic solution for the smart transportation planning using real time Big Data processing. The proposed scheme is realized using Spark over single node Hadoop setup with various input libraries. A huge amount of data from different authentic and reliable sources is measured to validate the proposed architecture. In addition, the effectiveness of proposed scheme also highlighted with regard to throughput.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  • Ahmad A, Paul A, Rathore MM (2016a) An efficient divide-and-conquer approach for big data analytics in machine-to-machine communication. Neurocomputing 174:439–453

    Article  Google Scholar 

  • Ahmad A, Paul A, Rathore MM, Chang H (2016b) Smart cyber society: integration of capillary devices with high usability based on Cyber Physical System. Future Gener Comput Syst 56:493–503

    Article  Google Scholar 

  • Babar M, Arif F (2017) Smart urban planning using Big Data analytics to contend with the interoperability in Internet of Things. Future Gener Comput Syst 77:65–76

    Article  Google Scholar 

  • Babar M, Rahman A, Arif F, Jeon G (2017) Energy-harvesting based on internet of things and big data analytics for smart health monitoring. Sustain Comput Inform Syst. https://doi.org/10.1016/j.suscom.2017.10.009

    Google Scholar 

  • Bischof S, Karapantelakis A, Nechifor C-S, Sheth A, Mileo A, Barnaghi P (2014) Semantic modeling of smart city data. Position paper in W3C workshop on the web of things: enablers and services for an open web of devices, 25–26 June 2014, Berlin

  • Cecchinel C, Jimenez M, Mosser S, Riveill M (2014) An architecture to support the collection of Big Data in the Internet of things. In: Proceedings of the 2014 IEEE world congress on services (SERVICES), pp 442–449. https://doi.org/10.1109/SERVICES.2014.83

  • Dean J, Ghemawat S (2008) MapReduce: simplified data processing on large clusters. Commun ACM 51(1):107–113

    Article  Google Scholar 

  • Gramaglia M, Trullols-Cruces O, Naboulsi D, Fiore M, Calderon M (2014) Vehicular networks on two Madrid highways. In: 2014 eleventh annual IEEE international conference on sensing, communication, and networking (SECON), pp 423–431, 3 July, 2014, Singapore

  • Guinard D, Trifa V, Pham T (2009) Towards physical mashups in the web of things. In: Sixth international conference on networked sensing systems (INSS)

  • Huang Y-S, Weng Y-S, Wu W, Chen B-Y (1990) Control strategies for solving the problem of traffic congestion. In: IET intelligent transport systems R175–R195 Actuators A21–A23 1070–1079

  • Islam SMR, Kwak D, Kabir MH, Hossain M, Kwak K-S (2015) The internet of things for health care: a comprehensive survey. IEEE Access 3:678–708

    Article  Google Scholar 

  • Jabbarpour MR, Nabaei A, Zarrabi H (2016) Intelligent Guardrails: an IoT application for vehicle traffic congestion reduction in smart city. In: IEEE international conference on Internet of Things (iThings) and IEEE green computing and communications (GreenCom) and IEEE cyber, physical and social computing (CPSCom) and IEEE smart data (SmartData)

  • Jara AJ, Genoud D, Bocchi Y (2014a) Big data in smart cities: from poisson to human dynamics. In: Proceedings of the 28th IEEE international conference on advanced information net-working and applications workshops (WAINA’14), pp 785–790, IEEE, Victoria, BC, Canada

  • Jara AJ, Bocchi Y, Genoud D (2014b) Social Internet of Things: the potential of the Internet of Things for defining human behaviours (2014). In: International conference on intelligent networking and collaborative systems (INCoS) IEEE, pp 581–585

  • Jin J, Gubbi J, Marusic S, Palaniswami M (2014) An information framework for creating a smart city through internet of things. IEEE Internet Things J 1(2):112–121

    Article  Google Scholar 

  • Khan M, Silva BN, Han K (2016) Internet of things based energy aware smart home control system. IEEE Access 4:7556–7566

    Article  Google Scholar 

  • Kolozali S, Bermudez-Edo M, Puschmann D, Ganz F, Barnaghi P (2014) A knowledge-based approach for real-time IoT data stream annotation and processing. In: Proceedings of the 2014 IEEE International Conference on Internet of Things (iThings 2014), Taipei, Taiwan, September 2014

  • Labrinidis A, Jagadish HV (2012) Challenges and opportunities with big data. Proc VLDB Endowment 5(12):2032–2033

    Article  Google Scholar 

  • Li D, Kar S, Moura JM, Poor HV, Cui S (2015) Distributed Kalman filtering over massive data sets: analysis through large deviations of random Riccati equations. IEEE Trans Inf Theory 61(3):1351–1372

    Article  MathSciNet  MATH  Google Scholar 

  • Möller DP, Vakilzadian H (2016) Cyber-physical systems in smart transportation. In: IEEE international conference on electro information technology (EIT)

  • Naboulsi D, Fiore M (2013) On the instantaneous topology of a large-scale urban vehicular network: the cologne case. ACM MobiHoc 2013, Bangalore

    Book  Google Scholar 

  • Ning H, Wang Z (2011) Future Internet of things architecture: like mankind neural system or social organization framework? Commun Lett IEEE 15(4):461–463

    Article  Google Scholar 

  • Rafique MM, Rose B, Butt AR, Nikolopoulos DS (2009) Supporting MapReduce on large-scale asymmetric multi-core clusters. ACM SIGOPS Oper Syst Rev 43(2):25–34

    Article  Google Scholar 

  • Ranger C, Penmetsa A, Raghuraman R, Bradski G, Kozyrakis C (2007) Evaluating mapreduce for multi-core and multiprocessor systems. In: IEEE 13th international symposium on high performance computer architecture, pp 13–24, IEEE, 2007

  • Rathore MM, Ahmad A, Paul A (2015) Efficient graph-oriented smart transportation using Internet of Things generated Big Data. In: 11th international conference on signal-image technology and internet-based systems (SITIS)

  • Rob K (2014) The real-time city? Big data and smart urbanism. GeoJournal 79(1):1–14

    Article  Google Scholar 

  • Saad AA, El Zouka HA, Al-Soufi SA (2016) Secure and intelligent road traffic management system based on RFID technology. In: World symposium on computer applications and research (WSCAR)

  • Simon D (2010) Kalman filtering with state constraints: a survey of linear and nonlinear algorithms. IET Control Theory Appl 4(8):1303–1318

    Article  MathSciNet  Google Scholar 

  • Tönjes R, Barnaghi P, Ali M, Mileo A, Hauswirth M, Ganz F, Ganea S, Kjærgaard B, Kuemper D, Nechifor S, Puiu D, Sheth A, Tsiatsis V, Vestergaard L (2014) Real time IoT stream processing and large-scale data analytics for smart city applications. In: Poster session, European conference on networks and communications

  • Uppoor S, Trullols-Cruces O, Fiore M, Barcelo-Ordinas JM (2014) Generation and analysis of a large-scale urban vehicular mobility dataset. IEEE Trans Mob Comput 13(5):3

    Article  Google Scholar 

  • Wang Y, Ram S, Currim F, Dantas E, Sabóia LA (2016) A Big Data approach for smart transportation management on bus network. In: IEEE international smart cities conference (ISC2)

  • Yoo RM, Romano A, Kozyrakis C (2009) Phoenix rebirth: scalable MapReduce on a large-scale shared-memory system. In: IEEE International Symposium on, pp 198–207. IEEE, 2009

Download references

Author information

Authors and Affiliations

  1. National University of Sciences and Technology, Islamabad, Pakistan

    Muhammad Babar & Fahim Arif

Authors
  1. Muhammad Babar
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fahim Arif
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Muhammad Babar.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Babar, M., Arif, F. Real-time data processing scheme using big data analytics in internet of things based smart transportation environment. J Ambient Intell Human Comput 10, 4167–4177 (2019). https://doi.org/10.1007/s12652-018-0820-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12652-018-0820-5

Keywords

Search

Navigation