Skip to main content
SpringerLink
Log in

Sipresk: A Big Data Analytic Platform for Smart Transportation

  • Conference paper
  • First Online:
Smart City 360° (SmartCity 360 2016, SmartCity 360 2015)

Abstract

In this paper, we propose a platform for performing analytics on urban transportation data to gain insights into traffic patterns. The platform consists of data, analytics and management layers and it can be leveraged by overlay traffic-related applications or directly by researchers, traffic engineers and planners. The platform is cluster-based and leverages the cloud to achieve reliability, scalability and adaptivity to the changing operating conditions. It can be leveraged for both on-line and retrospective analysis. We validated several use cases such as finding average speed and congested segments in the major highways in Greater Toronto Area (GTA).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://lucene.apache.org/solr.

  2. 2.

    http://www.openstack.org.

  3. 3.

    https://spark.apache.org.

  4. 4.

    http://www.r-project.org.

  5. 5.

    http://www.ceraslabs.com/people/hamzeh/bigdasc2015paper.

  6. 6.

    https://support.google.com/maps.

  7. 7.

    www.inrix.com.

References

  1. Abadi, D.J.: Data management in the cloud: limitations and opportunities. IEEE Data Eng. Bull. 32(1), 3–12 (2009)

    Google Scholar 

  2. Borthakur, D., Gray, J., Sarma, J.S., Muthukkaruppan, K., Spiegelberg, N., Kuang, H., Ranganathan, K., Molkov, D., Menon, A., Rash, S., et al.: Apache hadoop goes realtime at facebook. In: Proceedings of the 2011 ACM SIGMOD International Conference on Management of data, pp. 1071–1080. ACM (2011)

    Google Scholar 

  3. CVST. Connected Vehicles and Smart Transportation, June 2015. http://cvst.ca

  4. Dirks, S., Gurdgiev, C., Keeling, M.: Smarter cities for smarter growth: how cities can optimize theirsystems for the talent-based economy. IBM Institute for Business Value (2010)

    Google Scholar 

  5. Hayes, M., Shah, S. Hourglass: a library for incremental processing on hadoop. In: 2013 IEEE International Conference on Big Data, pp. 742–752. IEEE (2013)

    Google Scholar 

  6. Heger, D.: Hadoop performance tuning-a pragmatic & iterative approach. CMG J. 4, 97–113 (2013)

    Google Scholar 

  7. Hoh, B., Gruteser, M., Herring, R., Ban, J., Work, D., Herrera, J.-C., Bayen, A.M., Annavaram, M., Jacobson, Q.: Virtual trip lines for distributed privacy-preserving traffic monitoring. In: Proceedings of the 6th International Conference on Mobile systems, Applications, and Services, pp. 15–28. ACM (2008)

    Google Scholar 

  8. Hsu, Y.-T., Pan, Y.-C., Wei, L.-Y., Peng, W.-C., Lee, W.-C.: Key formulation schemes for spatial index in cloud data managements. In: 2012 IEEE 13th International Conference on Mobile Data Management (MDM), pp. 21–26. IEEE (2012)

    Google Scholar 

  9. Kephart, J.O., Chess, D.M.: The vision of autonomic computing. Computer 36(1), 41–50 (2003)

    Article  MathSciNet  Google Scholar 

  10. Kitchin, R.: The real-time city? big data and smart urbanism. GeoJ. 79(1), 1–14 (2014)

    Article  Google Scholar 

  11. Konstantinou, I., Angelou, E., Boumpouka, C., Tsoumakos, D., Koziris, N.: On the elasticity of NoSQL databases over cloud management platforms. In: Proceedings of the 20th ACM International Conference on Information and Knowledge Management, pp. 2385–2388. ACM (2011)

    Google Scholar 

  12. Lane, N.D., Miluzzo, E., Lu, H., Peebles, D., Choudhury, T., Campbell, A.T.: A survey of mobile phone sensing. IEEE Commun. Mag. 48(9), 140–150 (2010)

    Article  Google Scholar 

  13. Lo, C.-H., Peng, W.-C., Chen, C.-W., Lin, T.-Y., Lin, C.-S. Carweb: a traffic data collection platform. In: 9th International Conference on Mobile Data Management, MDM 2008, pp. 221–222. IEEE (2008)

    Google Scholar 

  14. Maerivoet, S., Logghe, S.: Validation of travel times based on cellular floating vehicle data. In: Proceedings from 6th European Congress and Exhibition on Intelligent Transport Systems and Services (2007)

    Google Scholar 

  15. Mian, R., Ghanbari, H., Zareian, S., Shtern, M., Litoiu, M.: A data platform for the highway traffic data. In: 2014 IEEE 8th International Symposium on the Maintenance and Evolution of Service-Oriented and Cloud-Based Systems (MESOCA), pp. 47–52. IEEE (2014)

    Google Scholar 

  16. Rabkin, A., Katz, R.H.: How hadoop clusters break. IEEE Softw. 30(4), 88–94 (2013)

    Article  Google Scholar 

  17. Rao, B.T., Sridevi, N., Reddy, V.K., Reddy, L.: Performance issues of heterogeneous hadoop clusters in cloudcomputing (2012). arXiv preprint arXiv:1207.0894

  18. SAVI. Smart Applications on Virtual Infrastructure. Cloud platform, June 2015. http://www.savinetwork.ca

  19. Shtern, M., Mian, R., Litoiu, M., Zareian, S., Abdelgawad, H., Tizghadam, A.: Towards a multi-cluster analytical engine for transportation data. In: 2014 International Conference on Cloud and Autonomic Computing (ICCAC), pp. 249–257. IEEE (2014)

    Google Scholar 

  20. Tizghadam, A., Leon-Garcia, A.: Connected Vehicles and Smart Transportation - CVST Platform, June 2015. http://cvst.ca/wp/wp-content/uploads/2015/06/cvst.pdf

  21. Varaiya, P.: Reducing highway congestion: an empirical approach. Eur. J. Control 11(4), 301–309 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  22. Wu, Y.-J., Wang, Y., Qian, D.: A google-map-based arterial traffic information system. In: Intelligent Transportation Systems Conference, ITSC 2007, pp. 968–973. IEEE (2007)

    Google Scholar 

  23. Zareian, S., Veleda, R., Litoiu, M., Shtern, M., Ghanbari, H., Garg, M.: K-feed, a data-oriented approach to application performance management in cloud. In: 2015 IEEE 8th International Conference on Cloud Computing (CLOUD), June 2015. IEEE (2015)

    Google Scholar 

Download references

Acknowledgments

This research was supported by the SAVI Strategic Research Network (Smart Applications on Virtual Infrastructure), funded by NSERC (The Natural Sciences and Engineering Research Council of Canada) and by Connected Vehicles and Smart Transportation (CVST) funded Ontario Research Fund. We acknowledge the contribution of the ONE-ITS platform in providing access to aggregated of-line traffic data. We also would like to thank Brian Ramprasad for his help in deployment of HBase clusters and Yan Fu for her help on data collection.

Author information

Authors and Affiliations

  1. School of Information Technology, York University, Toronto, ON, Canada

    Hamzeh Khazaei, Saeed Zareian, Rodrigo Veleda & Marin Litoiu

Authors
  1. Hamzeh Khazaei
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Saeed Zareian
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Rodrigo Veleda
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Marin Litoiu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hamzeh Khazaei .

Editor information

Editors and Affiliations

  1. University of Toronto, Toronto, Ontario, Canada

    Alberto Leon-Garcia

  2. Skoda Auto University, Mladá Boleslav, Czech Republic

    Radim Lenort

  3. Skoda Auto University, Mlada Boleslav, Czech Republic

    David Holman

  4. Škoda Auto University, Mladá Boleslav, Czech Republic

    David Staš

  5. Mendel University Brno, Brno, Czech Republic

    Veronika Krutilova

  6. Škoda Auto University, Mladá, Czech Republic

    Pavel Wicher

  7. Slovak University of Technology, Trnava, Slovakia

    Dagmar Cagáňová

  8. Slovak University of Technology, Bratislava, Czech Republic

    Daniela Špirková

  9. Slovak University of Technology, Brno, Czech Republic

    Julius Golej

  10. University of Quebec´s ETS, Montréal, Canada

    Kim Nguyen

Rights and permissions

Reprints and permissions

Copyright information

© 2016 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

About this paper

Cite this paper

Khazaei, H., Zareian, S., Veleda, R., Litoiu, M. (2016). Sipresk: A Big Data Analytic Platform for Smart Transportation. In: Leon-Garcia, A., et al. Smart City 360°. SmartCity 360 SmartCity 360 2016 2015. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 166. Springer, Cham. https://doi.org/10.1007/978-3-319-33681-7_35

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-33681-7_35

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-33680-0

  • Online ISBN: 978-3-319-33681-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation