Abstract
Unlike roads, shipping lanes are not carved in stone. Their size, boundaries and content vary over space and time, under the influence of trade and carrier patterns, but also infrastructure investments, climate change, political developments and other complex events. Today we only have a vague understanding of the specific routes vessels follow when travelling between ports, which is an essential metric for calculating any valid maritime statistics and indicators (e.g. trade indicators, emissions and others). Whilst in the past though, maritime surveillance had suffered from a lack of data, current tracking technology has transformed the problem into one of an overabundance of information, as huge amounts of vessel tracking data are slowly becoming available, mostly due to the Automatic Identification System (AIS). Due to the volume of this data, traditional data mining and machine learning approaches are challenged when called upon to decipher the complexity of these environments. In this work, our aim is to transform billions of records of spatiotemporal (AIS) data into information for understanding the patterns of global trade by adopting distributed processing approaches. We describe a four-step approach, which is based on the MapReduce paradigm, and demonstrate its validity in real world conditions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Savadove, B.: China Begins Using Arctic Shipping Route That Could “Change the Face of World Trade,” Bus. Insid. (2013)
Euronews: Arctic icebergs reach Canadian coast, disrupting sea lanes and fishing. Euronews (2017)
Tessa de Wit, A., Consten, M., Puts, C., Pierrakou, M., Bis, A., Bilska, et al.: ESSnet Big Data Deliverable 4.2 Deriving port visits and linking data from Maritime statistics with AIS-data (2017)
Cabrera, F., Molina, N., Tichavska, M., Arana, M.: Design of a low cost prototype of Automatic Identification System (AIS) receiver. In: 2015 1st URSI Atlantic Radio Science Conference (URSI AT-RASC), p. 1. IEEE (2015). https://doi.org/10.1109/URSI-AT-RASC.2015.7303000
Li, Y., Liu, R.W., Liu, J., Huang, Y., Hu, B., Wang, K.: Trajectory compression-guided visualization of spatio-temporal AIS vessel density. In: 2016 8th International Conference on Wireless Communication Signal Process, pp. 1–5. IEEE (2016). https://doi.org/10.1109/WCSP.2016.7752733
Fiorini, M., Capata, A., Bloisi, D.D.: AIS data visualization for Maritime Spatial Planning (MSP). Int. J. E-Navig. Marit. Econ. 5, 45–60 (2016). https://doi.org/10.1016/j.enavi.2016.12.004
Ristic, B., La Scala, B., Morelande, M., Gordon, N.: Statistical analysis of motion patterns in AIS data: anomaly detection and motion prediction. IEEE (2008)
Mazzarella, F., Arguedas, V.F., Vespe, M.: Knowledge-based vessel position prediction using historical AIS data. In: 2015 Sensor Data Fusion: Trends, Solutions, Applications, pp. 1–6. IEEE (2015). https://doi.org/10.1109/SDF.2015.7347707
Zhang, W., Goerlandt, F., Kujala, P., Wang, Y., Nikitakos, N.: An advanced method for detecting possible near miss ship collisions from AIS data. Ocean Eng. 124, 141–156 (2016). https://doi.org/10.1016/j.oceaneng.2016.07.059
Pallotta, G., Vespe, M., Bryan, K.: Vessel pattern knowledge discovery from AIS data: a framework for anomaly detection and route prediction. Entropy 15, 2218–2245 (2013). https://doi.org/10.3390/e15062218
Poļevskis, J., Krastiņš, M., Korāts, G., Skorodumovs, A., Trokšs, J.: Methods for processing and interpretation of AIS signals corrupted by noise and packet collisions. Latv. J. Phys. Tech. Sci. 49, 25–31 (2012). https://doi.org/10.2478/v10047-012-0015-3
Yang, M., Zou, Y., Fang, L.: Collision and detection performance with three overlap signal collisions in space-based AIS reception. In: 2012 IEEE 11th International Conference on Trust, Security and Privacy in Computing and Communications, pp. 1641–1648. IEEE (2012). https://doi.org/10.1109/TrustCom.2012.109
Willems, N., van de Wetering, H., van Wijk, J.J.: Visualization of vessel movements. Comput. Graph. Forum. 28, 959–966 (2009). https://doi.org/10.1111/j.1467-8659.2009.01440.x
Willems, N., van de Wetering, H., van Wijk, J.J.: Evaluation of the visibility of vessel movement features in trajectory visualizations. Comput. Graph. Forum 30, 801–810 (2011). https://doi.org/10.1111/j.1467-8659.2011.01929.x
Di Battista, G., Fekete, J.-D., Qu, H.: Technical Committee on Visualization and Graphics, Proceedings of IEEE Pacific Visualization Symposium 2011, Hong Kong, China, 1–4 March 2011. IEEE Computer Society, Institute of Electrical and Electronics Engineers (2011)
Arguedas, V., Vespe, M., Pallotta, G.: Automatic generation of geographical networks for maritime traffic surveillance. In: 2014 17th International Conference on Information Fusion (FUSION). IEEE (2014)
Wu, L., Xu, Y., Wang, Q., Wang, F., Xu, Z.: Mapping global shipping density from AIS data. J. Navig. 70, 67–81 (2017). https://doi.org/10.1017/S0373463316000345
Zaharia, M., Chowdhury, M., Franklin, M.J., Shenker, S., Stoica, I.: Spark: cluster computing with working sets (2010)
Stonebraker, M.: Hadoop at a Crossroads? n.d.
Wang, X., Liu, X., Liu, B., de Souza, E.N., Matwin, S.: Vessel route anomaly detection with Hadoop MapReduce. In: 2014 IEEE International Conference on Big Data (Big Data), pp. 25–30. IEEE (2014). https://doi.org/10.1109/BigData.2014.7004464
Millefiori, L.M., Zissis, D., Cazzanti, L., Arcieri, G.: A distributed approach to estimating sea port operational regions from lots of AIS data. In: 2016 IEEE International Conference on Big Data (Big Data), pp. 1627–1632. IEEE (2016). https://doi.org/10.1109/BigData.2016.7840774
Millefiori, L., Zissis, D., Cazzanti, L., Arcieri, G.: Computational Maritime Situational Awareness Techniques for Unsupervised Port Area, Nato Unclassified Reports, Science and Technology Organization Centre for Maritime Research and Experimentation, La Spezia, Italy (2016)
Millefiori, L.M., Zissis, D., Cazzanti, L., Arcieri, G.: Scalable and distributed sea port operational areas estimation from AIS data. In: 2016 IEEE 16th International Conference on Data Mining Workshops, pp. 374–381. IEEE (2016). https://doi.org/10.1109/ICDMW.2016.0060
Salmon, L., Ray, C.: Design principles of a stream-based framework for mobility analysis. Geoinformatica 21, 237–261 (2017). https://doi.org/10.1007/s10707-016-0256-z
Acknowledgement
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No. 732310 and by Microsoft Research through a Microsoft Azure for Research Award.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this paper
Cite this paper
Spiliopoulos, G., Zissis, D., Chatzikokolakis, K. (2018). A Big Data Driven Approach to Extracting Global Trade Patterns. In: Doulkeridis, C., Vouros, G., Qu, Q., Wang, S. (eds) Mobility Analytics for Spatio-Temporal and Social Data. MATES 2017. Lecture Notes in Computer Science(), vol 10731. Springer, Cham. https://doi.org/10.1007/978-3-319-73521-4_7
Download citation
DOI: https://doi.org/10.1007/978-3-319-73521-4_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-73520-7
Online ISBN: 978-3-319-73521-4
eBook Packages: Computer ScienceComputer Science (R0)