Advertisement

Real-Time Big Data Analytics in Smart Cities from LoRa-Based IoT Networks

  • Antonio M. Fernández
  • David Gutiérrez-Avilés
  • Alicia Troncoso
  • Francisco Martínez-ÁlvarezEmail author
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 950)

Abstract

The currently burst of the Internet of Things (IoT) technologies implies the emergence of new lines of investigation regarding not only to hardware and protocols but also to new methods of produced data analysis satisfying the IoT environment constraints: a real-time and a big data approach. The Real-time restriction is about the continuous generation of data provided by the endpoints connected to an IoT network; due to the connection and scaling capabilities of an IoT network, the amount of data to process is so high that Big data techniques become essential. In this article, we present a system consisting of two main modules. In one hand, the infrastructure, a complete LoRa based network designed, tested and deployment in the Pablo de Olavide University and, on the other side, the analytics, a big data streaming system that processes the inputs produced by the network to obtain useful, valid and hidden information.

Keywords

IoT LoRaWAN Real-time Big data Data streaming 

Notes

Acknowledgments

We would like to thank the Spanish Ministry of Economy and Competitiveness for the support under project TIN2017-88209-C2-1-R. Additionally, we want to express our gratitude to Enrique Parrilla, Lantia IoT’s CEO, since all the equipment has been provided by him. The T-Systems Iberia company is also acknowledged since all experiments have been carried out on its Open Telekom Cloud Platform based on the OpenStack open source.

References

  1. 1.
    Akgün, B., Öǧüdücü, S.G.: Streaming linear regression on Spark MLlib and MOA. In: Proceedings of the IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, pp. 1244–1247 (2015)Google Scholar
  2. 2.
    Chen, M., Mao, S., Liu, Y.: Big data: a survey. Mob. Netw. Appl. 19(2), 171–209 (2014)CrossRefGoogle Scholar
  3. 3.
    D’Silva, G.M., Khan, A., Gaurav, Bari, S.: Real-time processing of IoT events with historic data using Apache Kafka and Apache Spark with dashing framework. In: Proceedings of the IEEE International Conference on Recent Trends in Electronics, Information Communication Technology, pp. 1804–1809 (2017)Google Scholar
  4. 4.
    Galicia, A., Talavera-Llames, R., Troncoso, A., Koprinska, I., Martínez-Álvarez, F.: Multi-step forecasting for big data time series based on ensemble learning. Knowl. Based-Syst. 163, 830–841 (2019)CrossRefGoogle Scholar
  5. 5.
    Gutiérrez-Avilés, D., Fábregas, J.A., Tejedor, J., Martínez-Álvarez, F., Troncoso, A., Arcos, A., Riquelme, J.C.: SmartFD: a real big data application for electrical fraud detection. Lect. Notes Artif. Intell. 10870, 120–130 (2018)Google Scholar
  6. 6.
    Gutiérrez-Avilés, D., Rubio-Escudero, C., Martínez-Álvarez, F., Riquelme, J.: Trigen: a genetic algorithm to mine triclusters in temporal gene expression data. Neurocomputing 132, 42–53 (2014)CrossRefGoogle Scholar
  7. 7.
    Gutiérrez-Avilés, D., Giráldez, R., Gil-Cumbreras, F.J., Rubio-Escudero, C.: TRIQ: a new method to evaluate triclusters. BioData Min. 11, id15 (2018)CrossRefGoogle Scholar
  8. 8.
    Han, J., Pei, J., Kamber, M.: Data Mining: Concepts and Techniques. Elsevier, Amsterdam (2011)zbMATHGoogle Scholar
  9. 9.
    Hu, T., Wu, Q., Zhou, D.X.: Convergence of gradient descent for minimum error entropy principle in linear regression. IEEE Trans. Signal Process. 64(24), 6571–6579 (2016)MathSciNetCrossRefGoogle Scholar
  10. 10.
    Ichinose, A., Takefusa, A., Nakada, H., Oguchi, M.: A study of a video analysis framework using Kafka and Spark Streaming. In: Proceedings of the IEEE International Conference on Big Data, pp. 2396–2401 (2017)Google Scholar
  11. 11.
    Karakaya, Z., Yazici, A., Alayyoub, M.: A comparison of stream processing frameworks. In: Proceedings of the International Conference on Computer and Applications, pp. 1–12 (2017)Google Scholar
  12. 12.
    Lasi, H., Fettke, P., Kemper, H.G., Feld, T., Hoffmann, M.: Industry 4.0. Bus. Inf. Syst. Eng. 6(4), 239–242 (2014)CrossRefGoogle Scholar
  13. 13.
    Lauridsen, M., Nguyen, H., Vejlgaard, B., Kovacs, I.Z., Mogensen, P., Sorensen, M.: Coverage Comparison of GPRS, NB-IoT, LoRa, and SigFox in a 7800 km\(^{2}\) Area. In: Proceedings of the IEEE Vehicular Technology Conference, pp. 1–5 (2017)Google Scholar
  14. 14.
    Marz, N., Warren, J.: Big Data: Principles and Best Practices of Scalable Real-time Data Systems. Manning Publications Co., Shelter Island (2015)Google Scholar
  15. 15.
    Noac’h, P.L., Costan, A., Bougé, L.: A performance evaluation of Apache Kafka in support of big data streaming applications. In: Proceedings of the IEEE International Conference on Big Data, pp. 4803–4806 (2017)Google Scholar
  16. 16.
    Pallaprolu, S.C., Sankineni, R., Thevar, M., Karabatis, G., Wang, J.: Zero-day attack identification in streaming data using semantics and Spark. In: Proceedings of the IEEE International Congress on Big Data, pp. 121–128 (2017)Google Scholar
  17. 17.
    Rahman, A., Suryanegara, M.: The development of IoT LoRa: a performance evaluation on LoS and Non-LoS environment at 915 MHz ISM frequency. In: Proceedings of the International Conference on Signals and Systems, pp. 163–167 (2017)Google Scholar
  18. 18.
    Rizzi, M., Ferrari, P., Flammini, A., Sisinni, E.: Evaluation of the IoT LoRaWAN solution for distributed measurement applications. IEEE Trans. Instrum. Meas. 66(12), 3340–3349 (2017)CrossRefGoogle Scholar
  19. 19.
    Shvachko, K., Kuang, H., Radia, S., Chansler, R.: The Hadoop distributed file system. In: Proceedings of the IEEE Symposium on Mass Storage Systems and Technologies, pp. 1–10 (2010)Google Scholar
  20. 20.
    Torres, J.F., Galicia, A., Troncoso, A., Martínez-Álvarez, F.: A scalable approach based on deep learning for big data time series forecasting. Integr. Comput.-Aided Eng. 25(4), 335–348 (2018)CrossRefGoogle Scholar
  21. 21.
    Wortmann, F., Flüchter, K.: Internet of things. Bus. Inf. Syst. Eng. 57(3), 221–224 (2015)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • Antonio M. Fernández
    • 1
  • David Gutiérrez-Avilés
    • 1
  • Alicia Troncoso
    • 1
  • Francisco Martínez-Álvarez
    • 1
    Email author
  1. 1.Data Science & Big Data LabPablo de Olavide UniversitySevilleSpain

Personalised recommendations