Skip to main content

LE2ML: a microservices-based machine learning workbench as part of an agnostic, reliable and scalable architecture for smart homes

Abstract

Over the years, several architecture of smart home has been proposed to enable the use of ambient intelligence. However, the major issue with most of them lies in their lack of high reliability and scalability. Therefore, the first contribution of this paper introduces a novel distributed architecture for smart homes, inspired by private cloud architectures, which is reliable and scalable. This implementation aims at simplifying and encouraging both the deployment of new software components as well as their reutilization to achieve the activity recognition process inside smart homes. The second contribution of this paper is the introduction of the LIARA Environment for Modular Machine Learning (LE2ML), a new machine learning workbench. Its design relies on a microservices architecture to provide a better scalability as well as smaller and faster deployments. Experiments demonstrate that our architecture is resilient to both a node failure and a total power outage. Moreover, the workbench obtained similar results, as regards the performance of the recognition, when compared to previously proposed methods.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Notes

  1. 1.

    https://hadoop.apache.org/.

  2. 2.

    https://www.osgi.org/.

  3. 3.

    https://zeromq.org/.

  4. 4.

    https://numpy.org/.

  5. 5.

    https://www.scipy.org/.

  6. 6.

    https://scikit-learn.org/.

  7. 7.

    https://www.linbit.com/drbd/.

  8. 8.

    http://www.linux-ha.org/doc/man-pages/re-heartbeat.html.

  9. 9.

    https://www.docker.com/.

  10. 10.

    https://kubernetes.io/.

  11. 11.

    https://mesos.apache.org/.

  12. 12.

    https://docs.docker.com/engine/swarm/.

  13. 13.

    https://traefik.io/.

  14. 14.

    https://www.nginx.com/.

  15. 15.

    https://www.haproxy.org/.

  16. 16.

    https://www.ansible.com/.

  17. 17.

    https://www.portainer.io/.

  18. 18.

    https://www.mongodb.com/.

  19. 19.

    https://hub.docker.com/.

  20. 20.

    https://github.com/FlorentinTh/LE2ML.

  21. 21.

    https://github.com/FlorentinTh/LE2ML-API.

  22. 22.

    https://nodejs.org/.

  23. 23.

    https://expressjs.com/.

  24. 24.

    https://github.com/FlorentinTh/LE2ML-GUI.

  25. 25.

    https://github.com/FlorentinTh/LE2ML-Windowing-Module.

  26. 26.

    https://github.com/FlorentinTh/LE2ML-FeatureExtractor-Module.

  27. 27.

    https://github.com/LIARALab/GoLang-FeatureExtractor.

  28. 28.

    https://github.com/FlorentinTh/LE2ML-Learning-Module.

  29. 29.

    https://openwrt.org/.

  30. 30.

    https://www.raspberrypi.org/downloads/raspberry-pi-os/.

References

  1. Bae IH, Kim HG (2011) An ontology-based approach to ADL recognition in smart homes. In: International Conference on future generation communication and networking, Springer, Jeju Island, Korea 266:3 71–380. https://doi.org/10.1007/978-3-642-27201-1_42

  2. Bluestein LI (1970) A linear filtering approach to the computation of discrete Fourier transform. IEEE Trans Audio and Electroacoust 18(4):451–455. https://doi.org/10.1109/TAU.1970.1162132

    Article  Google Scholar 

  3. Bouchard K, Bouchard B, Bouzouane A (2014) Practical guidelines to build smart homes: lessons learned. In: Opportunistic networking, smart home, smart city, smart systems. CRC Press, Taylor & Francis, pp 1–37

  4. Bouchard K, Maitre J, Bertuglia C, Gaboury S (2020) Activity recognition in smart homes using uwb radars. Proc Comput Sci 170:10–17. https://doi.org/10.1016/j.procs.2020.03.004

    Article  Google Scholar 

  5. Bouckaert RR, Frank E, Hall MA, Holmes G, Pfahringer B, Reutemann P, Witten IH (2010) WEKA—experiences with a java open-source project. J Mach Learn Res 11:2533–2541

    MATH  Google Scholar 

  6. Chapron K, Plantevin V, Thullier F, Bouchard K, Duchesne E, Gaboury S (2018) A more efficient transportable and scalable system for real-time activities and exercises recognition. Sensors. https://doi.org/10.3390/s18010268

    Article  Google Scholar 

  7. Chen L, Nugent C (2010) Situation aware cognitive assistance in smart homes. J Mob Multimed 6(3):263–280

    Google Scholar 

  8. Chen L, Nugent C, Mulvenna M, Finlay D, Hong X (2009) Semantic smart homes: towards knowledge rich assisted living environments. In: McClean S, Millard P, El-Darzi E, Nugent C (eds) Intelligent patient management. Springer, Berlin, pp 279–296. https://doi.org/10.1007/978-3-642-00179-6_17

    Chapter  Google Scholar 

  9. Chen L, Nugent C, Biswas J, Hoey J (2011) Activity recognition in pervasive intelligent environments. In: Atlantis ambient and pervasive intelligence. Atlantis Press. https://doi.org/10.2991/978-94-91216-05-3

  10. Chen L, Hoey J, Nugent CD, Cook DJ, Yu Z (2012) Sensor-based activity recognition. IEEE Trans Syst Man Cybernet. https://doi.org/10.1109/TSMCC.2012.2198883

    Article  Google Scholar 

  11. Chen M, Mao S, Liu Y (2014) Big data: A survey. Mob Netw Appl 19:171–209. https://doi.org/10.1007/s11036-013-0489-0

    Article  Google Scholar 

  12. Cook D, Youngblood M, Heierman E, Gopalratnam K, Rao S, Litvin A, Khawaja F (2003) MavHome: an agent-based smart home. In: Proceedings of the First IEEE International Conference on pervasive computing and communications (PerCom), IEEE, Fort Worth, TX, USA, pp 521–524, https://doi.org/10.1109/PERCOM.2003.1192783

  13. Cook DJ, Crandall AS, Thomas BL, Krishnan NC (2013) CASAS: a smart home in a box. Computer 46(7):62–69. https://doi.org/10.1109/MC.2012.328

    Article  Google Scholar 

  14. Davis K, Owusu E, Bastani V, Marcenaro L, Hu J, Regazzoni C, Feijs L (2016) Activity recognition based on inertial sensors for ambient assisted living. In: FUSION 2016—19th International Conference on information fusion, proceedings, pp 371–378

  15. Demšar J, Zupan B, Leban G, Curk T (2004) Orange: from experimental machine learning to interactive data mining. Lecture Notes Comput Sci (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 3202:537–539. https://doi.org/10.1007/978-3-540-30116-5_58

    Article  Google Scholar 

  16. Demšar J, Curk T, Erjavec A, Gorup Č, Hočevar T, Milutinovič M, Možina M, Polajnar M, Toplak M, Starič A, Štajdohar M, Umek L, Žagar L, Žbontar J, Žitnik M, Zupan B (2013) Orange: data mining toolbox in python. J Mach Learn Res 14(1):2349–2353. https://doi.org/10.5555/2567709.2567736

    Article  MATH  Google Scholar 

  17. Dikaiakos MD, Katsaros D, Mehra P, Pallis G, Vakali A (2009) Cloud computing: distributed internet computing for IT and scientific research. IEEE Internet Comput 13(5):10–11. https://doi.org/10.1109/MIC.2009.103

    Article  Google Scholar 

  18. Dragoni N, Giallorenzo S, Lafuente AL, Mazzara M, Montesi F, Mustafin R, Safina L (2017) Microservices: yesterday, today, and tomorrow. In: Mazzara M, Meyer B (eds) Present and ulterior software engineering. Springer, Berlin, pp 195–216. https://doi.org/10.1007/978-3-319-67425-4_12

    Chapter  Google Scholar 

  19. Dua D, Graff C (2017) UCI machine learning repository. http://archive.ics.uci.edu/ml. Accessed 17 Nov 2020

  20. Fortin-Simard D, Bilodeau JS, Bouchard K, Gaboury S, Bouchard B, Bouzouane A (2015) Exploiting passive RFID technology for activity recognition in smart homes. IEEE Intell Syst 30(4):7–15. https://doi.org/10.1109/MIS.2015.18

    Article  Google Scholar 

  21. Ghaffarinejad A, Syrotiuk VR (2014) Load balancing in a campus network using software defined networking. In: Proceedings—2014 3rd GENI Research and Educational Experiment Workshop, GREE 2014, IEEE, Atlanta, GA, USA, pp 75–76, https://doi.org/10.1109/GREE.2014.9

  22. Giroux S, Leblanc T, Bouzouane A, Bouchard B, Pigot H, Bauchet J (2009) The praxis of cognitive assistance in smart homes. BMI Book, Ormond Beach, pp 183–211. https://doi.org/10.3233/978-1-60750-048-3-183

    Book  Google Scholar 

  23. Gubbi J, Buyya R, Marusic S, Palaniswami M (2013) Internet of Things (IoT): a vision, architectural elements, and future directions. Futur Gener Comput Syst 29(7):1645–1660. https://doi.org/10.1016/j.future.2013.01.010

    Article  Google Scholar 

  24. Hall M, Frank E, Holmes G, Pfahringer B, Reutemann P, Witten IH (2009) The WEKA data mining software: an update. ACM SIGKDD Explor Newslett 11(1):10–18. https://doi.org/10.1145/1656274.1656278

    Article  Google Scholar 

  25. Handa A, Sharma A, Shukla SK (2019) Machine learning in cybersecurity: a review. Wiley Interdiscipl Rev Data Min Knowl Discov. https://doi.org/10.1002/widm.1306

    Article  Google Scholar 

  26. Helal S, Mann W, El-Zabadani H, King J, Kaddoura Y, Jansen E (2005) The Gator tech smart house: a programmable pervasive space. Computer 38(3):50–60. https://doi.org/10.1109/MC.2005.107

    Article  Google Scholar 

  27. Hofmann M, Klinkenberg R (2014) RapidMiner: data mining use cases and business analytics applications. CRC Press, Taylor & Francis, Boca Raton

    Google Scholar 

  28. Holmes G, Donkin A, Witten IH (1994) WEKA: a machine learning workbench. In: Australian and New Zealand Conference on intelligent information systems—proceedings, pp 357–361, https://doi.org/10.1109/anziis.1994.396988

  29. Hornik K, Buchta C, Zeileis A (2009) Open-source machine learning: R meets Weka. Comput Stat 24(2):225–232. https://doi.org/10.1007/s00180-008-0119-7

    MathSciNet  Article  MATH  Google Scholar 

  30. Hu P, Ning H, Chen L, Daneshmand M (2019) An open internet of things system architecture based on software-defined device. IEEE Internet Things J 6(2):2583–2592. https://doi.org/10.1109/JIOT.2018.2872028

    Article  Google Scholar 

  31. Institute of Electrical and Electronics Engineers (1999) IEEE Std 1451.1-1999, IEEE Standard for a smart transducer interface for sensors and actuators—network capable application processor (NCAP) information model. In: IEEE, https://doi.org/10.1109/IEEESTD.2000.91313

  32. Jafarnejad Ghomi E, Masoud Rahmani A, Nasih Qader N (2017) Load-balancing algorithms in cloud computing: a survey. J Netw Comput Appl 88:50–71. https://doi.org/10.1016/j.jnca.2017.04.007

    Article  Google Scholar 

  33. Lago P, Lang F, Roncancio C, Jiménez-Guarín C, Mateescu R, Bonnefond N (2017) The contextact@a4h real-life dataset of daily-living activities. In: Brézillon P, Turner R, Penco C (eds) Modeling and using context, vol 10257. Springer, Berlin, pp 175–188. https://doi.org/10.1007/978-3-319-57837-8_14

    Chapter  Google Scholar 

  34. Langlois RE, Lu H (2008) Intelligible machine learning with malibu. In: Proceedings of the 30th Annual International Conference of the IEEE engineering in medicine and biology society, EMBS’08—“Personalized Healthcare through Technology”, pp 3795–3798, https://doi.org/10.1109/iembs.2008.4650035

  35. Larrañaga P, Calvo B, Santana R, Bielza C, Galdiano J, Inza I, Lozano JA, Armañanzas R, Santafé G, Pérez A, Robles V (2006) Machine learning in bioinformatics. Brief Bioinform 7(1):86–112. https://doi.org/10.1093/bib/bbk007

    Article  Google Scholar 

  36. MacKenzie CM, Laskey K, McCabe F, Brown PF, Metz R (2006) Reference model for service oriented architecture 1.0. OASIS Standard. OASIS Open 12:1–31

    Google Scholar 

  37. Mahalingam M, Dutt DG, Duda K, Agarwal P, Kreeger L, Sridhar T, Bursell M, Wright C (2014) Virtual eXtensible Local Area Network (VXLAN): a framework for overlaying virtualized layer 2 networks over layer 3 networks. RFC 7348, RFC Editor, https://www.rfc-editor.org/rfc/rfc7348.txt

  38. Marikyan D, Papagiannidis S, Alamanos E (2019) A systematic review of the smart home literature: a user perspective. Technol Forecast Soc Change 138:139–154. https://doi.org/10.1016/j.techfore.2018.08.015

    Article  Google Scholar 

  39. Ongaro D, Ousterhout J (2014) In search of an understandable consensus algorithm. In: Proceedings of the 2014 USENIX Annual Technical Conference, USENIX ATC 2014, Philadelphia, PA, USA, pp 305–319

  40. Plantevin V, Bouzouane A, Gaboury S (2017) The light node communication framework: a new way to communicate inside smart homes. Sensors 17(10):2397–2416. https://doi.org/10.3390/s17102397

    Article  Google Scholar 

  41. Plantevin V, Bouzouane A, Bouchard B, Gaboury S (2019) Towards a more reliable and scalable architecture for smart home environments. J Ambient Intell Humaniz Comput 10(7):2645–2656. https://doi.org/10.1007/s12652-018-0954-5

    Article  Google Scholar 

  42. Rajkomar A, Dean J, Kohane I (2019) Machine learning in medicine. N Engl J Med 380(14):1347–1358. https://doi.org/10.1056/NEJMra1814259

    Article  Google Scholar 

  43. Ramasamy Ramamurthy S, Roy N (2018) Recent trends in machine learning for human activity recognition—a survey. Wiley Interdiscipl Rev Data Min Knowl Discov 8:4. https://doi.org/10.1002/widm.1254

    Article  Google Scholar 

  44. Ritthoo O, Klinkenberg R, Fischer S, Mierswa I, Felske S (2003) Yale: yet another learning environment. Tech. rep., Universität Dortmund, Dortmund, Germany, https://doi.org/10.17877/DE290R-15309

  45. Salowey J, Choudhury A, McGrew D (2008) AES galois counter mode (GCM) cipher suites for TLS. RFC 5288, RFC Editor, https://www.rfc-editor.org/rfc/rfc5288.txt. Accessed 17 Nov 2020

  46. Thullier F, Plantevin V, Bouzouane A, Halle S, Gaboury S (2017) A position-independent method for soil types recognition using inertial data from a wearable device. In: 2017 IEEE SmartWorld, ubiquitous intelligence & computing, advanced & trusted computed, scalable computing & communications, cloud & big data computing, internet of people and smart city innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI), IEEE, San Francisco, CA, USA, pp 1–10, https://doi.org/10.1109/UIC-ATC.2017.8397511

  47. Thullier F, Plantevin V, Bouzouane A, Halle S, Gaboury S (2018) A comparison of inertial data acquisition methods for a position-independent soil types recognition. In: 2018 IEEE SmartWorld, ubiquitous intelligence & computing, advanced & trusted computing, scalable computing & communications, cloud & big data computing, internet of people and smart city innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI), IEEE, Guangzhou, China, pp 1052–1056, https://doi.org/10.1109/SmartWorld.2018.00183

  48. Triboan D, Chen L, Chen F, Wang Z (2016) Towards a service-oriented architecture for a mobile assistive system with real-time environmental sensing. Tsinghua Sci Technol 21(6):581–597. https://doi.org/10.1109/TST.2016.7787002

    Article  Google Scholar 

  49. Valiente-Rocha PA, Lozano-Tello A (2010) Ontology-based expert system for home automation controlling. In: International Conference on industrial, engineering and other applications of applied intelligent systems, Springer, Córdoba, Spain 6096:661–670. https://doi.org/10.1007/978-3-642-13022-9_66

  50. Wang J, Chen Y, Hao S, Peng X, Hu L (2019) Deep learning for sensor-based activity recognition: a survey. Pattern Recognit Lett 119:3–11. https://doi.org/10.1016/j.patrec.2018.02.010

    Article  Google Scholar 

  51. Witten IH, Frank E, Hall MA, Pal CJ (2016) Data mining: practical machine learning tools and techniques, 4th edn. Morgan Kaufmann Publishers Inc., Burlington. https://doi.org/10.1016/c2009-0-19715-5

    Book  Google Scholar 

  52. Zaharia M, Chowdhury M, Franklin MJ, Shenker S, Stoica I (2010) Spark: cluster computing with working sets. In: ACM (ed) 2nd USENIX Workshop on hot topics in cloud computing, HotCloud 2010, USENIX Association, Boston, MA, pp 1–10, https://doi.org/10.5555/1863103.1863113

  53. Zhang S, Wei Z, Nie J, Huang L, Wang S, Li Z (2017) A review on human activity recognition using vision-based method. J Healthc Eng. https://doi.org/10.1155/2017/3090343

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to thank the Canadian Foundation for Innovation (CFI) for providing the laboratory infrastructure and the equipment.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Florentin Thullier.

Ethics declarations

Conflict of interest

The authors declare no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Thullier, F., Hallé, S. & Gaboury, S. LE2ML: a microservices-based machine learning workbench as part of an agnostic, reliable and scalable architecture for smart homes. J Ambient Intell Human Comput (2021). https://doi.org/10.1007/s12652-021-03528-8

Download citation

Keywords

  • Machine learning
  • Workbench
  • Architecture
  • Smart home