Design for a System of Multimodal Interconnected ADL Recognition Services

  • Theodoros Giannakopoulos
  • Stasinos KonstantopoulosEmail author
  • Georgios Siantikos
  • Vangelis Karkaletsis


As smart interconnected sensing devices are becoming increasingly ubiquitous, more applications are becoming possible by re-arranging and re-connecting sensing and sensor signal analysis in different pipelines. Naturally, this is best facilitated by extremely thin services that expose minimal functionality and are extremely flexible regarding the ways in which they can be re-arranged. On the other hand, this ability to re-use might be purely theoretical since there are established patterns in the ways processing pipelines are assembled. By adding privacy and technical requirements the re-usability of some functionalities is further restricted, making it even harder to justify the communication and security overheads of maintaining them as independent services. This creates a design space that each application must explore using its own requirements. In this article we focus on detecting activities of daily life (ADL) for medical applications and especially independent living applications, but our setting also offers itself to sharing devices with home automation and home security applications. By studying the methods and pipelines that dominate the audio and visual analysis literature, we observe that there are several multi-component sub-systems that can be encapsulated by a single service without substantial loss of re-usability. We then use this observation to propose a design for our ADL recognition application that satisfies our medical and privacy requirements, makes efficient use of processing and transmission resources, and is also consistent with home automation and home security extensions.


Audio-visual analysis Activities of daily life Internet of things Connected sensing services 



This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 643892. For more details, please visit the RADIO Web site


  1. 1.
    R. Bencina, P. Burk, PortAudio-an open source cross platform audio API, in Proceedings of the International Computer Music Conference, Havana, pp. 263–266 (2001)Google Scholar
  2. 2.
    T. Giannakopoulos, pyAudioAnalysis: an open-source Python library for audio signal analysis. PloS One 10 (12) (2015)Google Scholar
  3. 3.
    T. Giannakopoulos, S. Petridis, Fisher linear semi-discriminant analysis for speaker diarization. IEEE Trans. Audio Speech Lang. Process. 20 (7), pp. 1913–1922 (2012)CrossRefGoogle Scholar
  4. 4.
    T. Giannakopoulos, A. Pikrakis, Introduction to Audio Analysis: A MATLAB Approach (Academic Press, London, 2014)Google Scholar
  5. 5.
    P. KaewTraKulPong, R. Bowden, An improved adaptive background mixture model for real-time tracking with shadow detection, in Video-Based Surveillance Systems (Springer, New York, 2002), pp. 135–144Google Scholar
  6. 6.
    H.G. Kim, N. Moreau, T. Sikora, MPEG-7 Audio and Beyond: Audio Content Indexing and Retrieval (Wiley, New York, 2006)Google Scholar
  7. 7.
    RADIO Project: Deliverable 2.2: Early detection methods and relevant system requirements. Tech. rep. (2015),
  8. 8.
    N. Sarafianos, T. Giannakopoulos, S. Petridis, Audio-visual speaker diarization using Fisher linear semi-discriminant analysis. J. Multimed. Tools Appl. 75(1), 115–130 (2016)Google Scholar
  9. 9.
    D. Sgouropoulos, T. Giannakopoulos, G. Siantikos, E. Spyrou, S. Perantonis, Detection of clothes change fusing color, texture, edge and depth information, in E-Business and Telecommunications (Springer, Berlin, 2014), pp. 383–392Google Scholar
  10. 10.
    D. Sgouropoulos, E. Spyrou, G. Siantikos, T. Giannakopoulos, Counting and tracking people in a smart room: an IoT approach, in Proceedings of the 10th International Workshop on Semantic and Social Media Adaptation and Personalization (SMAP 2015) (IEEE, New York, 2015)Google Scholar
  11. 11.
    G. Siantikos, D. Sgouropoulos, T. Giannakopoulos, E. Spyrou, Fusing multiple audio sensors for acoustic event detection, in Proceedings of the 9th International Symposium on Image and Signal Processing and Analysis (ISPA 2015) (IEEE, New York, 2015), pp. 265–269Google Scholar
  12. 12.
    G. Siantikos, T. Giannakopoulos, S. Konstantopoulos, A low-cost approach for detecting activities of daily living using audio information: a use case on bathroom activity monitoring, in Proceedings of the 2nd International Conference on Information and Communication Technologies for Ageing Well and e-Health (ICT4AWE 2016), Rome (2016)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2017

Authors and Affiliations

  • Theodoros Giannakopoulos
    • 1
  • Stasinos Konstantopoulos
    • 1
    Email author
  • Georgios Siantikos
    • 1
  • Vangelis Karkaletsis
    • 1
  1. 1.Institute of Informatics and TelecommunicationsNCSR ‘Demokritos’, Aghia Paraskevi 15310Agia ParaskeviGreece

Personalised recommendations