Abstract
Sensors represent the prerequisites for data collection in the field of digital phenotyping and mobile sensing. Today, many sensors are connected over the Internet or feature advanced processing, thus provide smart functions that go beyond simple measurements. Embedded in everyday devices such as smartphones and wearables, smart sensors enable the collection of a vast amount of data in a natural setting and the unobtrusive real-time monitoring of people’s lives. Initial empirical studies illustrate the possibilities and high potential of using ubiquitous smart sensors in health research. However, to realize the full potential, a deeper understanding of the underlying concept of smart sensors in health research is important. The present chapter aims to give a theoretical, non-technical introduction to the basic concepts of smart sensors in mobile health sensing. Hence, this chapter provides a brief overview of currently available sensors and proposes an overarching taxonomy. For the sake of simplicity, the focus of this chapter will be on smart mobile sensors, in particular those currently embedded in smartphones. Following this, we will briefly discuss what can be sensed and how health can be predicted from this sensor data. Additionally, we provide examples of research projects based on smartphone sensors, followed by an outlook on current challenges, future research perspectives, and potential clinical applications.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Agarwal S, LeFevre AE, Lee J, L’engle K, Mehl G, Sinha C, Labrique A (2016) Guidelines for reporting of health interventions using mobile phones: mobile health (mHealth) evidence reporting and assessment (mERA) checklist. BMJ 352
Alvarez-Lozano J, Osmani V, Mayora O, Frost M, Bardram J, Faurholt-Jepsen M, Kessing LV (2014) Tell me your apps and I will tell you your mood: correlation of apps usage with bipolar disorder state. In: Proceedings of the 7th international conference on pervasive technologies related to assistive environments, pp 1–7. https://doi.org/10.1145/2674396.2674408
Android (2021) Sensors overview. https://developer.android.com/guide/topics/sensors/sensors_overview. Accessed on 10 Apr 2021
AWARE (2021) Sensors. https://awareframework.com/sensors/. Accessed on 12 May 2021
Baumeister H, Montag C (2019) Digital phenotyping and mobile sensing In psychoinformatics—a rapidly evolving interdisciplinary research endeavor. In: Baumeister H, Montag C (eds) Digital phenotyping and mobile sensing, 1st edn. Springer, Cham, pp xiii–xx
Behar J, Roebuck A, Domingos JS, Gederi E, Clifford GD (2013) A review of current sleep screening applications for smartphones. Physiol Meas 34(7). https://doi.org/10.1088/0967-3334/34/7/R29
Benoit J, Onyeaka H, Keshavan M, Torous J (2020) Systematic review of digital phenotyping and machine learning in psychosis spectrum illnesses. Harv Rev Psychiatry 28(5):296–304. https://doi.org/10.1097/HRP.0000000000000268
Boukhechba M, Chow P, Fua K, Teachman BA, Barnes LE (2018) Predicting social anxiety from global positioning system traces of college students: feasibility study. J Med Internet Res 5(3):e10101. https://doi.org/10.2196/10101
Che Z, Purushotham S, Cho K, Sontag D, Liu Y (2018) Recurrent neural networks for multivariate time series with missing values. Sci Rep 8(1):1–12. https://doi.org/10.1038/s41598-018-24271-9
Cheffena M (2015) Fall detection using smartphone audio features. IEEE J Biomed Health Inform 20(4):1073–1080. https://doi.org/10.1109/JBHI.2015.2425932
Cornet VP, Holden RJ (2018) Systematic review of smartphone-based passive sensing for health and wellbeing. J Biomed Inform 77:120–132. https://doi.org/10.1016/j.jbi.2017.12.008
Dagum P (2019) Digital brain biomarkers of human cognition and mood. In: Baumeister H, Montag C (eds) Digital Phenotyping and mobile sensing, 1st edn. Springer, Cham, pp 93–107
Dutta J, Chowdhury C, Roy S, Middya AI, Gazi F (2017) Towards smart city: sensing air quality in city based on opportunistic crowd-sensing. In: Proceedings of the 18th international conference on distributed computing and networking, pp 1–6. https://doi.org/10.1145/3007748.3018286
Ebner-Priemer U, Santangelo P (2020) Digital phenotyping: hype or hope? Lancet Psychiatry 7(4):297–299. https://doi.org/10.1016/S2215-0366(19)30380-3
Fayyad U, Piatetsky-Shapiro G, Smyth P (1996) From data mining to knowledge discovery in databases. Artif Intell 17(3):37–54.https://doi.org/10.1007/978-3-319-18032-8_50
Ferreira D, Kostakos V, Dey AK (2015) AWARE: mobile context instrumentation framework. Front ICT 2(6). https://doi.org/10.3389/fict.2015.00006
Fraccaro P, Beukenhorst A, Sperrin M, Harper S, Palmier-Claus J, Lewis S, … Peek N (2019) Digital biomarkers from geolocation data in bipolar disorder and schizophrenia: a systematic review. J Am Med Inform Assoc 26(11):1412–1420.https://doi.org/10.1093/jamia/ocz043
Gu W, Yang Z, Shangguan L, Sun W, Jin K, Liu Y (2014) Intelligent sleep stage mining service with smartphones. In: Proceedings of the 2014 ACM international joint conference on pervasive and ubiquitous computing, pp 649–660. https://doi.org/10.1145/2632048.2632084
Huang RY, Dung LR (2016) Measurement of heart rate variability using off—the—shelf smart phones. Biomed Eng Online 15(1):1–16. https://doi.org/10.1186/s12938-016-0127-8
Insel TR (2017) Digital phenotyping: technology for a new science of behavior. JAMA 318(13):1215–1216. https://doi.org/10.1001/jama.2017.11295
Jain SH, Powers BW, Hawkins JB, Brownstein JS (2015) The digital phenotype. Nat Biotechnol 33(5):462–463. https://doi.org/10.1038/nbt.3223
Jonathan E, Leahy M (2010) Investigating a smartphone imaging unit for photoplethysmography. Physiol Meas 31(11). https://doi.org/10.1088/0967-3334/31/11/N01
Kalantar-zadeh K, Wlodarski W (2013) Sensors: an introductory course, 1st edn. Springer, New York
Kargl F, van der Heijden RW, Erb B, Bösch C (2019) Privacy in mobile sensing. In: Baumeister H, Montag C (eds) Digital phenotyping and mobile sensing, 1st edn. Springer, Cham, pp 3–12
Karlen W, Mattiussi C, Floreano D (2009) Sleep and wake classification with ECG and respiratory effort signals. IEEE Trans Biomed Circuits Syst 3(2):71–78. https://doi.org/10.1109/TBCAS.2008.2008817
Karlen W, Lim J, Ansermino JM, Dumont G, Scheffer C (2012) Design challenges for camera oximetry on a mobile phone. In: Proceedings of the annual international conference of the IEEE engineering in medicine and biology society, pp 2448–2451. https://doi.org/10.1109/EMBC.2012.6346459
Karlen W, Gan H, Chiu M, Dunsmuir D, Zhou G, Dumont GA, Ansermino JM (2014) Improving the accuracy and efficiency of respiratory rate measurements in children using mobile devices. PLoS ONE 9(6):e99266. https://doi.org/10.1371/journal.pone.0099266
Karlen W, Garde A, Myers D, Scheffer C, Ansermino JM, Dumont GA (2015) Estimation of respiratory rate from photoplethysmographic imaging videos compared to pulse oximetry. IEEE J Biomed Health Inform 19(4):1331–1338. https://doi.org/10.1109/JBHI.2015.2429746
Laport-López F, Serrano E, Bajo J, Campbell AT (2020) A review of mobile sensing systems, applications, and opportunities. Knowl Inf Syst 62(1):145–174. https://doi.org/10.1007/s10115-019-01346-1
Lima WS, Souto E, El-Khatib K, Jalali R, Gama J (2019) Human activity recognition using inertial sensors in a smartphone: an overview. Sensors 19(14):3213.https://doi.org/10.3390/s19143213
Liu L, Stroulia E, Nikolaidis I, Miguel-Cruz A, Rios Rincon A (2016) Smart homes and home health monitoring technologies for older adults: a systematic review. Int J Med Informatics 91:44–59. https://doi.org/10.1016/j.ijmedinf.2016.04.007
Lydon-Staley DM, Barnett I, Satterthwaite TD, Bassett DS (2019) Digital phenotyping for psychiatry: accommodating data and theory with network science methodologies. Curr Opin Biomed Eng 9:8–13.https://doi.org/10.1016/j.cobme.2018.12.003
Majumder S, Deen MJ (2019) Smartphone sensors for health monitoring and diagnosis. Sensors 19(9):2164. https://doi.org/10.3390/s19092164
Martinez-Martin N, Insel TR, Dagum P, Greely HT, Cho MK (2018) Data mining for health: staking out the ethical territory of digital phenotyping. Npj Digital Medicine 1(1):1–5. https://doi.org/10.1038/s41746-018-0075-8
Messner EM, Sariyska R, Mayer B, Montag C, Kannen C, Schwerdtfeger A, Baumeister H (2019) Insights: future implications of passive smartphone sensing in the therapeutic context. Verhaltenstherapie 1–10.https://doi.org/10.1159/000501735
Min J-K, Doryab A, Wiese J, Amini S, Zimmerman J, Hong JI (2014) Toss “N” turn: smartphone as sleep and sleep quality detector. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 477–486. https://doi.org/10.1145/2556288.2557220
Miotto R, Wang F, Wang S, Jiang X, Dudley JT (2018) Deep learning for healthcare: review, opportunities and challenges. Brief Bioinform 19(6):1236–1246. https://doi.org/10.1093/bib/bbx044
Mohr DC, Zhang M, Schueller SM (2017) Personal sensing: understanding mental health using ubiquitous sensors and machine learning. Annu Rev Clin Psychol 13:23–47. https://doi.org/10.1146/annurev-clinpsy-032816-044949
Montag C, Baumeister H, Kannen C, Sariyska R, Meßner E-M, Brand M (2019) Concept, possibilities and pilot-testing of a new smartphone application for the social and life sciences to study human behavior including validation data from personality psychology. J—Multidisciplinary Sci J 2(2):102–115. https://doi.org/10.3390/j2020008
Montag C, Sindermann C, Baumeister H (2020) Digital phenotyping in psychological and medical sciences: a reflection about necessary prerequisites to reduce harm and increase benefits. Curr Opin Psychol 36:19–24. https://doi.org/10.1016/j.copsyc.2020.03.013
Moshe I, Terhorst Y, Opoku Asare K, Sander LB, Ferreira D, Baumeister H, … Pulkki-Råback L (2021) Predicting symptoms of depression and anxiety using smartphone and wearable data. Front Psychiatry 12:1–12. https://doi.org/10.3389/fpsyt.2021.625247
Mukherjee N, Bhunia SS, Bose S (2016) Virtual sensors in remote healthcare delivery: some case studies. In: Proceedings of the 9th international conference on health informatics, pp 484–489. https://doi.org/10.5220/0005823204840489
Mylonas A, Meletiadis V, Mitrou L, Gritzalis D (2013) Smartphone sensor data as digital evidence. Comput Secur 38:51–75. https://doi.org/10.1016/j.cose.2013.03.007
Nahum-Shani I, Smith SN, Spring BJ, Collins LM, Witkiewitz K, Tewari A, Murphy SA (2018) Just-in-time adaptive interventions (JITAIs) in mobile health: key components and design principles for ongoing health behavior support. Ann Behav Med 52(6):446–462.https://doi.org/10.1007/s12160-016-9830-8
Nicholas J, Shilton K, Schueller SM, Gray EL, Kwasny MJ, Mohr DC (2019) The role of data type and recipient in individuals’ perspectives on sharing passively collected smartphone data for mental health: cross-sectional questionnaire study. JMIR Mhealth Uhealth 7(4):e12578. https://doi.org/10.2196/12578
Odenwald S (2019) Experimeter’s guide to smartphone sensors. https://spacemath.gsfc.nasa.gov/Sensor/SensorsBook.pdf. Accessed on 13 Apr 2021
Proudfoot J (2013) The future is in our hands: the role of mobile phones in the prevention and management of mental disorders. Aust N Z J Psychiatry 47(2):111–113. https://doi.org/10.1177/0004867412471441
Pryss R (2019) Mobile crowdsensing in healthcare scenarios: taxonomy, conceptual pillars, smart mobile crowdsensing services. In: Baumeister H, Montag C (eds) Digital phenotyping and mobile sensing, 1st edn. Springer, Cham, pp 221–234
Rowe M (2019) An introduction to machine learning for clinicians. Acad Med 94(10):1433–1436. https://doi.org/10.1097/ACM.0000000000002792
Saeb S, Zhang M, Karr CJ, Schueller SM, Corden ME, Kording KP, Mohr DC (2015) Mobile phone sensor correlates of depressive symptom severity in daily-life behavior: an exploratory study. J Med Internet Res 17(7):e175. https://doi.org/10.2196/jmir.4273
Sano A, Taylor S, McHill AW, Phillips AJK, Barger LK, Klerman E, Picard R (2018) Identifying objective physiological markers and modifiable behaviors for self-reported stress and mental health status using wearable sensors and mobile phones: observational study. J Med Internet Res 20(6):e210. https://doi.org/10.2196/jmir.9410
Schwab P, Karlen W (2019) PhoneMD: learning to diagnose Parkinson’s disease from smartphone data. In: Proceedings of the AAAI conference on artificial intelligence, pp 1118–1125
Schwab P, Karlen W (2020) A deep learning approach to diagnosing multiple sclerosis from smartphone data. ArXiv 1–8.https://doi.org/10.1109/jbhi.2020.3021143
Sony S, Laventure S, Sadhu A (2019) A literature review of next-generation smart sensing technology in structural health monitoring. Struct Control Health Monit 26(3):e2321. https://doi.org/10.1002/stc.2321
Statista (2020) Anzahl der Smartphone-Nutzer weltweit von 2016 bis 2019 und Prognose bis 2023 (in Milliarden). https://de.statista.com/statistik/daten/studie/309656/umfrage/prognose-zur-anzahl-der-smartphone-nutzer-weltweit/. Accessed on 13 Apr 2021
Stisen A, Blunck H, Bhattacharya S, Prentow TS, Kjærgaard MB, Dey A, … Jensen MM (2015) Smart devices are different: assessing and mitigating mobile sensing heterogeneities for activity recognition. In: Proceedings of the 13th ACM conference on embedded networked sensor systems, pp 127–140. https://doi.org/10.1145/2809695.2809718
Su X, Tong H, Ji P (2014) Activity recognition with smartphone sensors. Tsinghua Sci Technol 19(3):235–249. https://doi.org/10.1109/TST.2014.6838194
Tarabah F (2015) Good manufacturing practice (GMP) for biomaterials and medical devices in the EU and the USA. In: Amato SF, Ezzell RM (eds) Regulatory affairs for biomaterials and medical devices. Woodhead Publishing, pp 115–143. https://doi.org/10.1533/9780857099204.115
Torous J, Kiang MV, Lorme J, Onnela J-P (2016) New tools for new research in psychiatry: a scalable and customizable platform to empower data driven smartphone research. JMIR Mental Health 3(2):e16. https://doi.org/10.2196/mental.5165
Torous J, Onnela JP, Keshavan M (2017) New dimensions and new tools to realize the potential of RDoC: digital phenotyping via smartphones and connected devices. Transl Psychiatry 7(3):e1053. https://doi.org/10.1038/tp.2017.25
Trifan A, Oliveira M, Oliveira JL (2019) Passive sensing of health outcomes through smartphones: systematic review of current solutions and possible limitations. JMIR Mhealth Uhealth 7(8):e12649. https://doi.org/10.2196/12649
Wahle F, Kowatsch T, Fleisch E, Rufer M, Weidt S (2016) Mobile sensing and support for people with depression: a pilot trial in the wild. JMIR Mhealth Uhealth 4(3):e111. https://doi.org/10.2196/mhealth.5960
Zhang J (2021) Improving data quality in mobile health: design of a data integrity assurance framework. Thesis, ETH Zürich, no 27522
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Garatva, P., Terhorst, Y., Messner, EM., Karlen, W., Pryss, R., Baumeister, H. (2023). Smart Sensors for Health Research and Improvement. In: Montag, C., Baumeister, H. (eds) Digital Phenotyping and Mobile Sensing. Studies in Neuroscience, Psychology and Behavioral Economics. Springer, Cham. https://doi.org/10.1007/978-3-030-98546-2_23
Download citation
DOI: https://doi.org/10.1007/978-3-030-98546-2_23
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-98545-5
Online ISBN: 978-3-030-98546-2
eBook Packages: EngineeringEngineering (R0)