Skip to main content

Advertisement

SpringerLink
Log in

Design Factors of Longitudinal Smartphone-based Health Surveys

  • Research Article
  • Published:
Journal of Healthcare Informatics Research Aims and scope Submit manuscript

Abstract

Phone-based surveys are increasingly being used in healthcare settings to collect data from potentially large numbers of subjects, e.g., to evaluate their levels of satisfaction with medical providers, to study behaviors and trends of specific populations, and to track their health and wellness. Often, subjects respond to such surveys once, but it has become increasingly important to capture their responses multiple times over an extended period to accurately and quickly detect and track changes. With the help of smartphones, it is now possible to automate such longitudinal data collections, e.g., push notifications can be used to alert a subject whenever a new survey is available. This paper investigates various design factors of a longitudinal smartphone-based health survey data collection that contribute to user compliance and quality of collected data. This work presents the design recommendations based on analysis of data collected from 17 subjects over a 1-month period.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21

Similar content being viewed by others

References

  1. 7 ways Apple’s new software could change medical research for the better (2015) http://www.huffingtonpost.com/2015/03/10/apple-researchkit-health_n_6840484.html?ir=India

  2. Researchkit for developers (2015). https://developer.apple.com/researchkit/

  3. Alpers G W (2009) Ambulatory assessment in panic disorder and specific phobia. Psychol Assess 21(4):476

    Article  Google Scholar 

  4. Böhmer M, Lander C, Gehring S, Brumby D P, Krüger A (2014) Interrupted by a phone call: exploring designs for lowering the impact of call notifications for smartphone users. In: Proceedings of the SIGCHI conference on human factors in computing systems (CHI). ACM, pp 3045–3054

  5. Burmeister L, Engel U, Schmidt B O (2015) Survey measurements: techniques, data quality and sources of error, 1st edn., chap. In: Well-being, survey attitudes, and readiness to report on everyday life events in an experience sampling study. Campus Verlag, pp 146–159

  6. Buysse D J, Reynolds C F, Monk T H, Berman S R, Kupfer D J (1989) The Pittsburgh sleep quality index: a new instrument for psychiatric practice and research. Psych Res 28(2):193–213

    Article  Google Scholar 

  7. Cohen S, Kamarck T, Mermelstein R (1983) A global measure of perceived stress. J Health Soc Behav :385–396

  8. Diener E, Emmons R A, Larsen R J, Griffin S (1985) The satisfaction with life scale. J Person Assess 49(1):71–75

    Article  Google Scholar 

  9. Diener E, Oishi S, Lucas R E (2003) Personality, culture, and subjective well-being: emotional and cognitive evaluations of life. Annu Rev Psychol 54(1):403–425

    Article  Google Scholar 

  10. Diener E, Wirtz D, Tov W, Kim-Prieto C, Choi Dw, Oishi S, Biswas-Diener R (2010) New well-being measures: short scales to assess flourishing and positive and negative feelings. Soc Indicat Res 97(2):143–156

    Article  Google Scholar 

  11. Fischer J E, Greenhalgh C, Benford S (2011) Investigating episodes of mobile phone activity as indicators of opportune moments to deliver notifications. In Proceedings of the 13th international conference on human computer interaction with mobile devices and services (MobileHCI). ACM, pp 181–190

  12. Fowler F J (1995) Improving survey questions: design and evaluation, vol 38. Sage Publications

  13. Gould S, Brumby D, Cox A, González V, Salvucci D, Taatgen N (2012) Multitasking and interruptions: a SIG on bridging the gap between research on the micro and macro worlds. In: CHI’12 extended abstracts on human factors in computing systems (CHI EA). ACM, pp 1189–1192

  14. Hallowell R (1996) The relationships of customer satisfaction, customer loyalty, and profitability: an empirical study. Int J Serv Ind Manag 7(4):27–42

    Article  Google Scholar 

  15. Hektner J M, Schmidt J A, Csikszentmihalyi M (2007) Experience sampling method: measuring the quality of everyday life. Sage

  16. Hofmann W, Patel P V (2015) SurveySignal: a convenient solution for experience sampling research using participants’ own smartphones. Soc Sci Comput Rev 33 (2):235–253

    Article  Google Scholar 

  17. Iqbal S T, Bailey B P (2007) Understanding and developing models for detecting and differentiating breakpoints during interactive tasks. InL Proceedings of the SIGCHI conference on human factors in computing systems (CHI). ACM, pp 697–706

  18. Iqbal S T, Bailey B P (2010) Oasis: a framework for linking notification delivery to the perceptual structure of goal-directed tasks. ACM Trans Comput-Human Inter (TOCHI) 17(4):15–41

    Google Scholar 

  19. Ji Y G, Park J H, Lee C, Yun M H (2006) A usability checklist for the usability evaluation of mobile phone user interface. Int J Human-Comput Inter 20 (3):207–231

    Article  Google Scholar 

  20. Kahn J (2017) Reporting statistics in apa style. https://goo.gl/6nhNOI

  21. Kroenke K, Spitzer R L, Williams J B (2001) The phq-9. J Gen Internal Med 16(9):606–613

    Article  Google Scholar 

  22. Krosnick J A (1999) Maximizing questionnaire quality. Meas Polit Attitud 2 (1):37–58

    Google Scholar 

  23. Krosnick J A (1999) Survey research. Annu Rev Psychol 50(1):537–567

    Article  Google Scholar 

  24. Kruskal W H, Wallis W A (1952) Use of ranks in one-criterion variance analysis. J Amer Stat Assoc 47(260):583–621

    Article  MATH  Google Scholar 

  25. Lane N D, Lin M, Mohammod M, Yang X, Lu H, Cardone G, Ali S, Doryab A, Berke E, Campbell A T, Choudhury T (2014) Bewell: sensing sleep, physical activities and social interactions to promote wellbeing. Mobile Netw Appl 19(3):345–359

    Article  Google Scholar 

  26. Lynn P, Buck N, Burton J, Jäckle A, Laurie H (2005) A review of methodological research pertinent to longitudinal survey design and data collection. Institute for Social and Economic Research, University of Essex

  27. Mann H B, Whitney D R (1947) On a test of whether one of two random variables is stochastically larger than the other. Ann Math Stat :50–60

  28. Markopoulos P, Batalas N, Timmermans A (2015) On the use of personalization to enhance compliance in experience sampling. In: Proceedings of the European conference on cognitive ergonomics (ECCE). ACM, pp 15–18

  29. McCarty C, House M, Harman J, Richards S (2006) Effort in phone survey response rates: the effects of vendor and client-controlled factors. Field Methods 18 (2):172–188

  30. McDonough P, Amick B C (2001) The social context of health selection: a longitudinal study of health and employment. Soc Sci Med 53(1):135–145

    Article  Google Scholar 

  31. Mehrotra A, Musolesi M, Hendley R, Pejovic V (2015) Designing content-driven intelligent notification mechanisms for mobile applications. In: Proceedings of the 2015 ACM international joint conference on pervasive and ubiquitous computing (UbiComp). ACM, pp 813–824

  32. Minami H, McCarthy D E, Jorenby D E, Baker T B (2011) An ecological momentary assessment analysis of relations among coping, affect and smoking during a quit attempt. Addiction 106(3):641–650

    Article  Google Scholar 

  33. Okoshi T, Ramos J, Nozaki H, Nakazawa J, Dey A K, Tokuda H (2015) Reducing users’ perceived mental effort due to interruptive notifications in multi-device mobile environments. In: Proceedings of the 2015 ACM international joint conference on pervasive and ubiquitous computing (UbiComp). ACM, pp 475–486

  34. Osang J E, Udoimuk A B, Etta E B, Ushie F O, Offiong N E (2013) Methods of gathering data for research purpose and applications using ijser acceptance rate of monthly paper publication (march 2012 edition-may 2013 edition). IOSR J Comput Eng (IOSR-JCE) e-ISSN: 2278-0661, p-ISSN: 2278-8727 15(2):59–65

    Google Scholar 

  35. Pearson K (1895) Note on regression and inheritance in the case of two parents. Proc R Soc Lond :240–242

  36. Pejovic V, Lathia N, Mascolo C, Musolesi M (2015) Mobile-based experience sampling for behaviour research. arXiv preprint arXiv:1508.03725

  37. Reed P G (1987) Spirituality and well-being in terminally ill hospitalized adults. Res Nurs Health 10(5):335–344

  38. Ritter S (2015) Apple’s research kit development framework for iphone apps enables innovative approaches to medical research data collection. J Clin Trials 5 (2):120–121. http://goo.gl/Sswlai

    Google Scholar 

  39. Aan Het Rot M, Hogenelst K, Schoevers R A (2012) Mood disorders in everyday life: a systematic review of experience sampling and ecological momentary assessment studies. Clin Psychol Rev 32(6):510–523

  40. Russell D W (1996) UCLA loneliness scale (version 3): reliability, validity, and factor structure. J Person Assess 66(1):20–40

    Article  Google Scholar 

  41. Ryff C D (1989) Happiness is everything, or is it? Explorations on the meaning of psychological well-being. J Person Soc Psychol 57(6):1069

    Article  Google Scholar 

  42. Ryff C D, Keyes C L M (1995) The structure of psychological well-being revisited. J Person Soc Psychol 69(4):719

    Article  Google Scholar 

  43. Saris W E, Revilla M, Krosnick J A, Shaeffer EM (2010) Comparing questions with agree/disagree response options to questions with item-specific response options. 61–79

  44. Schaeffer N C, Presser S (2003) The science of asking questions. Annu Rev Sociol 65–88

  45. Schiller J S, Adams P F, Nelson Z C (2005) Summary health statistics for the us population: national health interview survey, 2003. Vital and health statistics. Series 10. Data Nat Health Surv 224:1–104

    Google Scholar 

  46. Scholtz J (2004) Usability evaluation. National institute of standards and technology. Encyclopedia of human-computer interaction. http://goo.gl/hFCSCe

  47. Schuman H, Presser S (1981) Questions and answers in attitude surveys: experiments on question form, wording, and context. Sage Publications, San Deigo

    Google Scholar 

  48. Serre F, Fatseas M, Debrabant R, Alexandre J M, Auriacombe M, Swendsen J (2012) Ecological momentary assessment in alcohol, tobacco, cannabis and opiate dependence: a comparison of feasibility and validity. Drug Alcohol Depend 126(1):118–123

    Article  Google Scholar 

  49. Shiffman S (2009) Ecological momentary assessment (EMA) in studies of substance use. Psychol Assess 21(4):486

    Article  Google Scholar 

  50. Sincero SM (2016) Types of survey. https://explorable.com/types-of-survey

  51. Spearman C (1904) The proof and measurement of association between two things. Amer J Psychol 15(1):72–101

    Article  Google Scholar 

  52. Stone A A, Broderick J E (2007) Real-time data collection for pain: appraisal and current status. Pain Med 8(s3):S85–S93

    Article  Google Scholar 

  53. Stone A A, Shiffman S, Schwartz J E, Broderick J E, Hufford M R (2003) Patient compliance with paper and electronic diaries. Control Clin Trials 24 (2):182–199

    Article  Google Scholar 

  54. Ugur M, Shastri D, Tsiamyrtzis P, Dcosta M, Kalpakci A, Sharp C, Pavlidis I (2015) Evaluating smartphone-based user interface designs for a 2d psychological questionnaire. In: Proceedings of the 2015 ACM international joint conference on pervasive and ubiquitous computing (UbiComp). ACM, pp 275–282

  55. Underwood L G, Teresi J A (2002) The daily spiritual experience scale: development, theoretical description, reliability, exploratory factor analysis, and preliminary construct validity using health-related data. Ann Behav Med 24(1):22–33

    Article  Google Scholar 

  56. Vhaduri S, Ali A, Sharmin M, Hovsepian K, Kumar S (2014) Estimating drivers’ stress from gps traces. In: Proceedings of the 6th international conference on automotive user interfaces and interactive vehicular applications. ACM, pp 1–8

  57. Vhaduri S, Munch A, Poellabauer C (2016) Assessing health trends of college students using smartphones. In: Proceedings of the IEEE-NIH special topics conference on healthcare innovations and point-of-care technologies (HI-POCT). IEEE

  58. Vhaduri S, Poellabauer C (2015) Design and implementation of a remotely configurable and manageable well-being study. In: Proceedings of the EAI international conference on smart wearable devices and IoT for health and wellbeing applications (SWIT-Health). EAI, pp 909–920

  59. Vhaduri S, Poellabauer C (2016) Cooperative discovery of personal places from location traces. In: Proceedings of the international conference on conference on computer communication and networks (ICCCN). IEEE, pp 1–9

  60. Vhaduri S, Poellabauer C (2016) Human factors in the design of longitudinal smartphone-based wellness surveys. In: Proceedings of the IEEE international conference on healthcare informatics (ICHI). IEEE

  61. Wang R, Chen F, Chen Z, Li T, Harari G, Tignor S, Zhou X, Ben-Zeev D, Campbell A T (2014) Studentlife: assessing mental health, academic performance and behavioral trends of college students using smartphones. In: Proceedings of the 2014 ACM international joint conference on pervasive and ubiquitous computing (UbiComp). ACM, pp 3–14

  62. Watson D, Clark LA (1999) The PANAS-X: manual for the positive and negative affect schedule-expanded form. Iowa Res Online 54(6). http://goo.gl/JV5w6x

  63. Wilcoxon F (1945) Individual comparisons by ranking methods. Biomet Bull 1(6):80–83

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Computer Science and Engineering, University of Notre Dame, Notre Dame, IN, USA

    Sudip Vhaduri & Christian Poellabauer

Authors
  1. Sudip Vhaduri
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Christian Poellabauer
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sudip Vhaduri.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Vhaduri, S., Poellabauer, C. Design Factors of Longitudinal Smartphone-based Health Surveys. J Healthc Inform Res 1, 52–91 (2017). https://doi.org/10.1007/s41666-017-0003-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s41666-017-0003-8

Keywords

Search

Navigation