The feasibility of cell phone based electronic diaries for STI/HIV research
Self-reports of sensitive, socially stigmatized or illegal behavior are common in STI/HIV research, but can raise challenges in terms of data reliability and validity. The use of electronic data collection tools, including ecological momentary assessment (EMA), can increase the accuracy of this information by allowing a participant to self-administer a survey or diary entry, in their own environment, as close to the occurrence of the behavior as possible. In this paper, we evaluate the feasibility of using cell phone-based EMA as a tool for understanding sexual risk and STI among adult men and women.
As part of a larger prospective clinical study on sexual risk behavior and incident STI in clinically recruited adult men and women, using study-provided cell phones, participants (N = 243) completed thrice–daily EMA diaries monitoring individual and partner-specific emotional attributes, non-sexual activities, non-coital or coital sexual behaviors, and contraceptive behaviors. Using these data, we assess feasibility in terms of participant compliance, behavior reactivity, general method acceptability and method efficacy for capturing behaviors.
Participants were highly compliant with diary entry protocol and schedule: over the entire 12 study weeks, participants submitted 89.7% (54,914/61,236) of the expected diary entries, with an average of 18.86 of the 21 expected diaries (85.7%) each week. Submission did not differ substantially across gender, race/ethnicity and baseline sexually transmitted infection status. A sufficient volume and range of sexual behaviors were captured, with reporting trends in different legal and illegal behaviors showing small variation over time. Participants found the methodology to be acceptable, enjoyed and felt comfortable participating in the study.
Achieving the correct medium of data collection can drastically improve, or degrade, the timeliness and quality of an individual’s self-reported sexual risk behavior, which in turn, is a key factor in the success of intervention or education programs relying on this information. Our findings demonstrate that completion of electronic diaries via cellular phone is feasible way to describe STI/HIV risk among clinically recruited adult men and women.
- Catania JA, Gibson DR, DD C: Methodological problems in AIDS behaviour research: influences on measurement error and participation bias in studies of sex behaviour. Psychological Bulletin 1990, 108:339–362. CrossRef
- Shiffman S, Stone AA: Introduction to the special section: Ecological momentary assessment in health psychology. Health Psychology 1998,17(1):3–5. CrossRef
- Scott-Sheldon LAJ, Kalichman SC, Carey M: Assessment of Sexual behavior. In Handbook of Behavioral Medicine: Methods and Applications. Edited by: Freeland KE, Jennings JR, Llabre MM, Manuck SB, Susman EJ. Springer, London; 2010:59–72. CrossRef
- Shiffman S, Stone A, Hufford M: Ecolocial Momentary Assessment. Annual Review of Clinical Psychology 2008, 4:1–32. CrossRef
- van Griensven F, Naorat S, Kilmarx PH, Jeeyapant S, Manopaiboon C, Chaikummao S, Jenkins RA, Uthaivoravit W, Wasinrapee P, Mock PA, et al.: Palmtop-assisted Self-Interviewing for the Collection of Sensitive Behavioral Data: Randomized Trial with Drug Use Urine Testing. American Journal of Epidemiology 2006,163(3):271–278. CrossRef
- Catania JA, Binson D, VdS A: Methodological research on sexual behavior in the AIDS era. Annual Review of Sex Research 1995, 16:77–125.
- Fenton KA, Johnson AM, McManus S, Erens B: Measuring sexual behaviour: methodological challenges in survey research. Sexually Transmitted Infections 2001,77(2):84. CrossRef
- Bolger N, Davis A, Rafaeli E: Diary Methods: Capturing Life as it is Lived. Annual Review of Psychology 2003, 54:579–616. CrossRef
- Phillips AE, Gomez GB, Boily M-C, Garnett GP: A systematic review and meta-analysis of quantitative interviewing tools to investigate self-reported HIV and STI associated behaviours in low- and middle-income countries. International Journal of Epidemiology 2010,39(6):1541–1555. CrossRef
- Stone A, Shiffman S: Ecological momentary assessment (EMA) in behavorial medicine. Annual of Behavioral Medicine 1994,16(3):199–202.
- Shiffman S: Ecological momentary assessment (EMA) in studies of substance use. Psychological Assessment 2009,21(4):486–497. CrossRef
- Shiffman S: Real-time self-report of momentary states in the natural environment: Computerized ecological momentary assessment. Lawrence Earlbaum Associates, Mahwah, NJ; 2000.
- Piasecki TM, Hufford MR, Solhan M, Trull TJ: Assessing clients in their natural environments with electronic diaries: Rationale, benefits, limitations, and barriers. Psychological Assessment 2007,19(1):25–43. CrossRef
- Hufford M: Special methodological challenges and opportunities in ecological momentary assessment. In The science of real-time data capture: Self-reports in health research edn. Edited by: Stone AA, Shiffman S, Atienza A, Nebeling L. Oxford University Press, Oxford, England; 2007:54–75.
- Shrier L, Koren S, Aneja P, de Moor C: Affect Regulation, Social Context, and Sexual Intercourse in Adolescents. Archives of Sexual Behavior 2010,39(3):695–705. CrossRef
- Cook PF, McElwain CJ, Bradley-Springer LA: Feasibility of a daily electronic survey to study prevention behavior with HIV-infected individuals. Research in Nursing & Health 2010,33(3):221–234. CrossRef
- Freedman MJ, Lester KM, McNamara C, Milby JB, Schumacher JE: Cell phones for ecological momentary assessment with cocaine-addicted homeless patients in treatment. Journal of Substance Abuse Treatment 2006,30(2):105–111. CrossRef
- Richens J, Copas A, Sadiq ST, Kingori P, McCarthy O, Jones V, Hay P, Miles K, Gilson R, Imrie J, et al.: A randomised controlled trial of computer-assisted interviewing in sexual health clinics. Sexually Transmitted Infections 2010,86(4):310–314. CrossRef
- Trull TJ, Ebner-Priemer UW: Using experience sampling methods/ecological momentary assessment (ESM/EMA) in clinical assessment and clinical research: Introduction to the special section. Psychological Assessment 2009,21(4):457–462. CrossRef
- Lim MSC, Sacks-Davis R, Aitken CK, Hocking JS, Hellard ME: Randomised controlled trial of paper, online and SMS diaries for collecting sexual behaviour information from young people. Journal of Epidemiology and Community Health 2010,64(10):885–889. CrossRef
- Hufford MR, Shields AL, Shiffman S, Paty J, Balabanis M: Reactivity to ecological momentary assessment: An example using undergraduate problem drinkers. Psychology of Addictive Behaviors 2002,16(3):205–211. CrossRef
- Blondin J, Abu-Hasaballah K, Tennen H, Lalla R: Electronic versus paper diaries: a pilot study of concordance and adherence in head and neck cancer patients receiving radiation therapy. Head & Neck Oncology 2010,2(1):29. CrossRef
- Luckmann R, Vidal A: Design of a handheld electronic pain, treatment and activity diary. Journal of Biomedical Informatics 2010,43(5, Supplement 1):S32-S36. CrossRef
- Epstein DH, Willner-Reid J, Vahabzadeh M, Mezghanni M, Lin J-L, Preston KL: Real-Time Electronic Diary Reports of Cue Exposure and Mood in the Hours Before Cocaine and Heroin Craving and Use. Arch Gen Psychiatry 2009,66(1):88–94. CrossRef
- Tideman RL, Pitts MK, Fairley CK: Client acceptability of the use of computers in a sexual health clinic. Int J STD AIDS 2006,17(2):121–123. CrossRef
- Turner CF, Rogers SM, Hendershot TP, Miller HG, Thornberry JP: Improving representation of linguistic minorities in health surveys. Public Health Reports 1996,111(3):276–279.
- Ghanem KG, Hutton HE, Zenilman JM, Zimba R, Erbelding EJ: Audio computer assisted self interview and face to face interview modes in assessing response bias among STD clinic patients. Sexually Transmitted Infections 2005,81(5):421–425. CrossRef
- Langhaug LF, Sherr L, Cowan FM: How to improve the validity of sexual behaviour reporting: systematic review of questionnaire delivery modes in developing countries. Tropical Medicine & International Health 2010,15(3):362–381. CrossRef
- Collins RL, Kashdan TB, Gollnisch G: The feasibility of using cellular phones to collect ecological momentary assessment data: Application to alcohol consumption. Experimental and Clinical Psychopharmacology 2003,11(1):73–78. CrossRef
- Fairley CK, Sze JK, Vodstrcil LA, Chen MY: Computer-Assisted Self Interviewing in Sexual Health Clinics. Sexually Transmitted Diseases 2010,37(11):665–668. CrossRef
- Weinstein SM, Mermelstein R, Shiffman S, Flay B: Mood variability and cigarette smoking escalation among adolescents. Psychology of Addictive Behaviors 2008,22(4):504–513. CrossRef
- Galloway GP, Didier R, Garrison K, Mendelson J: Feasibility of Ecological Momentary Assessment Using Cellular Telephones in Methamphetamine Dependent Subjects. Substance Abuse: Research and Treatment 2008, 1:9–14.
- Bartley J, Ferris D, Allmond L: Personal digitals assistants used to document compliance of bacterial vaginosis treatment. Sexually Transmitted Diseases 2004, 31:488–491. CrossRef
- Sonnenschein M, Sorbi MJ, van Doornen LJP, Maas CJM: Feasibility of an Electronic Diary in Clinical Burnout. International Journal of Behavioral Medicine 2006,13(4):315–319. CrossRef
- Tennen H, Affleck G, Coyne JC, Larsen RJ, DeLongis A: Paper and plastic in daily diary research: Comment on Green, Rafaeli, Bolger, Shrout, and Reis (2006). Psychological Methods 2006,11(1):112–118. CrossRef
- R Development Team: R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria; 2010.
- Schillinger JAMDM, Kissinger PP, Calvet HM, Whittington WLH, Ransom RLM, Sternberg MRP, Berman SMMDS, Kent CKM, Martin DHM, Oh MKM, et al.: Patient-Delivered Partner Treatment With Azithromycin to Prevent Repeated Chlamydia trachomatis Infection Among Women: A Randomized, Controlled Trial. Sexually Transmitted Diseases 2003,30(1):49–56. CrossRef
- Minnis AM, Padian NS: Reliability of adolescents’ self-reported sexual behavior: a comparison of two diary methodologies. Journal of Adolescent Health 2001,28(5):394–403. CrossRef
- Morrison DM, Leigh BC, Rogers Gillmore M: Daily Data Collection: A Comparison of Three Methods. Journal of Sex Research 1999,36(1):76–81. CrossRef
- Shrier LA, Shih M, Beardslee WR: Affect and sexual behavior in adolescents: a review of the literature and comparison of momentary sampling with diary and retrospective self-report methods of measurement. Pediatrics 2005,115(5):e573-e581. CrossRef
- Yancey AK, Ortega AN, Kumanyika SK: Effective recruitment and retention of minority research participants. Annual Review of Public Health 2006,27(1):1–28. CrossRef
- McFall RM, Stuart RB: Parameters of self-monitoring. In Behavioral self-management: Strategies, techniques, and outcome. Brunner/Mazel, New York; 1977:196–214.
- Stone AA, Broderick JE, Schwartz JE, Shiffman S, Litcher-Kelly L, Calvanese P: Intensive momentary reporting of pain with an electronic diary: reactivity, compliance, and patient satisfaction. Pain 2003,104(1–2):343–351. CrossRef
- Collins RL, Morsheimer ET, Shiffman S, Paty JA, Gnys M, Papandonatos GD: Ecological momentary assessment in a behavioral drinking moderation training program. Experimental and Clinical Psychopharmacology 1998,6(3):306–315. CrossRef
- Moos RH: Commentary. Context and mechanisms of reactivity to assessment and treatment. Addiction 2008,103(2):249–250. CrossRef
- Stone AA, Shiffman S: Capturing Momentary, Self-Report Data: A Proposal for Reporting Guidelines. Annals of Behavioral Medicine 2002,24(3):236. CrossRef
- Stone AA, Shiffman S, Schwartz JE, Broderick JE, Hufford MR: Patient compliance with paper and electronic diaries. Controlled Clinical Trials 2003,24(2):182–199. CrossRef
- Hong J, Jiangna H, Zhu Z, Wenbin X, Jinping Z, Yuanjue Z: Patient Compliance with Assessing and Monitoring of Asthma. Journal of Asthma 2009,46(10):1027–1031. CrossRef
- Litcher-Kelly L, Kellerman Q, Hanauer SB, Stone AA: Feasibility and Utility of an Electronic Diary to Assess Self-Report Symptoms in Patients With Inflammatory Bowel Disease. Annals of Behavioral Medicine 2007,33(2):207–212. CrossRef
- Palermo TM, Valenzuela D, Stork PP: A randomized trial of electronic versus paper pain diaries in children: impact on compliance, accuracy, and acceptability. Pain 2004,107(3):213–219. CrossRef
- Gauthier MA, WP C: Gaining and sustaining minority participation in longitudinal research projects. Alzheimer Dis Assoc Disord 1999, 13:S29-S33. CrossRef
- Hessol NA, Schneider M, Greenblatt RM, Bacon M, Barranday Y, Holman S, Robison E, Williams C, Cohen M, Weber K: Retention of Women Enrolled in a Prospective Study of Human Immunodeficiency Virus Infection: Impact of Race, Unstable Housing, and Use of Human Immunodeficiency Virus Therapy. Am J Epidemiol 2001,154(6):563–573. CrossRef
- Kimlin A-G, Patricia AG: Effect of time incentives on subject participation in a study of long-term breast cancer survivors: Are there ethnic differences? Journal of the National Medical Association 2000,92(11):528.
- Parra-Medina D, D’Antonio A, Smith SM, Levin S, Kirkner G, Mayer-Davis E: Successful recruitment and retention strategies for a randomized weight management trial for people with diabetes living in rural, medically underserved counties of South Carolina: the POWER study. Journal of the American Dietetic Association 2004,104(1):70–75. CrossRef
- Zayas LH, McKee MD, Jankowski KRB: Adapting Psychosocial Intervention Research to Urban Primary Care Environments: A Case Example. Annals of Family Medicine 2004,2(5):504–508. CrossRef
- Connell CM, Shaw BA, Holmes SB, Foster NL: Caregivers‘attitudes toward their family members’ participation in Alzheimer disease research: implications for recruitment and retention. Alzheimer Dis Assoc Disord 2001, 15:137–145. CrossRef
- Russell C, Palmer JR, Adams-Campbell LL, Rosenberg L: Follow-up of a Large Cohort of Black Women. Am J Epidemiol 2001,154(9):845–853. CrossRef
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2288/12/75/prepub
- The feasibility of cell phone based electronic diaries for STI/HIV research
- Open Access
- Available under Open Access This content is freely available online to anyone, anywhere at any time.
BMC Medical Research Methodology
- Online Date
- June 2012
- Online ISSN
- BioMed Central
- Additional Links
- Author Affiliations
- 1. Section of Adolescent Medicine, Indiana University School of Medicine, Indianapolis, IN, USA
- 3. Department of Sociology, Indiana University Purdue University-Indianapolis, Indianapolis, IN, USA
- 2. Division of Biostatistics, Indiana University School of Medicine, Indianapolis, IN, USA