Abstract
Ambulatory assessment methods (e.g., ecological momentary assessment [EMA], daily diary) are used to study the impact of daily stress on physical and mental health and behavior. However, there is relatively little information about how question format might influence responding. In two ambulatory studies, the effect of question format (i.e., binary yes/no vs. event checklist) on reporting of everyday stressors was evaluated. Study 1 included 58 urban caregivers of children with asthma in a diary design, and study 2 included 27 overweight/obese adults in an EMA design. Participants in both studies completed surveys that included questions about stressor occurrence and severity with one question format each week (binary vs. checklist); participants were randomized to question order, counterbalanced across weeks. Results suggested that participants in study 1, but not study 2, reported more stressors when provided a checklist vs. yes/no question. Stressor severity ratings did not systematically differ across question format. Additional research on question format across samples and designs could help to inform future ambulatory study design.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
aan het Rot, M., Hogenelst, K., & Schoevers, R.A. (2012). Mood disorders in everyday life: A systematic review of experience sampling and ecological momentary assessment studies. Clinical Psychology Review, 32, 510–523. https://doi.org/10.1016/j.cpr.2012.05.007
Almeida, D. M., Wethington, E., & Kessler, R. C. (2002). The daily inventory of stressful events: An interview-based approach for measuring daily stressors. Assessment, 9, 41–55. https://doi.org/10.1177/1073191102091006
Bai, S., Elavsky, S., Kishida, M., Dvorakova, K., & Greenberg, M. T. (2020). Effects of mindfulness training on daily stress response in college students: Ecological momentary assessment of a randomized controlled trial. Mindfulness, 11, 1433–1445. https://doi.org/10.1007/s12671-020-01358-x
Brantley, P. J., Waggoner, C. D., Jones, G. N., & Rappaport, N. B. (1987). A daily stress inventory: Development, reliability, and validity. Journal of Behavioral Medicine, 10, 61–74. https://doi.org/10.1007/BF00845128
Carels, R. A., Hoffman, J., Collins, A., Raber, A. C., Cacciapaglia, H., & O’Brien, W. H. (2001). Ecological momentary assessment of temptation and lapse in dieting. Eating Behaviors, 2, 307–321. https://doi.org/10.1016/S1471-0153(01)00037-X
Charles, S. T., Luong, G., Almeida, D. M., Ryff, C., Sturm, M., & Love, G. (2010). Fewer ups and downs: Daily stressors mediate age differences in negative affect. Journals of Gerontology Series b: Psychological Sciences and Social Sciences, 65(3), 279–286. https://doi.org/10.1093/geronb/gbq002
Chiang, J. J., Turiano, N. A., Mroczek, D. K., & Miller, G. E. (2018). Affective reactivity to daily stress and 20-year mortality risk in adults with chronic illness: Findings from the National Study of Daily Experiences. Health Psychology, 37(2), 170. https://doi.org/10.1037/hea0000567
Cohen, S., & Janicki-Deverts, D. (2012). Who’s stressed? Distributions of psychological stress in the United States in probability samples from 1983, 2006 and 2009. Journal of Applied Social Psychology, 42, 1320–1334. https://doi.org/10.1111/j.1559-1816.2012.00900.x
Cohen, S., Kamarck, T., & Mermelstein, R. (1983). A global measure of perceived stress. Journal of Health and Social Behavior, 24, 385–396. https://doi.org/10.2307/2136404
Cohen, S., Kessler, R. C., & Gordon, L. U. (1995). Strategies for measuring stress in studies of psychiatric and physical disorders. In S. Cohen, R. C. Kessler, & L. U. Gordon (Eds.), Measuring stress: A guide for health and social scientists (pp. 3–26). Oxford University Press.
Cohen, S., & Williamson, G. (1988). Perceived stress in a probability sample of the United States. In S. Spacapam & S. Oskamp (Eds.), The social psychology of health (pp. 31–76). Sage.
Diehl, M., & Hay, E. L. (2010). Risk and resilience factors in coping with daily stress in adulthood: The role of age, self-concept incoherence, and personal control. Developmental Psychology, 46, 1132–1146. https://doi.org/10.1037/a0019937
Entringer, S., Buss, C., Andersen, J., Chicz-DeMet, A., & Wadhwa, P. D. (2011). Ecological momentary assessment of maternal cortisol profiles over a multiple-day period predict the length of human gestation. Psychosomatic Medicine, 73, 469–474. https://doi.org/10.1097/PSY.0b013e31821fbf9a
Everhart, R. S., Borschuk, A., Miadich, S., Barsell, J., & Heron, K. E. (2018). Caregiver daily experiences associated with child asthma symptoms. American Journal of Health Behavior, 42, 50–60. https://doi.org/10.5993/AJHB.42.2.5
Goldschmidt, A. B., Wonderlich, S. A., Crosby, R. D., Engel, S. G., Lavender, J. M., Peterson, C. B., Crow, S. J., Cao, L., & Mitchell, J. E. (2014). Ecological momentary assessment of stressful events and negative affect in bulimia nervosa. Journal of Counseling and Clinical Psychology, 82, 30–39. https://doi.org/10.1037/a0034974
Grywacz, J. G., & Almeida, D. M. (2008). Stress and binge drinking: A daily process examination of stressor pile-up and socioeconomic status in affect regulation. International Journal of Stress Management, 15, 364–380. https://doi.org/10.1037/a0013368
Heron, K. E., Braitman, A. L., Dawson, C. A., MacIntyre, R. I., Howard, L. M., & Lewis, R. J. (2020). Evaluating study procedure training methods for a remote daily diary study of sexual minority women. mHealth, 2020. https://doi.org/10.21037/mhealth-20-116
Kanner, A. D., Coyne, J. C., Schaefer, C., & Lazarus, R. S. (1981). Comparison of two modes of stress measurement: Daily hassles and uplifts versus major life events. Journal of Behavioral Medicine, 4, 1–39. https://doi.org/10.1007/BF00844845
Lazarus, R. S. (1999). Stress and emotion: A new synthesis (Vol. 1). Free Association Books Limited.
Leahey, T. M., Crowther, J. H., & Mickelson, K. D. (2007). The frequency, nature, and effects of naturally occurring appearance-focused social comparisons. Behavior Therapy, 38, 132–143. https://doi.org/10.1016/j.beth.2006.06.004
Lewinsohn, P. M., Rohde, P., & Gau, J. M. (2003). Comparability of self-report checklist and interview data in the assessment of stressful life events in young adults. Psychological Reports, 93, 459–471. https://doi.org/10.2466/pr0.2003.93.2.459
MacIntyre, R. I., Heron, K. E., Dawson, C. A., Filipkowski, K. B., & Arigo, D. (2021). Does assessment alter responses? An examination of measurement reactivity in an ecological momentary assessment of body comparisons. Journal of Social and Clinical Psychology, 40, 304–332. https://doi.org/10.1521/jscp.2021.40.4.304
McCarthy, D. E., Minami, H., Yeh, V. M., & Bold, K. W. (2015). An experimental investigation of reactivity to ecological momentary assessment frequency among adults trying to quit smoking. Addiction, 110, 1549–1560. https://doi.org/10.1111/add.12996
McQuaid, J. R., Monroe, S. M., Roberts, J. R., Johnson, S. L., Garamoni, G. L., Kapfer, M. D., & Frank, E. (1992). Toward the standardization of life stress assessment: Definitional discrepancies and inconsistencies in methods. Stress Medicine, 8, 47–56. https://doi.org/10.1002/smi.2460080107
Monroe, S. M. (2008). Modern approaches to conceptualizing and measuring human life stress. Annual Review of Clinical Psychology, 4, 33–52. https://doi.org/10.1146/annurev.clinpsy.4.022007.141207
Mroczek, D. K., & Almeida, D. M. (2004). The effect of daily stress, personality, and age on daily negative affect. Journal of Personality, 72, 355–378. https://doi.org/10.1111/j.0022-3506.2004.00265.x
O’Connor, S. G., Habre, R., Bastain, T. M., Toledo-Corral, C. M., Gilliland, F. D., Eckel, S., Cabison, J., Naya, C., Farzan, S., Chu, D., Chavez, T., Brenton, C. V., & Dunton, G. (2019). Within-subject effects of environmental and social stressors on pre- and post-partum obesity-related biobehavioral responses in low-income Hispanic women: Protocol of an intensive longitudinal study. BMC Public Health, 19, 253. https://doi.org/10.1186/s12889-019-6583-x
Piazza, J. R., Charles, S. T., Sliwinski, M. J., Mogle, J., & Almeida, D. M. (2013). Affective reactivity to daily stressors and long-term risk of reporting a chronic physical health condition. Annals of Behavioral Medicine, 45, 110–120. https://doi.org/10.1007/s12160-012-9423-0
Radloff, L. S. (1977). The CES-D scale: A self-report depression scale for research in the general population. Applied Psychological Measurement, 1, 385–401. https://doi.org/10.1177/014662167700100306
Rook, K. S., August, K. J., Choi, S., Franks, M. M., & Parris Stephens, M. A. (2015). Emotional reactivity to daily stress, spousal emotional support, and fasting blood glucose among patients with type 2 diabetes. Journal of Health Psychology, 21, 2538–2549. https://doi.org/10.1177/1359105315581064
Rowan, P. J., Cofta-Woerpel, L., Mazas, C. A., Vidrine, J. I., Reitzel, L. R., Cinciripini, P. M., et al. (2007). Evaluating reactivity to ecological momentary assessment during smoking cessation. Experimental and Clinical Psychopharmacology, 15, 382–389. https://doi.org/10.1037/1064-1297.15.4.382
Schwarz, N. (1999). Self-reports: How the questions shape the answers. American Psychologist, 54, 93–105. https://doi.org/10.1037/0003-066X.54.2.93
Schwarz, N., Bless, H., Strack, F., Klumpp, G., Rittenauer-Schatka, H., & Simons, A. (1991). Ease of retrieval as information: Another look at the availability heuristic. Journal of Personality and Social Psychology, 61, 195–202. https://doi.org/10.1037/0022-3514.61.2.195
Shiffman, S., & Waters, A. J. (2004). Negative affect and smoking lapses: A prospective analysis. Journal of Consulting and Clinical Psychology, 72, 192–201. https://doi.org/10.1037/0022-006X.72.2.192
Smyth, J. M., Jones, D. R., Wen, C. K. F., Materia, F. T., Schneider, S., & Stone, A. (2021). Influence of ecological momentary assessment study design features on reported willingness to participate and perceptions of potential research studies: An experimental study. British Medical Journal Open, 11, e049154. https://doi.org/10.1136/bmjopen-2021-049154
Smyth, J. M., Sliwinski, M. J., Zawadzki, M. J., Scott, S. B., Conroy, D. E., Lanza, S. T., & Buxton, O. M. (2018). Everyday stress response targets in the science of behavior change. Behaviour Research and Therapy, 101, 20–29. https://doi.org/10.1016/j.brat.2017.09.009
Smyth, J. M., & Stone, A. A. (2003). Ecological momentary assessment research in behavioral medicine. Journal of Happiness Studies, 4, 35–52. https://doi.org/10.1023/A:1023657221954
Smyth, J. M., Wonderlich, S. A., Heron, K. E., Sliwinski, M. J., Crosby, R. D., Mitchell, J. E., & Engel, S. G. (2007). Daily and momentary mood and stress are associated with binge eating and vomiting in bulimia nervosa patients in the natural environment. Journal of Consulting and Clinical Psychology, 75, 629–638. https://doi.org/10.1037/0022-006X.75.4.629
Stone, A. A., Broderick, J. E., Schwartz, J. E., Shiffman, S., Litcher-Kelly, L., & Calvanese, P. (2003). Intensive momentary reporting of pain with an electronic diary: Reactivity, compliance, and patient satisfaction. Pain, 104, 343–351. https://doi.org/10.1016/S0304-3959(03)00040-X
Sudman, S., & Bradburn, N. (1982). Asking Questions. Jossey-Bass.
Sun, A., & Chen, X. (2016). Online education and its effective practice: A research review. Journal of Information Technology Education: Research, 15, 157–190. https://doi.org/10.28945/3502
Todd, M. (2004). Daily processes in stress and smoking: Effects of negative events, nicotine dependence, and gender. Psychology of Addictive Behaviors, 18, 31–39. https://doi.org/10.1037/0893-164X.18.1.31
van Ballegooijen, W., Ruwaard, J., Karyotaki, E., Ebert, D. D., Smit, J. H., & Riper, H. (2016). Reactivity to smartphone-based ecological momentary assessment of depressive symptoms (MoodMonitor): Protocol of a randomised controlled trial. BMC Psychiatry, 16, 359. https://doi.org/10.1186/s12888-016-1065-5
van der Meij, H., & van der Meij, J. (2014). A comparison of paper-based and video tutorials for software learning. Computers & Education, 78, 150–159. https://doi.org/10.1016/j.compedu.2014.06.003
van Eck, M., Berkhof, H., Nicolson, N., & Sulon, J. (1996). The effects of perceived stress, traits, mood states, and stressful daily events on salivary cortisol. Psychosomatic Medicine, 58, 447–458. https://doi.org/10.1097/00006842-199609000-00007
Walz, L. C., Nauta, M. H., & aan het Rot, M. (2014). Experience sampling and ecological momentary assessment for studying the daily lives of patients with anxiety disorders: A systematic review. Journal of Anxiety Disorders, 28, 925–937. https://doi.org/10.1016/j.janxdis.2014.09.022
Williams, D. R., Mohammed, S. A., Leavell, J., & Collins, C. (2010). Race, socioeconomic status, and health: Complexities, ongoing challenges, and research opportunities. Annals of the New York Academy of Sciences, 1186, 69–101. https://doi.org/10.1111/j.1749-6632.2009.05339.x
Wrzus, C., & Neubauer, A. B. (2022). Ecological momentary assessment: A meta-analysis on designs, samples, and compliance across research fields. Assessment. Online ahead of print. https://doi.org/10.1177/10731911211067538
Zautra, A. J. (2003). Emotions, stress, and health. Oxford University Press.
Zautra, A. J., Guarnaccia, C. A., & Dohrenwend, B. P. (1986). Measuring small life events. American Journal of Community Psychology, 14, 629–655. https://doi.org/10.1007/BF00931340
Zawadzki, M. J., Scott, S. B., Almeida, D. M., Lanza, S. T., Conroy, D. E., Sliwinski, M. J., Kim, J., Marcussion-Clavertz, D., Stawski, R. S., Green, P. M., Sciamanna, C. N., Johnson, J. A., & Smyth, J. M. (2019). Understanding stress reports in daily life: A coordinated analysis of factors associated with the frequency of reporting stress. Journal of Behavioral Medicine, 42, 545–560. https://doi.org/10.1007/s10865-018-00008-x
Funding
Study 2 described in this publication was supported by a grant from the Social Science Research Institute at the Pennsylvania State University and by the National Center for Research Resources and the National Center for Advancing Translational Sciences, National Institutes of Health, through Grant UL1TR000127.
The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Informed consent
The Institutional Review Board approved all study procedures and participants provided informed consent prior to beginning the study.
Competing interests
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Heron, K.E., Scott, S.B., Mogle, J.A. et al. Ambulatory Assessment of Everyday Stressors: A Two-Study Experiment Evaluating the Effect of Question Format on Self-Reported Daily and Momentary Stressors. J. technol. behav. sci. 7, 368–380 (2022). https://doi.org/10.1007/s41347-022-00259-1
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s41347-022-00259-1