Standardized Effect Sizes for Preventive Mobile Health Interventions in Micro-randomized Trials
- 318 Downloads
Mobile Health (mHealth) interventions are behavioral interventions that are accessible to individuals in their daily lives via a mobile device. Most mHealth interventions consist of multiple intervention components. Some of the components are “pull” components, which require individuals to access the component on their mobile device at moments when they decide they need help. Other intervention components are “push” components, which are initiated by the intervention, not the individual, and are delivered via notifications or text messages. Micro-randomized trials (MRTs) have been developed to provide data to assess the effects of push intervention components on subsequent emotions and behavior. In this paper, we review the micro-randomized trial design and provide an approach to computing a standardized effect size for these intervention components. This effect size can be used to compare different push intervention components that may be included in an mHealth intervention. In addition, a standardized effect size can be used to inform sample size calculations for future MRTs. Here, the standardized effect size is a function of time because the push notifications can occur repeatedly over time. We illustrate this methodology using data from an MRT involving HeartSteps, an mHealth intervention for physical activity as part of the secondary prevention of heart disease.
KeywordsMicro-randomized trials Precision behavioral science Standardized effect size
Research presented in this paper was supported by the National Heart, Lung and Blood Institute under award number R01HL125440; the National Institute on Alcohol Abuse and Alcoholism under award number R01AA023187; the National Institute on Drug Abuse under award number P50DA039838; and the National Institute of Biomedical Imaging and Bioengineering under award number U54EB020404.
Compliance with Ethical Standards
Conflict of Interest
The authors declare that they have no conflict of interest.
Human Participants and/or Animals
This article does not contain any studies with animals performed by any of the authors. Informed consent was obtained from all individual participants included in the study of HeartSteps.
- Cohen, J. (1988). Statistical power analysis for the social sciences. Hillsdale: Erlbaum.Google Scholar
- Efron, B., & Tibshirani, R. (1994). An introduction to the bootstrap. Boca Raton: Taylor & Francis.Google Scholar
- Friedman, J., Hastie, T., Tibshirani, R. (2009). The elements of statistical learning. New York: Springer.Google Scholar
- Hovsepian, K., al’Absi, M., Ertin, E., Kamarck, T., Nakajima, M., Kumar, S. (2015). cstress: Towards a gold standard for continuous stress assessment in the mobile environmentt. In Proceedings of the 2015 ACM international joint conference on pervasive and ubiquitous computing (pp. 493–504).Google Scholar
- Nahum-Shani, I., Smith, S.N., Spring, B.J., Collins, L.M., Witkiewitz, K., Tewari, A., Murphy, S.A. (2016). Just-in-time adaptive interventions (JITAIs) in mobile health: Key components and design principles for ongoing health behavior support. Annals of Behavioral Medicine, 1–17. https://doi.org/10.1007/s12160-016-9830-8.
- Seewald, N.J., Sun, J., Liao, P. (2016). MRT-SS Calculator: An R shiny application for sample size calculation in micro-randomized trials. arXiv:1609.00695. [February 18, 2017].
- Smith, S.N., Lee, A., Kelly, H., Seewald, N., Boruvka, A., Murphy, S.A., Klasnja, P. (2017). Design lessons from a micro-randomized pilot study in mobile health. In J. M. Rehg, S. A. Murphyand, & S. Kumar (Eds.), Mobile health: Sensors, analytic methods, and applications. Switzerland: Springer International Publishing. In press.Google Scholar