Abstract
This study examined how cultural adaptation and delivery quality of the school-based intervention keepin’ it REAL (kiR) influenced adolescent substance use. The goal of the study was to compare the effectiveness of the multi-cultural, urban (non-adapted) kiR intervention, a re-grounded (adapted) rural version of the kiR intervention and control condition in a new, rural setting. A total of 39 middle schools in rural communities of two states in the USA were randomly assigned to one of three conditions (i.e., control, non-adapted urban kiR, and adapted rural kiR). Data included adolescent self-reported lifetime substance use and observers’ ratings of delivery quality from video recordings of lessons. Ratings of delivery quality were used to create four comparison groups (i.e., low/high delivery quality in non-adapted/urban kiR condition and low/high quality in adapted/rural kiR condition). Controlling for substance use in the 7th grade, findings compared 9th graders’ (N = 2781) lifetime alcohol, cigarette, marijuana, and chewing tobacco use. Mixed model analyses revealed that rural youth receiving the culturally adapted/rural curriculum reported significantly less cigarette use than rural youth in the control condition regardless of delivery quality. In the non-adapted/urban condition, youth receiving high delivery quality delivery reported less marijuana use than those receiving low delivery quality condition. However, substance use outcomes of youth receiving high and low delivery quality in the non-adapted intervention did not differ significantly from those the control group. Findings support the effectiveness of the culturally adapted/rural keepin’ it REAL curriculum for rural youth.
Similar content being viewed by others
References
Baker, T. E. (2001). Finding the balance: Program fidelity and adaptation in substance abuse prevention: A state-of-the-art review. Center for Substance Abuse Prevention, Substance Abuse and Mental Health Services Administration. Retrieved from http://www.eric.ed.gov/PDFS/ED469354.pdf.
Barrera, M., Castro, F. G., & Steiker, H. (2011). A critical analysis of approaches to the development of preventive interventions for subcultural groups. American Journal of Community Psychology, 48, 439–454.
Barrera, M., Berkel, C., & Castro, F. G. (2017). Directions for the advancement of culturally adapted preventive interventions: Local adaptations, engagement, and sustainability. Prevention Science, 18, 640–648. https://doi.org/10.1007/s11121-016-0705-9.
Berkel, C., Mauricio, A. M., Schoenfelder, E., & Sandler, I. N. (2011). Putting the pieces together: An integrated model of program implementation. Prevention Science, 12, 23–33. https://doi.org/10.1007/s11121-010-0186-1.
Botvin, G. J. (2004). Advancing prevention science and practice: Challenges, critical issues, and future directions. Prevention Science, 5, 69–72. https://doi.org/10.1023/B:PREV.0000013984.83251.8b.
Botvin, G. J., Dusenbury, L., Baker, E., James-Ortiz, S., & Kerner, J. (1989). A skills training approach to smoking prevention among Hispanic youth. Journal of Behavioral Medicine, 12, 279–296.
Bumbarger, B. K. (2015). Readiness assessment to improve program implementation: Shifting the lens to optimizing intervention design. Prevention Science, 16, 1118–1122. https://doi.org/10.1007/s11121-015-0591-6.
Bumbarger, B., & Miller, A. (2007). Is there a role for police in school-based drug prevention? The law-enforcement education partnership to promote LifeSkills training (LEEP--LST) project. Prevention Research Center: Penn State University.
Castro, F. G., Barrera Jr., M., & Martinez Jr., C. R. (2004). The cultural adaptation of prevention interventions: Resolving tensions between fidelity and fit. Prevention Science, 5, 41–45. https://doi.org/10.1023/B:PREV.0000013980.12412.cd.
Colby, M., Hecht, M. L., Miller-Day, M., Krieger, J. R., Syverstsen, A. K., Graham, J. W., & Pettigrew, J. (2013). Adapting school-based substance use prevention curriculum through cultural grounding: An exemplar of adaptation processes for rural schools. American Journal of Community Psychology, 51, 190–205. https://doi.org/10.1007/s10464-012-9524-8.
Collins, L. M., Murphy, S. A., & Bierman, K. L. (2004). A conceptual framework for adaptive preventive interventions. Prevention Science, 5, 185–196. https://doi.org/10.1023/B:PREV.0000037641.26017.00.
Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350. https://doi.org/10.1007/s10464-008-9165-0.
Durlak, J. A., Domitrovich, C. E., Weissberg, R. P., & Gullotta, T. P. (Eds.). (2015). Handbook of social and emotional learning. New York: Guilford.
Dusenbury, L., Brannigan, R., Falco, M., & Hansen, W. B. (2003). A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings. Health Education Research, 18, 237–256. https://doi.org/10.1093/her/18.2.237.
Elliott, D. S., & Mihalic, S. (2004). Issues in disseminating and replicating effective prevention programs. Prevention Science, 5, 47–53. https://doi.org/10.1023/B:PREV.0000013981.28071.52.
Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., and Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, the National Implementation Research Network (FMHI Publication #231). Available from http://nirn.fmhi.usf.edu/resources/publications/Monograph/pdf/monograph_full.pdf.
Fixsen, D. L., Blase, K. A., Naoom, S. F., & Wallace, F. (2009). Core implementation components. Research on Social Work Practice, 19, 531–540. https://doi.org/10.1177/1049731509335549.
Graham, J. W. (2012). Missing data: Analysis and design. New York: Springer.
Graham, J. W., Hofer, S. M., & MacKinnon, D. P. (1996). Maximizing the usefulness of data obtained with planned missing value patterns: An application of maximum likelihood procedures. Multivariate Behavioral Research, 31, 197–218. https://doi.org/10.1207/s15327906mbr3102_3.
Graham, J. W., Taylor, B. J., Olchowski, A. E., & Cumsille, P. E. (2006). Planned missing data designs in psychological research. Psychological Methods, 11, 323–343.
Graham, J. W., Pettigrew, J., Miller-Day, M., Krieger, J. L., Zhou, J., & Hecht, M. L. (2014). Random assignment of schools to groups in the drug resistance strategies rural project: Some new methodological twists. Prevention Science, 15, 516–525. https://doi.org/10.1007/s11121-013-0403-9.
Green, J. (1999). Cultural awareness in human services: A multiethnic approach (3rd ed.). Boston: Allyn and Bacon.
Hammond, A., Sloboda, Z., Tonkin, P., Stephens, R., Teasdale, B., Grey, S. F., & Williams, J. (2008). Do adolescents perceive police officers as credible instructors of substance abuse prevention programs? Health Education Research, 23, 682–696. https://doi.org/10.1093/her/cym036.
Hansen, W. B., & Graham, J. W. (1991). Preventing alcohol, marijuana, and cigarette use among adolescents: Peer pressure resistance training versus establishing conservative norms. Preventive Medicine, 20, 414–430. https://doi.org/10.1016/0091-7435(91)90039-7.
Hayes, A. F., & Krippendorff, K. (2007). Answering the call for a standard reliability measure for coding data. Communication Methods and Measures, 1, 77–89.
Haynes, M. A., & Smedley, B. D. (Eds.). (1999). The unequal burden of cancer: An assessment of NIH research and programs for ethnic minorities and the medically underserved. Washington, DC: National Academies Press.
Hecht, M. L., & Krieger, J. K. (2006). The principle of cultural grounding in school-based substance use prevention: The drug resistance strategies project. Journal of Language and Social Psychology, 25, 301–319. https://doi.org/10.1177/0261927X06289476.
Hecht, M. L., & Miller-Day, M. (2009). The drug resistance strategies project: A communication approach to preventing adolescent drug use. In L. Frey & K. Cissna (Eds.), Handbook of applied communication (pp. 535–557). Mahwah: Lawrence Erlbaum.
Hecht, M. L., Marsiglia, F. F., Elek, E., Wagstaff, D. A., Kulis, S., Dustman, P., & Miller-Day, M. (2003). Culturally grounded substance use prevention: An evaluation of the keepin’it REAL curriculum. Prevention Science, 4, 233–248. https://doi.org/10.1023/A:1026016131401.
Hecht, M. L., Graham, J. W., & Elek, E. (2006). The drug resistance strategies intervention: Program effects on substance use. Health Communication, 20, 267–276. https://doi.org/10.1207/s15327027hc2003_6.
Johnson, C. A., Unger, J. B., Ritt-Olson, A., Palmer, P. H., Cen, S. Y., Gallaher, P., & Chou, C. P. (2005). Smoking prevention for ethnically diverse adolescents: 2-year outcomes of a multicultural, school-based smoking prevention curriculum in Southern California. Preventive Medicine, 40, 842–852. https://doi.org/10.1016/j.ypmed.2004.09.032.
Johnston, L. D., O’Malley, P. M., Miech, R. A., Bachman, J. G., & Schulenberg, J. E. (2016). Monitoring the future national survey results on drug use, 1975–2015: Overview, key findings on adolescent drug use. Ann Arbor: Institute for Social Research, The University of Michigan.
Kaner, E. F., Lock, C. A., McAvoy, B. R., Heather, N., & Gilvarry, E. (1999). A RCT of three training and support strategies to encourage implementation of screening and brief alcohol intervention by general practitioners. British Journal of General Practice, 49, 699–703.
Kang, H., & Sundar, S. S. (2016). When self is the source: Effects of media customization on message processing. Media Psychology, 19, 561–588.
Komro, K. A., Perry, C. L., Veblen-Mortenson, S., Farbakhsh, K., Toomey, T. L., Stigler, M. H., & Williams, C. L. (2008). Outcomes from a randomized controlled trial of a multi-component alcohol use preventive intervention for urban youth: Project Northland Chicago. Addiction, 103, 606–618. https://doi.org/10.1111/j.1360-0443.2007.02110.x.
Lee, S. J., Altschul, I., & Mowbray, C. T. (2008). Using planned adaptation to implement evidence-based programs with new populations. American Journal of Community Psychology, 41, 290–303. https://doi.org/10.1007/s10464-008-9160-5.
Lenardson, J. D., Hartley, D., Gale, J., & Pearson, K. B. (2012). Substance use and abuse in rural America. In K. B. Smalley, J. C. Warren, & J. P. Rainer (Eds.), Rural mental health: Issues, policies, and best practices (pp. 191–212). New York: Springer.
Marsiglia, F. F., Kulis, S., Yabiku, S. T., Nieri, T. A., & Coleman, E. (2011). When to intervene: Elementary school, middle school or both? Effects of keepin’ it REAL on substance use trajectories of Mexican heritage youth. Prevention Science, 12, 48–62. https://doi.org/10.1007/s11121-010-0189-y.
Miller, M. A., Alberts, J. K., Hecht, M. L., Trost, M., & Krizek, R. L. (2000). Adolescent relationships and drug use. Mahwah: Lawrence Erlbaum Associates.
Miller-Day, M., & Hecht, M. L. (2013). Narrative means to preventative ends: A narrative engagement approach to adolescent substance use prevention. Health Communication, 28, 657–670. https://doi.org/10.1080/10410236.2012.762825.
Moreland, J. J., Raup-Krieger, J. L., Miller-Day, M., & Hecht, M. L. (2013). The conceptualization and communication of risk among rural Appalachian adolescents. Journal of Health Communication, 18, 668–685. https://doi.org/10.1080/10810730.2012.743620.
Muthén, L. K., & Muthén, B. O. (1998–2015). Mplus user’s guide (6th ed.). Los Angeles: Muthén & Muthén.
Pentz, M. A. (2004). Form follows function: Designs for prevention defectiveness and diffusion research. Prevention Science, 5, 23–29. https://doi.org/10.1023/B:PREV.0000013978.00943.30.
Pettigrew, J., & Hecht, M. L. (2015). Developing prevention curricula. In K. Bosworth (Ed.), Prevention science in school settings: Complex relationships and processes (pp. 151–174). New York: Springer.
Pettigrew, J., Miller-Day, M., Krieger, J., & Hecht, M. L. (2011). Alcohol and other drug resistance strategies employed by rural adolescents. Journal of Applied Communication Research, 39, 103–122. https://doi.org/10.1080/00909882.2011.556139.
Pettigrew, J., Miller-Day, M., Krieger, J., & Hecht, M. L. (2012). The rural context of illicit substance offers a study of Appalachian rural adolescents. Journal of Adolescent Research, 27, 523–550. https://doi.org/10.1177/0743558411432639.
Pettigrew, J., Graham, J. W., Miller-Day, M., Hecht, M. L., Krieger, J. L., & Shin, Y. (2015). Adherence and delivery quality: Implementation quality and outcomes of 7th grade keepin’ it REAL program. Prevention Science, 16, 90–99. https://doi.org/10.1007/s11121-014-0459-1.
Ringwalt, C. L., Vincus, A., Ennett, S., Johnson, R., & Rohrbach, L. A. (2004). Reasons for teachers’ adaptation of substance use prevention curricula in schools with non-white student populations. Prevention Science, 5, 61–67. https://doi.org/10.1023/B:PREV.0000013983.87069.a0.
Ringwalt, C. L., Clark, H. K., Hanley, S., Shamblen, S. R., & Flewelling, R. L. (2009a). Project ALERT: A cluster randomized trial. Archives of Pediatrics & Adolescent Medicine, 163, 625–632.
Ringwalt, C. L., Pankratz, M. M., Hansen, W. B., Dusenbury, L., Jackson-Newsom, J., Giles, S. M., & Brodish, P. H. (2009b). The potential of coaching as a strategy to improve the effectiveness of school-based substance use prevention curricula. Health Education & Behavior, 36, 696–710. https://doi.org/10.1177/1090198107303311.
Ringwalt, C. L., Kovach, H. K., Hanley, S., Shamblen, S. R., & Flewelling, R. L. (2010). The effects of project ALERT one year past curriculum completion. Prevention Science, 11, 172–184.
Spitzberg, B. H., & Cupach, W. R. (1984). Interpersonal communication competence. Beverly Hills: Sage.
U.S. Department of Health and Human Services (2016). Facing addiction in America: The surgeon general’s report on alcohol, drugs, and health. Washington, DC: HHS, November 2016.
Warren, J. C., Smalley, K. B., & Barefoot, K. N. (2016). Recent alcohol, tobacco, and substance use variations between rural and urban middle and high school students. Journal of Child & Adolescent Substance Abuse, 26, 60–65.
Zollinger, T. W., Saywell, R. M., Overgaard, A. D., Przybylski, M. J., & Dutta-Bergman, M. (2006). Antitobacco media awareness of rural youth compared to suburban and urban youth in Indiana. The Journal of Rural Health, 22, 119–123. https://doi.org/10.1111/j.1748-0361.2006.00019.
Funding
This article was supported by Grant Number R01DA021670 from the National Institute on Drug Abuse to The Pennsylvania State University (Michael Hecht, Principal Investigator). Its contents are solely the responsibility of the authors and do not necessarily represent the official views of the National Institutes of Health.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare a potential financial conflict of interest. Hecht and Miller-Day are co-founders of REAL Prevention, LLC—a business dedicated to training, research, and dissemination of keepin’ it REAL and other allied health promotion programs—and hold intellectual property rights to the keepin’ it REAL curriculum. Pettigrew is a part-time consultant with REAL Prevention but was not remunerated for involvement with this project.
Ethical Approval
All study procedures involving human participants were approved by the Penn State Institutional Review Board and in accordance with standards for ethical research practice, including the 1964 Helsinki declaration and its later amendments.
Informed Consent
Participants were informed of their rights and parental informed consent coupled with youth assent was obtained prior to any data collection.
Rights and permissions
About this article
Cite this article
Hecht, M.L., Shin, Y., Pettigrew, J. et al. Designed Cultural Adaptation and Delivery Quality in Rural Substance Use Prevention: an Effectiveness Trial for the Keepin’ it REAL Curriculum. Prev Sci 19, 1008–1018 (2018). https://doi.org/10.1007/s11121-018-0937-y
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11121-018-0937-y