Abstract
Online interventions may offer a means of overcoming barriers experienced in face-to-face treatment for amphetamine use. Usability testing allows a website’s capacity to engage the targeted population to be optimised. This study evaluated the usability of an amphetamine treatment website (www.beatingtherush.com.au) and explored health professionals’ and amphetamine users’ Internet access and use. Eleven health professionals and 10 amphetamine users viewed the website and provided quantitative and qualitative feedback. All health professionals and 90% of amphetamine users had Internet access. All health professionals and 80% of amphetamine users felt comfortable and confident using the Internet. However, 40% of amphetamine users reported not using the Internet to obtain information about alcohol and drugs. Participants provided positive feedback regarding usability of the website, as well as areas for improvement. This study addressed usability issues prior to evaluating the effectiveness of the website, enabling modification of design features to enhance the user experience of the website.
Similar content being viewed by others
References
Australian Bureau of Statistics. (2014). Household use of information technology, Australia 2012–13 (cat. no. 8146.0). Retrieved April 14, 2015, from http://www.abs.gov.au/ausstats/abs@.nsf/Lookup/8146.0Chapter12012-13.
Australian Institute of Health and Welfare. (2014). National drug strategy household survey detailed report 2013. Drug statistics series no. 28. (cat. no. PHE 183). Retrieved April 14, 2015, from http://www.aihw.gov.au/publication-detail/?id=60129549469.
Benhunan-Fich, R. (2001). Using protocol analysis to evaluate the usability of a commercial web site. Information Management, 39, 151–163. doi:10.1016/S0378-7206(01)00085-4.
Bock, B. C., Graham, A. L., Sciamanna, C. N., Krishnamoorthy, J., Whiteley, J., Carmona-Barros, R., et al. (2004). Smoking cessation treatment on the Internet: content, quality, and usability. Nicotine & Tobacco Research, 6(2), 207–219. doi:10.1080/14622200410001676332.
Bock, B. C., Graham, A. L., Whiteley, J. A., & Stoddard, J. L. (2008). A review of web-assisted tobacco interventions (WATIs). Journal of Medical Internet Research, 10(5), 45–54. doi:10.2196/jmir.989.
Brouwer, W., Oenema, A., Crutzen, R., de Nooijer, J., de Vries, N. K., & Brug, J. (2008). An exploration of factors related to dissemination of and exposure to Internet-delivered behavior change interventions aimed at adults: a Delphi study approach. Journal of Medical Internet Research, 10(2), 22–31. doi:10.2196/jmir.956.
Brown, J., Michie, S., Geraghty, A. W., Miller, S., Yardley, L., Gardner, B., et al. (2012). A pilot study of StopAdvisor: a theory-based interactive internet-based smoking cessation intervention aimed across the social spectrum. Addictive Behaviors, 37(12), 1365–1370. doi:10.1016/j.addbeh.2012.05.016.
Brunette, M. F., Ferron, J. C., Devitt, T., Geiger, P., Martin, W. M., Pratt, S., et al. (2012). Do smoking cessation websites meet the needs of smokers with severe mental illnesses? Health Education Research, 27(2), 183–190. doi:10.1093/her/cyr092.
Casey, L. M., & Clough, B. A. (2016). Making and keeping the connection: improving consumer attitudes and engagement in e-mental health interventions. In R. Giuseppe, B. K. Wiederhold, & P. Cipresso (Eds.), The psychology of social networking volume 1: Personal experience in online communities (pp. 90–103). Warsaw: De Gruyter Open.
Clough, B. A., & Casey, L. M. (2011). Technological adjuncts to enhance current psychotherapy practices: a review. Clinical Psychology Review, 31(3), 279–292. doi:10.1016/j.cpr.2010.12.008.
Clough, B. A., & Casey, L. M. (2015). Smart designs for smart technologies: research challenges and emerging solutions for scientist-practitioners within e-mental health. Professional Psychology: Research and Practice, 46(6), 429–436. doi:10.1037/pro0000053.
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2013). Developing and evaluating complex interventions: the new medical research council guidance. International Journal of Nursing Studies, 50(5), 587–592. doi:10.1136/bmj.a1655.
Danaher, B. G., McKay, H., & Seeley, J. R. (2005). The information architecture of behavior change websites. Journal of Medical Internet Research, 7(2), e12. Retrieved from. doi:10.2196/jmir.7.2.e12.
Degenhardt, L., Coffey, C., Moran, P., Carlin, J.B., & Patton, G.C. (2007) The predictors and consequences of adolescent amphetamine use: findings from the Victoria Adolescent Health Cohort Study. Addiction, 102(7), 1076–1084. doi:10.1111/j.1360-0443.2007.01839.x.
Duffy, B., Smith, K., Terhanian, G., & Bremer, J. (2005). Comparing data from online and face-to-face surveys. International Journal of Market Research, 47(6), 615–639 Retrieved from https://www.mrs.org.uk/ijmr.
Dulin, P. L., Gonzalez, V. M., & Campbell, K. (2014). Results of a pilot test of a self-administered smartphone-based treatment system for alcohol use disorders: usability and early outcomes. Substance Abuse, 35(2), 168–175. doi:10.1080/08897077.2013.821437.
Ferron, J. C., Brunette, M. F., McHugo, G. J., Devitt, T. S., Martin, W. M., & Drake, R. E. (2011). Developing a quit smoking website that is usable by people with severe mental illnesses. Psychiatric Rehabilitation Journal, 35(2), 111–116. doi:10.2975/35.2.2011.111.116.
Hallett, J., Maycock, B., Kypri, K., Howat, P., & McManus, A. (2009). Development of a Web-based alcohol intervention for university students: processes and challenges. Drug and Alcohol Review, 28(1), 31–39. doi:10.1111/j.1465-3362.2008.00008.x.
Hirakis, E., & Casey, L.M. (2011). Beating the rush. Retrieved from www.beatingtherush.com.au.
Home Office. (2015). Drug misuse: findings from the 2014 to 2015 Crime Survey for England and Wales. Retrieved July 6, 2015, from https://www.gov.uk/government/statistics/drug-misuse-findings-from-the-2014-to-2015-csew.
Houston, T. K., & Ford, D. E. (2008). A tailored Internet-delivered intervention for smoking cessation designed to encourage social support and treatment seeking: usability testing and user tracing. Informatics for Health & Social Care, 33(1), 5–19. doi:10.1080/14639230701842240.
International Organization for Standardization. (1998). Ergonomic requirements for office work with visual display terminals—Part II: Guidance on usability (ISO 9241–11). Retrieved May 3, 2016, from https://www.iso.org/standard/16883.html.
Kay-Lambkin, F. J. (2008). Technology and innovation in the psychosocial treatment of methamphetamine use, risk and dependence. Drug and Alcohol Review, 27(3), 318–325. doi:10.1080/09595230801914768.
Kelly, E., McKetin, R., & McLaren, J. (2005). Health service utilisation among regular methamphetamine users (Technical Report No. 233). Retrieved September 1, 2015, from National Drug and Alcohol Research Centre: https://ndarc.med.unsw.edu.au/resource/health-service-utilisation-among-regular-methamphetamine-users.
Kenny, P., Harney, A., Lee, N. K., & Pennay, A. (2011). Treatment utilization and barriers to treatment: results of a survey of dependent methamphetamine users. Substance Abuse Treatment, Prevention, and Policy, 6(3). doi:10.1186/1747-597X-6-3.
King, V. L., Stoller, K. B., Kidorf, M., Kindbom, K., Hursh, S., Brady, T., & Brooner, R. K. (2009). Assessing the effectiveness of an Internet-based videoconferencing platform for delivering intensified substance abuse counseling. Journal of Substance Abuse Treatment, 36(3), 331–338. doi:10.1016/j.jsat.2008.06.011.
Kitzinger, J. (1994). The methodology of focus groups: the importance of interaction between research participants. Sociology of Health, 16(1), 103–121. doi:10.1111/1467-9566.ep11347023.
Klein, B., White, A., Kavanagh, D., Shandley, K., Kay-Lambkin, F., Proudfoot, J., et al. (2010). Content and functionality of alcohol and other drug websites: results of an online survey. Journal of Medical Internet Research, 12(5), 62–73. doi:10.2196/jmir.1449.
Koohang, A., & Weiss, E. (2003). Effect of prior experience with the Internet on graduate students’ perception toward courseware usability and web-based distance learning instruction: an exploratory study in a hybrid instruction environment. Issues in Information Systems, 4(2), 535–542 Retrieved from http://www.iacis.org/iis/iis.php.
Lankshear, A. J. (1993). The use of focus groups in a study of attitudes to student nurse assessment. Journal of Advanced Nursing, 18(12), 1986–1989. doi:10.1046/j.1365-2648.1993.18121986.x.
Lenert, L., Munoz, R., Stoddard, J., Delucchi, K., Bansod, A., Skoczen, S., & Perez-Stable, E. (2003). Design and pilot evaluation of an Internet smoking cessation program. Journal of the American Medical Informatics Association, 10(1), 16–20. doi:10.1197/jamia.M1128.
McKetin, R., McLaren, J., & Kelly, E. (2005a). The dynamics of the Sydney methamphetamine market: an overview of supply, use patterns, harms and social consequences (Monograph series no. 13). Retrieved September 1, 2015, from National Drug Law Enforcement Research Fund website: http://www.ndlerf.gov.au/publications/monographs/monograph-13.
McKetin, R., McLaren, J., Kelly, E., Hall, W., & Hickman, M. (2005b). Estimating the number of regular and dependent methamphetamine users in Australia. (Technical report no. 230). Retrieved September 1, 2015, from National Drug and Alcohol Research Centre website: https://ndarc.med.unsw.edu.au/resource/estimating-number-regular-and-dependent-methamphetamine-users-australia.
McKetin, R., McLaren, J., Lubman, D. I., & Hides, L. (2006). The prevalence of psychotic symptoms among methamphetamine users. Addiction, 101(10), 1473–1478. doi:10.1111/j.1360-0443.2006.01496.x.
Moock, J. (2014). Support from the internet for individuals with mental disorders: advantages and disadvantages of e-mental health service delivery. Frontiers in Public Health, 2, 65. doi:10.3389/fpubh.2014.00065.
Napolitano, M. A., Fotheringham, M., Tate, D., Sciamanna, C., Leslie, E., Owen, N., et al. (2003). Evaluation of an Internet-based physical activity intervention: a preliminary investigation. Annals of Behavioral Medicine, 25(2), 92–99. doi:10.1207/S15324796ABM2502_04.
Nielsen, J., & Levy, J. (1994). Measuring usability: preference vs. performance. Communications of the ACM, 37(4), 66–75. doi:10.1145/175276.175282.
Office for National Statistics. (2015). Internet access—households and individuals 2015. Retrieved July 6, 2015, from http://www.ons.gov.uk/peoplepopulationandcommunity/householdcharacteristics/homeinternetandsocialmediausage/bulletins/internetaccesshouseholdsandindividuals/2015-08-06
Pennay, A. E., & Lee, N. K. (2009). Barriers to methamphetamine withdrawal treatment in Australia: findings from a survey of AOD service providers. Drug and Alcohol Review, 28(6), 636–640. doi:10.1111/j.1465-3362.2009.00074.x.
Perrin, A., & Duggan, M. (2015). Americans' internet access: 2000–2015: as internet use nears saturation for some groups, a look at patterns of adoption. Retrieved July 6, 2015, from Pew Research Centre website:http://www.pewinternet.org/2015/06/26/americans-internet-access-2000-2015/.
Ramsay, J., Barbesi, A., & Preece, J. (1998). A psychological investigation of long retrieval times on the World Wide Web. Interacting with Computers, 10(1), 77–86. doi:10.1016/S0953-5438(97)00019-2.
Sillence, E., Briggs, P., Harris, P., & Fishwick, L. (2007). Going online for health advice: changes in usage and trust practices over the last five years. Interacting with Computers, 19(3), 397–406. doi:10.1016/j.intcom.2006.10.002.
Stafford, J., & Breen, C. (2016). Australian Drug Trends 2015. Findings from the Illicit Drug Reporting System (IDRS). Australian Drug Trend Series. No. 145. Retrieved April 30, 2017, from National Drug and Alcohol Research Centre website: https://ndarc.med.unsw.edu.au/sites/default/files/ndarc/resources/AUSTRALIAN_IDRS_2015_0.pdf.
Stoddard, J. L., Augustson, E. M., & Mabry, P. L. (2006). The importance of usability testing in the development of an internet-based smoking cessation treatment resource. Nicotine & Tobacco Research, 8(Suppl 1), S87–S93. doi:10.1080/14622200601048189.
Strecher, V. J., Shiffman, S., & West, R. (2006). Moderators and mediators of a web-based computer-tailored smoking cessation program among nicotine patch users. Nicotine & Tobacco Research, 8(Suppl 1), S95–S101. doi:10.1080/14622200601039444.
Strecher, V. J., McClure, J., Alexander, G., Chakraborty, B., Nair, V., Konkel, J., et al. (2008). The role of engagement in a tailored web-based smoking cessation program: randomized controlled trial. Journal of Medical Internet Research, 10(5), 23–32. doi:10.2196/jmir.1002.
Substance Abuse and Mental Health Services Administration. (2013). Results from the 2012 national survey on drug use and health: summary of national findings (NSDUH Series H-46, HHS Publication No. (SMA) 13–4795). Retrieved July 6, 2015, from http://www.samhsa.gov/data/sites/default/files/NSDUHresults2012/NSDUHresults2012.pdf.
Tait, R. J., McKetin, R., Kay-Lambkin, F., Carron-Arthur, B., Bennett, A., Bennett, K., et al. (2015). Six-month outcomes of a web-based intervention for users of amphetamine-type stimulants: randomized controlled trial. Journal of Medical Internet Research, 17(4), e105. doi:10.2196/jmir.3778.
Tognolli, G., Marcatto, F., Plet, S., Struzzo, P., Wallace, P., & Ferrante, D. (2014). Usability testing of a website about alcohol and health: a case study. Paper presented at the TSPC2014: Proceedings of the Trieste Symposium on Perception and Cognition, Trieste. Retrieved May 3, 2016, from http://www.openstarts.units.it/dspace/handle/10077/10543.
United Nations Office on Drugs and Crime. (2016). World drug report 2016 (United Nations publication, Sales No. E.16.XI.7). Retrieved June 7, 2016, from http://www.unodc.org/wdr2016/.
Westrup, D., Futa, K. T., Whitsell, S. D., Mussman, L., Wanat, S. F., Koopman, C., et al. (2003). Employees’ reactions to an interactive website assessing alcohol use and risk for alcohol dependence, stress level and coping. Journal of Substance Use, 8(2), 104–111. doi:10.1080/1465989031000109789.
White, A., Kavanagh, D., Stallman, H., Klein, B., Kay-Lambkin, F., Proudfoot, J., et al. (2010). Online alcohol interventions: a systematic review. Journal of Medical Internet Research, 12(5), 160–171. doi:10.2196/jmir.1479.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
All procedures followed were in accordance with the ethical standards of the responsible committee on human experimentation (institutional and national) and with the Helsinki Declaration of 1975, as revised in 2000.
Conflict of Interest
The authors declare that they have no conflict of interest.
Informed Consent
Informed consent was obtained from all patients for being included in the study.
Rights and permissions
About this article
Cite this article
Hirakis, E., Casey, L.M. & Clough, B.A. Investigating Website Usability: Enhancing Engagement of Amphetamine Users in Online Treatment. Int J Ment Health Addiction 16, 420–435 (2018). https://doi.org/10.1007/s11469-017-9796-1
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11469-017-9796-1