Skip to main content

Advertisement

Log in

Investigating Website Usability: Enhancing Engagement of Amphetamine Users in Online Treatment

  • Original Article
  • Published:
International Journal of Mental Health and Addiction Aims and scope Submit manuscript

Abstract

Online interventions may offer a means of overcoming barriers experienced in face-to-face treatment for amphetamine use. Usability testing allows a website’s capacity to engage the targeted population to be optimised. This study evaluated the usability of an amphetamine treatment website (www.beatingtherush.com.au) and explored health professionals’ and amphetamine users’ Internet access and use. Eleven health professionals and 10 amphetamine users viewed the website and provided quantitative and qualitative feedback. All health professionals and 90% of amphetamine users had Internet access. All health professionals and 80% of amphetamine users felt comfortable and confident using the Internet. However, 40% of amphetamine users reported not using the Internet to obtain information about alcohol and drugs. Participants provided positive feedback regarding usability of the website, as well as areas for improvement. This study addressed usability issues prior to evaluating the effectiveness of the website, enabling modification of design features to enhance the user experience of the website.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Australian Bureau of Statistics. (2014). Household use of information technology, Australia 2012–13 (cat. no. 8146.0). Retrieved April 14, 2015, from http://www.abs.gov.au/ausstats/abs@.nsf/Lookup/8146.0Chapter12012-13.

  • Australian Institute of Health and Welfare. (2014). National drug strategy household survey detailed report 2013. Drug statistics series no. 28. (cat. no. PHE 183). Retrieved April 14, 2015, from http://www.aihw.gov.au/publication-detail/?id=60129549469.

  • Benhunan-Fich, R. (2001). Using protocol analysis to evaluate the usability of a commercial web site. Information Management, 39, 151–163. doi:10.1016/S0378-7206(01)00085-4.

    Article  Google Scholar 

  • Bock, B. C., Graham, A. L., Sciamanna, C. N., Krishnamoorthy, J., Whiteley, J., Carmona-Barros, R., et al. (2004). Smoking cessation treatment on the Internet: content, quality, and usability. Nicotine & Tobacco Research, 6(2), 207–219. doi:10.1080/14622200410001676332.

    Article  Google Scholar 

  • Bock, B. C., Graham, A. L., Whiteley, J. A., & Stoddard, J. L. (2008). A review of web-assisted tobacco interventions (WATIs). Journal of Medical Internet Research, 10(5), 45–54. doi:10.2196/jmir.989.

    Article  Google Scholar 

  • Brouwer, W., Oenema, A., Crutzen, R., de Nooijer, J., de Vries, N. K., & Brug, J. (2008). An exploration of factors related to dissemination of and exposure to Internet-delivered behavior change interventions aimed at adults: a Delphi study approach. Journal of Medical Internet Research, 10(2), 22–31. doi:10.2196/jmir.956.

    Article  Google Scholar 

  • Brown, J., Michie, S., Geraghty, A. W., Miller, S., Yardley, L., Gardner, B., et al. (2012). A pilot study of StopAdvisor: a theory-based interactive internet-based smoking cessation intervention aimed across the social spectrum. Addictive Behaviors, 37(12), 1365–1370. doi:10.1016/j.addbeh.2012.05.016.

    Article  PubMed  Google Scholar 

  • Brunette, M. F., Ferron, J. C., Devitt, T., Geiger, P., Martin, W. M., Pratt, S., et al. (2012). Do smoking cessation websites meet the needs of smokers with severe mental illnesses? Health Education Research, 27(2), 183–190. doi:10.1093/her/cyr092.

    Article  PubMed  Google Scholar 

  • Casey, L. M., & Clough, B. A. (2016). Making and keeping the connection: improving consumer attitudes and engagement in e-mental health interventions. In R. Giuseppe, B. K. Wiederhold, & P. Cipresso (Eds.), The psychology of social networking volume 1: Personal experience in online communities (pp. 90–103). Warsaw: De Gruyter Open.

  • Clough, B. A., & Casey, L. M. (2011). Technological adjuncts to enhance current psychotherapy practices: a review. Clinical Psychology Review, 31(3), 279–292. doi:10.1016/j.cpr.2010.12.008.

    Article  PubMed  Google Scholar 

  • Clough, B. A., & Casey, L. M. (2015). Smart designs for smart technologies: research challenges and emerging solutions for scientist-practitioners within e-mental health. Professional Psychology: Research and Practice, 46(6), 429–436. doi:10.1037/pro0000053.

    Article  Google Scholar 

  • Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2013). Developing and evaluating complex interventions: the new medical research council guidance. International Journal of Nursing Studies, 50(5), 587–592. doi:10.1136/bmj.a1655.

    Article  PubMed  Google Scholar 

  • Danaher, B. G., McKay, H., & Seeley, J. R. (2005). The information architecture of behavior change websites. Journal of Medical Internet Research, 7(2), e12. Retrieved from. doi:10.2196/jmir.7.2.e12.

    Article  PubMed  PubMed Central  Google Scholar 

  • Degenhardt, L., Coffey, C., Moran, P., Carlin, J.B., & Patton, G.C. (2007) The predictors and consequences of adolescent amphetamine use: findings from the Victoria Adolescent Health Cohort Study. Addiction, 102(7), 1076–1084. doi:10.1111/j.1360-0443.2007.01839.x.

  • Duffy, B., Smith, K., Terhanian, G., & Bremer, J. (2005). Comparing data from online and face-to-face surveys. International Journal of Market Research, 47(6), 615–639 Retrieved from https://www.mrs.org.uk/ijmr.

    Article  Google Scholar 

  • Dulin, P. L., Gonzalez, V. M., & Campbell, K. (2014). Results of a pilot test of a self-administered smartphone-based treatment system for alcohol use disorders: usability and early outcomes. Substance Abuse, 35(2), 168–175. doi:10.1080/08897077.2013.821437.

    Article  PubMed  PubMed Central  Google Scholar 

  • Ferron, J. C., Brunette, M. F., McHugo, G. J., Devitt, T. S., Martin, W. M., & Drake, R. E. (2011). Developing a quit smoking website that is usable by people with severe mental illnesses. Psychiatric Rehabilitation Journal, 35(2), 111–116. doi:10.2975/35.2.2011.111.116.

    Article  PubMed  Google Scholar 

  • Hallett, J., Maycock, B., Kypri, K., Howat, P., & McManus, A. (2009). Development of a Web-based alcohol intervention for university students: processes and challenges. Drug and Alcohol Review, 28(1), 31–39. doi:10.1111/j.1465-3362.2008.00008.x.

    Article  PubMed  Google Scholar 

  • Hirakis, E., & Casey, L.M. (2011). Beating the rush. Retrieved from www.beatingtherush.com.au.

  • Home Office. (2015). Drug misuse: findings from the 2014 to 2015 Crime Survey for England and Wales. Retrieved July 6, 2015, from https://www.gov.uk/government/statistics/drug-misuse-findings-from-the-2014-to-2015-csew.

  • Houston, T. K., & Ford, D. E. (2008). A tailored Internet-delivered intervention for smoking cessation designed to encourage social support and treatment seeking: usability testing and user tracing. Informatics for Health & Social Care, 33(1), 5–19. doi:10.1080/14639230701842240.

    Article  Google Scholar 

  • International Organization for Standardization. (1998). Ergonomic requirements for office work with visual display terminals—Part II: Guidance on usability (ISO 9241–11). Retrieved May 3, 2016, from https://www.iso.org/standard/16883.html.

  • Kay-Lambkin, F. J. (2008). Technology and innovation in the psychosocial treatment of methamphetamine use, risk and dependence. Drug and Alcohol Review, 27(3), 318–325. doi:10.1080/09595230801914768.

    Article  PubMed  Google Scholar 

  • Kelly, E., McKetin, R., & McLaren, J. (2005). Health service utilisation among regular methamphetamine users (Technical Report No. 233). Retrieved September 1, 2015, from National Drug and Alcohol Research Centre: https://ndarc.med.unsw.edu.au/resource/health-service-utilisation-among-regular-methamphetamine-users.

  • Kenny, P., Harney, A., Lee, N. K., & Pennay, A. (2011). Treatment utilization and barriers to treatment: results of a survey of dependent methamphetamine users. Substance Abuse Treatment, Prevention, and Policy, 6(3). doi:10.1186/1747-597X-6-3.

  • King, V. L., Stoller, K. B., Kidorf, M., Kindbom, K., Hursh, S., Brady, T., & Brooner, R. K. (2009). Assessing the effectiveness of an Internet-based videoconferencing platform for delivering intensified substance abuse counseling. Journal of Substance Abuse Treatment, 36(3), 331–338. doi:10.1016/j.jsat.2008.06.011.

    Article  PubMed  Google Scholar 

  • Kitzinger, J. (1994). The methodology of focus groups: the importance of interaction between research participants. Sociology of Health, 16(1), 103–121. doi:10.1111/1467-9566.ep11347023.

    Article  Google Scholar 

  • Klein, B., White, A., Kavanagh, D., Shandley, K., Kay-Lambkin, F., Proudfoot, J., et al. (2010). Content and functionality of alcohol and other drug websites: results of an online survey. Journal of Medical Internet Research, 12(5), 62–73. doi:10.2196/jmir.1449.

    Article  Google Scholar 

  • Koohang, A., & Weiss, E. (2003). Effect of prior experience with the Internet on graduate students’ perception toward courseware usability and web-based distance learning instruction: an exploratory study in a hybrid instruction environment. Issues in Information Systems, 4(2), 535–542 Retrieved from http://www.iacis.org/iis/iis.php.

    Google Scholar 

  • Lankshear, A. J. (1993). The use of focus groups in a study of attitudes to student nurse assessment. Journal of Advanced Nursing, 18(12), 1986–1989. doi:10.1046/j.1365-2648.1993.18121986.x.

    Article  CAS  PubMed  Google Scholar 

  • Lenert, L., Munoz, R., Stoddard, J., Delucchi, K., Bansod, A., Skoczen, S., & Perez-Stable, E. (2003). Design and pilot evaluation of an Internet smoking cessation program. Journal of the American Medical Informatics Association, 10(1), 16–20. doi:10.1197/jamia.M1128.

    Article  PubMed  PubMed Central  Google Scholar 

  • McKetin, R., McLaren, J., & Kelly, E. (2005a). The dynamics of the Sydney methamphetamine market: an overview of supply, use patterns, harms and social consequences (Monograph series no. 13). Retrieved September 1, 2015, from National Drug Law Enforcement Research Fund website: http://www.ndlerf.gov.au/publications/monographs/monograph-13.

  • McKetin, R., McLaren, J., Kelly, E., Hall, W., & Hickman, M. (2005b). Estimating the number of regular and dependent methamphetamine users in Australia. (Technical report no. 230). Retrieved September 1, 2015, from National Drug and Alcohol Research Centre website: https://ndarc.med.unsw.edu.au/resource/estimating-number-regular-and-dependent-methamphetamine-users-australia.

  • McKetin, R., McLaren, J., Lubman, D. I., & Hides, L. (2006). The prevalence of psychotic symptoms among methamphetamine users. Addiction, 101(10), 1473–1478. doi:10.1111/j.1360-0443.2006.01496.x.

    Article  PubMed  Google Scholar 

  • Moock, J. (2014). Support from the internet for individuals with mental disorders: advantages and disadvantages of e-mental health service delivery. Frontiers in Public Health, 2, 65. doi:10.3389/fpubh.2014.00065.

    Article  PubMed  PubMed Central  Google Scholar 

  • Napolitano, M. A., Fotheringham, M., Tate, D., Sciamanna, C., Leslie, E., Owen, N., et al. (2003). Evaluation of an Internet-based physical activity intervention: a preliminary investigation. Annals of Behavioral Medicine, 25(2), 92–99. doi:10.1207/S15324796ABM2502_04.

    Article  PubMed  Google Scholar 

  • Nielsen, J., & Levy, J. (1994). Measuring usability: preference vs. performance. Communications of the ACM, 37(4), 66–75. doi:10.1145/175276.175282.

    Article  Google Scholar 

  • Office for National Statistics. (2015). Internet access—households and individuals 2015. Retrieved July 6, 2015, from http://www.ons.gov.uk/peoplepopulationandcommunity/householdcharacteristics/homeinternetandsocialmediausage/bulletins/internetaccesshouseholdsandindividuals/2015-08-06

  • Pennay, A. E., & Lee, N. K. (2009). Barriers to methamphetamine withdrawal treatment in Australia: findings from a survey of AOD service providers. Drug and Alcohol Review, 28(6), 636–640. doi:10.1111/j.1465-3362.2009.00074.x.

    Article  PubMed  Google Scholar 

  • Perrin, A., & Duggan, M. (2015). Americans' internet access: 2000–2015: as internet use nears saturation for some groups, a look at patterns of adoption. Retrieved July 6, 2015, from Pew Research Centre website:http://www.pewinternet.org/2015/06/26/americans-internet-access-2000-2015/.

  • Ramsay, J., Barbesi, A., & Preece, J. (1998). A psychological investigation of long retrieval times on the World Wide Web. Interacting with Computers, 10(1), 77–86. doi:10.1016/S0953-5438(97)00019-2.

    Article  Google Scholar 

  • Sillence, E., Briggs, P., Harris, P., & Fishwick, L. (2007). Going online for health advice: changes in usage and trust practices over the last five years. Interacting with Computers, 19(3), 397–406. doi:10.1016/j.intcom.2006.10.002.

    Article  Google Scholar 

  • Stafford, J., & Breen, C. (2016). Australian Drug Trends 2015. Findings from the Illicit Drug Reporting System (IDRS). Australian Drug Trend Series. No. 145. Retrieved April 30, 2017, from National Drug and Alcohol Research Centre website: https://ndarc.med.unsw.edu.au/sites/default/files/ndarc/resources/AUSTRALIAN_IDRS_2015_0.pdf.

  • Stoddard, J. L., Augustson, E. M., & Mabry, P. L. (2006). The importance of usability testing in the development of an internet-based smoking cessation treatment resource. Nicotine & Tobacco Research, 8(Suppl 1), S87–S93. doi:10.1080/14622200601048189.

    Article  Google Scholar 

  • Strecher, V. J., Shiffman, S., & West, R. (2006). Moderators and mediators of a web-based computer-tailored smoking cessation program among nicotine patch users. Nicotine & Tobacco Research, 8(Suppl 1), S95–S101. doi:10.1080/14622200601039444.

  • Strecher, V. J., McClure, J., Alexander, G., Chakraborty, B., Nair, V., Konkel, J., et al. (2008). The role of engagement in a tailored web-based smoking cessation program: randomized controlled trial. Journal of Medical Internet Research, 10(5), 23–32. doi:10.2196/jmir.1002.

    Article  Google Scholar 

  • Substance Abuse and Mental Health Services Administration. (2013). Results from the 2012 national survey on drug use and health: summary of national findings (NSDUH Series H-46, HHS Publication No. (SMA) 13–4795). Retrieved July 6, 2015, from http://www.samhsa.gov/data/sites/default/files/NSDUHresults2012/NSDUHresults2012.pdf.

  • Tait, R. J., McKetin, R., Kay-Lambkin, F., Carron-Arthur, B., Bennett, A., Bennett, K., et al. (2015). Six-month outcomes of a web-based intervention for users of amphetamine-type stimulants: randomized controlled trial. Journal of Medical Internet Research, 17(4), e105. doi:10.2196/jmir.3778.

    Article  PubMed  PubMed Central  Google Scholar 

  • Tognolli, G., Marcatto, F., Plet, S., Struzzo, P., Wallace, P., & Ferrante, D. (2014). Usability testing of a website about alcohol and health: a case study. Paper presented at the TSPC2014: Proceedings of the Trieste Symposium on Perception and Cognition, Trieste. Retrieved May 3, 2016, from http://www.openstarts.units.it/dspace/handle/10077/10543.

  • United Nations Office on Drugs and Crime. (2016). World drug report 2016 (United Nations publication, Sales No. E.16.XI.7). Retrieved June 7, 2016, from http://www.unodc.org/wdr2016/.

  • Westrup, D., Futa, K. T., Whitsell, S. D., Mussman, L., Wanat, S. F., Koopman, C., et al. (2003). Employees’ reactions to an interactive website assessing alcohol use and risk for alcohol dependence, stress level and coping. Journal of Substance Use, 8(2), 104–111. doi:10.1080/1465989031000109789.

    Article  Google Scholar 

  • White, A., Kavanagh, D., Stallman, H., Klein, B., Kay-Lambkin, F., Proudfoot, J., et al. (2010). Online alcohol interventions: a systematic review. Journal of Medical Internet Research, 12(5), 160–171. doi:10.2196/jmir.1479.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Eliana Hirakis.

Ethics declarations

All procedures followed were in accordance with the ethical standards of the responsible committee on human experimentation (institutional and national) and with the Helsinki Declaration of 1975, as revised in 2000.

Conflict of Interest

The authors declare that they have no conflict of interest.

Informed Consent

Informed consent was obtained from all patients for being included in the study.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hirakis, E., Casey, L.M. & Clough, B.A. Investigating Website Usability: Enhancing Engagement of Amphetamine Users in Online Treatment. Int J Ment Health Addiction 16, 420–435 (2018). https://doi.org/10.1007/s11469-017-9796-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11469-017-9796-1

Keywords

Navigation