Abstract
Problematic anger as a symptom of posttraumatic stress disorder (PTSD) is prevalent in military populations, including Veterans. Existing anger management programs may be underutilized due to barriers to accessing standard care. Mobile applications (apps) for anger management could increase access to care while using minimal resources. The current mixed-methods pilot study evaluated the satisfaction and helpfulness of the Anger and Irritability Management Skills (AIMS) app, a self-manageable mobile app developed by the VA’s National Center for PTSD for individuals struggling with anger. Veterans (N = 23) were recruited from the women’s (n = 6) and men’s (n = 15) residential Trauma Recovery Program at the VA Palo Alto Health Care System. Participants completed the Anger Expression Index (AEI) before and after using AIMS in a self-directed manner for 3 weeks. After 3 weeks, they also completed a satisfaction survey and participated in a qualitative focus group to share experiences and opinions about the app to inform future app updates. Paired samples t-tests were used to examine changes in AEI scores. Descriptive statistics were used to examine the perceived helpfulness of AIMS. Qualitative data were examined using Rapid Qualitative Analysis and themes were identified using matrix analysis. Perceived helpfulness of the AIMS app was rated, on average, between moderately to very helpful, and app satisfaction was rated between moderately to very satisfied. AEI scores significantly reduced from pre- to post-app use. Qualitative results revealed four themes: (1) symptom monitoring, (2) tailoring app use to fit users’ needs, (3) potential as a self-management resource, and (4) potential as a supplement to care. Participants generally perceived AIMS to be helpful for managing their anger and they were satisfied with the app, indicating preliminary acceptability and helpfulness of the app. Future studies with a larger sample size to explore novel ways to increase app dissemination efforts and explore using AIMS in other healthcare settings are warranted.
Similar content being viewed by others
Data Availability
Data is available upon request sent to Carmen.McLean4@va.gov.
References
Adler, A. B., LeardMann, C. A., Villalobos, J., Jacobson, I. G., Forbes, D., & Millennium Cohort Study Team. (2022). Association of problematic anger with long-term adjustment following the military-to-civilian transition. JAMA Network Open, 5(7), e2223236. https://doi.org/10.1001/jamanetworkopen.2022.23236
Alqahtani, F., & Orji, R. (2020). Insights from user reviews to improve mental health apps. Health Informatics Journal, 26(3), 2042–2066. https://doi.org/10.1177/1460458219896492
Averill, J. B. (2002). Matrix analysis as a complementary analytic strategy in qualitative inquiry. Qualitative Health Research, 12(6), 855–866. https://doi.org/10.1177/104973230201200611
Dillon, K. H., Hertzberg, J. A., Mosher, T. M., Levi, R. D., Elbogen, E. B., Calhoun, P. S., Morland, L. A., & Beckham, J. C. (2023). Development and refinement of the mobile anger reduction intervention for veterans with posttraumatic stress disorder. Psychological Trauma: Theory, Research, Practice and Policy. [Advance Online Publication]. https://doi.org/10.1037/tra0001491
Forbes, D., Hawthorne, G., Elliott, P., McHugh, T., Biddle, D., Creamer, M., & Novaco, R. W. (2004). A concise measure of anger in combat-related posttraumatic stress disorder. Journal of Traumatic Stress, 17(3), 249–256. https://doi.org/10.1023/B:JOTS.0000029268.22161.bd
Forbes, D., Metcalf, O., Lawrence-Wood, E., & Adler, A. B. (2022). Problematic anger in the military: Focusing on the forgotten emotion. Current Psychiatry Reports, 24(12), 789–797. https://doi.org/10.1007/s11920-022-01380-x
Gould, C. E., Loup, J., Kuhn, E., Beaudreau, S. A., Ma, F., Goldstein, M. K., Loebach Wetherell, J., Zapata, A. L., Chloe, P., & O’Hara, R. (2020). Technology use and preferences for mental health self management interventions among older veterans. International Journal of Geriatric Psychiatry., 35(3), 321–330. https://doi.org/10.1002/330gps.5252
Greene, C., Reilly, P., Lai, W., & Weingardt, K. R. (2014). Anger and Irritability Management Skills (Version 1.0). https://www.veterantraining.va.gov/aims/
Guracho, Y., Susan, J., & Than, W. (2023). Smartphone application use patterns for mental health disorders: A systematic literature review and meta-analysis. International Journal of Medical Informatics, 179, 105217. https://doi.org/10.1016/j.ijmedinf.2023.105217
Hamilton, A. B. (2013). Qualitative Methods in Rapid Turn-Around Health Services Research. https://www.hsrd.research.va.gov/for_researchers/cyber_seminars/archives/video_archive.cfm?SessionID=780
Hamilton, A. B., & Finley, E. P. (2019). Qualitative methods in implementation research: An introduction. Psychiatry Research, 280, 112516. https://doi.org/10.1016/j.psychres.2019.112516
Hoffman, J., Ramsey, K. M., Jaworski, B. K., Jimenez, J., & Greene, C. J. (2015a). Anger and Irritability Management System (AIMS) (Version 1.7.2) [Mobile application software]. Mobile Mental Health. https://play.google.com/store/apps/details?id=gov.va.mobilehealth.ncptsd.aims
Hoffman, J., Ramsey, K. M., Jaworski, B. K., Jimenez, J., & Greene, C. J. (2015b). Anger and Irritability Management System (AIMS) (Version 1.7.2) [Mobile application software]. Mobile Mental Health. https://itunes.apple.com/us/app/anger-and-irritability-management-skills-aims/id1243035440?mt=8
Jaworski, C. C., Geslin, B., Zakardjian, M., Lecareux, C., Caillault, P., Nève, G., Meunier, J.-Y., Dupouyet, S., Sweeney, A. C. T., Lewis, O. T., Dicks, L. V., & Fernandez, C. (2022). Long-term experimental drought alters floral scent and pollinator visits in a Mediterranean plant community despite overall limited impacts on plant phenotype and reproduction. Journal of Ecology, 110(11), 2628–2648. https://doi.org/10.1111/1365-2745.13974
Kalkstein, S., Scott, J. C., Vickers Smith, R., & Cruz, J. (2018). Effectiveness of an anger control program among veterans with PTSD and other mental health issues: A comparative study. Journal of Clinical Psychology, 74(9), 1422–1430. https://doi.org/10.1002/jclp.22631
Kuhn, E., Greene, C., Hoffman, J., Nguyen, T., Wald, L., Schmidt, J., Ramsey, K. M., & Ruzek, J. (2014). Preliminary evaluation of PTSD coach, a smartphone app for post-traumatic stress symptoms. Military Medicine, 179(1), 12–18. https://doi.org/10.7205/MILMED-D-13-00271
Mackintosh, M.-A., Niehaus, J., Taft, C. T., Marx, B. P., Grubbs, K., & Morland, L. A. (2017). Using a mobile application in the treatment of dysregulated anger among veterans. Military Medicine, 182(11), e1941–e1949. https://doi.org/10.7205/MILMED-D-17-00063
Metcalf, O., Finlayson-Short, L., Forbes, D., O’Donnell, M. L., & Varker, T. (2023). A systematic review of treatments for problem anger in veteran and military populations with PTSD. Aggression and Violent Behavior, 70, 101837. https://doi.org/10.1016/j.avb.2023.101837
Miller, M. L., Davis, C. A., & McLean, C. P. (2023). Perceptions and experiences of renew: An exposure-based mobile app for posttraumatic stress. Journal of Technology in Behavioral Science, 1–13. https://doi.org/10.1007/s41347-023-00358-7
Miller, M. L., Davis, A. C., & McLean, C. P. (2022). Development and pilot testing of a trauma-focused cognitive-behavioral self-management mobile app for post-traumatic stress symptoms. Journal of Technology in Behavioral Science, 7(1), 63–72.
Morland, L. A., Greene, C. J., Rosen, C. S., Foy, D., Reilly, P., Shore, J., He, Q., & Frueh, C. (2010). Telemedicine for anger management therapy in a rural population of combat veterans with posttraumatic stress disorder: A randomized noninferiority trial. The Journal of Clinical Psychiatry, 71(07), 855–863. https://doi.org/10.4088/JCP.09m05604blu
Morland, L. A., Greene, C. J., Rosen, C. S., Kuhn, E., Hoffman, J., & Sloan, D. M. (2017). Telehealth and eHealth interventions for posttraumatic stress disorder. Current Opinion in Psychology, 14, 102–108. https://doi.org/10.1016/j.copsyc.2016.12.003
Morland, L. A., Love, A. R., Mackintosh, M., Greene, C. J., & Rosen, C. S. (2012). Treating anger and aggression in military populations: Research updates and clinical implications. Clinical Psychology: Science and Practice, 19(3), 305–322. https://doi.org/10.1111/cpsp.12007
Morland, L. A., Niehaus, J., Taft, C., Marx, B. P., Menez, U., & Mackintosh, M.-A. (2016). Using a mobile application in the management of anger problems among veterans: A pilot study. Military Medicine, 181(9), 990–995. https://doi.org/10.7205/MILMED-D-15-00293
Novaco, R. W. (1976). The functions and regulation of the arousal of anger. American Journal of Psychiatry, 133(10), 1124–1128.
Novaco, R., Swanson, R., Gonzalez, O., Gahm, G., & Reger, M. (2012). Anger and Postcombat Mental Health: Validation of a brief anger measure with U.S. soldiers postdeployed from Iraq and Afghanistan. Psychological Assessment, 24, 661–675. https://doi.org/10.1037/a0026636
Orth, U., & Wieland, E. (2006). Anger, hostility, and posttraumatic stress disorder in trauma-exposed adults: A meta-analysis. Journal of Consulting and Clinical Psychology, 74(4), 698–706. https://doi.org/10.1037/0022-006X.74.4.698
Owen, J. E., Kuhn, E., Jaworski, B. K., McGee-Vincent, P., Juhasz, K., Hoffman, J. E., & Rosen, C. (2018). VA mobile apps for PTSD and related problems: Public health resources for veterans and those who care for them. Mhealth, 4. https://doi.org/10.21037/mhealth.2018.05.07
Owen, J. E., Kuhn, E., Jamison, A., Ramsey, K. M., Taylor, K., Heinz, A., Senti, S., Moraja, G., Romano, D., Mackintosh, M.-A., Davis, A., Backet-Davenport, C., Bosch, J., Reyes, S., McGee-Vincent, P., McCaslin, S., Hampole, S., Hallenbeck, H., Wielgosz, J., Stanley, L., Thelemaque, L., Jaworski, B., Nazem, S., & Rosen, C. S. (2024). The NCPTSD model for digital mental health: A public sector approach to development, evaluation, and implementation of resources for helping trauma survivors. [Manuscript submitted for publication].
Peterson, A. L., Young-McCaughan, S., Roache, J. D., Mintz, J., Litz, B. T., Williamson, D. E., Resick, P. A., Foa, E. B., McGeary, D. D., Dondanville, K. A., Taylor, D. J., Wachen, J. S., Fox, P. T., Bryan, C. J., McLean, C. P., Pruiksma, K. E., Yarvis, J. S., Niles, B. L., Abdallah, C. G., … Keane, T. M. (2021). STRONG STAR and the Consortium to Alleviate PTSD: Shaping the future of combat PTSD and related conditions in military and veteran populations. Contemporary Clinical Trials, 110, 106583. https://doi.org/10.1016/j.cct.2021.106583
Reger, G. M., Harned, M., Stevens, E. S., Porter, S., Nguyen, J., & Norr, A. M. (2022). Mobile applications may be the future of veteran mental health support but do veterans know yet? A survey of app knowledge and use. Psychological Services, 19(3), 480–487. https://doi.org/10.1037/ser0000562
Reilly, P. M., Shopshire, M. S., Durazzo, T. C., & Campbell, T. A. (2019). Anger management for substance use disorder and mental health clients: Participant workbook. https://store.samhsa.gov/sites/default/files/d7/priv/anger_management_workbook_508_compliant.pdf
Rosen, C., Adler, E., & Tiet, Q. (2013). Presenting concerns of veterans entering treatment for posttraumatic stress disorder. Journal of Traumatic Stress, 26(5), 640–643. https://doi.org/10.1002/jts.21841
Spielberger, C. D. (1999). State-Trait Anger Expression Inventory 2. https://www.parinc.com/Products/Pkey/429
Spielberger, C. D., & Reheiser, E. C. (2004). Measuring anxiety, anger, depression, and curiosity as emotional states and personality traits with the STAI, STAXI and STPI. In Comprehensive handbook of psychological assessment, Vol. 2: Personality assessment. John Wiley & Sons, Inc.
Taft, C., Watkins, L., Stafford, J., Street, A., & Monson, C. (2011). Posttraumatic stress disorder and intimate relationship problems: A meta-analysis. Journal of Consulting and Clinical Psychology, 79, 22–33. https://doi.org/10.1037/a0022196
Tanielian T. L., Jaycox L. (2008). Invisible wounds of war: psychological and cognitive injuries, their consequences, and services to assist recovery. RAND Center for Military Health Policy Research. Santa Monica, CA.
Tong, Y., Mo, W., & Sun, Y. (2023). Emovo: A real-time anger detector on the smartphone using acoustic signal. [Conference Proceedings]. In Proceedings of the 16th International Conference on PErvasive Technologies Related to Assistive Environments. https://doi.org/10.1145/3594806.3594833
Varker, T., Cowlishaw, S., Baur, J., McFarlane, A. C., Lawrence-Wood, E., Metcalf, O., Van Hooff, M., Sadler, N., O’Donnell, M. L., Hodson, S., Benassi, H., & Forbes, D. (2022). Problem anger in veterans and military personnel: Prevalence, predictors, and associated harms of suicide and violence. Journal of Psychiatric Research, 151, 57–64. https://doi.org/10.1016/j.jpsychires.2022.04.004
Vasterling, J. J. (2008). Posttraumatic stress disorder and health functioning in a non-treatment-seeking sample of Iraq war veterans: A prospective analysis. The Journal of Rehabilitation Research and Development, 45(3), 347–358. https://doi.org/10.1682/JRRD.2007.05.0077
Wells, S. Y., Patel, T. A., Halverson, T. F., LoSavio, S. T., Morland, L. A., Wachsman, T., Ponzini, G. T., Kelton, K., Mackintosh, M., Powell, A., Kaplan, S. & Dillon, K. H. (2024). The impact of trauma-focused psychotherapies on anger: A systematic review and meta-analysis. Psychological Trauma: Theory, Research, Practice, and Policy. Advance Online Publication. https://doi-org.stanford.idm.oclc.org/10.1037/tra0001697
Acknowledgements
The authors would like to acknowledge Dr. Robert Jenkins, Men’s Trauma Recovery Program Coordinator, and Dr. Jean Cooney, Women’s Trauma Recovery Program Coordinator, at VA Menlo Park, for assisting us with participant scheduling and recruitment.
Funding
This material is the result of work supported with resources and the use of facilities at the VA Palo Alto Health Care System.
Author information
Authors and Affiliations
Contributions
Carmen McLean contributed to study conception and design. Material preparation and data collection were performed by Nadia Malek. All authors contributed to data analysis and interpretation. The draft of the manuscript was written by Nadia Malek and all authors contributed to manuscript revisions. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics Approval
Approval for this study was granted by the Stanford University Institutional Review Board.
Consent to Participate
Informed consent was obtained from all individual participants included in the study.
Conflict of Interest
The authors declare no conflict of interests.
Disclaimer
The views expressed in this article are solely those of the authors and do not reflect an endorsement by, or the offical policy of the Department of Veteran Affairs (VA) or the U.S. Government. This material is the result of work supported with resources and the use of facilities at the VA Palo Alto Health Care System.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Malek, N., Hampole, S., Mackintosh, MA. et al. Acceptability and Feasibility of the Anger and Irritability Management Skills Mobile App Among Veterans with Posttraumatic Stress Disorder: A Mixed-Methods Pilot Study. J. technol. behav. sci. (2024). https://doi.org/10.1007/s41347-024-00426-6
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s41347-024-00426-6