Abstract
Background
This study aims to provide insight into the specific cognitive constructs that are most strongly correlated with disturbed anger and could guide the development of more effective cognitive-behavioral treatments. The Anger Cognitions Scale-Revised (ACS-R) presents participants with nine scenarios of anger-provoking events and asks them to indicate the degree to which the situations would trigger the experience of seven different cognitive processes: hostile attributions, negative consequences of anger, inflammatory labeling, demandingness, frustration intolerance, awfulizing, and overgeneralization. The current study tested the factor structure and the construct validity of the ACS-R in a diverse sample to examine which cognitive constructs best predict dysfunctional anger and, consequently should be targeted when treating angry clients.
Method
1024 participants with an average age of 20.4 years (SD = 6.15) completed the ACS-R and measures of dysfunctional anger and anger outcomes via online administration.
Results
Confirmatory factor analyses found that ACS-R scores best fit a bifactor model, with 7-factors representing the seven cognitive constructs with a separate set of 9-factors in which items loaded on their respective scenarios. Multiple regression analyses revealed that negative consequences of anger, hostile attributions, and inflammatory labeling contributed more significant variance in models predicting dysfunctional anger.
Discussion
Although additional research should replicate these results, our findings suggest that cognitive-behavioral treatment for dysfunctional anger might improve their outcomes if they targeted negative cognitions most strongly associated with dysfunctional anger. In addition, the inclusion of situational factors in our best-fitting CFA models suggests that assessing the circumstances in which one experiences distressing and unhelpful anger is essential in clinical practice.
Similar content being viewed by others
Data Availability
The datasets generated during the current study are available from the corresponding author on request.
References
Ahmed, A. G., Kingston, D. A., DiGiuseppe, R., Bradford, J. M., & Seto, M. C. (2012). Developing a clinical typology of dysfunctional anger. Journal of Affective Disorders, 136(1–2), 139–148. https://doi.org/10.1016/j.jad.2011.09.008
Akinwande, M. O., Dikko, H. G., & Samson, A. (2015). Variance inflation factor: As a condition for the inclusion of suppressor variable (s) in regression analysis. Open Journal of Statistics, 5(07), 754. https://doi.org/10.4236/ojs.2015.57075
American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed.). American Psychiatric Press.
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). American Psychiatric Press.
Beck, A. T. (1999). Prisoners of hate: The cognitive basis of anger, hostility, and violence. Harper Collins Publishers. https://doi.org/10.1891/0889-8391.14.2.201
Beck, A. T., Epstein, N., Brown, G., & Steer, R. A. (1988). An inventory for measuring clinical anxiety: Psychometric properties. Journal of Consulting and Clinical Psychology, 56(6), 893. https://doi.org/10.1037/0022-006X.56.6.893
Beck, A. T., & Haigh, E. A. P. (2014). Advances in cognitive theory and therapy: The generic cognitive model. Annual Review of Clinical Psychology, 10, 1–24. https://doi.org/10.1146/annurev-clinpsy-032813-153734
Brazão, N., Rijo, D., da Silva, D. R., Salvador, M., & & Pinto-Gouveia, J. (2021). Personality pathology profiles as moderators of the growing pro-social program: Outcomes on cognitive, emotion, and behavior regulation in male prison inmates. Journal of Personality Disorders, 35(1), 84–113. https://doi.org/10.1521/pedi_2019_33_424
Brazão, N., Rijo, D., Salvador, M., & Pinto-Gouveia, J. (2017). The effects of the growing pro-social program on cognitive distortions and early maladaptive schemas over time in male prison inmates: A randomized controlled trial. Journal of Consulting and Clinical Psychology, 85(11), 1064–1079. https://doi.org/10.1037/ccp0000247
Brazão, N., Rijo, D., Salvador, M., & Pinto-Gouveia, J. (2018). Promoting emotion and behavior regulation in male prison inmates: A secondary data analysis from a randomized controlled trial testing the efficacy of the growing pro-social program. Law and Human Behavior, 42(1), 57–70. https://doi.org/10.1037/lhb0000267
Bruehl, S., Liu, X., Burns, J. W., Chont, M., & Jamison, R. N. (2012). Associations between daily chronic pain intensity, daily anger expression, and trait anger expressiveness: An ecological momentary assessment study. Pain, 153, 2352–2358. https://doi.org/10.1016/j.pain.2012.08.001
Byrne, B. M. (2012). Structural equation modeling with Mplus: Basic concepts, applications, and programming. Rutledge.
Campbell, M, & Flanagan, R. (2001). Review of the Reynolds depression screening inventory. In B. S. Plake & J. C. Impara (Eds.), The fourteenth mental measurements yearbook. Retrieved from https://web-b-ebscohost-com.jerome.stjohns.edu/ehost/
Charles, D., Wilson, A., DiGiuseppe, R. (2016). The development of the anger management outcome questionnaire. Poster at the American Psychological Association (APA) Annual Convention, August 2016.
Cole, D. A., & Turner, J. E., Jr. (1993). Models of cognitive mediation and moderation in child depression. Journal of Abnormal Psychology, 102, 271–281. https://doi.org/10.1037/0021-843X.102.2.271
Covin, R., Dozois, D. J., Ogniewicz, A., & Seeds, P. M. (2011). Measuring cognitive errors: Initial development of the Cognitive Distortions Scale (CDS). International Journal of Cognitive Therapy, 4(3), 297–322. https://doi.org/10.1521/ijct.2011.4.3.297
Dahlen, E. R., & Martin, R. C. (2005). The experience, expression, and control of anger in perceived social support. Personality and Individual Differences, 39, 391–401. https://doi.org/10.1016/j.paid.2005.01.019
David, D., Cristeal, O., & Hofmann, S. G. (2018). Why cognitive behavioral therapy is the current gold standard of psychotherapy. Frontiers of Psychiatry, 4. https://doi.org/10.3389/fpsyt.2018.00004
Deffenbacher, J. L. (1992). Trait anger: Theory, findings, and implications. In C. D. Spielberger & J. N. Butcher (Eds.), Advances in personality assessment (pp. 177–201). Lawrence Erlbaum Associates.
Deffenbacher, J. L., & Deffenbacher, D. M. (2003). Where is the anger in introductory and abnormal psychology texts? Teaching of Psychology, 30(1), 65–67.
DiGiuseppe, R., Charles, D., Pzena, R., Cheney, B., Taboas, W. (2017). Development of an Anger Management Outcome Questionnaire. Poster presented at the 51st annual convention of the Association of Behavioral and Cognitive Therapies, San Diego, CA.
DiGiuseppe, R., Gorman, B., & Raptis, J. (2020). The factor structure of the attitudes and beliefs Scale 2: Implications for rational emotive behavior therapy. Journal of Rational-Emotive & Cognitive-Behavior Therapy., 38(2), 111–142. https://doi.org/10.1007/s10942-020-00349-0
DiGiuseppe, R., Gorman, B., Raptis, J., Agiurgioaei-Boie, A., Agiurgioaei, F., Leaf, R., & Robin, M. W. (2021). The development of a short form of an irrational/rational beliefs scale. Journal of Rational-Emotive & Cognitive-Behavior Therapy, 39(3), 456–490. https://doi.org/10.1007/s10942-021-00386-3
DiGiuseppe, R., Leaf, R., Gorman, B., & Robin, R. (2018). The development of a measure of irrational/rational beliefs. Journal of Rational-Emotive and Cognitive-Behavior Therapies, 36(1), 47–79. https://doi.org/10.1007/s10942-017-0273-3
DiGiuseppe, R., & Tafrate, R. (2004). The anger disorder scale: Manual. Toronto, Ontario, Canada: MultiHealth Systems.
DiGiuseppe, R., & Tafrate, R. C. (2006). Anger treatment for adults: A meta-analytic review. Clinical Psychology: Science and Practice, 10(1), 70–84. https://doi.org/10.1093/clipsy.10.1.70
DiGiuseppe, R., & Tafrate, R. C. (2007). Understanding anger disorders. Oxford University Press.
DiStefano, C., & Morgan, G. B. (2014). A comparison of diagonal weighted least squares robust estimation techniques for ordinal data. Structural Equation Modeling, 21(3), 425–438. https://doi.org/10.1080/10705511.2014.915373
Dodge, K. A. (1991). The structure and function of reactive and proactive aggression. In D. Pepler & K. Rubin (Eds.), The development and treatment of childhood aggression (pp. 201–218). Erlbaum.
Dowd, E. T, & Waller, N. G. (1998). Review of the Beck Anxiety Inventory. In C. Impara & B. S. Plake (Eds.), The thirteenth mental measurements yearbook.
Dryden, W. (1990). Dealing with anger problems: Rational–emotive therapeutic interventions. Practitioner’s Resource Exchange Inc.
Eiden, R. D., Leonard, K. E., Colder, C. R., Homish, G. G., Schuetze, P., Gray, T. R., et al. (2012). Anger, hostility, and aggression as predictors of persistent smoking during pregnancy. Journal of Studies on Alcohol and Drugs, 73, 926–932. https://doi.org/10.15288/jsad.2011.72.926
Ellis, A. (1977). How to live with and without anger. Reader’s Digest Press.
Ellis, A. (1994). Reason and emotion in psychotherapy: A comprehensive method of treating human disturbance. Revised and updated. Birch Lane Press.
Epictetus (90BC/1996). The Enchiridion. Raleigh, NC: Alex Catalogue. Also available as an e-book. Boulder, CO: NetLibrary.
Fernandez, E., & Johnson, S. L. (2016). Anger in psychological disorders: Prevalence, presentation, etiology, and prognostic implications. Clinical Psychology Review, 46, 124–135. https://doi.org/10.1016/j.cpr.2016.04.012
Flora, D. B., & Curran, P. J. (2004). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods, 9, 466–491. https://doi.org/10.1037/1082-989X.9.4.466
Goss-Sampson, M. A. (2020). Statistical analysis in JASP 0.14: A guide for students. November 2020. (Free PDF).
Harrington, N. (2005). Dimensions of frustration intolerance and their relationship to self-control problems. Journal of Rational-Emotive & Cognitive-Behavior Therapy, 23(1), 1–20. https://doi.org/10.1007/s10942-005-0001-2
Hayes, A.F. & Coutts, J. J. (2020). Use omega rather than Cronbach’s Alpha for estimating reliability. But…, Communication Methods and Measures, 14 (1), 1–24. https://doi.org/10.1080/19312458.2020.1718629
Howells, K. (1998). Cognitive–behavioural therapy for anger, aggression, and violence. In N. Tarrier & A. Wells (Eds.), Complex cases in cognitive–behavioral therapy (pp. 295–318). Wiley.
Hunsley, J., & Mash, E. J. (2007). Evidence-based assessment. Annual Review of Clinical Psychology, 3, 446–554. https://doi.org/10.1146/annurev.clinpsy.3.022806.091419
Hyland, P., Shevlin, M., Adamson, G., & Boduszek, D. (2014). Modeling the structure of the Attitudes and Belief Scale 2 using CFA and bifactor approaches: Toward the development of an abbreviated version. Cognitive Behaviour Therapy, 43(1), 60–71. https://doi.org/10.1080/16506073.2013.777467
Hyland, P., Shevlin, M., Adamson, G., & Boduszek, D. (2015). Irrational beliefs in posttraumatic stress responses: A rational emotive behavior therapy approach. Journal of Loss and Trauma, 20(2), 171–188. https://doi.org/10.1080/15325024.2013.839772
JASP Team (2022). JASP (Version 0.16.3) Computer software. Retrieved Oct 4, 2022a from https://jasp-stats.org/.
Kaplan, D. (2000). Structural equation modeling: Foundations and extensions. Sage.
Kingery, J. N., Kepley, H. O., Ginsburg, G. S., Walkup, J. T., Silva, S. G., Hoyle, R. H., Reinecke, M. A., & March, J. S. (2009). Factor structure and psychometric properties of the Children’s Negative Cognitive Error Questionnaire with a clinically depressed adolescent sample. Journal of Clinical Child and Adolescent Psychology, 38(6), 768–780. https://doi.org/10.1080/15374410903297130
Kline, P. (1994). An easy guide to factor analysis. Routledge.
Klein Tuente, S., Bogaerts, S., & Veling, W. (2019). Hostile attribution bias and aggression in adults—A systematic review. Aggression and Violent Behavior, 46, 66–81. https://doi.org/10.1016/j.avb.2019.01.009
Koch, T., Holtmann, J., Bohn, J., & Eid, M. (2018). Explaining general and specific factors in longitudinal, multimethod, and bifactor models: Some caveats and recommendations. Psychological Methods, 23(3), 505–523. https://doi.org/10.1037/met0000146
Lachmund, E., DiGiuseppe, R., & Fuller, J. R.(2005). Clinicians' diagnosis of a case with anger problems. Journal of Psychiatric Research, 39(4), 439–447.
Lee, A. H., & DiGiuseppe, R. (2018). Anger and aggression treatments: A review of meta-analyses. Current Opinion in Psychology, 19, 65–74. https://doi.org/10.1016/j.copsyc.2017.04.004
Leitenberg, H., Yost, L. W., & Carroll-Wilson, M. (1986). Negative cognitive errors in children: Questionnaire development, normative data, and comparisons between children with and without self-reported symptoms of depression, low self-esteem, and evaluation anxiety. Journal of Consulting and Clinical Psychology, 54(4), 528–536. https://doi.org/10.1037/0022-006X.54.4.528
Li, C. H. (2016). Confirmatory factor analysis with ordinal data: Comparing robust maximum likelihood and diagonally weighted least squares. Behavior Research Methods, 48(3), 936–949. https://doi.org/10.3758/s13428-015-0619-7
Loehlin, J. C. (2004). Latent variable models: An introduction to factor, path, and structural equation analysis, 4th ed. Lawrence Erlbaum Associates Publishers.
Lubke, G. H., & Muthén, B. O. (2004). Applying multigroup confirmatory factor models for continuous outcomes to Likert scale data complicates meaningful group comparisons. Structural Equation Modeling, 11, 514–534. https://doi.org/10.1207/s15328007sem1104_2
Mabel, S. (1994). Empirical determination of anger-provoking characteristics intrinsic to anger-provoking circumstances. Journal of Social and Clinical Psychology, 13, 174–188. https://doi.org/10.1521/jscp.1994.13.2.174
Mardia, J. R., Kent, J. T., & Bibby, J. M. (1979). Multivariate analysis. Academic Press.
Martin, R. C., & Dahlen, E. R. (2007). The angry cognitions scale: A new inventory for assessing cognitions in anger. Journal of Rational-Emotive & Cognitive-Behavior Therapy, 25(3), 155–173. https://doi.org/10.1007/s10942-006-0033-2
Martin, R. C., & Dahlen, E. R. (2011). Angry thoughts and response to provocation: Validity of the Angry Cognitions Scale. Journal of Rational-Emotive & Cognitive-Behavior Therapy, 29(2), 65–76. https://doi.org/10.1007/s10942-009-0104-2
Martin, R. C., & Vieaux, L. E. (2013). Angry thoughts and daily emotion logs: Validity of the Angry Cognitions Scale. Journal of Rational-Emotive & Cognitive-Behavior Therapy, 31, 219–230. https://doi.org/10.1007/s10942-013-0171-2
McDermut, W., Fuller, J. R., DiGiuseppe, R., Chelminski, I., & Zimmerman, M. (2009). Trait anger and axis I disorders: Implications for REBT. Journal of Rational-Emotive & Cognitive-Behavior Therapy, 27(2), 121–135. https://doi.org/10.1007/s10942-009-0092-2
McGill, K. A., DiGiuseppe & Zhuo, Y. (2021). The code of honor as a predictor of anger and aggression. Journal of Aggression, Maltreatment & Trauma, 30(2), 226–242. https://doi.org/10.1080/10926771.2020.1832169
Muthén, B. O., & Kaplan, D. (1985). A comparison of some methodologies for the factor analysis of non-normal Likert variables. British Journal of Mathematical and Statistical Psychology, 38, 171–189. https://doi.org/10.1111/j.2044-8317.1985.tb00832.x
Nezu, A. M., Nezu, C. M., & Hayes, A. M. (2019). Emotion-centered problem-solving therapy. In K. Dobson & D. Dozois (Eds.), Handbook of cognitive-behavioral therapies (4th ed., pp. 171–190). Guilford Press.
Randel, J. L. (2020). The Psychometric Properties of an Anger Management Routine Outcome Monitoring Measure (Order No. 28148585). Available from ProQuest Dissertations & Theses Global. (2467848921). Retrieved from https://jerome.stjohns.edu/login?url=https://www.proquest.com/dissertations-theses/psychometric-properties-anger-management-routine/docview/2467848921/se-2
Reynolds, W. M., & Kobak, K. A. (1998). Reynolds Depression Screening Inventory: RDSI: Professional Manual. Psychological Assessment Resources.
Romero, K., & DiGiuseppe, R. (November 2022b). Identifying subtypes of dysfunctional anger: a latent profile analysis of the anger disorders scale (ADS). In Poster presented at the 56th annual convention of the association of behavioral and cognitive therapies, New York, NY.
Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36.
Scaini, S., Piron, R., Nicoli, S., Fiore, F., DiGiuseppe, R., Ruggiero, G. M., & Caruso, C. (2022). A cross-validation of the Anger Cognitions Scale-revised: Cognitions and anger in an Italian adolescent sample. Journal of Rational-Emotive & Cognitive-Behavior Therapy, 40(2), 278–294. https://doi.org/10.1007/s10942-021-00411-5
Schreiber, J. B., Nora, A., Stage, F. K., Barlow, E. A., & King, J. (2006). Reporting structural equation modeling and confirmatory factor analysis results: A review. Journal of Educational Research, 99(6), 323–338.
Seneca. (1958). On anger. In Moral Essays (Vol. 1, pp. 106–355). Translated by J. W. Basore. Loeb Classical Library 214. Cambridge, MA: Harvard University Press.
Slade, M. (2002). Routine outcome assessment in mental health services. Psychological Medicine, 32(8), 1339–1343. https://doi.org/10.1017/S0033291701004974
Soto, B., & DiGiuseppe, R. (2016, October). Which Beliefs Best Predict Anger? In Poster session presented at the 50th Annual Convention of the Association for Behavioral and Cognitive Therapies, New York, NY.
Spivack, G., Platt, J., & Shure, M. (1976). The social problem-solving approach to adjustment. Jossey-Bass.
Stevanovic, D., Lalic, B., Batinic, J., Damjanovic, R., Jovic, V., Brkic-cvetkovic, S., & Jancic, J. (2016). Children’s negative cognitive error questionnaire–revised: The factor structure and associations with anxiety and depressive symptoms across age, gender, and clinical/community samples. Cognitive Therapy and Research, 40(4), 584–592. https://doi.org/10.1007/s10608-016-9767-z
Stewart, S. M., Kennard, B. D., Lee, P. W., Hughes, C. W., Mayes, T. L., Emslie, G. J., & Lewinsohn, P. M. (2004). A cross-cultural investigation of cognitions and depressive symptoms in adolescents. Journal of Abnormal Psychology, 113, 248–257. https://doi.org/10.1037/0021-843X.113.2.248
Sukhodolsky, D. G., Smith, S. D., McCauley, S. A., Ibrahim, K., & Piasecka, J. B. (2016). Behavioral interventions for anger, irritability, and aggression in children and adolescents. Journal of Child and Adolescent Psychopharmacology, 26(1), 58–64. https://doi.org/10.1089/cap.2015.0120
Tabachnick, B. G., & Fidell, L. S. (2018). Using multivariate statistics (6th ed.). Pearson.
Walitzer, K. S., Deffenbacher, J. L., & Shyhalla, K. (2015). Alcohol-adapted anger management treatment: A randomized controlled trial of an innovative therapy for alcohol dependence. Journal of Substance Abuse Treatment, 59, 83–93. https://doi.org/10.1016/j.jsat.2015.08.003
Wydo, M. R., & Martin, R. C. (2015). An assessment instrument for anger management in correctional settings: the angry cognitions scale-prison form. Journal of Rational-Emotive & Cognitive-Behavior Therapies, 33, 374–386. https://doi.org/10.1007/s10942-015-0219-6
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
Raymond DiGiuseppe, the first author, is also the author of the Anger Disorders Scale—Short Form that was used in this research. This test is published by MHS, and the first author receives royalties for the clinical use of this scale. This author also receives honoraria from speaking engagements on the clinical treatment of people with anger problems. Groups that have paid this author to provide continuing education workshops on anger include the Albert Ellis Institute in New York City; 2) the Association for Rational Emotive Behaviour Therapy (AREBT) International Conference, 2022, U.K.; 3) SDS Seminars Ltd.; 4): Studi Cognitivi, Milano, Italia. Amanda Fisher, Joanne Raptis, Katharine Romero, Annette Schieffelin, and William Chaplin have no conflict of interest.
Ethical Approval
This research that resulted in this article was approved by the Institutional Review Board of St. John’s University, Queens, New York, USA.
Informed Consent
This research was approved by the St. John's Univesity Institutional Review Board. Because the first author served as the Chair of this Board at the time of this research, he recused himself of all and any discussion involving this research. All participants completed an informed consent form before participating in this study.
Animal Rights
No animal studies were carried out by the authors for this article.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
DiGiuseppe, R., Fisher, A., Raptis, J. et al. What Cognitions Best Predict Disturbed Anger in Adults? A Revision of the Anger Cognitions Scale. Cogn Ther Res 47, 510–529 (2023). https://doi.org/10.1007/s10608-023-10362-z
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10608-023-10362-z