Skip to main content

Advertisement

SpringerLink
Log in

Psychometric Evaluation of the interRAI Child and Youth Mental Health Disruptive/Aggression Behaviour Scale (DABS) and Hyperactive/Distraction Scale (HDS)

  • Original Article
  • Published:
Child Psychiatry & Human Development Aims and scope Submit manuscript

Abstract

The present study aims to validate the interRAI Child and Youth Mental Health (interRAI ChYMH), Disruptive/Aggression Behaviour Scale (DABS) and Hyperactive/Distraction Scale (HDS). Data were collected from children/youth aged 4–18 (N = 3464) across 39 mental health agencies in Ontario, Canada. Unrestricted factor analysis using polychoric correlation matrices and Samejima’s graded item response theory (IRT) parameterizations were conducted for both measures. Scores on the HDS and DABS were also compared amongst children/youth diagnosed with attention-deficit hyperactivity disorder (ADHD) and disruptive behaviour disorder (DBD) respectively using DSM-IV criteria. Results from the factor analysis and IRT analysis demonstrated good measurement properties. Using a receiver operating characteristics curve, the area under the curve (AUC) for the HDS and DABS is 0.79 and 0.75 for a diagnosis of ADHD and DBD respectively. Overall, converging results suggest that the interRAI HDS and DABS may serve as effective measures that detect externalizing mental health indicators.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  1. Patel V, Flisher AJ, Hetrick S, McGorry P (2007) Mental health of young people: a global public-health challenge. Lancet 369(9569):1302–1313

    Article  PubMed  Google Scholar 

  2. Mental Health Commissions of Canada. School-based mental health and substance abuse project. http://www.mentalhealthcommission.ca/sites/default/files/2016-06/SubstanceAbuse_SBMHSA_Summary_ENG_1_0.pdf. Accessed 31 Oct 2016

  3. Kirby K, Keon WJ (2012) Out of the shadows at last: transforming mental health, mental illness and addiction service in Canada. Senate of Canada, Standing Committee on Social Affairs, Science and Technology, Ottawa

    Google Scholar 

  4. Smith JP, Smith GC (2010) Long-term economic costs of psychological problems during childhood. Soc Sci Med 71:110–115

    Article  PubMed  PubMed Central  Google Scholar 

  5. Hirdes JP, Smith TF, Rabinowitz T, Yamauchi K, Pérez E, Telegdi NC et al (2000) Resident assessment instrument-mental health group: development of the resident assessment instrument–mental health (RAI-MH). Hosp Q 4:44–51

    PubMed  Google Scholar 

  6. Hirdes JP, Curtin-Telegdi N, Mathias K, Perlman CM, Saarela T, Kolbeinsson H et al (2011) InterRAI mental health clinical assessment protocols (CAPs) for use with community and hospital-based mental health assessment instruments Version 9.1. interRAI, Washington, DC

    Google Scholar 

  7. Stewart SL, Hirdes JP, Curtin-Telegdi N, Perlman C, MacLeod K, Ninan A et al (2011) InterRAI Child and Youth Mental Health (ChYMH) assessment form and user’s manual Version 1. interRAI, Washington, DC

    Google Scholar 

  8. Hirdes JP, Smith TF, Rabinowitz T, Yamauchi K, Pérez E, Telegdi NC et al (2002) The resident assessment instrument-mental health (RAI-MH): inter-rater reliability and convergent validity. J Behav Health Serv Res 29(4):419–432

    Article  PubMed  Google Scholar 

  9. Hirdes JP, Fries BE, Morris JN, Steel K, Mor V, Frijters D et al (1999) Integrated health information systems based on the RAI/MDS series of instruments. Health Manag Forum 12:30–40

    Article  Google Scholar 

  10. Phillips CD, Hawes C (2015) The interRAI pediatric home care (PEDS HC) assessment: evaluating the long-term community-based service and support needs of children facing special healthcare challenges. Health Serv Insights 8:17

    PubMed  PubMed Central  Google Scholar 

  11. Stewart SL, Hirdes JP, Curtin-Telegdi N, Perlman C, MacLeod K, Ninan A et al (2015) interRAI Child and Youth Mental Health (ChYMH) assessment form and user’s manual, version 9.3. interRAI, Washington, DC

    Google Scholar 

  12. Hirdes JP, Ljunggren G, Morris JN, Frijters DH, Soveri HF, Gray L et al (2008) Reliability of the interRAI suite of assessment instruments: a 12-country study of an integrated health information system. BMC Health Serv Res 8:277–288

    Article  PubMed  PubMed Central  Google Scholar 

  13. Stewart SL, Hirdes JP (2015) Identifying mental health symptoms in children and youth in residential and in-patient care settings. Healthcare Manag Forum 28:150–156.

    Article  Google Scholar 

  14. Berenbaum H (2013) Classification and psychopathology research. J Abnorm Psychol 122(3):894–901

    Article  PubMed  Google Scholar 

  15. American Psychiatric Association (2013) Diagnostic and statistical manual of mental disorders, 5th edn. American Psychiatric Publishing, Arlington

    Book  Google Scholar 

  16. Newcorn JH, Halperin JM, Jensen PS, Abikoff HB, Arnold LE, Cantwell DP et al (2001) Symptom profiles in children with ADHD: effects of comorbidity and gender. J Am Acad Child Adolesc Psychiatry 40(2):137–146

    Article  PubMed  Google Scholar 

  17. Beauchaine TP, Hinshaw SP, Pang KL (2010) Comorbidity of attention-deficit/hyperactivity disorder and early-onset conduct disorder: biological, environmental, and developmental mechanisms. Clin Psychol Sci 17(4):327–336

    Article  Google Scholar 

  18. Costello EJ, Mustillo S, Erkanli A et al (2003) Prevalence and development of psychiatric disorders in childhood and adolescence. Arch Gen Psychiatry 60(8):837–844

    Article  PubMed  Google Scholar 

  19. Lahey BB, Waldman ID, McBurnett K (1999) The development of antisocial behavior: an integrative causal model. J Child Psychol Psychiatry 40:669–682

    Article  PubMed  Google Scholar 

  20. Rowe R, Maughan B, Pickles A, Costello EJ, Angold A (2002) The relationship between DSM-IV oppositional defiant disorder and conduct disorder: findings from the Great Smoky Mountains Study. J Child Psychol. Psychiatry 43(3):365–373

    Article  PubMed  Google Scholar 

  21. Weiss G, Hechtman LT (1993) Hyperactive children grown up: ADHD in children, adolescence, and adults, 2nd edn. Guilford Press, New York

    Google Scholar 

  22. Mannuzza S, Klein RG, Bessler A, Malloy P, LaPadula M (1993) Adult outcome of hyperactive boys: educational achievement, occupational rank, and psychiatric status. Arch Gen Psychiatry 50:565–576

    Article  PubMed  Google Scholar 

  23. Weiss G, Hechtman L, Milroy T, Perlman T (1985) Psychiatric status of hyperactives as adults: a controlled prospective 15 year follow-up of 63 hyperactive children. J Am Acad Child Adolesc Psychiatry 24(2):211–220

    Article  Google Scholar 

  24. Faraone SV, Biederman J, Jetton JG, Tsuang MT (1997) Attention deficit disorder and conduct disorder: longitudinal evidence for a familial subtype. Psychol Med 27(2):291–300

    Article  PubMed  Google Scholar 

  25. Faraone SV, Biederman J, Mennin D, Russell R, Tsuang MT (1998) Familial subtypes of attention deficit hyperactivity disorder: a 4-year follow-up study of children from antisocial-ADHD Families. J Child Psychol Psychiatry 39(7):1045–1053

    Article  PubMed  Google Scholar 

  26. Huesmann LR, Eron LD, Dubow EF (2002) Childhood predictors of adult criminality: are all risk factors reflected in childhood aggressiveness? CMBH 12(3):185–208

    Google Scholar 

  27. Kim H, Jung YI, Sung M, Lee JY, Yoon JY, Yoon JL (2015) Reliability of the interRAI long term care facilities (LTCF) and interRAI home care (HC). Geriatr Gerontol Int 15(2):220–228

    Article  PubMed  Google Scholar 

  28. Burrows AB, Morris JN, Simon SE, Hirdes JP, Phillips CH (2000) Development of a minimum data set-based depression rating scale for use in nursing homes. Age Ageing 29(2):165–172

    Article  PubMed  Google Scholar 

  29. Martin L, Hirdes JP, Fries BE, Smith TF (2007) Development and psychometric properties of an assessment for persons with intellectual disability—the interRAI ID. J Policy Pract Intellect Disabil 4(1):23–29

    Article  Google Scholar 

  30. Morris JN, Carpenter I, Berg K, Jones RN (2000) Outcome measures for use with home care clients. Can J Aging 19(2):87–105

    Article  Google Scholar 

  31. Stewart SL, Currie M, Arbeau K, Leschied A, Kerry A (2015) Assessment and planning for community and custodial services: the application of interRAI assessment in the youth justice system. Serious and Violent Young Offenders and Youth Criminal Justice: a Canadian perspective. Simon Fraser University Publications, Burnaby

    Google Scholar 

  32. Stewart SL, Hamza CA (2017) The Child and Youth Mental Health Assessment (ChYMH): an examination of the psychometric properties of an integrated assessment developed for clinically referred children and youth. BMC Health Serv Res 17(1):82

    Article  PubMed  PubMed Central  Google Scholar 

  33. Xie H, Peel NM, Hirdes JP, Poss JW, Gray LC (2016) Validation of the interRAI pressure Ulcer Risk Scale in acute care hospitals. J Am Geriatr Soc 64(6):1324–1328

    Article  PubMed  Google Scholar 

  34. Travers C, Byrne GJ, Pachana NA, Klein K, Gray L (2013) Validation of the interRAI Cognitive Performance Scale against independent clinical diagnosis and the Mini-Mental State Examination in older hospitalized patients. J Nutr Health Aging 17(5):435–439

    Article  PubMed  Google Scholar 

  35. Wodchis WP, Naglie G, Teare GF (2008) Validating diagnostic information on the minimum data set in Ontario hospital-based long-term care. Med Care 46(8):882–887

    Article  PubMed  Google Scholar 

  36. Davidson M (2014) Known-groups validity. In: Encyclopedia of quality of life and well-being research. Springer, Dordrecht, p 3481–3482

    Chapter  Google Scholar 

  37. Fisher K, Seow H, Cohen J, Declercq A, Freeman S, Guthrie DM (2015) Patient characteristics associated with prognostic awareness: a study of a Canadian palliative care population using the InterRAI Palliative Care Instrument. J Pain Symptom Manag 49(4):716–725

    Article  Google Scholar 

  38. Mindrilla D (2010) Maximum likelihood (ML) and diagonally weighted least squares (DWLS) estimation procedures: a comparison of estimation bias with ordinal and multivariate non-normal data. Int J Digit Soc 1(1):60–66

    Article  Google Scholar 

  39. Holgado-Tello FP, Chacón-Moscoso S, Barbero-García I, Vila-Abad E (2010) Polychoric versus Pearson correlations in exploratory and confirmatory factor analysis of ordinal variables. Qual Quant 44(1):153–166

    Article  Google Scholar 

  40. O’Connor BP (2000) SPSS and SAS programs for determining the number of components using parallel analysis and Velicer’s MAP test. Behav Res Methods 32(3):396–402.

    Article  Google Scholar 

  41. Samejima F (1969) Estimation of latent ability using a response pattern of graded scores (psychometric monograph no. 17). Psychometric Society, Richmond

    Google Scholar 

  42. Lorenzo-Seva U, Ferrando PJ (2006) FACTOR: a computer program to fit the exploratory factor analysis model. Behav Res Methods 38(1):88–91

    Article  PubMed  Google Scholar 

  43. Lorenzo-Seva U, Ferrando PJ (2013) FACTOR 9.2: a comprehensive program for fitting exploratory and semiconfirmatory factor analysis and IRT models. Appl Psychol Meas 37(6):497–498

    Article  Google Scholar 

  44. Hanley JA, McNeil BJ (1982) The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 43(1):29–36

    Article  Google Scholar 

  45. Zweig MH, Campbell G (1993) Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine. Clin Chem 39(4):561–577

    PubMed  Google Scholar 

  46. Lorenzo-Seva U (2013) Why rotate my data using Promin? Technical report. Department of Psychology, Universitat Rovira i Virgili, Tarragona

    Google Scholar 

  47. Li CH (2016) Confirmatory factor analysis with ordinal data: comparing robust maximum likelihood and diagonally weighted least squares. Behav Res Methods 48(3):936–949

    Article  PubMed  Google Scholar 

  48. Axelson D, Findling RL, Fristad MA, Kowatch RA, Youngstrom EA, Horwitz SM et al (2012) Examining the proposed disruptive mood dysregulation disorder diagnosis in children in the Longitudinal Assessment of Manic Symptoms study. J Clin Psychiatry 73(10):1342–1350

    Article  PubMed  PubMed Central  Google Scholar 

  49. Dumesnil H, Verger P (2009) Public awareness campaigns about depression and suicide: a review. Psychiatr Serv 60(9):1203–1213.

    Article  PubMed  Google Scholar 

  50. Kelly CM, Jorm AF, Wright A (2007) Improving mental health literacy as a strategy to facilitate early intervention for mental disorders. Med J Aust 187(7 Suppl):26–30

    Google Scholar 

Download references

Funding

Special thanks to the London Community Foundation for providing funding for the interRAI Child and Youth Mental Health (ChYMH) pilot project. The funders did not participate in study design, data analysis, or preparation of the manuscript.

Author information

Authors and Affiliations

  1. Department of Psychology, Faculty of Social Sciences, Western University, 1151 Richmond St, London, ON, N6A 3K7, Canada

    Chloe Lau, Donald H. Saklofske & Paul F. Tremblay

  2. Faculty of Education, Western University, London, ON, Canada

    Shannon L. Stewart

  3. School of Public Health and Health Systems, University of Waterloo, 200 University Ave W, Waterloo, ON, N2L 3G1, Canada

    John Hirdes

Authors
  1. Chloe Lau
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shannon L. Stewart
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Donald H. Saklofske
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Paul F. Tremblay
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. John Hirdes
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chloe Lau.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Appendix 1

Appendix 1

Disruptive/Aggression Behaviour Scale (DABS)

Item

Short description and examples

Physical abuse

Physical abuse and assault on others (e.g., hits schoolmate, punches sibling in the face)

Verbal abuse

Verbal abuse and assault (e.g., others were threatened, cursed at)

Socially inappropriate or disruptive behaviour

Behaviour that is not appropriate and negatively affects others (e.g., screamed out during class, smeared or threw food or feces)

Destructive behaviour towards property

Damages or destroys property (e.g., throwing or breaking objects, turning over beds or tables, vandalism)

Outburst of anger

Intense flare-up of anger in reaction to a specific action or event (e.g., tantrums when told “no”)

Hyperactive/Distraction Scale (HDS)

Item

Short description and examples

Impulsivity

Behaviour that is not thought out or cognitively mediated (e.g., running into traffic, interrupts, taking risky actions without thinking, difficulty taking turns)

Easily distracted

Loss of focus and staying on a task (e.g., episodes of difficulty paying attention, gets sidetracked)

Hyperactivity

More than normal activity (e.g., excessive level of activity)

Disorganization

Not organized or task focused (e.g., problems organizing personal belongings, difficulty adhering to schedule)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lau, C., Stewart, S.L., Saklofske, D.H. et al. Psychometric Evaluation of the interRAI Child and Youth Mental Health Disruptive/Aggression Behaviour Scale (DABS) and Hyperactive/Distraction Scale (HDS). Child Psychiatry Hum Dev 49, 279–289 (2018). https://doi.org/10.1007/s10578-017-0751-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10578-017-0751-y

Keywords

Search

Navigation