Reliability of the Terry: A Mental Health Cartoon-Like Screener for African-American Children

Abstract

Test-retest reliability and internal consistency of the Terry, a cartoon-based child mental health screener developed for African-American children, were measured in 36 boys (age 5 \({\raise0.7ex\hbox{$1$} \!\mathord{\left/ {\vphantom {1 2}}\right.\kern-\nulldelimiterspace}\!\lower0.7ex\hbox{$2$}}\) to 13) in a test-retest design. Reliability of the diagnosis (0.70 ≤ k ≤ 0.75) was good for ADHD, ODD, CD, and OAD, and excellent for MDD and SAD. Because of low base-rate, no kappa value was calculated for SPh. Both test-retest agreement, and reliability of the symptom scale (0.75 ≤ ICC≤0.80) were very good for all 7 diagnoses. Internal consistency according to symptom scale (0.78≤ Cronbach α≤O.90), was moderate for OAD, good for SPh, MDD, SAD, CD, and ODD, and excellent for ADHD. The Terry is a culturally-sensitive questionnaire with good reliability.

This is a preview of subscription content, access via your institution.

References

  1. 1.

    Cohen P, Cohen J, Kasen S, Velez CN, Hartmark C et al: An epidemiological study of disorders in late childhood and adolescence; I, age and gender-specific prevalence. J Child Psychol Psychiatry 34:851–867, 1993.

    Google Scholar 

  2. 2.

    Kilgus MD, Pumariega AJ, Cuffe S: Influence of race on diagnosis in adolescent psychiatric inpatients. J Am Acad Child Adolesc Psychiatry 34:67–72, 1995.

    Google Scholar 

  3. 3.

    Langner TS, Gersten JC, Greene EL, Eisenberg JG, et al: Treatment of psychological disorders among urban children. J Consult Clin Psychol 42:170–179, 1974.

    Google Scholar 

  4. 4.

    Harrison G, Owens D, Holton A, et al: A prospective study of mental disorder in Afro-Caribbean patients. Psychol Med 18:643–657, 1988.

    Google Scholar 

  5. 5.

    Rosenstein MJ, Maillots-Sayre LJ, McAskill RL, et al.: Use of inpatient services by special populations. In: Mental Health, United States, 1987, Manderscheid RW, Barrett SA, eds. DHHS pub (ADM) 87-1518. Rockville, Md, National Institute of Mental Health, 1988.

    Google Scholar 

  6. 6.

    Robins LN, Regier DA, eds. Psychiatric Disorders in America: The Epidemiologic Catchment Area Study. New York, Free Press, 1991.

    Google Scholar 

  7. 7.

    Sartorius N, Jablensky A, Korten A, et al: Early manifestations and first contact incidence of schizophrenia in different cultures. Psychol Med 16:909–928, 1986.

    Google Scholar 

  8. 8.

    Fabrega Jr. H. Cultural challenges to the Psychiatric Enterprise. Comp Psychiatry 36:377–383, 1995.

    Google Scholar 

  9. 9.

    Malgady RG, Rogler LH, Tyron WW: Issues of validity in the Diagnostic Interview Schedule. J Psychiatry Res 26:59–67, 1992.

    Google Scholar 

  10. 10.

    Rogler LH: The meaning of culturally sensitive research in mental health. Am J Psychiatry 146:296–303, 1989.

    Google Scholar 

  11. 11.

    Adebimpe VR, Gigandet J, Harris E: MMPI diagnosis of black psychiatric patients. Am J Psychiatry 136:85–87, 1979.

    Google Scholar 

  12. 12.

    Greene RL: Ethnicity and MMPI performance: a review. J Consult Clin Psychol 55:497–512, 1987.

    Google Scholar 

  13. 13.

    Pritchard DA, Rosenblatt A: Racial bias in the MMPI: a methodological review. J Consult Clin Psychol 48:263–267, 1980.

    Google Scholar 

  14. 14.

    Hamberger LK, Hastings JE: Racial differences in the Millon Clinical Multi axial Inventory in an outpatient clinical sample. J Pers Assess 58:90–96, 1992.

    Google Scholar 

  15. 15.

    Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition. Washington, DC, American Psychiatric Association, 1994.

  16. 16.

    Butcher JN, Graham JR, Williams CL, et al: Development and use of the MMPI-II content scales. Minneapolis, University of Minnesota Press, 1990.

    Google Scholar 

  17. 17.

    Achenbach TM: What is “developmental” about developmental psychopathology? In Risk and Protective factors in the Development of Psychopathology, eds. Roll J, Masten AS, Cicetti D, Nuechterlein KH & Weintraub S. New York: Cambridge University Press, pp 29–48, 1990.

    Google Scholar 

  18. 18.

    Cicchetti D: A historical perspective on the discipline of developmental psychopathology. In Risk and Protective factors in the Development of Psychopathology, eds. Roll J, Masten AS, Cicetti D, Nuechterlein KH & Weintraub S. New York: Cambridge University Press, pp 1–28, 1990.

    Google Scholar 

  19. 19.

    Langner TS, Gersten JC, Eisenberg JG: Approaches to measurement and definition in the epidemiology of behavior disorders: ethnic background and child behavior. Int J Health Serv 4:483–501, 1974.

    Google Scholar 

  20. 20.

    Canino IA, Gould MS, Prupis S, Shaffer D: A comparison of symptoms and diagnoses in Hispanic and Black children in an outpatient mental health clinic. J Am Acad Child Adolesc Psychiatry 25:254–259, 1986.

    Google Scholar 

  21. 21.

    Canino IA, Spurlock J: Culturally diverse children and adolescents: Assessment, diagnosis and treatment. New York: The Guilford Press. 1994.

    Google Scholar 

  22. 22.

    Mann EM, Ikeda Y, Mueller CW, Takahashi A, Tao KT, et al: Cross-cultural differences in rating hyperactive-disruptive behaviors in children. Am J Psychiatry 149:1539–1542, 1992.

    Google Scholar 

  23. 23.

    Weisz JR, Suwanlert S, Chaiyasit W, Weiss B, Achenbach TM, Eastman KL: Behavioral and emotional problems among Thai and American adolescents: parent reports for ages 12–16. J Abnorm Psychol 102:395–403, 1993.

    Google Scholar 

  24. 24.

    Pepler DJ, Lessa I: The mental health of Portuguese children. Can J Psychiatry 38:46–50, 1993.

    Google Scholar 

  25. 25.

    Lambert MC, Knight F, Taylor R, Achenbach TM: Epidemiology of behavioral and emotional problems among children of Jamaica and the United States: parent reports for ages 6 to 11. J Abnorm Child Psychol 22:113–28, 1994.

    Google Scholar 

  26. 26.

    Achenbach TM, Hensley VR, Phares V, Grayson D: Problems and competencies reported by parents of Australian and American children. J Child Psych Psychiatry 31:265–286, 1990.

    Google Scholar 

  27. 27.

    Achenbach TM, Verhulst FC, Byron GD, Akkerhuis GW: Epidemiological comparisons of American and Dutch children: I. Behavioral/emotional problems and competencies reported by parents for age 4 to 16. J Am Acad Child Adolesc Psychiatry 26:317–325, 1987.

    Google Scholar 

  28. 28.

    Sue DW, Sue D: Counseling the culturally different. New York, Wiley, 1990.

    Google Scholar 

  29. 29.

    Costello EJ, Janiszewski S: Who gets treated? Factors associated with referrals in children with psychiatric disorders. Acta Psychiatr Scand 81:523–529, 1990.

    Google Scholar 

  30. 30.

    Bond CF, DiCandia CG, MacKinnon JR: Responses to violence in a psychiatric setting: the role of the patient's race. Personality and Social Psychology Bulletin 14:448–458, 1988.

    Google Scholar 

  31. 31.

    Flaherty J, Meagher R: Measuring racial bias in inpatient treatment. Am J Psychiatry 137:379–382, 1980.

    Google Scholar 

  32. 32.

    Blacks more likely to get long-acting drugs. Psychiatr News 134:18–19, 1984.

  33. 33.

    Cuffe SP, Waller J, Cuccaro ML, Pumariega AJ, Garrison CZ: Race and gender differences in the treatment of psychiatric disorders in young adolescents. J Am Acad Child Adolesc Psychiatry 34:1536–1543, 1995.

    Google Scholar 

  34. 34.

    Adebimpe V: Race, racism, and epidemiological surveys. Hosp Com Psychiatry 45:27–32, 1994.

    Google Scholar 

  35. 35.

    Schwab-Stone M, Fallon T, Briggs M, Crowther B: Reliability of Diagnostic Reporting for children aged 6–11 years: a test-retest study of the Diagnostic Interview Schedule for Children-Revised. Am J Psychiatry 151:1048–1054, 1994.

    Google Scholar 

  36. 36.

    Schwab-Stone M, Fisher P, Piacentini J, Shaffer D, Davies M, et al: The Diagnostic Interview Schedule for Children-Revised version (DISC-R): II. Test-Retest Reliability. J Am Acad Child Adolesc Psychiatry 32:651–657, 1993.

    Google Scholar 

  37. 37.

    Goodman ME: Race awareness in young children (rev. ed.). New York: Collier. 1964.

    Google Scholar 

  38. 38.

    Porter JDW: Black child, white child: the development of racial attitudes. Cambridge, MA: Harvard University Press. 1971.

    Google Scholar 

  39. 39.

    Rosenberg M, Simmons RG: Black and white self-esteem: the urban school child. Washington, DC: American Sociological Association. 1972.

    Google Scholar 

  40. 40.

    Valla JP, Bergeron L, Bérubé H, Gaudet N, St. George M: A structured pictorial questionnaire to assess DSM-III-R-Based diagnoses in children (6–11 years): Development, Validity, and Reliability. J. Abnormal Child Psychology 22:403–423, 1994.

    Google Scholar 

  41. 41.

    Valla JP, Bergeron L, Bidaut-Russell M, St. Georges M, Gaudet N: Reliability of the Dominic-R: A young child mental health questionnaire combining visual and auditory stimuli. J Child Psychol Psychiatry, 1997 (in press).

  42. 42.

    Neugebauer R: Psychometric Properties of DARRYL, a cartoon-based measure of PTSD. Scientific proceedings of the annual meeting of the American Academy of Child & Adolescent Psychiatry NR-92:111, 1996.

    Google Scholar 

  43. 43.

    Rotheram MJ, Phinney JS: Introduction: Definition and perspectives in the study of children's ethnic socialization. In Children's ethnic socialization: Pluralism and development. J.S. Phinney & M.J. Rotheram (Eds.), Newbury park, CA. Pages:10–28, 1986.

  44. 44.

    Kashani JH, Orvaschel H, Burk JP, Reid JC: Informant variance: the issue of parent-child disagreement. J Am Acad Child Psychiatry 24:437–441, 1985.

    Google Scholar 

  45. 45.

    Edelbrock C, Costello AJ, Dulcan MK, Calabro Conover N, Kalas R: Parent-child agreement on child psychiatric symptoms assessed via structured interviews. J Child Psychol Psychiatry 27:181–190, 1986.

    Google Scholar 

  46. 46.

    Herjanic B, Reich W: Development of a structured psychiatric interview for children: agreement between child and parent on individual symptoms. J Abnorm Child Psychol. 10:307–324, 1982.

    Google Scholar 

  47. 47.

    Iran-Nedaj A: Active and dynamic self-regulation of learning process. Review of Educational Research 60:573–602, 1990.

    Google Scholar 

  48. 48.

    Diagnostic and Statistical Manual of Mental Disorders (Third Edition-Revised). American Psychiatric Association. 1987.

  49. 49.

    Yates T: Theories of cognitive development. In: Lewis M. (Ed.). Child and Adolescent Psychiatry. Baltimore, Williams & Wilkins. 1990.

    Google Scholar 

  50. 50.

    Cohen J: A coefficient of agreement for nominal scales. Educ Psychol Measurement 20:37–46, 1960.

    Google Scholar 

  51. 51.

    Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 33:159–174, 1977.

    Google Scholar 

  52. 52.

    Shrout PE, Fleiss JL: Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 2:420–428, 1979.

    Google Scholar 

  53. 53.

    Cronbach LJ, Gleser GC, Nanda H, Rajaratnam N: The Dependability of Behavioral Measurements. John Wiley & Sons, New York. 1971.

    Google Scholar 

  54. 54.

    Peters MF: Child rearing in black families: potential continuities and discontinuities between home and school. Paper presented at the annual meeting of the National Council on Family Relations, Portland, OR, October 1974.

  55. 55.

    Andrews VC, Garrison CZ, Jackson KL, Addy CL, McKeown RE: Mother-child agreement on the symptoms and diagnoses of child depression and conduct disorders. J Am Acad Child Adolesc Psychiatry 32:731–738, 1993.

    Google Scholar 

  56. 56.

    Chambers WJ, Puig-Antich J, Hirsch M, Paez P, Ambrosini PJ, Tabrizi MA, Davies M: The assessment of affective disorders in children and adolescents by semi-structured interviews. Arch Gen Psychiatry 42:696–702, 1985.

    Google Scholar 

  57. 57.

    Edelbrock C, Costello AJ, Dulcan MK, Calabro-Conover N, Kalas R: Parent-child agreement on child psychiatric symptoms assessed via structured interviews. J Child Psychol Psychiatry 27:181–190, 1986.

    Google Scholar 

  58. 58.

    Orvaschel H, Puig-Antich J, Chambers WJ, Tabrizi MA, Johnson R: Retrospective assessment of prepubertal major depression with the Kiddie-SADS-E. J Am Acad Child Adolesc Psychiatry. 21:392–397, 1982.

    Google Scholar 

  59. 59.

    Reich W, Herjanic B, Welner Z, Gandy PR: Development of a structured psychiatric interview for children: agreement on diagnosis comparing child and parent interviews. J Abnorm Child Psychol 10:325–336, 1982.

    Google Scholar 

  60. 60.

    Bidaut-Russell M, Reich W, Cottler LB, Robins LE, Compton WM, Mattison RE: The Diagnostic Interview Schedule for Children (PC-DISC v.3.0): Parents and adolescents suggest reasons for expecting discrepant answers. J Abnorm Child Psychol 23:641–659, 1995.

    Google Scholar 

  61. 61.

    Peters MF: Child rearing patterns in a sample of Black parents of children age 1 to 3. Paper presented at the annual meeting of the Society for Research in Child Development. 1981.

  62. 62.

    Andrews VC, Garrison CZ, Jackson KL, Addy CL, McKeown RE: Mother-child agreement on the symptoms and diagnoses of child depression and conduct disorders. J Am Acad Child Adolesc Psychiatry 32:731–738, 1993.

    Google Scholar 

  63. 63.

    Reich W, Herjanic B, Welner Z, Gandy PR: Development of a structured psychiatric interview for children: agreement on diagnosis comparing child and parent interviews. J Abnorm Child Psychol 10:325–336, 1982.

    Google Scholar 

  64. 64.

    Krech KH, Johnston C: The relationship of depressed mood and life stress to maternal perceptions of child behavior. J Clin Child Psychol 21:115–122, 1992.

    Google Scholar 

  65. 65.

    Angold A, Weissman MM, John K, et al: Parent and child reports of depressive symptoms in children at low and high risk of depression. J Child Psychol Psychiatry 28:901–915, 1987.

    Google Scholar 

  66. 66.

    Weissman MM, Wickramaratne P, Warner V, et al.: Assessing psychiatric disorders in children: discrepancies between mother's and child's reports. Arch Gen Psychiatry 44:747–753, 1987.

    Google Scholar 

  67. 67.

    Brody GH, Stoneman Z, Flor D, McCrary C, Hastings L, Conyers O: Financial resources, parent psychologinal functioning, parent co-caregiving, and early adolescent competence in rural two-parent African-American families. Child Development 65(2):590–605, 1994.

    Google Scholar 

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to Michelle Bidaut-Russell.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Bidaut-Russell, M., Valla, JP., Thomas, J.M. et al. Reliability of the Terry: A Mental Health Cartoon-Like Screener for African-American Children. Child Psychiatry Hum Dev 28, 249–263 (1998). https://doi.org/10.1023/A:1022636115485

Download citation

  • Child Mental Health
  • Diagnostic Interviews
  • Diagnosis
  • Assessment