Abstract
Test-retest reliability and internal consistency of the Terry, a cartoon-based child mental health screener developed for African-American children, were measured in 36 boys (age 5 \({\raise0.7ex\hbox{$1$} \!\mathord{\left/ {\vphantom {1 2}}\right.\kern-\nulldelimiterspace}\!\lower0.7ex\hbox{$2$}}\) to 13) in a test-retest design. Reliability of the diagnosis (0.70 ≤ k ≤ 0.75) was good for ADHD, ODD, CD, and OAD, and excellent for MDD and SAD. Because of low base-rate, no kappa value was calculated for SPh. Both test-retest agreement, and reliability of the symptom scale (0.75 ≤ ICC≤0.80) were very good for all 7 diagnoses. Internal consistency according to symptom scale (0.78≤ Cronbach α≤O.90), was moderate for OAD, good for SPh, MDD, SAD, CD, and ODD, and excellent for ADHD. The Terry is a culturally-sensitive questionnaire with good reliability.
Similar content being viewed by others
References
Cohen P, Cohen J, Kasen S, Velez CN, Hartmark C et al: An epidemiological study of disorders in late childhood and adolescence; I, age and gender-specific prevalence. J Child Psychol Psychiatry 34:851–867, 1993.
Kilgus MD, Pumariega AJ, Cuffe S: Influence of race on diagnosis in adolescent psychiatric inpatients. J Am Acad Child Adolesc Psychiatry 34:67–72, 1995.
Langner TS, Gersten JC, Greene EL, Eisenberg JG, et al: Treatment of psychological disorders among urban children. J Consult Clin Psychol 42:170–179, 1974.
Harrison G, Owens D, Holton A, et al: A prospective study of mental disorder in Afro-Caribbean patients. Psychol Med 18:643–657, 1988.
Rosenstein MJ, Maillots-Sayre LJ, McAskill RL, et al.: Use of inpatient services by special populations. In: Mental Health, United States, 1987, Manderscheid RW, Barrett SA, eds. DHHS pub (ADM) 87-1518. Rockville, Md, National Institute of Mental Health, 1988.
Robins LN, Regier DA, eds. Psychiatric Disorders in America: The Epidemiologic Catchment Area Study. New York, Free Press, 1991.
Sartorius N, Jablensky A, Korten A, et al: Early manifestations and first contact incidence of schizophrenia in different cultures. Psychol Med 16:909–928, 1986.
Fabrega Jr. H. Cultural challenges to the Psychiatric Enterprise. Comp Psychiatry 36:377–383, 1995.
Malgady RG, Rogler LH, Tyron WW: Issues of validity in the Diagnostic Interview Schedule. J Psychiatry Res 26:59–67, 1992.
Rogler LH: The meaning of culturally sensitive research in mental health. Am J Psychiatry 146:296–303, 1989.
Adebimpe VR, Gigandet J, Harris E: MMPI diagnosis of black psychiatric patients. Am J Psychiatry 136:85–87, 1979.
Greene RL: Ethnicity and MMPI performance: a review. J Consult Clin Psychol 55:497–512, 1987.
Pritchard DA, Rosenblatt A: Racial bias in the MMPI: a methodological review. J Consult Clin Psychol 48:263–267, 1980.
Hamberger LK, Hastings JE: Racial differences in the Millon Clinical Multi axial Inventory in an outpatient clinical sample. J Pers Assess 58:90–96, 1992.
Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition. Washington, DC, American Psychiatric Association, 1994.
Butcher JN, Graham JR, Williams CL, et al: Development and use of the MMPI-II content scales. Minneapolis, University of Minnesota Press, 1990.
Achenbach TM: What is “developmental” about developmental psychopathology? In Risk and Protective factors in the Development of Psychopathology, eds. Roll J, Masten AS, Cicetti D, Nuechterlein KH & Weintraub S. New York: Cambridge University Press, pp 29–48, 1990.
Cicchetti D: A historical perspective on the discipline of developmental psychopathology. In Risk and Protective factors in the Development of Psychopathology, eds. Roll J, Masten AS, Cicetti D, Nuechterlein KH & Weintraub S. New York: Cambridge University Press, pp 1–28, 1990.
Langner TS, Gersten JC, Eisenberg JG: Approaches to measurement and definition in the epidemiology of behavior disorders: ethnic background and child behavior. Int J Health Serv 4:483–501, 1974.
Canino IA, Gould MS, Prupis S, Shaffer D: A comparison of symptoms and diagnoses in Hispanic and Black children in an outpatient mental health clinic. J Am Acad Child Adolesc Psychiatry 25:254–259, 1986.
Canino IA, Spurlock J: Culturally diverse children and adolescents: Assessment, diagnosis and treatment. New York: The Guilford Press. 1994.
Mann EM, Ikeda Y, Mueller CW, Takahashi A, Tao KT, et al: Cross-cultural differences in rating hyperactive-disruptive behaviors in children. Am J Psychiatry 149:1539–1542, 1992.
Weisz JR, Suwanlert S, Chaiyasit W, Weiss B, Achenbach TM, Eastman KL: Behavioral and emotional problems among Thai and American adolescents: parent reports for ages 12–16. J Abnorm Psychol 102:395–403, 1993.
Pepler DJ, Lessa I: The mental health of Portuguese children. Can J Psychiatry 38:46–50, 1993.
Lambert MC, Knight F, Taylor R, Achenbach TM: Epidemiology of behavioral and emotional problems among children of Jamaica and the United States: parent reports for ages 6 to 11. J Abnorm Child Psychol 22:113–28, 1994.
Achenbach TM, Hensley VR, Phares V, Grayson D: Problems and competencies reported by parents of Australian and American children. J Child Psych Psychiatry 31:265–286, 1990.
Achenbach TM, Verhulst FC, Byron GD, Akkerhuis GW: Epidemiological comparisons of American and Dutch children: I. Behavioral/emotional problems and competencies reported by parents for age 4 to 16. J Am Acad Child Adolesc Psychiatry 26:317–325, 1987.
Sue DW, Sue D: Counseling the culturally different. New York, Wiley, 1990.
Costello EJ, Janiszewski S: Who gets treated? Factors associated with referrals in children with psychiatric disorders. Acta Psychiatr Scand 81:523–529, 1990.
Bond CF, DiCandia CG, MacKinnon JR: Responses to violence in a psychiatric setting: the role of the patient's race. Personality and Social Psychology Bulletin 14:448–458, 1988.
Flaherty J, Meagher R: Measuring racial bias in inpatient treatment. Am J Psychiatry 137:379–382, 1980.
Blacks more likely to get long-acting drugs. Psychiatr News 134:18–19, 1984.
Cuffe SP, Waller J, Cuccaro ML, Pumariega AJ, Garrison CZ: Race and gender differences in the treatment of psychiatric disorders in young adolescents. J Am Acad Child Adolesc Psychiatry 34:1536–1543, 1995.
Adebimpe V: Race, racism, and epidemiological surveys. Hosp Com Psychiatry 45:27–32, 1994.
Schwab-Stone M, Fallon T, Briggs M, Crowther B: Reliability of Diagnostic Reporting for children aged 6–11 years: a test-retest study of the Diagnostic Interview Schedule for Children-Revised. Am J Psychiatry 151:1048–1054, 1994.
Schwab-Stone M, Fisher P, Piacentini J, Shaffer D, Davies M, et al: The Diagnostic Interview Schedule for Children-Revised version (DISC-R): II. Test-Retest Reliability. J Am Acad Child Adolesc Psychiatry 32:651–657, 1993.
Goodman ME: Race awareness in young children (rev. ed.). New York: Collier. 1964.
Porter JDW: Black child, white child: the development of racial attitudes. Cambridge, MA: Harvard University Press. 1971.
Rosenberg M, Simmons RG: Black and white self-esteem: the urban school child. Washington, DC: American Sociological Association. 1972.
Valla JP, Bergeron L, Bérubé H, Gaudet N, St. George M: A structured pictorial questionnaire to assess DSM-III-R-Based diagnoses in children (6–11 years): Development, Validity, and Reliability. J. Abnormal Child Psychology 22:403–423, 1994.
Valla JP, Bergeron L, Bidaut-Russell M, St. Georges M, Gaudet N: Reliability of the Dominic-R: A young child mental health questionnaire combining visual and auditory stimuli. J Child Psychol Psychiatry, 1997 (in press).
Neugebauer R: Psychometric Properties of DARRYL, a cartoon-based measure of PTSD. Scientific proceedings of the annual meeting of the American Academy of Child & Adolescent Psychiatry NR-92:111, 1996.
Rotheram MJ, Phinney JS: Introduction: Definition and perspectives in the study of children's ethnic socialization. In Children's ethnic socialization: Pluralism and development. J.S. Phinney & M.J. Rotheram (Eds.), Newbury park, CA. Pages:10–28, 1986.
Kashani JH, Orvaschel H, Burk JP, Reid JC: Informant variance: the issue of parent-child disagreement. J Am Acad Child Psychiatry 24:437–441, 1985.
Edelbrock C, Costello AJ, Dulcan MK, Calabro Conover N, Kalas R: Parent-child agreement on child psychiatric symptoms assessed via structured interviews. J Child Psychol Psychiatry 27:181–190, 1986.
Herjanic B, Reich W: Development of a structured psychiatric interview for children: agreement between child and parent on individual symptoms. J Abnorm Child Psychol. 10:307–324, 1982.
Iran-Nedaj A: Active and dynamic self-regulation of learning process. Review of Educational Research 60:573–602, 1990.
Diagnostic and Statistical Manual of Mental Disorders (Third Edition-Revised). American Psychiatric Association. 1987.
Yates T: Theories of cognitive development. In: Lewis M. (Ed.). Child and Adolescent Psychiatry. Baltimore, Williams & Wilkins. 1990.
Cohen J: A coefficient of agreement for nominal scales. Educ Psychol Measurement 20:37–46, 1960.
Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics. 33:159–174, 1977.
Shrout PE, Fleiss JL: Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 2:420–428, 1979.
Cronbach LJ, Gleser GC, Nanda H, Rajaratnam N: The Dependability of Behavioral Measurements. John Wiley & Sons, New York. 1971.
Peters MF: Child rearing in black families: potential continuities and discontinuities between home and school. Paper presented at the annual meeting of the National Council on Family Relations, Portland, OR, October 1974.
Andrews VC, Garrison CZ, Jackson KL, Addy CL, McKeown RE: Mother-child agreement on the symptoms and diagnoses of child depression and conduct disorders. J Am Acad Child Adolesc Psychiatry 32:731–738, 1993.
Chambers WJ, Puig-Antich J, Hirsch M, Paez P, Ambrosini PJ, Tabrizi MA, Davies M: The assessment of affective disorders in children and adolescents by semi-structured interviews. Arch Gen Psychiatry 42:696–702, 1985.
Edelbrock C, Costello AJ, Dulcan MK, Calabro-Conover N, Kalas R: Parent-child agreement on child psychiatric symptoms assessed via structured interviews. J Child Psychol Psychiatry 27:181–190, 1986.
Orvaschel H, Puig-Antich J, Chambers WJ, Tabrizi MA, Johnson R: Retrospective assessment of prepubertal major depression with the Kiddie-SADS-E. J Am Acad Child Adolesc Psychiatry. 21:392–397, 1982.
Reich W, Herjanic B, Welner Z, Gandy PR: Development of a structured psychiatric interview for children: agreement on diagnosis comparing child and parent interviews. J Abnorm Child Psychol 10:325–336, 1982.
Bidaut-Russell M, Reich W, Cottler LB, Robins LE, Compton WM, Mattison RE: The Diagnostic Interview Schedule for Children (PC-DISC v.3.0): Parents and adolescents suggest reasons for expecting discrepant answers. J Abnorm Child Psychol 23:641–659, 1995.
Peters MF: Child rearing patterns in a sample of Black parents of children age 1 to 3. Paper presented at the annual meeting of the Society for Research in Child Development. 1981.
Andrews VC, Garrison CZ, Jackson KL, Addy CL, McKeown RE: Mother-child agreement on the symptoms and diagnoses of child depression and conduct disorders. J Am Acad Child Adolesc Psychiatry 32:731–738, 1993.
Reich W, Herjanic B, Welner Z, Gandy PR: Development of a structured psychiatric interview for children: agreement on diagnosis comparing child and parent interviews. J Abnorm Child Psychol 10:325–336, 1982.
Krech KH, Johnston C: The relationship of depressed mood and life stress to maternal perceptions of child behavior. J Clin Child Psychol 21:115–122, 1992.
Angold A, Weissman MM, John K, et al: Parent and child reports of depressive symptoms in children at low and high risk of depression. J Child Psychol Psychiatry 28:901–915, 1987.
Weissman MM, Wickramaratne P, Warner V, et al.: Assessing psychiatric disorders in children: discrepancies between mother's and child's reports. Arch Gen Psychiatry 44:747–753, 1987.
Brody GH, Stoneman Z, Flor D, McCrary C, Hastings L, Conyers O: Financial resources, parent psychologinal functioning, parent co-caregiving, and early adolescent competence in rural two-parent African-American families. Child Development 65(2):590–605, 1994.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Bidaut-Russell, M., Valla, JP., Thomas, J.M. et al. Reliability of the Terry: A Mental Health Cartoon-Like Screener for African-American Children. Child Psychiatry Hum Dev 28, 249–263 (1998). https://doi.org/10.1023/A:1022636115485
Issue Date:
DOI: https://doi.org/10.1023/A:1022636115485