Prevention Science

, Volume 7, Issue 1, pp 31–41 | Cite as

Validity of Teacher Ratings in Selecting Influential Aggressive Adolescents for a Targeted Preventive Intervention

  • David B. HenryEmail author
  • Shari Miller-Johnson
  • Thomas R. Simon
  • Michael E. Schoeny
  • The Multi-site Violence Prevention Project
Research Article

This study describes a method for using teacher nominations and ratings to identify socially influential, aggressive middle school students for participation in a targeted violence prevention intervention. The teacher nomination method is compared with peer nominations of aggression and influence to obtain validity evidence. Participants were urban, predominantly African American and Latino sixth-grade students who were involved in a pilot study for a large multi-site violence prevention project. Convergent validity was suggested by the high correlation of teacher ratings of peer influence and peer nominations of social influence. The teacher ratings of influence demonstrated acceptable sensitivity and specificity when predicting peer nominations of influence among the most aggressive children. Results are discussed in terms of the application of teacher nominations and ratings in large trials and full implementation of targeted prevention programs.


selective interventions teacher ratings halo effects ecological risk 



This research was supported by cooperative agreement number #99067 from the Centers for Disease Control and Prevention. The Multi-Site Violence Prevention Project included Robin Ikeda, MD, Thomas Simon, PhD, Emilie Smith, PhD, and LeRoy Reese, PhD from the Centers for Disease Control and Prevention; David Rabiner, PhD, Shari Miller-Johnson, PhD, Donna-Marie Winn, Ph.D, Steven Asher, PhD, and Kenneth Dodge, PhD from Duke University; Arthur Horne, PhD, Pamela Orpinas, PhD, William Quinn, PhD, and Carl Huberty, PhD from the University of Georgia; Patrick Tolan, PhD, Deborah Gorman-Smith, PhD, David Henry, PhD, and Franklin Gay, MPH from the University of Illinois at Chicago; and Albert Farrell, PhD, Aleta Meyer, PhD, Terri Sullivan, PhD, Kevin Allison, PhD from Virginia Commonwealth University


  1. Achenbach, T. M. (1991). Manual for the Child Behavior Checklist/4-18 and 1991 Profile. Burlington, VT: University of Vermont, Department of Psychiatry.Google Scholar
  2. August, G. J., Realmuto, G. M., Crosby, R. D., & MacDonald, A. W. (1995). Community-based multiple-gate screening of children at risk for conduct disorder. Journal of Abnormal Child Psychology, 23, 521–544.PubMedCrossRefGoogle Scholar
  3. Biederman, J., Mick, E., & Faraone, S. V. (1998). Biased maternal reporting of child psychopathology? Journal of the American Academy of Child and Adolescent Psychiatry, 37, 10–11.PubMedCrossRefGoogle Scholar
  4. Casat, C. D., North, J. H., & Boyle-Whitesel, M. (1999). Identification of elementary school children at risk for disruptive behavioral disturbance: Validation of a combined screening method. Journal of the American Academy of Child and Adolescent Psychiatry, 38, 1246–1253.PubMedCrossRefGoogle Scholar
  5. Coie, J. D., & Jacobs, M. R. (1993). The role of social context in the prevention of conduct disorder. Development and Psychopathology, 5, 263–275.CrossRefGoogle Scholar
  6. Coie, J. D., Terry, R., Zakriski, A., & Lochman, J. (1995). Early adolescent social influences on delinquent behavior. In J. McCord (Ed.), Coercion and punishment in long-term perspectives (pp. 229–244). New York: Cambridge University Press.Google Scholar
  7. Coie, J. D., Watt, N. F., West, S. G., Hawkins, J. D., Asarnow, J. R., Markman, H. J., Ramey, S. L., Shure, M. B., & Long, B. (1993). The science of prevention. A conceptual framework and some directions for a national research program. American Psychologist, 48, 1013–1022.PubMedCrossRefGoogle Scholar
  8. Dishion, T. J., Patterson, G. R., & Griesler, P. C. (1994). Peer adaptation in the development of antisocial behavior: A confluence model. In L. R. Huesmann (Ed.), Aggressive behavior: Current perspectives (pp. 61–95). New York: Plenum.Google Scholar
  9. Dishion, T. J., Spracklen, K. M., Andrews, D. W., & Patterson, G. R. (1996). Deviancy training in male adolescents friendships. Behavior Therapy, 27, 373–390.CrossRefGoogle Scholar
  10. Epkins, C. C. (1994). Peer ratings of depression, anxiety, and aggression in inpatient and elementary school children: Rating biases and influence of rater's self-reported depression, anxiety, and aggression. Journal of Abnormal Child Psychology, 22, 611–640.PubMedCrossRefGoogle Scholar
  11. Eron, L. D., & Huesmann, L. R. (1987). The stability of aggressive behavior in cross-national comparison. In C. Kagitcibasi (Ed.), Growth and progress in cross-cultural psychology. (pp. 207–217). Proceedings of the 8th Annual Meeting of the International Association for Cross-Cultural Psychology, Istanbul, Turkey.Google Scholar
  12. Eron, L. D., Walder, L. O., & Lefkowitz, M. M. (1971). The learning of aggression in children. Boston, MA: Little-Brown.Google Scholar
  13. Guerra, N. G. (1998). Social functionality of aggression as a moderator of prevention impact. In N. G. Guerra (Chair), Person in context approaches to prevention. Symposium conducted at the 106th Annual Meeting of the American Psychological Assocation, San Francisco, CA.Google Scholar
  14. Guerra, N. G., Eron, L. D., Huesmann, L. R., Tolan, P. H., & van Acker, R. (1995). A cognitive/ecological approach to the prevention and mitigation of violence and aggression in inner-city youth. In K. Bjorkquist & D. P. Fry (Eds.), Styles of conflict resolution: Models and applications from around the world. New York: Academic .Google Scholar
  15. Henry, D., Farrell, A., & The Multisite Violence Prevention Project. (in press). The study designed by a committee: Research Design of the GREAT Schools and Families Project. American Journal of Preventive Medicine.Google Scholar
  16. Huesmann, L. R., & Eron, L. D. (1992). Childhood aggression and adult criminality. In J. McCord (Ed.), Advances in criminological theory: Crime facts, fictions, and theory. New Brunswick: NJL Transaction.Google Scholar
  17. Huesmann, L. R., Eron, L. D., Guerra, N. G., & Crawshaw, V. B., (1994). Measuring children's aggression with teachers' predictions of peer nominations. Psychological Assessment, 6, 329–336.CrossRefGoogle Scholar
  18. Huesmann, L. R., Maxwell, C. D., Eron, L., Dalhberg, L. L., Guerra, N. G., Tolan, P. H., Van Acker, R., & Henry, D. (1996). Evaluating a cognitive/ecological program for the prevention of aggression among urban children. American Journal of Preventive Medicine, 12(Suppl.), 120–128.PubMedGoogle Scholar
  19. Institute of Medicine. (1994). Reducing risks for mental disorders: Frontiers for preventive intervention research. Washington, DC: National Academy Press.Google Scholar
  20. Kraemer, H. C., Kazdin, A. E., Offord, D. R., Kessler, R. C., Jensen, P. S., & Kupfer, D. J. (1999). Measuring the potency of risk factors for clinical or policy significance. Psychological Methods, 4, 257–271.CrossRefGoogle Scholar
  21. Letendre, J., Henry, D., & Tolan, P. H. (2003). Leader and therapeutic influences and prosocial skill building in school based groups to prevent aggression. Research on Social Work Practice, 13, 569–587.CrossRefGoogle Scholar
  22. Lochman, J. E., & The Conduct Problems Prevention Research Group. (1995). Screening of child behavior problems for prevention programs at school entry. Journal of Consulting and Clinical Psychology, 63, 549–559.PubMedCrossRefGoogle Scholar
  23. Luthar, S. S. (1997). Sociodemographic disadvantage and psychosocial adjustment: Perspectives from developmental psychopathology. In S. S. Luthar, J. A. Burack, D. Cicchetti, & J. R. Weisz (Eds.), Developmental psychopathology. Perspectives on adjustment, risk, and disorder (pp. 459–483). New York: Cambridge University Press.Google Scholar
  24. Meyer, A. L., Allison, K. W., Reese, L., Gay, F., & The Multisite Violence Prevention Project. (in press). Choosing to be violence-free in middle-school: The student component of the GREAT schools and families universal program. American Journal of Preventive Medicine.Google Scholar
  25. Miller-Johnson, S., & Costanzo, P. (in press). If you can't beat ‘em ... have them join you: Peer-based interventions during adolescence. In K. Dodge & J. Kupersmidt (Eds.), Children's peer relations: From development to intervention to policy: A festschrift in honor of John D. Coie. Washington, DC: American Psychological Association.Google Scholar
  26. Miller-Johnson, S., Costanzo, P., Coie, J. D., Rose, M. R., Browne, D. C., & Johnson, C. (in press). Peer social structure and risk-taking behaviors among African American Early Adolescents. Journal of Youth and Adolescence.Google Scholar
  27. Miller-Johnson, S., Sullivan, T., Simon, T., & The Multisite Violence Prevention Project. (in press). Evaluation of a multi-site violence prevention study: Measures, procedures and baseline data. American Journal of Preventive Medicine.Google Scholar
  28. Moffitt, T. E. (1993). Adolescence-limited and life-course-persistent antisocial behavior: A developmental taxonomy. Psychological Review, 100, 674–701.PubMedCrossRefGoogle Scholar
  29. Orpinas, P., Horne, A. M., & The Multisite Violence Prevention Project. (in press). A teacher-focused approach to prevent and reduce students' aggressive behavior: The GREAT teacher program. American Journal of Preventive Medicine.Google Scholar
  30. Petras, H., Chilcoat, H., Ialongo, N., Leaf, P., & Kellam, S. (2004). Utility of the TOCA-R scores during the elementary school years in identifying later violence among adolescent males. Journal of the American Academy of Child and Adolescent Psychiatry, 43, 88–96.PubMedCrossRefGoogle Scholar
  31. Reid, J. B., & Eddy, J. M. (1997). The prevention of antisocial behavior: Some considerations in the search or effective interventions. In D. M. Stoff & J. Breiling (Eds.), Handbook of antisocial behavior (pp. 343–356). New York: Wiley.Google Scholar
  32. Schachar, R. J., Sandberg, S., & Rutter, M. (1986). Agreement between teachers' ratings and observations of hyperactivity, inattentiveness, and defiance. Journal of Abnormal Child Psychology, 14, 331–345.PubMedCrossRefGoogle Scholar
  33. Smith, E. P., Gorman-Smith, D., Quinn, W., Rabiner, D., Tolan, P., Winn, D. M., & The Multisite Violence Prevention Project. (in press). Community-based multiple family groups to prevent and reduce violent and aggressive behavior: The GREAT families program. American Journal of Preventive Medicine.Google Scholar
  34. Yugar, J. M., & Shapiro, E. S. (2001). Elementary children's school friendship: A comparison of peer assessment methodologies. School Psychology Review, 30, 468–585.Google Scholar
  35. Zakriski, A. L., Seifer, R., Sheldrick, C., Prinstein, M. J., Dickstein, S., & Sameroff, A. J. (1999). Child-focused versus school-focused sociometrics: A challenge for the applied researcher. Journal of Applied Developmental Psychology, 20, 481–499.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, Inc. 2005

Authors and Affiliations

  • David B. Henry
    • 1
    • 5
    Email author
  • Shari Miller-Johnson
    • 2
  • Thomas R. Simon
    • 3
  • Michael E. Schoeny
    • 1
  • The Multi-site Violence Prevention Project
    • 4
  1. 1.University of Illinois at ChicagoChicagoUSA
  2. 2.Duke UniversityDurhamUSA
  3. 3.Centers for Disease Control and PreventionAtlantaUSA
  4. 4.The Multi-Site Violence Prevention ProjectAtlantaUSA
  5. 5.PhD, Institute for Juvenile Research, Department of PsychiatryUniversity of Illinois at ChicagoChicagoUSA

Personalised recommendations