Abstract
Multiple informants commonly disagree when reporting child and family behavior. In many studies of informant discrepancies, researchers take the difference between two informants’ reports and seek to examine the link between this difference score and external constructs (e.g., child maladjustment). In this paper, we review two reasons why difference scores cannot serve as unambiguous predictors of outcomes. Further, we use polynomial regression analyses to both test the validity of difference scores and provide a more direct test of the hypothesis that discrepancies in parent and child reports predict child psychopathology. Data from 218 parent-adolescent dyads (M adolescent age = 11.5 years, 51 % female; 49 % European American, 47 % African American) were used to predict adolescent-reported antisocial behavior and depression from parent and adolescent reports of parent-adolescent conflict, parental knowledge, parental acceptance, adolescent rule-breaking behavior, and adolescent pubertal development. Results demonstrate that analyses using difference scores do not provide valid tests of the utility of informant discrepancies in predicting adolescent psychosocial maladjustment. However, interaction terms in polynomial regression analyses provide evidence that informant discrepancies predict child psychopathology. Parent-adolescent informant discrepancies predict adolescent psychopathology but researchers should avoid using difference scores to measure informant discrepancies. Polynomial regression analyses provide more comprehensive and accurate tests of whether informant discrepancies predict child and adolescent psychopathology.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987). Child/adolescent behavioral and emotional problems: implications of cross-informant correlations for situational specificity. Psychological Bulletin, 101, 213–232. doi:10.1037//0033-2909.101.2.213.
Barnes, J. C., Beaver, K. M., & Piquero, A. R. (2011). A test of Moffitt’s hypotheses of delinquency abstention. Criminal Justice and Behavior, 38, 690–709. doi:10.1177/0093854811405282.
Bosworth, K., & Espelage, D. (1995). Teen conflict survey. Center for Adolescent Studies, Indiana University.
Brown, B. B., Mounts, N., Lamborn, S. D., & Steinberg, L. (1993). Parenting practices and peer group affiliation in adolescence. Child Development, 64, 467–482. doi:10.1111/j.1467-8624.1993.tb02922.x.
Cohen, J. (1988). Statistical power analyses for the behavioral sciences (2nd ed.). Mahwah: Erlbaum.
Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2003). Applied multiple regression/correlation for the behavioral sciences (3rd ed.). Mahwah: Erlbaum.
Collins, W. A., & Laursen, B. (2006). Parent-adolescent relationships. In P. Noller & J. Feeney (Eds.), Close relationships: Functions, forms, and processes (pp. 111–125). New York: Psychology Press.
Dahlberg, L. L., Toal, S. B., Swahn, M., & Behrens, C. B. (2005). Measuring violence related attitudes, behaviors, and influences among youth: A compendium of assessment tools. Atlanta: Centers for Disease Control and Prevention, National Center for Injury Prevention and Control.
De Los Reyes, A. (2011). Introduction to the special section: more than measurement error: discovering meaning behind informant discrepancies in clinical assessments of children and adolescents. Journal of Clinical Child and Adolescent Psychology, 40, 1–9. doi:10.1080/15374416.2011.533405.
De Los Reyes, A. (2012). Strategic objectives for improving understanding of informant discrepancies in developmental psychopathology research. Development and Psychopathology.
De Los Reyes, A., & Kazdin, A. E. (2004). Measuring informant discrepancies in clinical child research. Psychological Assessment, 16, 330–334. doi:10.1037/1040-3590.16.3.330.
De Los Reyes, A., & Kazdin, A. E. (2005). Informant discrepancies in the assessment of childhood psychopathology: a critical review, theoretical framework, and recommendations for further study. Psychological Bulletin, 131, 483–509. doi:10.1037/0033-2909.131.4.483.
De Los Reyes, A., & Kazdin, A. E. (2006). Conceptualizing changes in behavior in intervention research: the range of possible changes model. Psychological Review, 113, 554–583. doi:10.1037/0033-295X.113.3.554.
De Los Reyes, A., & Kazdin, A. E. (2008). When the evidence says, “Yes, no, and maybe so”: attending to and interpreting inconsistent findings among evidence-based interventions. Current Directions in Psychological Science, 17, 47–51. doi:10.1111/j.1467-8721.2008.00546.x.
De Los Reyes, A., & Kazdin, A. E. (2009). Identifying evidence-based interventions for children and adolescents using the range of possible changes model: a meta-analytic illustration. Behavior Modification, 33, 583–617. doi:10.1177/0145445509343203.
De Los Reyes, A., Henry, D. B., Tolan, P. H., & Wakschlag, L. S. (2009). Linking informant discrepancies to observed variations in young children’s disruptive behavior. Journal of Abnormal Child Psychology, 37, 637–652. doi:10.1007/s10802-009-9307-3.
De Los Reyes, A., Goodman, K. L., Kliewer, W., & Reid-Quiñones, K. (2010a). The longitudinal consistency of mother-child reporting discrepancies of parental monitoring and their ability to predict child delinquent behaviors two years later. Journal of Youth and Adolescence, 39, 1417–1430. doi:10.1007/s10964-009-9496-7.
De Los Reyes, A., Reynolds, E. K., Wang, F., MacPherson, L., & Lejuez, C. W. (2010b). Discrepancy between how children perceive their own alcohol risk and how they perceive alcohol risk for other children longitudinally predicts alcohol use. Addictive Behaviors, 35, 1061–1066. doi:10.1016/j.addbeh.2010.07.006.
De Los Reyes, A., Youngstrom, E. A., Pabón, S. C., Youngstrom, J. K., Feeny, N. C., & Findling, R. L. (2011). Internal consistency and associated characteristics of informant discrepancies in clinic referred youths age 11 to 17 years. Journal of Clinical Child and Adolescent Psychology, 40, 36–53. doi:10.1080/15374416.2011.533402.
De Los Reyes, A., Aldao, A., Thomas, S. A., Daruwala, S. E., Swan, A. J., Van Wie, et al. (2012a). Adolescent self-reports of social anxiety: can they disagree with objective psychophysiological measures and still be valid? Journal of Psychopathology and Behavioral Assessment. Advance online publication. doi:10.1007/s10862-012-9289-2.
De Los Reyes, A., Ehrlich, K. B., Swan, A. J., Luo, T., Van Wie, M., & Pabón, S. C. (2012b). An experimental test of whether informants can report about child and family behavior based on settings of behavioral expression. Journal of Child and Family Studies. Advance online publication. doi:10.1007/s10826-012-9567-3.
De Los Reyes, A., Thomas, S. A., Swan, A. J., Ehrlich, K. B., Reynolds, E. K., Suarez, L., et al. (2012c). “It depends on what you mean by ‘disagree’”: differences between parent and child perceptions of parent-child conflict. Journal of Psychopathology and Behavioral Assessment. Advance online publication. doi:0.1007/s10862-012-9288-3.
Dishion, T. J., & McMahon, R. J. (1998). Parental monitoring and the prevention of child and adolescent problem behavior: a conceptual and empirical formulation. Clinical Child and Family Psychology Review, 1, 61–75. doi:10.1023/A:1021800432380.
Dishion, T. J., Patterson, G. R., Stoolmiller, M., & Skinner, M. L. (1991). Family, school, and behavioral antecedents to early adolescent involvement with antisocial peers. Developmental Psychology, 27, 172–180. doi:10.1037/0012-1649.27.1.172.
Edwards, J. R. (1994). The study of congruence in organizational behavior research: critique and a proposed alternative. Organizational Behavior and Human Decision Processes, 58, 51–100. doi:10.1006/obhd.1994.1029.
Edwards, J. R. (2002). Alternatives to difference scores: Polynomial regression analysis and response surface methodology. In F. Drasgow & N. Schmitt (Eds.), Measuring and analyzing behavior in organizations: Advances in measurement and data analysis (pp. 350–400). San Francisco: Jossey-Bass.
Edwards, J. R. (2009). Latent variable modeling in congruence research: current problems and future directions. Organizational Research Methods, 12, 34–62. doi:10.1177/1094428107308920.
Edwards, J. R., & Harrison, R. V. (1993). Job demands and worker health: three-dimensional reexamination of the relationship between person-environment fit and strain. Journal of Applied Psychology, 78, 628–648. doi:10.1037/0021-9010.78.4.628.
Farrell, A. D., Kung, E. M., White, K. S., & Valois, R. F. (2000). The structure of self-reported aggression, drug use, and delinquent behaviors during early adolescence. Journal of Clinical Child Psychology, 29, 282–292. doi:10.1207/S15374424jccp2902_13.
Ferdinand, R. F., van der Ende, J., & Verhulst, F. C. (2004). Parent-adolescent disagreement regarding psychopathology in adolescents from the general population as a risk factor for adverse outcome. Journal of Abnormal Psychology, 113, 198–206. doi:10.1037/0021-843X.113.2.198.
Funder, D. C. (2009). Persons, behaviors and situations: an agenda for personality psychology in the postwar era. Journal of Research in Personality, 43, 120–126. doi:10.1016/j.jrp. 2008.12.041.
Ganzach, Y. (1997). Misleading interaction and curvilinear terms. Psychological Methods, 2, 235–247. doi:10.1037/1082-989X.2.3.235.
Goodman, K. L., De Los Reyes, A., & Bradshaw, C. P. (2010). Understanding and using informants’ reporting discrepancies of youth victimization: a conceptual model and recommendations for research. Clinical Child and Family Psychology Review, 13, 366–383. doi:10.1007/s10567-010-0076-x.
Griffin, D., Murray, S., & Gonzalez, R. (1999). Difference score correlations in relationship research: a conceptual primer. Personal Relationships, 6, 505–518. doi:10.1111/j.1475-6811.1999.tb00206.x.
Johns, G. (1981). Difference score measures of organizational behavior variables: a critique. Organizational Behavior and Human Performance, 27, 443–463. doi:10.1016/0030-5073(81)90033-7.
Kraemer, H. C., Measelle, J. R., Ablow, J. C., Essex, M. J., Boyce, W. T., & Kupfer, D. J. (2003). A new approach to integrating data from multiple informants in psychiatric assessment and research: mixing and matching contexts and perspectives. American Journal of Psychiatry, 160, 1566–1577. doi:10.1176/appi.ajp. 160.9.1566.
Laird, R. D., & Marrero, M. D. (2010). Information management and behavior problems: is concealing misbehavior necessarily a sign of trouble? Journal of Adolescence, 33, 297–308. doi:10.1016/j.adolescence.2009.05.018.
Laird, R. D., & Marrero, M. D. (2011). Mothers’ knowledge of early adolescents’ activities following the middle school transition and pubertal maturation. Journal of Early Adolescence, 31, 209–233. doi:10.1177/0272431609361202.
Laird, R. D., & Weems, C. F. (2011). The equivalence of regression models using difference scores and models using separate scores for each informant: implications for the study of informant discrepancies. Psychological Assessment, 23, 388–397. doi:10.1037/a0021926.
Moffitt, T. E. (1993). Adolescence-limited and life-course-persistent antisocial behavior: a developmental taxonomy. Psychological Review, 100, 674–701. doi:10.1037/0033-295X.100.4.674.
Muthén, L. K., & Muthén, B. O. (2010). Mplus user’s guide (6th ed.). Los Angeles: Muthén & Muthén.
Nelson, D. A., Hart, C. H., Yang, C., Olsen, J. A., & Jin, S. (2006). Aversive parenting in China: Associations with child physical and relational aggression. Child Development, 77, 554–572. doi:10.1111/j.1467-8624.2006.00890.x.
Orpinas, P. (1993). Skills training and social influences for violence prevention in middle schools: A curriculum evaluation. Unpublished doctoral dissertation. Houston, TX: University of Texas Health Science Center.
Pelton, J., & Forehand, R. (2001). Discrepancy between mother and child perceptions of their relationship: I. Consequences for adolescents considered within the context of parental divorce. Journal of Family Violence, 16, 1–15. doi:10.1023/A:1026527008239.
Petersen, A. C., Crockett, L., Richards, M., & Boxer, A. (1988). A self-report measure of pubertal status: reliability, validity, and initial norms. Journal of Youth and Adolescence, 17, 117–133. doi:10.1007/BF01537962.
Racz, S. J., & McMahon, R. J. (2011). The relationship between parental knowledge and monitoring and child and adolescent conduct problems: a 10-year update. Clinical Child and Family Psychology Review, 14, 377–398. doi:10.1007/s10567-011-0099-y.
Richters, J. E. (1992). Depressed mothers as informants about their children: a critical review of the evidence for distortion. Psychological Bulletin, 112, 485–499. doi:10.1037/0033-2909.112.3.485.
Robin, A. L., & Foster, S. L. (1989). Negotiating parent-adolescent conflict: A behavioral-family systems approach. Guilford Press.
Rogosa, D. R., & Willett, J. B. (1983). Demonstrating the reliability of the difference score in the measurement of change. Journal of Educational Measurement, 20, 335–343. doi:10.1111/j.1745-3984.1983.tb00211.x.
Schaefer, E. S. (1965). Children’s reports of parental behavior: an inventory. Child Development, 36, 413–424.
Schludermann, S., & Schludermann, E. (1988). Questionnaire for children and youth (CRPBI-30). Unpublished manuscript, University of Manitoba, Winnipeg.
Sentse, M., & Laird, R. D. (2010). Parent-child relationships and dyadic friendship experiences as predictors of behavior problems in early adolescence. Journal of Clinical Child and Adolescent Psychology, 39, 873–884. doi:10.1080/15374416.2010.517160.
Shirtcliff, E. A., Dahl, R. E., & Pollack, S. D. (2009). Pubertal development: correspondence between hormonal and physical development. Child Development, 80, 327–337. doi:10.1111/j.1467-8624.2009.01263.x.
Tein, J.-Y., Roosa, M. W., & Michaels, M. (1994). Agreement between parent and child reports on parental behaviors. Journal of Marriage & The Family, 56, 341–355. doi:10.2307/353104.
Author information
Authors and Affiliations
Corresponding author
Additional information
This research was supported by grants from the National Science Foundation (BCS 0517980 & 0807650) to R. D. Laird. We thank the teachers and principals from the East Baton Rouge Parish School System and the families who participated in this research. Thanks to Carl F. Weems for comments on early drafts of this paper.
Rights and permissions
About this article
Cite this article
Laird, R.D., De Los Reyes, A. Testing Informant Discrepancies as Predictors of Early Adolescent Psychopathology: Why Difference Scores Cannot Tell You What You Want to Know and How Polynomial Regression May. J Abnorm Child Psychol 41, 1–14 (2013). https://doi.org/10.1007/s10802-012-9659-y
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10802-012-9659-y