Abstract
Most studies of life experiences rely on retrospective self-reports due to the major advantages of this method of data collection. However, some clinicians and researchers express doubts regarding the reliability of self-reports about lived experiences. One option to explore reliability is to assess two or more sources of information, a procedure usually labeled agreement, which consists of the comparison of a self-report (main participant) and a collateral report, to assess whether both reporters describe the same experiences (concordance) and/or to explore whether the collateral confirms the experiences reported by the main participant (corroboration). We studied concordance and corroboration of positive and negative life experiences in 47 pairs of adult twins (N = 94), both genders, 18–50 years of age; 32 pairs were monozygotic. Participants were asked about their own life experiences (to assess concordance) and about their twin’s life experiences (to assess corroboration). Overall agreement between twins was quite acceptable, although it was heterogeneous across items and/or domains. For instance, physical abuse presented a moderate kappa for concordance, while sexual abuse achieved a poor kappa. Corroboration presented globally higher kappa than concordance, suggesting that twins seem to be especially good source of collateral information. Remarkably, when valence (i.e., positive vs. negative experiences) was analyzed, concordance and corroboration were higher for positives experiences than for negative ones. Our results suggest that self- and collateral-reports are reliable means of assessing life experiences, which has important implications for future research.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Azevedo, V., Martins. C., & Maia, A. (2017). Lifetime Experiences Scale (LIFES): Development, validation and reliability in community samples. Manuscript submitted for publication.
Baumeister, R. F., Bratslavsky, E., Finkenauer, C., & Vohs, K. D. (2001). Bad is stronger than good. Review of General Psychology, 5, 323–370. https://doi.org/10.1037//1089-2680.5.4.323.
Beckett, M., Da Vanzo, J., Sastry, N., Panis, C., & Peterson, C. (2001). The quality of retrospective data: An examination of long-term recall in a developing country. Journal of Human Resources, 3, 593–625.
Bifulco, A., Brown, G. W., Lillie, A., & Jarvis, J. (1997). Memories of childhood neglect and abuse: Corroboration in a series of sisters. Journal of Child Psychology and Psychiatry, 38, 365–374. https://doi.org/10.1111/j.1469-7610.1997.tb01520.x.
Brown, J., Cohen, P., Johnson, J. G., & Salzinger, S. (1998). A longitudinal analysis of risk factors for child maltreatment: Findings of a 17-year prospective study of officially recorded and self-reported child abuse and neglect. Child Abuse & Neglect, 22, 1065–1078. https://doi.org/10.1016/S0145-2134(98)00087-8.
Castro, R. (2013). Inconsistent respondents and sensitive questions. Field Methods, 25, 283–298.
Cicchetti, D., & Feinstein, A. R. (1990). High agreement but low kappa: II. Resolving the paradoxes. Journal of Clinical Epidemiology, 43, 551–558. https://doi.org/10.1016/0895-4356(90)90159-M.
Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37–46. https://doi.org/10.1177/001316446002000104.
Dhanani, R. M., Nield, L. S., & Ogershok, P. R. (2006). Traumatized twins: A case report and discussion of the maltreatment of multiples. Clinical Pediatrics, 45, 173–176.
Dill, D. L., Chu, J. A., Grob, M. C., & Eisen, S. V. (1991). The reliability of abuse history reports: A comparison of two inquiry formats. Comprehensive Psychiatry, 32, 166–169. doi: 10.1016/0010-440X(91)90009-2.
Dube, S. R., Williamson, D. F., Thompson, T., Felitti, V. J., & Anda, R. F. (2004). Assessing the reliability of retrospective reports of adverse childhood experiences among adult HMO members attending a primary care clinic. Child Abuse & Neglect, 28, 729–737. https://doi.org/10.1016/j.chiabu.2003.08.009.
Duggal, S., Malkoff-Schwartz, S., Birmaher, B., Anderson, B. P., Matty, M. K., Houck, P. R., Bailey-Orr, M., Williamson, D. E., & Frank, E. (2000). Assessment of life stress in adolescents: Self-report versus interview methods. Journal of American Academy of Child and Adolescence Psychiatry, 39, 445–452. https://doi.org/10.1097/00004583-200004000-00013.
Feinstein, A. R., & Cicchetti, D. (1990). High agreement but low kappa: I. The problems of two paradoxes. Journal of Clinical Epidemiology, 43, 543–549. https://doi.org/10.1016/0895-4356(90)90158-L.
Fergusson, D. M., Horwood, L. J., & Woodward, L. J. (2000). The stability of child abuse reports: A longitudinal study of the reporting behaviour of young adults. Psychological Medicine, 30, 529–544. https://doi.org/10.1017/S0033291799002111.
Fisher, H. L., Bunn, A., Jacobs, C., Moran, P., & Bifulco, A. (2011). Concordance between mother and offspring retrospective reports of childhood adversity. Child Abuse and Neglect, 35, 117–122. https://doi.org/10.1016/j.chiabu.2010.10.003.
Geertzen, J. (2012). Inter-rater agreement with multiple raters and variables. https://mlml.net.jg/software.ira
Hardt, J., & Rutter, M. (2004). Validity of adult retrospective reports of adverse childhood experiences: Review of the evidence. Journal of Child Psychology and Psychiatry, 45, 260–273. https://doi.org/10.1111/j.1469-7610.2004.00218.x.
Kendall-Tackett, K., & Becker-Blease, K. (2004). The importance of retrospective findings in child maltreatment research. Child Abuse and Neglect, 28, 723–727. https://doi.org/10.1016/j.chiabu.2004.02.002.
Kendler, K. S., Neale, M., Kessler, R., Heath, A. C., & Eaves, L. (1993). A twin study of recent life events and difficulties. Archives of General Psychiatry, 50, 789–796. https://doi.org/10.1001/archpsyc.1993.01820220041005.
Kottner, J., Audige, L., Brorson, S., Donner, A., Gajewski, B. J., Hróbjartsson, A., et al. (2011). Guidelines for reporting reliability and agreement studies (GRAAS) were proposed. Journal of Clinical Epidemiology, 48(6), 661–671. https://doi.org/10.1016/j.ijnurstu.2011.01.16.
Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159–174.
Lantz, C. A., & Nebenzahl, E. (1996). Behavior and interpretation of the K statistic: Resolution of the two paradoxes. Journal of Clinical Epidemiology, 49(4), 431–434. https://doi.org/10.1016/0895-4356(95)00571-4.
Overbeek, G., Vermulst, A., De Graaf, R., Ten Have, M., Engels, R., & Scholte, R. (2010). Positive life events and mood disorders: Longitudinal evidence for an erratic lifecourse hypothesis. Journal of Psychiatric Research, 44, 1095–1100. https://doi.org/10.1016/j.jpsychires.2010.03.019.
Paykel, E. S. (2001). The evolution of life events research in psychiatry. Journal of Affective Disorders, 62, 141–149. https://doi.org/10.1016/S0165-0327(00)00174-9.
Robins, L. N., Schoenberg, S. P., Holmes, S. J., Ratcliff, K. S., Benham, A., & Works, J. (1985). Early home environment and retrospective recall: A test for concordance between siblings with and without psychiatric disorders. American Journal of Orthopsychiatry, 55, 27–41. https://doi.org/10.1111/j.1939-0025.1985.tb03419.x.
Shaffer, A., Huston, L., & Egeland, B. (2008). Identification of child maltreatment using prospective and self-report methodologies: A comparison of maltreatment incidence and relation to later psychopathology. Child Abuse and Neglect, 32, 682–692. https://doi.org/10.1016/j.chiabu.2007.09.010.
Sher, K. J., & Descutner, C. (1986). Reports of paternal alcoholism: Reliability across siblings. Addictive Behavior, 11, 25–30. https://doi.org/10.1016/0306-4603(86)90005-5.
Viera, A. J., & Garrett, J. M. (2005). Understanding interobserver agreement: The kappa statistic. Family Medicine, 37, 360–363.
Widom, C., Raphael, K., & DuMont, K. (2004). The case for prospective longitudinal studies in child maltreatment research: Commentary on Dube. Child Abuse & Neglect, 28, 715–722. https://doi.org/10.1016/j.chiabu.2004.03.009.
Author Contributions
V.A.: designed the study, analyzed the data, wrote part of the paper and review the manuscript. F.F.C.: designed the study, collected and analyzed the data and wrote part of the manuscript; A.M.: designed the study, assisted with the data analyses, the writing of the study and the review of the manuscript.
Funding
This study was conducted at Psychology Research Centre (UID/PSI/01662/2013), University of Minho, and supported by the Portuguese Foundation for Science and Technology and the Portuguese Ministry of Education and Science through national funds and co-financed by FEDER through COMPETE2020 under the PT2020 Partnership Agreement (POCI-01-0145-FEDER-007653).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare that they have no conflict of interest.
Ethical Approval
All procedures performed involving human participants were in accordance with the ethical standards of the institutional and or/ national research committee and with the Helsinki Declaration of 1964 and its later amendments or comparable ethical standards. This study was approved by the IRB of School of Psychology (University of Minho).
Informed Consent
Informed consent was obtained from all individual participants included in the study.
Rights and permissions
About this article
Cite this article
Azevedo, V., Fernandes-Costa, F. & Maia, Â. Twins’ Agreement on Negative and Positive Life Experiences. J Child Fam Stud 27, 2057–2067 (2018). https://doi.org/10.1007/s10826-018-1036-1
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10826-018-1036-1