Skip to main content
Log in

The Aftercare and School Observation System (ASOS): Reliability and Component Structure

  • Original Paper
  • Published:
Journal of Child and Family Studies Aims and scope Submit manuscript

Abstract

This study examines the psychometric properties and component structure of a newly developed observational system, the Aftercare and School Observation System (ASOS). Participants included 468 children drawn from a larger longitudinal intervention study. The system was utilized to assess participant children in school lunchrooms and recess and various afterschool environments. Exploratory factor analyses examined whether a core set of component constructs assessing qualities of children’s relationships, caregiver involvement and monitoring, and experiences in school and aftercare contexts that have been linked to children’s behavior problems would emerge. Construct validity was assessed by examining associations between ASOS constructs and questionnaire measures assessing children’s behavior problems and relationship qualities in school and aftercare settings. Across both settings, two factors showed very similar empirical structures and item loadings, reflecting the constructs of a negative/aggressive context and caregiver positive involvement, with one additional unique factor from the school setting reflecting the extent to which caregiver methods used resulted in less negative behavior and two additional unique factors from the aftercare setting reflecting positivity in the child’s interactions and general environment and negativity in the child’s interactions and setting. Modest correlations between ASOS factors and aftercare provider and teacher ratings of behavior problems, adult-child relationships, and a rating of school climate contributed to our interpretation that the ASOS scores capture meaningful features of children’s experiences in these settings. This study represents the first step of establishing that the ASOS reliably and validly captures risk and protective relationships and experiences in extra-familial settings.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Achenbach, T. M. (1991a). Manual for the child behavior checklist/4-18 and 1991 profile. Burlington, VT: University of Vermont, Department of Psychiatry.

    Google Scholar 

  • Achenbach, T. (1991b). Manual for the teacher’s report form and 1991 profile. Burlington: University of Vermont, Department of Psychiatry.

    Google Scholar 

  • Baker, J. A. (2006). Contributions of teacher-child relationships to positive school adjustment during elementary school. Journal of School Psychology, 44, 211–229.

    Article  Google Scholar 

  • Burchinal, M. R., Peisner-Feinberg, E., Pianta, R., & Howes, C. (2002). Development of academic skills from preschool through second grade: Family and classroom predictors of developmental trajectories. Journal of School Psychology, 40, 415–436.

    Article  Google Scholar 

  • Chang, H., Shaw, D. S., Dishion, T. J., Gardner, F., Wilson, M. N. (2012). Direct and indirect effects of the Family Check-Up on self-regulation from toddlerhood to early school age. Manuscript submitted for publiation.

  • Costello, A. B., & Osborne, J. W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation, 10, 1–9.

    Google Scholar 

  • Cushing, L. S., & Horner, R. (2003). Student interaction in specific settings (SISS) measure, coding procedures, and definitions. Unpublished coding manual. (Available from Peabody College at Vanderbilt University, Box 328, Nashville, TN 37203).

  • Dishion, T. J., & Kavanagh, K. (2003). Intervening in adolescent problem behavior: A family centered approach. New York: Guilford.

    Google Scholar 

  • Dishion, T. J., Shaw, D., Connell, A., Gardner, F., Weaver, C., & Wilson, M. (2008). The family check-up with high-risk indigent families: Preventing problem behavior by increasing parents’ positive behavior support in early childhood. Child Development, 79(5), 1395–1414.

    Article  PubMed  Google Scholar 

  • Eccles, J. S. (1999). The development of children ages 6 to 14. The Future of Children, 9, 30–44.

    Article  PubMed  Google Scholar 

  • Fauth, R. C., Roth, J. L., & Brooks-Gunn, J. (2007). Does the neighborhood context alter the link between youth’s after-school time activities and developmental outcomes? A multilevel analysis. Developmental Psychology, 43, 760–777.

    Article  PubMed  Google Scholar 

  • Ferguson, D. M., Lynskey, M. R., & Horwood, L. J. (1993). The effect of maternal depression on ratings of child behavior. Journal of Abnormal Child Psychology, 21(3), 245–269.

    Article  Google Scholar 

  • Hofferth, S. L., & Sandberg, J. F. (2001). How American children use their time. Journal of Marriage and the Family, 63, 295–308.

    Article  Google Scholar 

  • Ialongo, N., Poduska, J., Werthamer, L., & Kellam, S. (2001). The distal impact of two first-grade preventive interventions on conduct problems and disorder in early adolescence. Journal of Emotional and Behavioral Disorders, 9, 146–160.

    Article  Google Scholar 

  • Ingoldsby, E. M., Shelleby, E. C., Lane, T., & Shaw, D. S. (2012). Extrafamilial contexts and children’s conduct problems. In V. Malhomes & R. King (Eds.), The Oxford handbook of child development and poverty (pp. 404–422). New York: Oxford University Press.

    Google Scholar 

  • Kellam, S., Ling, X., Merisca, R., Brown, C. H., & Ialongo, N. (1998). The effect of the level of aggression in the first grade classroom on the course and malleability of aggressive behavior into middle school. Development and Psychopathology, 10, 165–185.

    Article  PubMed  Google Scholar 

  • Leff, S. S., & Lakin, R. (2005). Playground-based observational systems: A review and implications for practitioners and researchers. School Psychology Review, 34, 475–489.

    Google Scholar 

  • Leff, S. S., Power, T. J., Costigan, T. E., & Manz, P. H. (2003). Assessing the climate of the playground and lunchroom: Implications for bullying prevention programming. School Psychology Review, 32, 418–430.

    Google Scholar 

  • Mahoney, J., Vandell, D., Simpkins, S., & Zarrett, N. (2009). Adolescent out-of-school activities. In R. M. Lerner & L. Steinberg (Eds.), Handbook of adolescent psychology (3rd ed., Vol. 2, pp. 228–267). Hoboken, NJ: Wiley.

    Google Scholar 

  • Nelson, J. R., Martella, R. M., & Marchand-Martella, N. (2002). Maximizing student learning: The effects of comprehensive school-based program for preventing problem behaviors. Journal of Emotional and Behavioral Disorders, 10, 136–148.

    Article  Google Scholar 

  • Pianta, R. C. (1994). Patterns of relationships between children and kindergarten teachers. Journal of School Psychology, 32, 15–31.

    Article  Google Scholar 

  • Pianta, R. C., & Steinberg, M. (1991). Relationships between children and kindergarten teachers: Associations with home and classroom behavior. Paper presentation at the biennial conference of the Society for Research in Child Development, Seattle, WA (April).

  • Pianta, R. C., Steinberg, M. S., & Rollins, K. B. (1995). The first two years of school: Teacher-child relationships and deflections in children’s classroom adjustment. Development and Psychopathology, 7, 295–312.

    Article  Google Scholar 

  • Pierce, K. M., Bolt, D. M., & Vandell, D. L. (2010). Specific features of after-school program quality: Associations with children’s functioning in middle childhood. American Journal of Community Psychology, 45, 381–393.

    Article  PubMed  Google Scholar 

  • Rusby, J., Estes, A., & Dishion, T. J. (1991). Interpersonal process code. Unpublished technical manual. Oregon Social Learning Center, Eugene, OR.

  • Vandell, D. L., Shumow, L., & Posner, J. (2005). After-school programs for low-income children: Differences in program quality. In R. W. Larson & J. L. Mahoney (Eds.), Organized activities as contexts of development: Extracurricular activities, after-school and community programs (pp. 437–456). Mahwah, NJ: Erlbaum.

    Google Scholar 

  • Youngblade, L. M., & Theokas, C. (2006). The multiple contexts of youth development: Implications for theory, research, and practice. Applied Developmental Science, 10, 58–60.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Elizabeth C. Shelleby.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Ingoldsby, E.M., Shelleby, E.C., Lane, T. et al. The Aftercare and School Observation System (ASOS): Reliability and Component Structure. J Child Fam Stud 22, 893–902 (2013). https://doi.org/10.1007/s10826-012-9648-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10826-012-9648-3

Keywords

Navigation