An Initial Psychometric Evaluation of the Joint Attention Protocol
- 560 Downloads
The goal of this paper is to examine the psychometric properties of a live-coded behavioral measure of joint attention, the Attention-Following and Initiating Joint Attention Protocol (JA Protocol), in order to assist researchers and clinicians in identifying when this measure may meet their joint attention assessment needs. Data from 260 children with autism spectrum disorder, developmental delay, or typical development between the ages of 2 and 12 years were used to evaluate this measure using quality standards for measurement. Overall, the JA Protocol demonstrated good psychometric properties. Recommendations and limitations for use of this measure based on psychometric analysis results are reported.
KeywordsJoint attention Psychometric Measurement Autism ASD
This research was supported in part by grants from The National Institute for Child Health and Human Development (R01-HD42168, P30-HD003110) to the University of North Carolina at Chapel Hill. The authors would like to thank the families who participated in the Sensory Experiences Project. The authors also gratefully acknowledge the contributions of Rachel Rhyne in refining the Attention Following and Initiating Joint Attention Protocol manual and for her leadership in collecting test–retest data.
SWN drafted the manuscript and analysed the data. LRW was a co-investigator for the parent study, led data collection for both of the JA Protocol samples, contributed to writing the introduction, methods, and conclusion sections, and edited the manuscript. RAF co-developed the data analysis plan, assisted SWN with conducting the analyses, contributed to writing the results section for the paper, and edited the manuscript. GTB was the principal investigator for the parent study, contributed to writing the introduction and conclusion sections, and edited the manuscript.
This research was supported in part by grants from The National Institute for Child Health and Human Development. R01-HD42168 to Grace Baranek and P30-HD003110 to the Carolina Institute for Developmental Disabilities (current PI: Gabriel Dichter) at the University of North Carolina at Chapel Hill.
Compliance with Ethical Standards
Conflict of interest
Dr. Watson and Dr. Baranek have intellectual property rights related to the JA Protocol as authors. Ms. Nowell and Dr. Faldowski declare no conflicts of interest. The authors declare they have no financial conflicts of interest.
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed consent was obtained from all individual participants included in the study.
- Baranek, G. T., Watson, L. R., Boyd, B. A., Poe, M. D., David, F. J., & McGuire, L. (2013). Hyporesponsiveness to social and nonsocial sensory stimuli in children with autism, children with developmental delays, and typically developing children. Development and Psychopathology, 25(2), 307–320.CrossRefPubMedPubMedCentralGoogle Scholar
- Baron-Cohen, S. (1991). Precursors to a theory of mind: Understanding attention in others. In A. Whiten (Ed.), Natural theories of mind. Oxford: Basil Blackwell.Google Scholar
- Bates, E. (1976). Language and context. New York: Academic Press.Google Scholar
- Cicchetti, D. V., & Sparrow, S. S. (1990). Assessment of adaptive behavior in young children. In J. H. Johnson & J. Goldman (Eds.), Pergamon general psychology series, 163. Developmental assessment in clinical child psychology: A handbook (pp. 173–196). Elmsford, NY: Pergamon Press.Google Scholar
- Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory. Orlando, FL: Holt, Rinehart and Winston.Google Scholar
- Drasgow, F. (1988). Polychoric and polyserial correlations. In L. Kotz & N. L. Johnson (Eds.), Encyclopedia of Statistical Sciences (Vol 7, pp. 69–74). New York: Wiley.Google Scholar
- Harris, B. (1988). Tetrachoric correlation coefficient. In L. Kotz & N. L. Johnson (Eds.), Encyclopedia of Statistical Sciences (Vol 9, pp. 223–225). New York: Wiley.Google Scholar
- Hus, V., Gotham, K., & Lord, C. (2014). Standardizing ADOS domain scores: Separating severity of social affect and restricted and repetitive behaviors. Journal of Autism and Developmental Disorders, 40, 1–13.Google Scholar
- Klin, A., Saulnier, C., Tsatsanis, K., & Volkmar, F. R. (2005). Clinical evaluation in autism spectrum disorders: Psychological assessment within a transdisciplinary framework. Handbook of Autism and Pervasive Developmental Disorders, 2, 772–798.Google Scholar
- Lord, C., Risi, S., Lambrecht, L., Cook, E. H., Leventhal, B. L., DiLavore, P. C., … Rutter, M. (2000). The Autism Diagnostic Observation Schedule–Generic: A standard measure of social and communication deficits associated with the spectrum of autism. Journal of Autism and Developmental Disorders, 30, 205–223.CrossRefPubMedGoogle Scholar
- Lord, C., Rutter, M., DiLavore, P. C., & Risi, S. (2002). Autism diagnostic observation schedule manual. Los Angeles: Western Psychological Services.Google Scholar
- Lord, C., Rutter, M., DiLavore, P. C., Risi, S., Gotham, K., & Bishop, S. (2012). Autism diagnostic observation schedule: ADOS-2. Los Angeles, CA: Western Psychological Services.Google Scholar
- Mullen, E. M. (1995). Mullen scales of early learning. Circle Pines, MN: American Guidance Service.Google Scholar
- Mundy, P., Delgado, C., Block, J., Venezia, M., Hogan, A., & Seibert, J. (2003). Early Social Communication Scales (ESCS). Coral Gables, FL: University of Miami.Google Scholar
- Muthen, L. K., & Muthen, B. O. (1998–2017). Mplus user’s guide (7th ed.). Los Angeles, CA: Authors.Google Scholar
- Naglieri, J. A., & Chambers, K. M. (2009). Psychometric issues and current scales for assessing autism spectrum disorders. In S. Goldstein, J. A. Naglieri, & S. Ozonoff (Eds.), Assessment of autism spectrum disorders (pp. 55–90). New York: Guilford.Google Scholar
- Poon, K. K., Watson, L. R., Baranek, G. T., & Poe, M. D. (2012). To what extent do joint attention, imitation, and object play behaviors in infancy predict later communication and intellectual functioning in ASD? Journal of Autism and Developmental Disorders, 42(6), 1064–1074.CrossRefPubMedPubMedCentralGoogle Scholar
- Rutter, M., Bailey, A., & Lord, C. (2003). Social communication questionnaire. Los Angeles: Western Psychological Services.Google Scholar
- Sigman, M., Ruskin, E., Arbelle, S., Corona, R., Dissanayake, C., Espinosa, M., … Robinson, B. F. (1999). Continuity and change in the social competence of children with autism, Down syndrome, and developmental delays. Monographs of the Society for Research in Child Development, 64, i-139.Google Scholar
- Sparrow, S., Balla, D., & Cicchetti, D. (1984). Vineland Adaptive Behavior Scales. Circle Pines, MN: American Guidance Service.Google Scholar
- Tomasello, M. (1995). Joint attention as social cognition. In C. Moore & P. J. Dunham (Eds.), Joint attention: Its origins and role in development (pp. 103–130). Hillsdale, NJ: Lawrence Erlbaum AssociatesGoogle Scholar
- Uebersax, J. S. (2017). Introduction to the tetrachoric and polychoric correlation coefficients. Retrieved May 7, 2017, from http://www.john-uebersax.com/stat/tetra.htm.
- Watson, L. R., Poston, V., Baranek, G. T. (2003). The attention-following and initiating joint attention protocol (JA protocol). Unpublished manuscript.Google Scholar
- Wetherby, A., & Prizant, B. (2002). Communication and symbolic behavior scales developmental profile—first normed edition. Baltimore: Paul H. Brookes.Google Scholar
- Zimmerman, I. L., Steiner, V. G., & Pond, R. E. (2002). Preschool Language Scale–Fourth edition examiner’s manual. San Antonio, TX: Psychological Corporation.Google Scholar