Skip to main content

Small-Group Technology-Assisted Instruction: Virtual Teacher and Robot Peer for Individuals with Autism Spectrum Disorder

Abstract

The authors combined virtual reality technology and social robotics to develop a tutoring system that resembled a small-group arrangement. This tutoring system featured a virtual teacher instructing sight words, and included a humanoid robot emulating a peer. The authors used a multiple-probe design across word sets to evaluate the effects of the instructional package on the explicit acquisition and vicarious learning of sight words instructed to three children with autism spectrum disorder (ASD) and the robot peer. Results indicated that participants acquired, maintained, and generalized 100% of the words explicitly instructed to them, made fewer errors while learning the words common between them and the robot peer, and vicariously learned 94% of the words solely instructed to the robot.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

References

  • Alcorn, A., Pain, H., Rajendran, G., Smith, T., Lemon, O., Porayska-Pomsta, K., … Bernardini, S. (2011). Social communication between virtual characters and children with autism. In G. Biswas, S. Bull, J. Kay, & A. Mitrovic (Eds.), Artificial intelligence in education: 15th international conference (pp. 7–14). Berlin: Springer. https://doi.org/10.1007/978-3-642-21869-9_4.

    Chapter  Google Scholar 

  • Alpern, G. D. (2007). Developmental profile 3 (DP-3). Los Angeles, CA: Western Psychological Services.

    Google Scholar 

  • American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Arlington, VA: American Psychiatric Publishing.

    Book  Google Scholar 

  • Argyle, M., & Dean, J. (1965). Eye-contact, distance and affiliation. Sociometry, 28, 289–304. https://doi.org/10.2307/2786027.

    Article  PubMed  Google Scholar 

  • Beirne-Smith, M., Patton, J. R., & Ittenbach, R. (1994). Mental retardation. Indianapolis: Bobbs-Merrill.

    Google Scholar 

  • Biocca, F., Harms, C., & Burgoon, J. K. (2003). Toward a more robust theory and measure of social presence: Review and suggested criteria. Presence: Teleoperators & Virtual Environments, 12(5), 456–480. https://doi.org/10.1162/105474603322761270.

    Article  Google Scholar 

  • Bitterman, A., Daley, T. C., Misra, S., Carlson, E., & Markowitz, J. (2008). A national sample of preschoolers with autism spectrum disorders: Special education services and parent satisfaction. Journal of Autism and Developmental Disorders, 38(8), 1509–1517. https://doi.org/10.1007/s10803-007-0531-9.

    Article  PubMed  Google Scholar 

  • Bohil, C. J., Alicea, B., & Biocca, F. A. (2011). Virtual reality in neuroscience research and therapy. Nature Reviews Neuroscience, 12(12), 752. https://doi.org/10.1038/nrn3122.

    Article  PubMed  Google Scholar 

  • Boucenna, S., Cohen, D., Meltzoff, A. N., Gaussier, P., & Chetouani, M. (2016). Robots learn to recognize individuals from imitative encounters with people and avatars. Scientific Reports, 6(1), 19908. https://doi.org/10.1038/srep19908.

    Article  PubMed  PubMed Central  Google Scholar 

  • Brigance, A. H. (1978). Brigance (TM) diagnostic inventory of early development including developmental record book. North Billerica: Curriculum Associates, Inc.

    Google Scholar 

  • Brigance, A. H. (2010). Brigance transition skills inventory. North Billerica, MA: Curriculum Associates.

    Google Scholar 

  • Browder, D. M., & Lalli, J. S. (1991). Review of research on sight word instruction. Research in Developmental Disabilities, 12(3), 203–228.

    Article  Google Scholar 

  • Campbell, M. L., & Mechling, L. C. (2009). Small group computer-assisted instruction with SMART board technology: An investigation of observational and incidental learning of nontarget information. Remedial and Special Education, 30(1), 47–57.

    Article  Google Scholar 

  • Carr, E. G., & Darcy, M. (1990). Setting generality of peer modeling in children with autism. Journal of Autism and Developmental Disorders, 20(1), 45–59.

    Article  Google Scholar 

  • Charman, T. (2003). Why is joint attention a pivotal skill in autism? Philosophical Transactions of the Royal Society B: Biological Sciences, 358(1430), 315–324.

    Article  Google Scholar 

  • Cheng, Y., Huang, C., & Yang, C. (2015). Using a 3D immersive virtual environment system to enhance social understanding and social skills for children with autism spectrum disorders. Focus on Autism and Other Developmental Disabilities, 30(4), 222–236. https://doi.org/10.1177/1088357615583473.

    Article  Google Scholar 

  • Collins, B. C., Gast, D. L., Ault, M. J., & Wolery, M. (1991). Small group instruction: Guidelines for teachers of students with moderate to severe handicaps. Education and Training in Mental Retardation, 26, 18–32.

    Google Scholar 

  • David, D. O., Costescu, C. A., Matu, S., Szentagotai, A., & Dobrean, A. (2018). Developing joint attention for children with autism in robot-enhanced therapy. International Journal of Social Robotics. https://doi.org/10.1007/s12369-017-0457-0.

    Article  Google Scholar 

  • Dolch, E. W. (1948). Problems in reading. Champaign: Garrard Press.

    Google Scholar 

  • Duker, P., Didden, R., & Sigafoos, J. (2004). One-to-one training: Instructional procedures for learners with developmental disabilities. Austin: ERIC.

    Google Scholar 

  • Falkenstine, K. J., Collins, B. C., Schuster, J. W., & Kleinert, H. (2009). Presenting chained and discrete tasks as non-targeted information when teaching discrete academic skills through small group instruction. Education and Training in Developmental Disabilities, 44, 127–142.

    Google Scholar 

  • Fink, W. T., & Sandall, S. R. (1978). One-to-one vs group academic instruction with handicapped and nonhandicapped preschool children. Mental Retardation, 16(3), 236–240.

    PubMed  Google Scholar 

  • Gabig, C. S. (2010). Phonological awareness and word recognition in reading by children with autism. Communication Disorders Quarterly, 31(2), 67–85.

    Article  Google Scholar 

  • Ganz, J. B., Bourgeois, B. C., Flores, M. M., & Campos, B. A. (2008). Implementing visually cued imitation training with children with autism spectrum disorders and developmental delays. Journal of Positive Behavior Interventions, 10(1), 56–66.

    Article  Google Scholar 

  • Greer, R. D., Dudek-Singer, J., & Gautreaux, G. (2006). Observational learning. International Journal of Psychology, 41(6), 486–499.

    Article  Google Scholar 

  • Gupta, P., & MacWhinney, B. (1997). Vocabulary acquisition and verbal short-term memory: Computational and neural bases. Brain and Language, 59(2), 267–333.

    Article  Google Scholar 

  • Henkel, Z., & Bethel, C. L. (2017). A robot forensic interviewer: The BAD, the GOOD, and the undiscovered. In Proceedings of the companion of ACM/IEEE international conference on human-robot interaction, pp. 10–20. https://doi.org/10.1145/3029798.3034783.

  • Kamps, D., Walker, D., Locke, P., Delquadri, J., & Hall, R. V. (1990). A comparison of instructional arrangements for children with autism served in a public school setting. Education and Treatment of Children, 13, 197–215.

    Google Scholar 

  • Kamps, D., Walker, D., Maher, J., & Rotholz, D. (1992). Academic and environmental effects of small group arrangements in classrooms for students with autism and other developmental disabilities. Journal of Autism and Developmental Disorders, 22(2), 277–293. https://doi.org/10.1007/bf01058156.

    Article  PubMed  Google Scholar 

  • Kanda, T., & Ishiguro, H. (2012). Human-robot interaction in social robotics. Boca Raton: CRC Press.

    Book  Google Scholar 

  • Kandalaft, M., Didehbani, N., Krawczyk, D., Allen, T., & Chapman, S. (2013). Virtual reality social cognition training for young adults with high-functioning autism. Journal of Autism and Developmental Disorders, 43(1), 34–44. https://doi.org/10.1007/s10803-012-1544-6.

    Article  PubMed  Google Scholar 

  • Ke, F., & Im, T. (2013). Virtual-reality-based social interaction training for children with high-functioning autism. Journal of Educational Research., 106(6), 441–461.

    Article  Google Scholar 

  • Kroeger, K., Schultz, J. R., & Newsom, C. (2007). A comparison of two group-delivered social skills programs for young children with autism. Journal of Autism and Developmental Disorders, 37(5), 808–817.

    Article  Google Scholar 

  • Leaf, J. B., Tsuji, K. H., Lentell, A. E., Dale, S. E., Kassardjian, A., Taubman, M., … Oppenheim-Leaf, M. L. (2013). A comparison of discrete trial teaching implemented in a one-to-one instructional format and in a group instructional format. Behavioral Interventions, 28(1), 82–106.

    Article  Google Scholar 

  • Ledford, J. R., Gast, D. L., Luscre, D., & Ayres, K. M. (2008). Observational and incidental learning by children with autism during small group instruction. Journal of Autism and Developmental Disorders, 38(1), 86–103.

    Article  Google Scholar 

  • Leekam, S. R., Hunnisett, E., & Moore, C. (1998). Targets and cues: Gaze-following in children with autism. Journal of Child Psychology and Psychiatry, 39(7), 951–962.

    Article  Google Scholar 

  • Lord, C., Rutter, M., DiLavore, P. C., Risi, S., Gotham, K., & Bishop, S. (2012). Autism diagnostic observation schedule: ADOS-2. Torrance, CA: Western Psychological Services.

    Google Scholar 

  • Masia, C. L., & Chase, P. N. (1997). Vicarious learning revisited: A contemporary behavior analytic interpretation. Journal of Behavior Therapy and Experimental Psychiatry, 28(1), 41–51.

    Article  Google Scholar 

  • Maskey, M., Lowry, J., Rodgers, J., McConachie, H., & Parr, J. R. (2014). Reducing specific phobia/fear in young people with autism spectrum disorders (ASDs) through a virtual reality environment intervention. PLoS ONE. https://doi.org/10.1371/journal.pone.0100374.

    Article  PubMed  PubMed Central  Google Scholar 

  • Mechling, L. C., Gast, D. L., & Krupa, K. (2007). Impact of SMART board technology: An investigation of sight word reading and observational learning. Journal of Autism and Developmental Disorders, 37(10), 1869–1882.

    Article  Google Scholar 

  • Miller, H. L., & Bugnariu, N. L. (2016). Level of immersion in virtual environments impacts the ability to assess and teach social skills in autism spectrum disorder. Cyberpsychology, Behavior, and Social Networking, 19(4), 246–256. https://doi.org/10.1089/cyber.2014.0682.

    Article  Google Scholar 

  • Mundy, P. (1995). Joint attention and social-emotional approach behavior in children with autism. Development and Psychopathology, 7(1), 63–82.

    Article  Google Scholar 

  • Mundy, P., & Crowson, M. (1997). Joint attention and early social communication: Implications for research on intervention with autism. Journal of Autism and Developmental Disorders, 27(6), 653–676.

    Article  Google Scholar 

  • Neitzel, J., & Wolery, M. (2009). Steps for implementation: Time delay. Chapel Hill: The National Professional Development Center on Autism Spectrum Disorders, Frank Porter Graham Child Development Institute, The University of North Carolina.

    Google Scholar 

  • Ozen, A., Ergenekon, Y., & Ulke-Kurkcuoglu, B. (2017). Effects of using simultaneous prompting and computer-assisted instruction during small group instruction. Journal of Early Intervention, 39(3), 236–252. https://doi.org/10.1177/1053815117708998.

    Article  Google Scholar 

  • Parsons, S., & Cobb, S. (2011). State-of-the-art of virtual reality technologies for children on the autism spectrum. European Journal of Special Needs Education, 26(3), 355–366. https://doi.org/10.1080/08856257.2011.593831.

    Article  Google Scholar 

  • Parsons, T. D., & Carlew, A. R. (2016). Bimodal virtual reality stroop for assessing distractor inhibition in autism spectrum disorders. Journal of Autism and Developmental Disorders, 46(4), 1255–1267. https://doi.org/10.1007/s10803-015-2663-7.

    Article  PubMed  Google Scholar 

  • Powers, A., Kiesler, S., Fussell, S., & Torrey, C. (2007). Comparing a computer agent with a humanoid robot. In ACM/IEEE international conference on human-robot interaction, pp. 145–152. https://doi.org/10.1145/1228716.1228736.

  • Ross, A. H., & Stevens, K. B. (2003). Teaching spelling of social studies content vocabulary prior to using the vocabulary in inclusive learning environments: An examination of constant time delay, observational learning, and instructive feedback. Journal of Behavioral Education, 12(4), 287–309.

    Article  Google Scholar 

  • Saadatzi, M. N. (2016). Psychophysiological analysis of a pedagogical agent and robotic peer for individuals with autism spectrum disorders (Electronic theses and dissertations, paper 2570). https://doi.org/10.18297/etd/2570.

  • Saadatzi, M. N., Pennington, R. C., Welch, K. C., Graham, J. H., & Scott, R. E. (2017). The use of an autonomous pedagogical agent and automatic speech recognition for teaching sight words to students with autism spectrum disorder. Journal of Special Education Technology, 32(3), 173–183. https://doi.org/10.1177/0162643417715751.

    Article  Google Scholar 

  • Saadatzi, M. N., Welch, K. C., & Graham, J. H. (2012). Robotic assistance for individuals with Autism: A survey of current technology and insight into future directions. In: G. Hu (Ed.) ISCA international conference on computer applications in industry and engineering (CAINE 2012), (pp. 217–224). New York: Curran Associates, Inc., Red Hook.

    Google Scholar 

  • Sallows, G. O., & Graupner, T. D. (2005). Intensive behavioral treatment for children with autism: Four-year outcome and predictors. American Journal on Mental Retardation, 110(6), 417–438.

    Article  Google Scholar 

  • Scassellati, B., Admoni, H., & Matarić, M. (2012). Robots for use in autism research. Annual Review of Biomedical Engineering, 14, 275–294. https://doi.org/10.1146/annurev-bioeng-071811-150036.

    Article  PubMed  Google Scholar 

  • Schoen, S. F., & Ogden, S. (1995). Impact of time delay, observational learning, and attentional cuing upon word recognition during integrated small-group instruction. Journal of Autism and Developmental Disorders, 25(5), 503–519.

    Article  Google Scholar 

  • Schopler, E., Van Bourgondien, M. E., Wellman, G. J., & Love, S. R. (2010). Childhood autism rating scale, (CARS2). Torrance, CA: WPS.

    Google Scholar 

  • Slater, M., & Wilbur, S. (1997). A framework for immersive virtual environments (FIVE): Speculations on the role of presence in virtual environments. Presence: Teleoperators & Virtual Environments, 6(6), 603–616. https://doi.org/10.1162/pres.1997.6.6.603.

    Article  Google Scholar 

  • Smith, M. J., Fleming, M. F., Wright, M. A., Losh, M., Humm, L. B., Olsen, D., & Bell, M. D. (2015). Brief report: Vocational outcomes for young adults with autism spectrum disorders at six months after virtual reality job interview training. Journal of Autism and Developmental Disorders, 45(10), 3364–3369. https://doi.org/10.1007/s10803-015-2470-1.

    Article  PubMed  PubMed Central  Google Scholar 

  • Smith, M. J., Ginger, E. J., Wright, K., Wright, M. A., Taylor, J. L., Humm, L. B., … Fleming, M. F. (2014). Virtual reality job interview training in adults with autism spectrum disorder. Journal of Autism and Developmental Disorders, 44(10), 2450–2463. https://doi.org/10.1007/s10803-014-2113-y.

    Article  PubMed  PubMed Central  Google Scholar 

  • Stone, W. L., & Yoder, P. J. (2001). Predicting spoken language level in children with autism spectrum disorders. Autism, 5(4), 341–361.

    Article  Google Scholar 

  • Stonecipher, E. L., Schuster, J. W., Collins, B. C., & Grisham-Brown, J. (1999). Teaching gift wrapping skills in a quadruple instructional arrangement using constant time delay. Journal of Developmental and Physical Disabilities, 11(2), 139–158.

    Article  Google Scholar 

  • Strickland, D. C., Coles, C. D., & Southern, L. B. (2013). JobTIPS: A transition to employment program for individuals with autism spectrum disorders. Journal of Autism and Developmental Disorders., 43(10), 2472–2483.

    Article  Google Scholar 

  • Tawney, J. W., & Gast, D. L. (1984). Single subject research in special education. Columbus, OH: Merrill.

    Google Scholar 

  • Taylor, B. A., & DeQuinzio, J. A. (2012). Observational learning and children with autism. Behavior Modification, 36, 341–360.

    Article  Google Scholar 

  • U.S. Department of Education, Office of Educational Technology. (2017). Reimagining the role of technology in education: 2017 national education technology plan update. Retrieved January 31, 2017 from https://tech.ed.gov/netp/.

  • U.S. Department of Education, Office of Postsecondary Education. (2014). Teacher shortage areas nationwide listing 1990–1991 thru 2013–2014. Retrieved June 15, 2017 from https://www2.ed.gov/about/offices/list/ope/pol/tsa.html#list.

  • Vasquez, I. I. I., Nagendran, E., Welch, A., Marino, G. F., Hughes, M. T., Koch, D. E. A., & Delisio, L. (2015). Virtual learning environments for students with disabilities: A review and analysis of the empirical literature and two case studies. Rural Special Education Quarterly, 34(3), 26. https://doi.org/10.1177/875687051503400306.

    Article  Google Scholar 

  • Wallace, S., Parsons, S., Westbury, A., White, K., & Bailey, A. (2010). Sense of presence and atypical social judgments in immersive virtual environments: Responses of adolescents with autism spectrum disorders. Autism, 14(3), 199–213. https://doi.org/10.1177/1362361310363283.

    Article  PubMed  Google Scholar 

  • Warren, Z. E., Zheng, Z., Swanson, A. R., Bekele, E., Zhang, L., Crittendon, J. A., … Sarkar, N. (2015). Can robotic interaction improve joint attention skills? Journal of Autism and Developmental Disorders, 45(11), 3726–3734. https://doi.org/10.1007/s10803-013-1918-4.

    Article  PubMed  PubMed Central  Google Scholar 

  • Wechsler, D., Scales, P. I., & Index, V. C. (2012). Wechsler preschool and primary scale of intelligence (4th ed.). San Antonio, TX: NCS Pearson.

    Google Scholar 

  • Welch, K. C., Lahiri, U., Warren, Z., & Sarkar, N. (2010). An approach to the design of socially acceptable robots for children with autism spectrum disorders. International Journal of Social Robotics, 2, 391–403. https://doi.org/10.1007/s12369-010-0063-x.

    Article  Google Scholar 

  • Werry, I., Dautenhahn, K., Ogden, B., & Harwin, W. (2001). Can social interaction skills be taught by a social agent? The role of a robotic mediator in autism therapy In Cognitive technology: Instruments of mind (pp. 57–74). New York: Springer.

    Chapter  Google Scholar 

  • Wilson, R., Majsterek, D., & Simmons, D. (1996). The effects of computer-assisted versus teacher-directed instruction on the multiplication performance of elementary students with learning disabilities. Journal of Learning Disabilities, 29(4), 382–390.

    Article  Google Scholar 

  • Wolery, M., Ault, M. J., Gast, D. L., Doyle, P. M., & Griffen, A. K. (1991). Teaching chained tasks in dyads acquisition of target and observational behaviors. The Journal of Special Education, 25(2), 198–220.

    Article  Google Scholar 

  • Xin, J. F., & Sutman, F. X. (2011). Using the smart board in teaching social stories to students with autism. Teaching Exceptional Children, 43(4), 18–24. https://doi.org/10.1177/004005991104300402.

    Article  Google Scholar 

Download references

Acknowledgments

This work was supported in part by the National Science Foundation under Grant BRIGE-1228027. This study is based on a doctoral dissertation by Mohammad Nasser Saadatzi at the Department of Electrical and Computer Engineering, University of Louisville.

Author information

Authors and Affiliations

Authors

Contributions

MNS conceptualized and designed the study, developed the tutoring system, conducted the experiment, analyzed the data, prepared the initial manuscript, and revised the final manuscript for important intellectual content. RCP made significant assistance in the conception and design of the study, contributed in the initial manuscript write-up, advised on the data analysis, and revised the manuscript for important intellectual content. Supervision and feedback throughout the study were provided by KCW and JHG.

Corresponding author

Correspondence to Mohammad Nasser Saadatzi.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Saadatzi, M.N., Pennington, R.C., Welch, K.C. et al. Small-Group Technology-Assisted Instruction: Virtual Teacher and Robot Peer for Individuals with Autism Spectrum Disorder. J Autism Dev Disord 48, 3816–3830 (2018). https://doi.org/10.1007/s10803-018-3654-2

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10803-018-3654-2

Keywords

  • Autism spectrum disorder
  • Virtual reality and pedagogical agents
  • Social robotics
  • Small-group instruction
  • Observational learning
  • Sight word instruction