Small-Group Technology-Assisted Instruction: Virtual Teacher and Robot Peer for Individuals with Autism Spectrum Disorder

Abstract

The authors combined virtual reality technology and social robotics to develop a tutoring system that resembled a small-group arrangement. This tutoring system featured a virtual teacher instructing sight words, and included a humanoid robot emulating a peer. The authors used a multiple-probe design across word sets to evaluate the effects of the instructional package on the explicit acquisition and vicarious learning of sight words instructed to three children with autism spectrum disorder (ASD) and the robot peer. Results indicated that participants acquired, maintained, and generalized 100% of the words explicitly instructed to them, made fewer errors while learning the words common between them and the robot peer, and vicariously learned 94% of the words solely instructed to the robot.

This is a preview of subscription content, log in to check access.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

References

  1. Alcorn, A., Pain, H., Rajendran, G., Smith, T., Lemon, O., Porayska-Pomsta, K., … Bernardini, S. (2011). Social communication between virtual characters and children with autism. In G. Biswas, S. Bull, J. Kay, & A. Mitrovic (Eds.), Artificial intelligence in education: 15th international conference (pp. 7–14). Berlin: Springer. https://doi.org/10.1007/978-3-642-21869-9_4.

    Google Scholar 

  2. Alpern, G. D. (2007). Developmental profile 3 (DP-3). Los Angeles, CA: Western Psychological Services.

    Google Scholar 

  3. American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Arlington, VA: American Psychiatric Publishing.

    Google Scholar 

  4. Argyle, M., & Dean, J. (1965). Eye-contact, distance and affiliation. Sociometry, 28, 289–304. https://doi.org/10.2307/2786027.

    Article  PubMed  Google Scholar 

  5. Beirne-Smith, M., Patton, J. R., & Ittenbach, R. (1994). Mental retardation. Indianapolis: Bobbs-Merrill.

    Google Scholar 

  6. Biocca, F., Harms, C., & Burgoon, J. K. (2003). Toward a more robust theory and measure of social presence: Review and suggested criteria. Presence: Teleoperators & Virtual Environments, 12(5), 456–480. https://doi.org/10.1162/105474603322761270.

    Article  Google Scholar 

  7. Bitterman, A., Daley, T. C., Misra, S., Carlson, E., & Markowitz, J. (2008). A national sample of preschoolers with autism spectrum disorders: Special education services and parent satisfaction. Journal of Autism and Developmental Disorders, 38(8), 1509–1517. https://doi.org/10.1007/s10803-007-0531-9.

    Article  PubMed  Google Scholar 

  8. Bohil, C. J., Alicea, B., & Biocca, F. A. (2011). Virtual reality in neuroscience research and therapy. Nature Reviews Neuroscience, 12(12), 752. https://doi.org/10.1038/nrn3122.

    Article  PubMed  Google Scholar 

  9. Boucenna, S., Cohen, D., Meltzoff, A. N., Gaussier, P., & Chetouani, M. (2016). Robots learn to recognize individuals from imitative encounters with people and avatars. Scientific Reports, 6(1), 19908. https://doi.org/10.1038/srep19908.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Brigance, A. H. (1978). Brigance (TM) diagnostic inventory of early development including developmental record book. North Billerica: Curriculum Associates, Inc.

    Google Scholar 

  11. Brigance, A. H. (2010). Brigance transition skills inventory. North Billerica, MA: Curriculum Associates.

    Google Scholar 

  12. Browder, D. M., & Lalli, J. S. (1991). Review of research on sight word instruction. Research in Developmental Disabilities, 12(3), 203–228.

    Article  Google Scholar 

  13. Campbell, M. L., & Mechling, L. C. (2009). Small group computer-assisted instruction with SMART board technology: An investigation of observational and incidental learning of nontarget information. Remedial and Special Education, 30(1), 47–57.

    Article  Google Scholar 

  14. Carr, E. G., & Darcy, M. (1990). Setting generality of peer modeling in children with autism. Journal of Autism and Developmental Disorders, 20(1), 45–59.

    Article  Google Scholar 

  15. Charman, T. (2003). Why is joint attention a pivotal skill in autism? Philosophical Transactions of the Royal Society B: Biological Sciences, 358(1430), 315–324.

    Article  Google Scholar 

  16. Cheng, Y., Huang, C., & Yang, C. (2015). Using a 3D immersive virtual environment system to enhance social understanding and social skills for children with autism spectrum disorders. Focus on Autism and Other Developmental Disabilities, 30(4), 222–236. https://doi.org/10.1177/1088357615583473.

    Article  Google Scholar 

  17. Collins, B. C., Gast, D. L., Ault, M. J., & Wolery, M. (1991). Small group instruction: Guidelines for teachers of students with moderate to severe handicaps. Education and Training in Mental Retardation, 26, 18–32.

    Google Scholar 

  18. David, D. O., Costescu, C. A., Matu, S., Szentagotai, A., & Dobrean, A. (2018). Developing joint attention for children with autism in robot-enhanced therapy. International Journal of Social Robotics. https://doi.org/10.1007/s12369-017-0457-0.

    Article  Google Scholar 

  19. Dolch, E. W. (1948). Problems in reading. Champaign: Garrard Press.

    Google Scholar 

  20. Duker, P., Didden, R., & Sigafoos, J. (2004). One-to-one training: Instructional procedures for learners with developmental disabilities. Austin: ERIC.

    Google Scholar 

  21. Falkenstine, K. J., Collins, B. C., Schuster, J. W., & Kleinert, H. (2009). Presenting chained and discrete tasks as non-targeted information when teaching discrete academic skills through small group instruction. Education and Training in Developmental Disabilities, 44, 127–142.

    Google Scholar 

  22. Fink, W. T., & Sandall, S. R. (1978). One-to-one vs group academic instruction with handicapped and nonhandicapped preschool children. Mental Retardation, 16(3), 236–240.

    PubMed  Google Scholar 

  23. Gabig, C. S. (2010). Phonological awareness and word recognition in reading by children with autism. Communication Disorders Quarterly, 31(2), 67–85.

    Article  Google Scholar 

  24. Ganz, J. B., Bourgeois, B. C., Flores, M. M., & Campos, B. A. (2008). Implementing visually cued imitation training with children with autism spectrum disorders and developmental delays. Journal of Positive Behavior Interventions, 10(1), 56–66.

    Article  Google Scholar 

  25. Greer, R. D., Dudek-Singer, J., & Gautreaux, G. (2006). Observational learning. International Journal of Psychology, 41(6), 486–499.

    Article  Google Scholar 

  26. Gupta, P., & MacWhinney, B. (1997). Vocabulary acquisition and verbal short-term memory: Computational and neural bases. Brain and Language, 59(2), 267–333.

    Article  Google Scholar 

  27. Henkel, Z., & Bethel, C. L. (2017). A robot forensic interviewer: The BAD, the GOOD, and the undiscovered. In Proceedings of the companion of ACM/IEEE international conference on human-robot interaction, pp. 10–20. https://doi.org/10.1145/3029798.3034783.

  28. Kamps, D., Walker, D., Locke, P., Delquadri, J., & Hall, R. V. (1990). A comparison of instructional arrangements for children with autism served in a public school setting. Education and Treatment of Children, 13, 197–215.

    Google Scholar 

  29. Kamps, D., Walker, D., Maher, J., & Rotholz, D. (1992). Academic and environmental effects of small group arrangements in classrooms for students with autism and other developmental disabilities. Journal of Autism and Developmental Disorders, 22(2), 277–293. https://doi.org/10.1007/bf01058156.

    Article  PubMed  Google Scholar 

  30. Kanda, T., & Ishiguro, H. (2012). Human-robot interaction in social robotics. Boca Raton: CRC Press.

    Google Scholar 

  31. Kandalaft, M., Didehbani, N., Krawczyk, D., Allen, T., & Chapman, S. (2013). Virtual reality social cognition training for young adults with high-functioning autism. Journal of Autism and Developmental Disorders, 43(1), 34–44. https://doi.org/10.1007/s10803-012-1544-6.

    Article  PubMed  Google Scholar 

  32. Ke, F., & Im, T. (2013). Virtual-reality-based social interaction training for children with high-functioning autism. Journal of Educational Research., 106(6), 441–461.

    Article  Google Scholar 

  33. Kroeger, K., Schultz, J. R., & Newsom, C. (2007). A comparison of two group-delivered social skills programs for young children with autism. Journal of Autism and Developmental Disorders, 37(5), 808–817.

    Article  Google Scholar 

  34. Leaf, J. B., Tsuji, K. H., Lentell, A. E., Dale, S. E., Kassardjian, A., Taubman, M., … Oppenheim-Leaf, M. L. (2013). A comparison of discrete trial teaching implemented in a one-to-one instructional format and in a group instructional format. Behavioral Interventions, 28(1), 82–106.

    Article  Google Scholar 

  35. Ledford, J. R., Gast, D. L., Luscre, D., & Ayres, K. M. (2008). Observational and incidental learning by children with autism during small group instruction. Journal of Autism and Developmental Disorders, 38(1), 86–103.

    Article  Google Scholar 

  36. Leekam, S. R., Hunnisett, E., & Moore, C. (1998). Targets and cues: Gaze-following in children with autism. Journal of Child Psychology and Psychiatry, 39(7), 951–962.

    Article  Google Scholar 

  37. Lord, C., Rutter, M., DiLavore, P. C., Risi, S., Gotham, K., & Bishop, S. (2012). Autism diagnostic observation schedule: ADOS-2. Torrance, CA: Western Psychological Services.

    Google Scholar 

  38. Masia, C. L., & Chase, P. N. (1997). Vicarious learning revisited: A contemporary behavior analytic interpretation. Journal of Behavior Therapy and Experimental Psychiatry, 28(1), 41–51.

    Article  Google Scholar 

  39. Maskey, M., Lowry, J., Rodgers, J., McConachie, H., & Parr, J. R. (2014). Reducing specific phobia/fear in young people with autism spectrum disorders (ASDs) through a virtual reality environment intervention. PLoS ONE. https://doi.org/10.1371/journal.pone.0100374.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Mechling, L. C., Gast, D. L., & Krupa, K. (2007). Impact of SMART board technology: An investigation of sight word reading and observational learning. Journal of Autism and Developmental Disorders, 37(10), 1869–1882.

    Article  Google Scholar 

  41. Miller, H. L., & Bugnariu, N. L. (2016). Level of immersion in virtual environments impacts the ability to assess and teach social skills in autism spectrum disorder. Cyberpsychology, Behavior, and Social Networking, 19(4), 246–256. https://doi.org/10.1089/cyber.2014.0682.

    Article  Google Scholar 

  42. Mundy, P. (1995). Joint attention and social-emotional approach behavior in children with autism. Development and Psychopathology, 7(1), 63–82.

    Article  Google Scholar 

  43. Mundy, P., & Crowson, M. (1997). Joint attention and early social communication: Implications for research on intervention with autism. Journal of Autism and Developmental Disorders, 27(6), 653–676.

    Article  Google Scholar 

  44. Neitzel, J., & Wolery, M. (2009). Steps for implementation: Time delay. Chapel Hill: The National Professional Development Center on Autism Spectrum Disorders, Frank Porter Graham Child Development Institute, The University of North Carolina.

    Google Scholar 

  45. Ozen, A., Ergenekon, Y., & Ulke-Kurkcuoglu, B. (2017). Effects of using simultaneous prompting and computer-assisted instruction during small group instruction. Journal of Early Intervention, 39(3), 236–252. https://doi.org/10.1177/1053815117708998.

    Article  Google Scholar 

  46. Parsons, S., & Cobb, S. (2011). State-of-the-art of virtual reality technologies for children on the autism spectrum. European Journal of Special Needs Education, 26(3), 355–366. https://doi.org/10.1080/08856257.2011.593831.

    Article  Google Scholar 

  47. Parsons, T. D., & Carlew, A. R. (2016). Bimodal virtual reality stroop for assessing distractor inhibition in autism spectrum disorders. Journal of Autism and Developmental Disorders, 46(4), 1255–1267. https://doi.org/10.1007/s10803-015-2663-7.

    Article  PubMed  Google Scholar 

  48. Powers, A., Kiesler, S., Fussell, S., & Torrey, C. (2007). Comparing a computer agent with a humanoid robot. In ACM/IEEE international conference on human-robot interaction, pp. 145–152. https://doi.org/10.1145/1228716.1228736.

  49. Ross, A. H., & Stevens, K. B. (2003). Teaching spelling of social studies content vocabulary prior to using the vocabulary in inclusive learning environments: An examination of constant time delay, observational learning, and instructive feedback. Journal of Behavioral Education, 12(4), 287–309.

    Article  Google Scholar 

  50. Saadatzi, M. N. (2016). Psychophysiological analysis of a pedagogical agent and robotic peer for individuals with autism spectrum disorders (Electronic theses and dissertations, paper 2570). https://doi.org/10.18297/etd/2570.

  51. Saadatzi, M. N., Pennington, R. C., Welch, K. C., Graham, J. H., & Scott, R. E. (2017). The use of an autonomous pedagogical agent and automatic speech recognition for teaching sight words to students with autism spectrum disorder. Journal of Special Education Technology, 32(3), 173–183. https://doi.org/10.1177/0162643417715751.

    Article  Google Scholar 

  52. Saadatzi, M. N., Welch, K. C., & Graham, J. H. (2012). Robotic assistance for individuals with Autism: A survey of current technology and insight into future directions. In: G. Hu (Ed.) ISCA international conference on computer applications in industry and engineering (CAINE 2012), (pp. 217–224). New York: Curran Associates, Inc., Red Hook.

    Google Scholar 

  53. Sallows, G. O., & Graupner, T. D. (2005). Intensive behavioral treatment for children with autism: Four-year outcome and predictors. American Journal on Mental Retardation, 110(6), 417–438.

    Article  Google Scholar 

  54. Scassellati, B., Admoni, H., & Matarić, M. (2012). Robots for use in autism research. Annual Review of Biomedical Engineering, 14, 275–294. https://doi.org/10.1146/annurev-bioeng-071811-150036.

    Article  PubMed  Google Scholar 

  55. Schoen, S. F., & Ogden, S. (1995). Impact of time delay, observational learning, and attentional cuing upon word recognition during integrated small-group instruction. Journal of Autism and Developmental Disorders, 25(5), 503–519.

    Article  Google Scholar 

  56. Schopler, E., Van Bourgondien, M. E., Wellman, G. J., & Love, S. R. (2010). Childhood autism rating scale, (CARS2). Torrance, CA: WPS.

    Google Scholar 

  57. Slater, M., & Wilbur, S. (1997). A framework for immersive virtual environments (FIVE): Speculations on the role of presence in virtual environments. Presence: Teleoperators & Virtual Environments, 6(6), 603–616. https://doi.org/10.1162/pres.1997.6.6.603.

    Article  Google Scholar 

  58. Smith, M. J., Fleming, M. F., Wright, M. A., Losh, M., Humm, L. B., Olsen, D., & Bell, M. D. (2015). Brief report: Vocational outcomes for young adults with autism spectrum disorders at six months after virtual reality job interview training. Journal of Autism and Developmental Disorders, 45(10), 3364–3369. https://doi.org/10.1007/s10803-015-2470-1.

    Article  PubMed  PubMed Central  Google Scholar 

  59. Smith, M. J., Ginger, E. J., Wright, K., Wright, M. A., Taylor, J. L., Humm, L. B., … Fleming, M. F. (2014). Virtual reality job interview training in adults with autism spectrum disorder. Journal of Autism and Developmental Disorders, 44(10), 2450–2463. https://doi.org/10.1007/s10803-014-2113-y.

    Article  PubMed  PubMed Central  Google Scholar 

  60. Stone, W. L., & Yoder, P. J. (2001). Predicting spoken language level in children with autism spectrum disorders. Autism, 5(4), 341–361.

    Article  Google Scholar 

  61. Stonecipher, E. L., Schuster, J. W., Collins, B. C., & Grisham-Brown, J. (1999). Teaching gift wrapping skills in a quadruple instructional arrangement using constant time delay. Journal of Developmental and Physical Disabilities, 11(2), 139–158.

    Article  Google Scholar 

  62. Strickland, D. C., Coles, C. D., & Southern, L. B. (2013). JobTIPS: A transition to employment program for individuals with autism spectrum disorders. Journal of Autism and Developmental Disorders., 43(10), 2472–2483.

    Article  Google Scholar 

  63. Tawney, J. W., & Gast, D. L. (1984). Single subject research in special education. Columbus, OH: Merrill.

    Google Scholar 

  64. Taylor, B. A., & DeQuinzio, J. A. (2012). Observational learning and children with autism. Behavior Modification, 36, 341–360.

    Article  Google Scholar 

  65. U.S. Department of Education, Office of Educational Technology. (2017). Reimagining the role of technology in education: 2017 national education technology plan update. Retrieved January 31, 2017 from https://tech.ed.gov/netp/.

  66. U.S. Department of Education, Office of Postsecondary Education. (2014). Teacher shortage areas nationwide listing 1990–1991 thru 2013–2014. Retrieved June 15, 2017 from https://www2.ed.gov/about/offices/list/ope/pol/tsa.html#list.

  67. Vasquez, I. I. I., Nagendran, E., Welch, A., Marino, G. F., Hughes, M. T., Koch, D. E. A., & Delisio, L. (2015). Virtual learning environments for students with disabilities: A review and analysis of the empirical literature and two case studies. Rural Special Education Quarterly, 34(3), 26. https://doi.org/10.1177/875687051503400306.

    Article  Google Scholar 

  68. Wallace, S., Parsons, S., Westbury, A., White, K., & Bailey, A. (2010). Sense of presence and atypical social judgments in immersive virtual environments: Responses of adolescents with autism spectrum disorders. Autism, 14(3), 199–213. https://doi.org/10.1177/1362361310363283.

    Article  PubMed  Google Scholar 

  69. Warren, Z. E., Zheng, Z., Swanson, A. R., Bekele, E., Zhang, L., Crittendon, J. A., … Sarkar, N. (2015). Can robotic interaction improve joint attention skills? Journal of Autism and Developmental Disorders, 45(11), 3726–3734. https://doi.org/10.1007/s10803-013-1918-4.

    Article  PubMed  PubMed Central  Google Scholar 

  70. Wechsler, D., Scales, P. I., & Index, V. C. (2012). Wechsler preschool and primary scale of intelligence (4th ed.). San Antonio, TX: NCS Pearson.

    Google Scholar 

  71. Welch, K. C., Lahiri, U., Warren, Z., & Sarkar, N. (2010). An approach to the design of socially acceptable robots for children with autism spectrum disorders. International Journal of Social Robotics, 2, 391–403. https://doi.org/10.1007/s12369-010-0063-x.

    Article  Google Scholar 

  72. Werry, I., Dautenhahn, K., Ogden, B., & Harwin, W. (2001). Can social interaction skills be taught by a social agent? The role of a robotic mediator in autism therapy In Cognitive technology: Instruments of mind (pp. 57–74). New York: Springer.

    Google Scholar 

  73. Wilson, R., Majsterek, D., & Simmons, D. (1996). The effects of computer-assisted versus teacher-directed instruction on the multiplication performance of elementary students with learning disabilities. Journal of Learning Disabilities, 29(4), 382–390.

    Article  Google Scholar 

  74. Wolery, M., Ault, M. J., Gast, D. L., Doyle, P. M., & Griffen, A. K. (1991). Teaching chained tasks in dyads acquisition of target and observational behaviors. The Journal of Special Education, 25(2), 198–220.

    Article  Google Scholar 

  75. Xin, J. F., & Sutman, F. X. (2011). Using the smart board in teaching social stories to students with autism. Teaching Exceptional Children, 43(4), 18–24. https://doi.org/10.1177/004005991104300402.

    Article  Google Scholar 

Download references

Acknowledgments

This work was supported in part by the National Science Foundation under Grant BRIGE-1228027. This study is based on a doctoral dissertation by Mohammad Nasser Saadatzi at the Department of Electrical and Computer Engineering, University of Louisville.

Author information

Affiliations

Authors

Contributions

MNS conceptualized and designed the study, developed the tutoring system, conducted the experiment, analyzed the data, prepared the initial manuscript, and revised the final manuscript for important intellectual content. RCP made significant assistance in the conception and design of the study, contributed in the initial manuscript write-up, advised on the data analysis, and revised the manuscript for important intellectual content. Supervision and feedback throughout the study were provided by KCW and JHG.

Corresponding author

Correspondence to Mohammad Nasser Saadatzi.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Saadatzi, M.N., Pennington, R.C., Welch, K.C. et al. Small-Group Technology-Assisted Instruction: Virtual Teacher and Robot Peer for Individuals with Autism Spectrum Disorder. J Autism Dev Disord 48, 3816–3830 (2018). https://doi.org/10.1007/s10803-018-3654-2

Download citation

Keywords

  • Autism spectrum disorder
  • Virtual reality and pedagogical agents
  • Social robotics
  • Small-group instruction
  • Observational learning
  • Sight word instruction