Advertisement

Development and Validation of the Ability in Behavior Assessment and Interventions for Teachers Using Delphi Technique and Rasch Analysis

  • Anuradha Dutt
  • Marilyn Tan
  • Sivakumar Alagumalai
  • Rahul NairEmail author
Original Paper

Abstract

Functional Behavior Assessment (FBA) and behavior interventions have been effective in the management of challenging behavior among children with developmental disabilities including autism spectrum disorders. Research suggests the need for valid measurement instruments for verifying, calibrating and scoring competence in FBA and behavior interventions. The validation for the Ability in Behaviour Assessment and Interventions for Teachers (ABAIT) adopted the Delphi method for developing consensus followed by the application of Rasch Measurement Model (RMM). RMM among 292 special educators reported appropriate infit (0.84–1.11), outfit (0.94–1.05), and item separation reliability (0.99), though some items reported low point-biserial correlation. The ABAIT was developed with expert consensus and was found to have a suitable fit with RMM.

Keywords

Scale validation Teacher training Autism spectrum disorders Functional behavior assessments and interventions Rasch Measurement Model 

Notes

Acknowledgments

This research study is supported by the Office of Education Research – National Institute of Education, Nanyang Technological University (Grant No. OER 18/14 AD).

Author Contributions

AD contributed to the conceptualization of the study, data collection, interpretation of results, manuscript preparation and critically reviewed the manuscript. MT contributed to the data collection, interpretation of the results, and manuscript preparation. SA contributed to data analyses, interpretation of the results, preparation of the manuscript and critically reviewed the manuscript. RN contributed to the conceptualization of the study, data analyses, interpretation of results, manuscript preparation and critically reviewed the manuscript.

Compliance with Ethical Standards

Conflict of interest

The authors declared that they have no conflict of interest.

Ethical Approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Informed Consent

Informed consent was obtained from all individual participants included in the study.

Supplementary material

10803_2019_3887_MOESM1_ESM.docx (33 kb)
Supplementary material 1 (DOCX 33 KB)

References

  1. Alberto, P. A., & Troutman, A. C. (2013). Applied behaviour analysis for teachers (9th ed.). Upper Saddle River, NJ: Pearson Education.Google Scholar
  2. American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: Author.CrossRefGoogle Scholar
  3. Bethune, K. S., & Wood, C. L. (2013). Effects of coaching on teachers’ use of function-based interventions for students with severe disabilities. Teacher Education and Special Education, 36(2), 97–114.  https://doi.org/10.1177/0888406413478637.CrossRefGoogle Scholar
  4. Blair, K. C., Fox, L., & Lentini, R. (2010). Use of positive behavior support to address the challenging behavior of young children within a community early childhood program. Topics in Early Childhood Special Education, 30(2), 68–79.  https://doi.org/10.1177/0271121410372676.CrossRefGoogle Scholar
  5. Blair, K. C., Umbreit, J., Dunlap, G., & Jung, K. (2007). Promoting inclusion and peer participation through assessment-based intervention. Topics in Early Childhood Special Education, 27, 134–147.  https://doi.org/10.1177/02711214070270030401.CrossRefGoogle Scholar
  6. Boone, W. J., & Scantlebury, K. (2006). The role of Rasch analysis when conducting science education research utilizing multiple-choice tests. Science Education, 90(2), 253–269.  https://doi.org/10.1002/sce.20106.CrossRefGoogle Scholar
  7. Borgmeier, C., Loman, S. L., Hara, M., & Rodriguez, B. J. (2015). Training school personnel to identify interventions based on functional behavioral assessment. Journal of Emotional and Behavioral Disorders, 23(2), 78–89.  https://doi.org/10.1177/1063426614528244.CrossRefGoogle Scholar
  8. Community Report on Autism. (2016). Retrieved from https://www.cdc.gov/ncbddd/autism/documents/comm-report-autism-deeper-dive.pdf.
  9. Conroy, M. A., Asmus, J. M., & Sellers, J. A. (2005). Using an antecedent-based intervention to decrease automatically reinforced stereotypic behavior in a general education classroom: A case study. Focus on Autism and Developmental Disorders, 20, 223–230.  https://doi.org/10.1177/10883576050200040401.CrossRefGoogle Scholar
  10. Crone, D. A., Hawken, L. S., & Bergstrom, M. K. (2007). A demonstration of training, implementing, and using functional behavioral assessment in 10 elementary and middle school settings. Journal of Positive Behavior Interventions, 9(1), 15–29.  https://doi.org/10.1177/10983007070090010301.CrossRefGoogle Scholar
  11. Dukes, C., Rosenberg, H., & Brady, M. (2008). Effects of training in functional behavior assessment. International Journal of Special Education, 23(1), 163–173.Google Scholar
  12. Durand, V. M., & Merges, E. (2001). Functional communication training: A contemporary behavior analytic intervention for problem behaviors. Focus on Autism and Other Developmental Disabilities, 16(2), 110–119.  https://doi.org/10.1177/108835760101600207.CrossRefGoogle Scholar
  13. Dutt, A. S., Chen, I., & Nair, R. (2016). Reliability and validity of skills and needs inventories in functional behavior assessments and interventions for school personnel. The Journal of Special Education, 49(4), 233–242.  https://doi.org/10.1177/0022466915574598.CrossRefGoogle Scholar
  14. Elsabbagh, M., Divan, G., Koh, Y. J., Kim, Y. S., Kauchali, S., Marcín, C., … Fombonne, E. (2012). Global prevalence of autism and other pervasive developmental disorders. Autism Research, 5, 160–179.  https://doi.org/10.1002/aur.239.
  15. Gable, R. A., Tonelson, S. W., & Sheth, M. (2012). Importance, usage, and preparedness to implement evidence-based practices for students with emotional disabilities: A comparison of knowledge and skills of special education and general education teachers. Education and Treatment of Children, 35(4), 499–519.CrossRefGoogle Scholar
  16. Goodwin, C. J. (2009). Research in psychology: Methods and design. London: Wiley.Google Scholar
  17. Hemmeter, M. L., Ostrosky, M., & Fox, L. (2006). Social and emotional foundations for early learning: A conceptual model for intervention. School Psychology Review, 35(4), 583–601.Google Scholar
  18. Hepworth, L. R., & Rowe, F. J. (2018). Using Delphi methodology in the development of a new patient-reported outcome measure for stroke survivors with visual impairment. Brain and Behavior, 8(2), e00898.  https://doi.org/10.1002/brb3.898.CrossRefGoogle Scholar
  19. Horner, R. H., Sugai, G., Smolkowski, K., Eber, L., Nakasato, J., Todd, A. W., et al. (2009). A randomized, wait-list controlled effectiveness trial assessing school-wide positive behavior support in elementary schools. Journal of Positive Behavior Interventions, 11, 133–144.CrossRefGoogle Scholar
  20. Hsu, C. C., & Sandford, B. A. (2007). The Delphi technique: Making sense of consensus. Practical Assessment, Research & Evaluation, 12(10), 1–8.Google Scholar
  21. Johnston, S. S., & O’Neill, R. E. (2001). Searching for effectiveness and efficiency in conducting functional assessments: A review and proposed process for teachers and other practitioners. Focus on Autism and Other Developmental Disabilities, 16(4), 205–214.  https://doi.org/10.1177/108835760101600402.CrossRefGoogle Scholar
  22. Keeves, J. P., & Alagumalai, S. (1999). New approach to measurement. In G. N. Masters & J. P. Keeves (Eds.), Advances in measurement and educational research and assessment (pp. 23–42). Oxford: Pergamon.Google Scholar
  23. Kern, L., Hilt, A. M., & Gresham, F. M. (2004). An evaluation of the functional behavioral assessment process used with students with or at risk for emotional and behavioral disorders. Education and Treatment of Children, 27, 440–452.Google Scholar
  24. Kurtz, P. F., Boelter, E. W., Jarmolowicz, D. P., Chin, M. D., & Hagopian, L. P. (2011). An analysis of functional communication training as an empirically supported treatment for problem behavior displayed by individuals with intellectual disabilities. Research in Developmental Disabilities, 32, 2935–2942.  https://doi.org/10.1016/j.ridd.2011.05.009.CrossRefGoogle Scholar
  25. Loman, S. L., & Horner, R. H. (2014). Examining the efficacy of a basic functional behavioral assessment training package for school personnel. Journal of Positive Behavior Interventions, 16, 18–30.  https://doi.org/10.1177/1098300712470724.CrossRefGoogle Scholar
  26. Luiselli, J. K., Bass, J. D., & Whitcomb, S. A. (2010). Teaching applied behavior analysis knowledge competencies to direct-care service providers: Outcome assessment and social validation of a training program. Behavior modification, 34, 403–414.  https://doi.org/10.1177/0145445510383526.CrossRefGoogle Scholar
  27. Mancil, G. R., & Boman, M. (2010). Functional communication training in the classroom: A guide for success. Preventing School Failure: Alternative Education for Children and Youth, 54, 238–246.  https://doi.org/10.1080/10459881003745195.CrossRefGoogle Scholar
  28. Matson, J. L., & Minshawi, N. F. (2007). Functional assessment of challenging behavior: Toward a strategy for applied settings. Research in Developmental Disabilities, 28, 353–361.  https://doi.org/10.1016/j.ridd.2006.01.005.CrossRefGoogle Scholar
  29. McCarthy, J., Hemmings, C., Kravariti, E., Dworzynski, K., Holt, G., Bouras, N., et al. (2010). Challenging behavior and co-morbid psychopathology in adults with intellectual disability and autism spectrum disorders. Research in Developmental Disabilities, 31, 362–366.  https://doi.org/10.1016/j.ridd.2009.10.009.CrossRefGoogle Scholar
  30. Mortenson, B. P., Rush, K. S., Webster, J., & Beck, T. (2008). Early career teachers accuracy in predicting behavioral functioning: A pilot study of teacher skills. International Journal of Behavioral Consultation and Therapy, 4(4), 311–318.  https://doi.org/10.1037/h0100861.CrossRefGoogle Scholar
  31. Myers, C. L., & Holland, K. L. (2000). Classroom behavioral interventions: Do teachers consider the function of the behavior? Psychology in the Schools. 37(3), 271–280.  https://doi.org/10.1002/(SICI)1520-6807(200005)37:3%3C271::AID-PITS7%3E3.0.CO;2-8.CrossRefGoogle Scholar
  32. Newcomer, L. L., & Lewis, T. J. (2004). Functional behavioral assessment: An investigation of assessment reliability and effectiveness of function-based interventions. Journal of Emotional and Behavioral Disorders, 12(3), 168–181.  https://doi.org/10.1177/10634266040120030401.CrossRefGoogle Scholar
  33. O’Brien, G., & Pearson, J. (2004). Autism and learning disability. Autism, 8, 125–140.  https://doi.org/10.1177/1362361304042718.CrossRefGoogle Scholar
  34. Peck Peterson, S. M., Caniglia, C., Jo Royster, A., Macfarlane, E., Plowman, K., Baird, S. J., et al. (2005). Blending functional communication training and choice making to improve task engagement and decrease problem behaviour. Educational Psychology, 25, 257–274.  https://doi.org/10.1080/0144341042000301193.CrossRefGoogle Scholar
  35. Pindiprolu, S. S., Peterson, S. M., & Berglof, H. (2007). School personnel’s professional development needs and skill level with functional behavior assessments in ten Midwestern states in the United States: analysis and issues. Journal of International Association of Special Education, 8, 31–42.Google Scholar
  36. Powell, C. (2003). The Delphi technique: Myths and realities. Journal of Advanced Nursing, 41(4), 376–382.  https://doi.org/10.1046/j.1365-2648.2003.02537.x.CrossRefGoogle Scholar
  37. Stormont, M., Lewis, T. J., Beckner, R., & Johnson, N. W. (2008). Implementing systems of positive behaviour support systems in early childhood and elementary settings. Thousand Oaks: Corwin Press.Google Scholar
  38. Tennant, A., & Conaghan, P. G. (2007). The Rasch measurement model in rheumatology: What is it and why use it? When should it be applied, and what should one look for in a Rasch paper? Arthritis & Rheumatology, 57, 1358–1362.CrossRefGoogle Scholar
  39. Tiger, J. H., Hanley, G. P., & Bruzek, J. (2008). Functional communication training: A review and practical guide. Behavior Analysis in Practice, 1, 16–23.CrossRefGoogle Scholar
  40. Tobin, T. J., & Crone, D. A. (2003). Reliability of a functional assessment knowledge test. Unpublished manuscript, University of Oregon, Eugene.Google Scholar
  41. Waugh, R. F., & Chapman, E. S. (2005). An analysis of dimensionality using factor analysis (true-score theory) and Rasch measurement: What is the difference? Which method is better? Journal of Applied Measurement, 6(1), 80–99.Google Scholar
  42. Westling, D. L. (2010). Teachers and challenging behavior: Knowledge, views, and practices. Remedial and Special Education, 31(1), 48–63.  https://doi.org/10.1177/0741932508327466.CrossRefGoogle Scholar
  43. Yu, C. H., Popp, S. O., DiGangi, S., & Jannasch-Pennell, A. (2007). Assessing unidimensionality: A comparison of Rasch modeling, parallel analysis, and TETRAD. Practical Assessment, Research & Evaluation, 12(14), 1–18.Google Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Psychological Studies Academic Group, National Institute of EducationNanyang Technological UniversitySingaporeSingapore
  2. 2.School of EducationUniversity of AdelaideAdelaideAustralia
  3. 3.Adelaide Dental SchoolARCPOH, University of AdelaideAdelaideAustralia

Personalised recommendations