Program Characteristics and Certification Examination Pass Rates: A Statistical Analysis of BACB-Published 2015–2019 Data

Abstract

The Behavior Analyst Certification Board (BACB) annually publishes data on the pass rates of institutions with verified course sequences (VCS). The current study analyzed BACB-published data from the years 2015–2019 and explored relations among program mode, number of first-time candidates, and examination pass rates. In a correlation analysis of number of first-time candidates and pass rates, there was a weak negative correlation, indicating that larger numbers of first-time candidates are associated with lower pass rates. Further, statistically significant differences were found among the mean number of first-time candidates, mean pass rates, and mean number of passing first-time candidates across program modes. Campus and hybrid programs had higher mean pass rates than distance programs, whereas distance programs had higher numbers of passing first-time candidates than campus programs. External validity and implications for indicators of program quality are discussed.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2

References

  1. Applied Behavior Analysis Programs Guide. (2019). Top 25 best applied behavior analysis programs 2019. https://www.appliedbehavioranalysisprograms.com/rankings/applied-behavior-analysis-programs/

  2. Arias, J. J., & Walker, D. M. (2004). Additional evidence on the relationship between class size and student performance. Journal of Economic Education, 35(4), 311–329 https://www.jstor.org/stable/30042611.

    Article  Google Scholar 

  3. Association for Behavior Analysis International (ABAI). (n.d.). Accreditation standards. https://accreditation.abainternational.org/apply/accreditation-standards.aspx

  4. Behavior Analyst Certification Board (BACB). (2020a). About the BACB. https://www.bacb.com/about/

  5. Behavior Analyst Certification Board (BACB). (2020b). BCBA examination pass rates for verified course sequences. https://www.bacb.com/wp-content/uploads/2020/05/BCBA-Pass-Rates-Combined-20200422.pdf

  6. Carr, J. E., & Nosik, M. R. (2017). Professional credentialing of practicing behavior analysts. Policy Insights from the Behavioral & Brain Sciences, 4(1), 3–8. https://doi.org/10.1177/2372732216685861.

    Article  Google Scholar 

  7. Critchfield, T. S. (2015). What counts as high-quality practitioner training in applied behavior analysis? Behavior Analysis in Practice, 8(1), 3–6. https://doi.org/10.1007/s40617-015-0049-0.

    Article  PubMed  PubMed Central  Google Scholar 

  8. de Winter, J. C. F., Gosling, S. D., & Potter, J. (2016). Comparing the Pearson and Spearman correlation coefficients across distributions and sample sizes: A tutorial using simulations and empirical data. Psychological Methods, 21(3), 273–290. https://doi.org/10.1037/met0000079.

    Article  PubMed  Google Scholar 

  9. Dixon, M. R., Reed, D. D., Smith, T., Belisle, J., & Jackson, R. E. (2015). Research ranking of behavior analytic training programs and their faculty. Behavior Analysis in Practice, 8(1), 7–15. https://doi.org/10.1007/s40617-015-0057-0.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Dodge, Y. (2008). The concise encyclopedia of statistics. Springer. https://doi.org/10.1111/j.1751-5823.2008.00062_25.x.

  11. Guder, F., Malliaris, M., & Jalilvand, A. (2009). Changing the culture of a school: The effect of larger class size on instructor and student performance. American Journal of Business Education, 2(9), 83–90.

    Google Scholar 

  12. Kazemi, E., Fahmie, T. A., & Eldevik, S. (2019). Experimental analysis of behavior readings assigned by accredited master's degree programs in behavior analysis. Behavior Analysis in Practice, 12, 12–21. https://doi.org/10.1007/s40617-018-00301-w.

    Article  PubMed  Google Scholar 

  13. Kelley III, D. P., Wilder, D. A., Carr, J. E., Rey, C., Green, N., & Lipschultz, J. (2015). Research productivity among practitioners in behavior analysis: Recommendations from the prolific. Behavior Analysis in Practice, 8(2), 201–206. https://doi.org/10.1007/s40617-015-0064-1.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Malangoni, M. A., Jones, A. T., Rubright, J., Biester, T. W., Buyske, J., & Lewis, J. F. R. (2012). Delay in taking the American Board of Surgery qualifying examination affects examination performance. Surgery, 152(4), 738–746. https://doi.org/10.1016/j.surg.2012.07.001.

    Article  PubMed  Google Scholar 

  15. Marco, C. A., Counselman, F. L., Korte, R. C., Purosky, R. G., Whitley, C. T., Reisdorff, E. J., & Burton, J. (2014). Delaying the American board of emergency medicine qualifying examination is associated with poorer performance. Academic Emergency Medicine, 21(6), 688–693. https://doi.org/10.1111/acem.12391.

    Article  PubMed  Google Scholar 

  16. Pastrana, S. J., Frewing, T. M., Grow, L. L., Nosik, M. R., Turner, M., & Carr, J. E. (2018). Frequently assigned readings in behavior analysis graduate training programs. Behavior Analysis in Practice, 11(3), 267–273. https://doi.org/10.1007/s40617-016-0137-9.

  17. Shepley, C., Allday, R. A., Crawford, D., Pence, R., Johnson, M., & Winstead, O. (2017). Examining the emphasis on consultation in behavior analyst preparation programs. Behavior Analysis: Research & Practice, 17(4), 381–392. https://doi.org/10.1037/bar0000064.

    Article  Google Scholar 

  18. Shepley, C., Allday, R. A., & Shepley, S. B. (2018). Towards a meaningful analysis of behavior analyst preparation programs. Behavior Analysis in Practice, 11(1), 39–45. https://doi.org/10.1007/s40617-017-0193-9.

    Article  PubMed  Google Scholar 

  19. Tseng, H. K. (2010). Has the student performance in managerial economics been affected by the class size of principles of microeconomics? Journal of Economics & Economic Education Research, 11(3), 15–27.

    Google Scholar 

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to Kendra E. Guinness.

Ethics declarations

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Ethical Approval

This article does not include research with human participants or animals by any of the authors.

Additional information

Research Highlights

• Statistical analyses revealed relations among VCS characteristics reported by the BACB and certification examination pass rates.

• A negative correlation between number of first-time candidates and pass rates was detected, though this correlation was extremely weak.

• Mean pass rates were higher for campus and hybrid programs over distance programs, and mean numbers of first-time candidates were higher for distance programs over campus programs.

• Potential explanations for these findings include differences in VCS quality and/or characteristics of students who select different program modes or cohort sizes, and further investigation is needed to clarify the nature of these variables’ influences.

• Additional variables, such as practicum requirements, average class sizes, and average latency to sitting for the examination may also influence an institution’s pass rate, and therefore would be beneficial additions to the BACB’s publications.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Guinness, K.E., Turner, K.S. Program Characteristics and Certification Examination Pass Rates: A Statistical Analysis of BACB-Published 2015–2019 Data. Behav Analysis Practice (2021). https://doi.org/10.1007/s40617-021-00610-7

Download citation

Keywords

  • BACB
  • Certification examination pass rates
  • Distance learning