Abstract
The number of colleges and universities offering behavior analytic training has grown rapidly over the last decade and it is time for our profession to evaluate the rigor of such trainings and to gain quality control. In this study we set out to investigate first-time pass rates on the Board Certified Behavior Analyst (BCBA) examinations across Verified Course Sequences (VCSs) using publicly available data between 2013 to 2020. We evaluated outcomes related to overall first-time pass rates; the small number of programs contributing the greatest number of BCBA exam candidates; and the difference in first-time pass rates by mode of instruction and ABAI accreditation. We discuss the use of first-time pass rate data as a quality indicator and provide some recommendations based on the outcomes evaluated.
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs40617-021-00660-x/MediaObjects/40617_2021_660_Fig1_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs40617-021-00660-x/MediaObjects/40617_2021_660_Fig2_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs40617-021-00660-x/MediaObjects/40617_2021_660_Fig3_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs40617-021-00660-x/MediaObjects/40617_2021_660_Fig4_HTML.png)
Similar content being viewed by others
Notes
BCBA certificants may receive a designation as a Board Certified Behavior Analyst-Doctoral(BCBA-D) if they have received additional training at the doctoral-level and meet other prerequisite conditions. For more information visit www.bacb.com.
The Qualified Applied Behavior Analysis Credentialing Board (QABA), Behavioral Intervention Certification Council (BICC), and American Board of Professional Psychology (ABPP) also offer credentials to behavioral providers.
The BCBA-D and BCaBA credentials have seen steady growth but nowhere near the same level as the BCBA and RBT credential. The RBT credential in particular has seen exponential growth since the BACB began offering this credential in 2014 (Carr & Nosik, 2017).
Licensure requirements vary by state. However, in the 31 states that have adopted some form of regulation of behavior analytic practice, it is estimated that at least 97% of the licensees at the graduate level hold a BCBA credential and 91% of the licensees at the undergraduate level hold a BCaBA credential (Dubuque et al., 2020).
BACB select and trains diverse representative panels of SMEs based on demographics, education/training, employment, experience, and geography. More information about the SME process can be found on the BACB website at https://www.bacb.com/bacb-subject-matter-expert-information/.
Although not currently required, the BACB has begun creating new exam eligibility pathways for students graduating from ABAI-accredited programs. The most-up-to-date information on these efforts can be found on their website: www.bacb.com.
ABAI’s VCS program designation should not be confused with their recently introduced VCS CBS designation. This new designation includes different requirements for training programs that offer coursework in culturo-behavior science studies. At the time of writing, only seven training programs had this designation.
ABAI began accepting applications for VCSs under the BACB Fifth Edition Task List after this date. Because many programs currently have an overlapping fourth and fifth edition VCS within their training programs this date was chosen as a more accurate (i.e., conservative) representation of the number of applied behavior analytic training programs that exist across universities.
Certification examinations based off the BACB Third Edition Task List began in Fall 2005 (BACB, 2005b). Certification examinations based off the BACB Fourth Edition Task List began in February 2015 (BACB, 2017b, January). BACB certification examinations based on the BACB Fifth Edition Task List are scheduled to begin January 1, 2022.
It is worth noting that the passage of a BACB exam is not the focus of many behavior analytic training programs. For example, some training programs have an explicit focus in the experimental analysis of behavior or organizational behavior management. For these types of programs, a BACB credential is less relevant and may be unnecessary. However, it could be argued that programs that are not interested in preparing their students to sit for a BACB exam should not have a Verified Course Sequence (VCS).
The BACB will report combined data for a VCS if they have too few first-time candidates in a given year but six or more in a 2-year period.
Undergraduate-level BCaBA VCS training programs were originally included in the analysis. However, we decided to exclude reporting these results given the relatively few certificants that hold this credential and the outsized influence of a single BCaBA VCS in training professionals pursuing this credential. In particular, initial analyses of publicly available data indicated that a single BCaBA VCS out of 40 accounted for 57% of all BCaBA exam candidates completing their coursework requirements and just 12 BCaBA VCSs accounted for 90% of candidates between 2013 and 2019.
BACB only reported data only if a VCS had at least six candidates take the exam during a given year.
For example, if a VCS’s first-time pass rate for the year 2017 did not match across two published data sets, the 2017 data from the later publication was used. This assumes that corrections or updates to the data were likely made after the first publication.
VCS first-time pass rate data for 2020 were released late during manuscript preparation (BACB, 2021b). Reliability checks for this set was not conducted given the high rate of agreement shown with the earlier data sets.
Published first-time pass rate data values are rounded. As a result, the product of multiplying the total number of candidates by the first-time pass rate has the potential to produce a noninteger.
This value was calculated by dividing total first-time candidates by the sum of first-time candidates passing the exam within each mode of instruction.
At the time of writing, the program where this VCS is housed no longer holds ABAI accreditation.
In previous iterations of the BACB’s published VCS first-time pass rate reports, this designation was referred to as “Distance.”
According to the BACB (2020b), VCSs with a “Hybrid” designation offer both online and campus courses and VCSs with a “Both” designation require students to choose either all online or all campus courses.
It is important to note that we decided to not include the names of VCS in this article to place the focus of the discussion on the quantifiable trends. We did not believe adding names would add any value to the discussion except provide opportunity for either showcasing or blaming specific VCS.
ABAI appears to have updated the categorization names slightly when they inherited the VCS system from the BACB in 2019. For example, “Campus” became “On-Campus,” “Distance” became “Online,” and “Both” became “Both On-Campus and Online.”
References
Ahearn, W. H., Green, G., Riordan, M. M., & Weatherly, N. L. (2015). Evaluating the quality of behavior analytic practitioner training programs. Behavior Analysis in Practice, 8(2), 149–151. https://doi.org/10.1007/s40617-015-0085-9
Arena, R., Chambers, S., Rhames, A., & Donahoe, K. (2015). The importance of research—A student perspective. Behavior Analysis in Practice, 8(2), 152–153. https://doi.org/10.1007/s40617-015-0084-x
Assessment Systems. (2018, March 15). Intro to the modified Angoff method of standard setting [Video file]. YouTube. https://www.youtube.com/watch?v=bQF1kSlZkBE
Association for Behavior Analysis International. (2018). VCS handbook.https://www.abainternational.org/media/155079/abai_vcs_handbook_2018.pdf
Association for Behavior Analysis International. (2019, May 25) Verified Course Sequence Directory.https://www.abainternational.org/vcs/directory.aspx.
Association for Behavior Analysis International. (2021, September 7). Verified Course Sequence Program.https://www.abainternational.org/vcs/bacb.aspx
Association for Behavior Analysis International Accreditation Board. (2019a, September). Self-study report. https://accreditation.abainternational.org/media/110574/abai_accreditation_board_self_study_report_20190901.docx
Association for Behavior Analysis International Accreditation Board. (2019b, May 26). Accredited programs.https://accreditation.abainternational.org/apply/accredited-programs.aspx.
Association for Behavior Analysis International Accreditation Board. (2021, February). Accreditation handbook.https://accreditation.abainternational.org/media/110571/abai_accreditation_board_accreditation_handbook_2021.pdf
Behavior Analyst Certification Board. (2005a). BCBA and BCaBA behavior analyst task list (3rd ed.). https://web.archive.org/web/20101211232714/http://bacb.com/index.php?page=100248
Behavior Analyst Certification Board. (2005b). News and notes. BACB Online Newsletter.https://www.bacb.com/wp-content/uploads/2020/05/BACB_Newsletter_8_05.pdf
Behavior Analyst Certification Board. (2011). How do distance education programs measure up? A comparison of distance and on-campus course sequences. BACB Online Newsletter. https://www.bacb.com/wp-content/uploads/2020/05/BACB_Newsletter_9-9-11.pdf
Behavior Analyst Certification Board. (2012a). Behavior Analyst Certification Board: 4th edition task list.https://www.bacb.com/wp-content/uploads/2017/09/160101-BCBA-BCaBA-task-list-fourth-edition-english.pdf
Behavior Analyst Certification Board. (2012b). Coursework requirements for BACB credentials: 4th edition task list.https://www.bacb.com/wp-content/uploads/2020/05/BACB_CourseContentAllocation.pdf
Behavior Analyst Certification Board. (2012c, January). Examination pass rates now available from universities. BACB Online Newsletter.https://www.bacb.com/wp-content/uploads/2020/05/BACB_Newsletter_1_12.pdf
Behavior Analyst Certification Board. (2013a). Behavior Analyst Certification Board: Registered behavior technician task list.https://www.bacb.com/wp-content/uploads/2017/09/161019-RBT-task-list-english.pdf
Behavior Analyst Certification Board. (2013b, February). Pass rates to be reported for approved course sequences. BACB Newsletter—Special Edition on New Standards.https://www.bacb.com/wp-content/uploads/BACB_Newsletter_2-13.pdf
Behavior Analyst Certification Board. (2017a). BCBA/BCaBA task list (5th Ed.). https://www.bacb.com/wp-content/uploads/2017/09/170113-BCBA-BCaBA-task-list-5th-ed-.pdf
Behavior Analyst Certification Board. (2017b, January). Introducing the BCBA/BCaBA task list (5th ed.). BACB Newsletter.https://www.bacb.com/wp-content/uploads/2020/05/170113-newsletter-1.pdf
Behavior Analyst Certification Board. (2017c, October). A summary of recent & upcoming changes to BACB standards. BACB Newsletter. https://www.bacb.com/wp-content/uploads/2020/05/BACB_Newsletter_101317-2.pdf
Behavior Analyst Certification Board. (2018). BCBA examination pass rates for Verified Course Sequences (2013–2017). https://abascool.com/wp-content/uploads/2018/10/BCBA-Pass-Rates-Percent_181015-2.pdf
Behavior Analyst Certification Board. (2019a). U.S. employment demand for behavior analysts: 2010–2018.
Behavior Analyst Certification Board. (2019b). BACB annual data reports.https://web.archive.org/web/20190422110637/https://www.bacb.com/about/bacb-certificant-annual-report-data/
Behavior Analyst Certification Board. (2019c). BCBA examination pass rates for Verified Course Sequences: 2014–2018.https://www.bacb.com/wp-content/uploads/BCBA-Pass-Rates-Alpha_190813.pdf
Behavior Analyst Certification Board. (2020a, July 1). BACB certificant data.https://www.bacb.com/BACB-certificant-data
Behavior Analyst Certification Board. (2020b, July 14). Examination information.https://www.bacb.com/examination-information/#ExaminationResults
Behavior Analyst Certification Board. (2020c). BCBA examination pass rates for Verified Course sequences (2015–2019).https://www.bacb.com/wp-content/uploads/2020/05/BCBA-Pass-Rates-Combined-20200422.pdf
Behavior Analyst Certification Board. (2020e). BACB annual report data.https://www.bacb.com/bacb-certificant-annual-report-data/
Behavior Analyst Certification Board. (2021a). U.S. employment demand for behavior analysts: 2010–2020.https://www.bacb.com/wp-content/uploads/2021/01/BurningGlass2021_210126.pdf
Behavior Analyst Certification Board. (2021b). BCBA examination pass rates for Verified Course sequences (2016–2020).https://www.bacb.com/wp-content/uploads/2021/06/BCBA-Pass-Rates-Combined-210601.pdf
Behavior Analyst Certification Board. (2021c). BCBA 2022 eligibility requirements. https://www.bacb.com/wp-content/uploads/2020/11/BCBA-2022EligibilityRequirements_210513.pdf
Blydenburg, D. M., & Diller, J. W. (2016). Evaluating components of behavior-analytic training programs. Behavior Analysis in Practice, 9(2), 179–183. https://doi.org/10.1007/s40617-016-0123-2
Carr, J. E., & Nosik, M. R. (2015). On the complexity of correlating a graduate program’s experiences with the success of its graduates: A response to Dixon et al. (2015). Behavior Analysis in Practice, 8(2), 163–164. https://doi.org/10.1007/s40617-015-0091-y
Carr, J. E., & Nosik, M. R. (2017). Professional credentialing of practicing behavior analysts. Policy Insights from the Behavioral & Brain Sciences, 4(1), 3–8. https://doi.org/10.1177/2372732216685861
Critchfield, T. S. (2015). In dreams begin responsibility: Why and how to measure the quality of graduate training in applied behavior analysis. Behavior Analysis in Practice, 8(2), 123–133. https://doi.org/10.1007/s40617-015-0090-z
Deochand, N., & Fuqua, R. W. (2016). BACB certification trends: State of the states (1999–2014). Behavior Analysis in Practice, 9(3), 243–252. https://doi.org/10.1007/s40617-016-0118-z
Detrich, R. (2015). Are we looking for love in all the wrong places? Comment on Dixon et al. Behavior Analysis in Practice, 8(2), 144–146. https://doi.org/10.1007/s40617-015-0069-9
Dixon, M. R., Reed, D. D., Smith, T., Belisle, J., & Jackson, R. E. (2015a). Research rankings of behavior analytic graduate training programs and their faculty. Behavior Analysis in Practice, 8(1), 7–15. https://doi.org/10.1007/s40617-015-0057-0
Dixon, M. R., Reed, D. D., Smith, T., Belisle, J., & Jackson, R. E. (2015b). Top 10 responses to the commentaries on Dixon, Reed, Smith et al. (2015). Behavior Analysis in Practice, 8(2), 165–169. https://doi.org/10.1007/s40617-015-0094-8
Dubuque, E. M., Yingling, M. E., & Allday, R. A. (2020). The misclassification of behavior analysts: How National Provider Identifiers (NPI) fail to adequately capture the scope of the field. Behavior Analysis in Practice.https://doi.org/10.1007/s40617-020-00451-w
Guinness, K. E., & Turner, K. S. (2021). Program characteristics and certification examination pass rates: A statistical analysis of BACB-Published 2015-2019 data. Behavior Analysis in Practice.https://doi.org/10.1007/s40617-021-00610-7
Hayes, L. J. (2015). There’s a man goin’ round taking names. Behavior Analysis in Practice, 8(2), 134–135. https://doi.org/10.1007/s40617-015-0070-3
Hopkins, B. L., & Moore, J. (1993). ABA accreditation of graduate programs of study. The Behavior Analyst, 16(1), 117–121. https://doi.org/10.1007/BF03392616
Iwata, B. A. (2015). Metrics of quality in graduate training. Behavior Analysis in Practice, 8(2), 136–137. https://doi.org/10.1007/s40617-015-0076-x
Maguire, R. W., & Allen, R. F. (2015). Another perspective on research as a measure of high-quality practitioner training: A response to Dixon, Reed, Smith, Belisle, and Jackson. Behavior Analysis in Practice, 8(2), 154–155. https://doi.org/10.1007/s40617-015-0087-7
Pritchard, J. K., & Wine, B. (2015). Icing on the cake: The role of research in practitioner training. Behavior Analysis in Practice, 8(2), 140–141. https://doi.org/10.1007/s40617-015-0074-z
Reeve, S. A. (2015). Expanding the scope of research productivity indices: A commentary on Dixon, Reed, Smith, Belisle, and Jackson (2015). Behavior Analysis in Practice, 8(2), 142–143. https://doi.org/10.1007/s40617-015-0073-0
Shepley, C., Allday, R. A., & Shepley, S. B. (2017). Towards a meaningful analysis of behavior analyst preparation programs. Behavior Analysis in Practice, 31(11), 39–45. https://doi.org/10.1007/s40617-017-0193-9
Wilczynski, S. M. (2015). The emperor just might be wearing pants. Behavior Analysis in Practice, 8(2), 147–148. https://doi.org/10.1007/s40617-015-0066-z
Wilder, D. A., Lipschultz, J. L., Kelley, D. P., Rey, C., & Enderli, A. (2015). An alternative measure of research productivity among behavior analytic graduate training programs: A response to Dixon et al. (2015). Behavior Analysis in Practice, 8(2), 156–158. https://doi.org/10.1007/s40617-015-0075-y
Maguire, R. W. (2015). Another perspective on research as a measure of high-quality practitioner training: A response to Dixon, Reed, Smith, Belisle, and Jackson. Behavior Analysis in Practice, 8, 154–155. https://doi.org/10.1007/s40617-015-0087-7
Blair, B. J., Shawler, L. A., Debacher, E. A., Harper, J. M. & Dorsey, M. F. (2018). Ranking graduate programs based on research productivity of faculty: A replication and extension. Education and Treatment of Children, 41(3), 299–318. https://doi.org/10.1080/01608061.2020.1746726
Disclaimer
The views and opinions expressed herein are those of the authors and do not necessarily reflect the official policies or positions of the Association for Behavior Analysis International (ABAI), the Behavior Analyst Certification Board (BACB), the University of Louisville, The Council of Autism Service Providers (CASP), California State University, Northridge (CSUN), or Behavioral Health Center of Excellence (BHCOE).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The first author accepted the position of Vice President of Accreditation with The Council of Autism Service Providers (CASP) during manuscript revisions. In addition, he was employed part-time as the Accreditation Administrator for the Association for Behavior Analysis International (ABAI) from October 2015 to February 2018. He currently serves as a subject matter expert (SME) for the Behavior Analyst Certification Board (BACB) and is married to a member of the BACB leadership team. Lastly, during preparation of the manuscript the first author was a Verified Course Sequence (VCS) Coordinator for a graduate training program in applied behavior analysis. The second author does not currently have an affiliation with ABAI accreditation or the BACB. She has served as a BACB SME and on a few task forces in the past. At present, she a faculty member in a VCS program she founded in 2006 and directed until 2016. Lastly, she is the Chief Science Officer at Behavioral Health Center of Excellence, which is an accrediting organization.
Ethical approval
This project was submitted to the University of Louisville Human Subjects Protection Program and was deemed to not meet the “Common Rule” definition of human subjects’ research. As such the project did not require IRB review.
Informed consent
This project did not utilize any human subjects and relied on publicly available data sets.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Author Note
The authors acknowledge Emily Zoernig for her assistance in conducting reliability checks of the VCS data sets.
Rights and permissions
About this article
Cite this article
Dubuque, E.M., Kazemi, E. An Investigation of BCBA Exam Pass Rates as a Quality Indicator of Applied Behavior Analysis Training Programs . Behav Analysis Practice 15, 909–923 (2022). https://doi.org/10.1007/s40617-021-00660-x
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40617-021-00660-x