Abstract
This technical report provides detailed information on the rationale for using a common computer spreadsheet program (Microsoft Excel®) to calculate various forms of interobserver agreement for both continuous and discontinuous data sets. In addition, we provide a brief tutorial on how to use an Excel spreadsheet to automatically compute traditional total count, partial agreement-within-intervals, exact agreement, trial-by-trial, interval-by-interval, scored-interval, unscored-interval, total duration, and mean duration-per-interval interobserver agreement algorithms. We conclude with a discussion of how practitioners may integrate this tool into their clinical work.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Behavior Analyst Certification Board. (2005, Fall). BCBA® & BCaBA® Behavior Analyst Task List — Third edition. Retrieved from http://www.bacb.com/Downloadfiles/TaskList/2073rdEd-TaskList.pdf
Brennan, R. L. (2001). An essay on the history and future of reliability from the perspective of replications. Journal of Education Measurement, 38, 295–317.
Carr, J. E., & Burkholder, E. O. (1998). Creating single-subject design graphs with Microsoft Excel. Journal of Applied Behavior Analysis, 31, 245–251.
Christensen, A. R., & Stephens, L. J. (2003). Microsoft Excel as a supplement in a high school statistics course. International Journal of Mathematical Education in Science and Technology, 36, 881–885.
Cooper, J. O., Heron, T. E., & Heward, W. L. (2007). Improving and assessing the quality of behavioral measurement. In. J. O. Cooper, T. E. Heron, & W. L. Heward (Eds.), Applied behavior analysis (2nd ed.; pp. 102–124). Upper Saddle River, NJ: Prentice Hall.
Dixon, M. R., Jackson, J. W., Small, S. L., Horner-King, M. J., Lik, N. M. K., Garcia, Y., & Rosales, R. (2009). Creating single-subject design graphs in Microsoft Excel 2007. Journal of Applied Behavior Analysis, 42, 277–293.
Friman, P. C. (2009). Behavior assessment. In D. H. Barlow, M. K. Nock, & M. Hersen (Eds.), Single case experimental designs: Strategies for studying behavior change (3rd ed.; pp. 99–134). Boston, MA: Pearson.
Kelly, M. B. (1977). A review of the observational data-collection and reliability procedures reported in the Journal of Applied Behavior Analysis. Journal of Applied Behavior Analysis, 10, 97–101.
Mudford, O. C., Taylor, S. A., & Martin, N. T. (2009). Continuous recording and interobserver agreement algorithms reported in the Journal of Applied Behavior Analysis (1995–2005). Journal of Applied Behavior Analysis, 42, 165–169.
Neurath, R. A., & Stephens, L. J. (2006). The effect of using Microsoft Excel in a high school algebra class. International Journal of Mathematical Education in Science and Technology, 37, 721–756.
Powell, S. G., Baker, K. R., & Lawson, B. (2008). A critical review of the literature on spreadsheet errors. Decision Support Systems, 46, 128–138.
Stephens, L. J. (2003). Microsoft Excel as a supplement to intermediate algebra. International Journal of Mathematical Education in Science and Technology, 34, 575–579.
Vollmer, T. R., Sloman, K. N., & St. Peter Pipkin, C. (2008). Practical implications of data reliability and treatment integrity monitoring. Behavior Analysis in Practice, 1, 4–11.
Warner, C. B., & Meehan, A. M. (2001). Microsoft Excel as a tool for teaching basic statistics. Teaching of Psychology, 28, 295–298.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Reed, D.D., Azulay, R.L. A Microsoft Excel® 2010 Based Tool for Calculating Interobserver Agreement. Behav Analysis Practice 4, 45–52 (2011). https://doi.org/10.1007/BF03391783
Published:
Issue Date:
DOI: https://doi.org/10.1007/BF03391783