Skip to main content
SpringerLink
Log in

Interobserver Agreement as a Function of the Number of Behaviors Recorded Simultaneously

  • Published:
The Psychological Record Aims and scope Submit manuscript

Abstract

Interobserver agreement scores were analyzed using the Interval-by-Interval and Occurrence-Agreement methods to determine the number of different behaviors an observer may reliably record at a time. Observer pairs recorded 1, 4, 6, 9, 11, and 14 different behaviors at a time from videotape recordings of a classroom. The results suggest that at least 14 behaviors may be recorded simultaneously by experienced, well-trained observers without a decrement in inter observer agreement.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References Note

  1. KASS, R.E., & O’LEARY, K.D. 1970. The effects of observer bias in field-experimental settings. Paper presented at a symposium entitled “Behavior Analysis in Education,” University of Kansas, Lawrence, April.

    Google Scholar 

References

  • BAER, D. M., WOLF, M. M., & RISLEY, T. R. 1968. Some current dimensions of applied behavior analysis. Journal of Applied Behavior Analysis, 1, 91–97.

    Article  PubMed  PubMed Central  Google Scholar 

  • BIJOU, S.W., PETERSON, R.F., HARRIS, F.R., ALLEN, E., & JOHNSTON, M.S. 1969. Methodology for experimental studies of young children in natural settings. The Psychological Record, 19, 177–210.

    Article  Google Scholar 

  • CORNFIELD, J., & TUKEY, J. W. 1956. Average values of mean squares in factorials. Annals of Mathematical Statistics, 27, 907–949.

    Article  Google Scholar 

  • HALL, R.V. 1971 Behavior modification: The measurement of behavior. Lawrence, Kansas: H & H Enterprises, Inc.

    Google Scholar 

  • HAWKINS, R.P., & DOBES, R.W. 1977. Behavioral definitions in applied behavior analysis: Explicit or implicit? In B.C. Etzel, J. M. LeBlanc, & D.M. Baer (Eds.), New developments in behavioral research: Theory, method, and application. Hillsdale, N.J.: Lawrence Erlbaum Associates.

    Google Scholar 

  • HAWKINS, R.P., & DOTSON, V.A. 1975. Reliability scores that delude: An Alice in Wonderland trip through the misleading characteristics of interobserver agreement scores in interval recording. In E. Ramp & G. Semb (Eds.), Behavior analysis: Areas of research and application. Englewood Cliffs, N.J.: Prentice-Hall.

    Google Scholar 

  • KELLY, M.B. 1977. A review of the observational data collection and reliability procedures Reported in the: Journal of Applied Behavior Analysis, 10, 97–101.

    Article  PubMed  PubMed Central  Google Scholar 

  • KENT, R.N., KANOWITZ, J., O’LEARY, K.D., & CHEIKEN, M. 1977. Observer reliability as a function of circumstances of assessment. Journal of Applied Behavior Analysis, 10, 317–324.

    Article  PubMed  PubMed Central  Google Scholar 

  • MADSEN, C.H., Jr., BECKER, W.C., & THOMAS, D. H. 1968. Rules, praise and ignoring: Elements of elementary classroom control. Journal of Applied Behavior Analysis, 1, 139–150.

    Article  PubMed  PubMed Central  Google Scholar 

  • MASH, E.J., & MCELWEE, J. D. 1974. Situational effects on observer accuracy: Behavioral predictability, prior experience, and complexity of coding categories. Child Development, 45, 367–377.

    Article  Google Scholar 

  • O’LEARY, K.D., & KENT, R.N. 1973. Behavior modification for social action: Research tactics and problems. In L.A. Hammerlynck, L.C. Handy, & E.J. Mash (Eds.), Behavior Change: Methodology, concepts and practice. Champaign, Ill.: Research Press.

    Google Scholar 

  • REID, J. B. 1970. Reliability assessment of observation data: A possible methodological problem. Child Development, 41, 1143–1150.

    Article  Google Scholar 

  • ROMANCZYK, R. G., KENT, R. N., DIAMENT, C., & O’LEARY, K. D. 1973. Measuring the reliability of observational data: A reactive process. Journal of Applied Behavior Analysis, 6, 175–184.

    Article  PubMed  PubMed Central  Google Scholar 

  • TAPLIN, P.S., & REID, J. B. 1973. Effects of instructional set and experimenter influence on observer reliability, Child Development, 44, 547–554.

    Article  Google Scholar 

  • WALKER, H..M., & BUCKLEY, N.K. 1972. Programming generalization and maintenance treatment effects across time, and across settings. Journal of Applied Behavior A nalysis, 5, 209–224.

    Article  Google Scholar 

  • WINER, B.J. 1971. Statistical principles in experimental design. New York: McGraw-Hill Book Co.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Michigan State University, 136 Oakland Dr., East Lansing, Michigan, 48823, USA

    Roger E. Frame

Authors
  1. Roger E. Frame
    View author publications

    You can also search for this author in PubMed Google Scholar

Additional information

The author thanks Robert P. Hawkins, Bradley E. Huitema, Jack Michael, Andrew Porter, and J. Sutherland Frame for their advice and asistance. Ansley Bacon, Mohammed Behbehani, Daryl Bonneau, Lynn Hitch, Eli Karmini, Susan Leiphart, Deborah MacCormack, and Patrick Rimel also contributed considerable time for minimal compensation.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Frame, R.E. Interobserver Agreement as a Function of the Number of Behaviors Recorded Simultaneously. Psychol Rec 29, 287–296 (1979). https://doi.org/10.1007/BF03394614

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF03394614

Search

Navigation