Article PDF
Avoid common mistakes on your manuscript.
References
Antonak, R. F. A computer program to compute measures of response agreement for nominal scale data obtained from two judges.Behavior Research Methods & Instrumentation, 1977,9, 553.
Berk, R. A., &Campbell, K. L. A FORTRAN program lor Cohen’s kappa coefficient of observer agreement.Behavior Research Methods & Instrumentation, 1976,8, 396.
Cohen, J. A coefficient of agreement for nominal scales.Educational and Psychological Measurement, 1960,20, 37–46.
Kelly, M. B. A review of the observational data collection and reliability procedures reported in theJournal of Applied Behavior Analysis.Journal of Applied Behavior Analysis, 1977,10, 97–101.
Krippendorff, K. Bivariate agreement coefficients for reliability of data. In F. F. Borgatta & G. W. Bohrnstedt (Eds.),Sociological methodology. San Francisco: Jossey-Bass, 1970.
Scott, W. A. Reliability of content analysis: The case of nominal scale coding.Public Opinion Quarterly, 1955,19, 321–325.
Spitzer, R. L., &Fleiss, J. L. A re-analysis of the reliability of psychiatric diagnosis.British Journal of Psychiatry, 1974,125, 341–347.
Thornton, B. W., &Croskey, F. L. A computer program for calculating an index of interobserver reliability from timeseries data.Educational and Psychological Measurement, 1975,35, 735–737.
Watkins, M. W. Chance and interrater agreement on manuscripts.American Psychologist, 1979,34, 796–798.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Watkins, M.W., Larimer, L.D. Interrater agreement statistics with the microcomputer. Behavior Research Methods & Instrumentation 12, 466 (1980). https://doi.org/10.3758/BF03201699
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03201699