Abstract
There is an impressive published literature on the statistical issues of assessment of agreement among two or more raters involving both qualitative and quantitative data. We propose to present basic ideas and relevant statistical methods toward assessment of agreement.
This chapter draws material from co-published work of one of the authors: ‘Some further aspects of assessment of agreement involving bivariate normal responses,’ published in Int’l Jour. of Statistical Sciences, Vol. 13, 2013, pp. 1–19. Portions have been used here with permission from the Author Dr. Ganesh Dutta as well as Publisher.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References and Suggested Readings
Anderson, S., & Hauck, W. W. (1990). Consideration of individual bioequivalence. Journal of Pharmacokinetics and Biopharmaceutics, 18, 259–273.
Anderson, T. W. (2003). An introduction to multivariate statistical analysis. New York: Wiley.
Banerjee, M., Capozzoli, M., McSweeney, L., & Sinha, D. (1999). Beyond kappa: A review of interrater agreement measures. The Canadian Journal of Statistics, 27, 3–23.
Barnhar, H. X., Haber, M. J., & Lin, L. I. (2007). An Overview On Assessing Agreement With Continuous Measurement.
Bland, J. M., & Altman, D. (1986). Statistical methods for assessing agreement between two methods of clinical measurement. The Lancet, 8, 307–310.
Chinchilli, V. M., Martel, J. K., Kumanyika, S., & Lloyd, T. (1996). A weighted concordance correlation coefficient for repeated measures designs. Biometrics, 52, 341–353.
Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37–46.
Cohen, J. (1968). Weighted kappa: Nominal scale agreement with provision for scaled disagreement or partial credit. Psychological Bulletin, 70, 213–220.
Dutta, G., & Sinha, B. K. (2013). Some further aspects of assessment of agreement involving bivariate normal responses. International Journal of Statistical Sciences, 13.
Fleiss, J. L. (1981). Statistical methods for rates and proportions. 2nd ed. (pp. 38–46). New York: John Wiley.
Hedayat, A. S., Lou, C., & Sinha, B. K. (2009). A statistical approach to assessment of agreement involving multiple raters. Communications in Statistics - Theory & Methods, 38, 2899–2922.
Holder, D. J., & Hsuan, F. (1993). Moment-based criteria for determining bioequivalence. Biometrika, 80, 835–846.
King, T. S., & Chinchilli, V. M. (2001). A generalized concordance correlation coefficient for continuous and categorical data. Statistics in Medicine. pp. 2131–2147.
Kraemer, H. C., Periyakoil, V. S., & Noda, A. (2002). Kappa coefficients in medical research. Statistics in Medicine (pp. 2109–2129).
Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–74.
Lin, L., Hedayat, A. S., Sinha, B. K., & Yang, M. (2002). Statistical methods in assessing agreement: Models, issues, and tools. Journal of the American Statistical Association, 97, 257–270.
Lin, L., Hedayat, A. S., & Wu, W. (2012). Statistical tools for measuring agreement. Berlin: Springer.
Lin, L. I. (1989). A concordance correlation coefficient to evaluate reproducibility. Biometrics, 45, 255–268.
Lin, L. I. (1992). Assay validation using the concordance correlation coefficient. Biometrics, 48, 599–604.
Lin, L. I. (1997). Rejoinder to the letter to the editor by Atkinson and Nevill. Biometrics, 53, 777–778.
Lin, L. I. (2000). Total deviation index for measuring individual agreement: With application in lab performance and bioequivalence. Statistics in Medicine, 19, 255–270.
Lin, L. I., & Torbeck, L. D. (1998). Coefficient of accuracy and concordance correlation coefficient: New statistics for method comparison. PDA Journal of Pharmaceutical Science and Technology, 52, 55–59.
Pornpis, Y., Tiensuwan, M., & Sinha, B. K. (2006). Cohen’s kappa statistic: A critical appraisal and some modifications. Calcutta Statistical Association Bulletin, 58, 151–169.
Schall, R. (1995). Assessment of individual and population bioequivalence using the probability that bioavailabilities are similar. Biometrics, 51, 615–626.
Schall, R., & Luus, H. G. (1993). On population and individual bioequivalence. Statistics in Medicine, 12, 1109–1124.
Schall, R., & Williams, R. L. (1996). Towards a practical strategy for assessing individual bioequivalence. Journal of Pharmacokinetics and Biopharmaceutics, 24, 133–149.
Sheiner, L. B. (1992). Bioequivalence revisited. Statistics in Medicine, 11, 1777–1788.
Shoukri, M. M. (2004). Measures of interobserver agreement. Boca Raton: Chapman & Hall/CRC.
Von Eye, A., & Mun, E. Y. (2005). Analyzing rater agreement: Manifest variable methods.
Vonesh, E. F., & Chinchilli, V. M. (1997). Linear and nonlinear models for the analysis of repeated measurements. New York: Marcel Dekker.
Vonesh, E. F., Chinchilli, V. M., & Pu, K. (1996). Goodness-of-fit in generalised nonlinear mixed-effect models. Biometrics, 52, 572–587.
Yimprayoon, P., Tiensuwan, M., & Sinha Bimal, K. (2006). Some statistical aspects of assessing agreement: Theory and applications (English summary). Festschrift for Tarmo Pukkila on his 60th birthday (pp. 327–346). Tampere: Department of Mathematics, Statistics and Philosophy, University of Tampere.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2018 Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Mukherjee, S.P., Sinha, B.K., Chattopadhyay , A. (2018). Statistical Assessment of Agreement. In: Statistical Methods in Social Science Research. Springer, Singapore. https://doi.org/10.1007/978-981-13-2146-7_6
Download citation
DOI: https://doi.org/10.1007/978-981-13-2146-7_6
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-2145-0
Online ISBN: 978-981-13-2146-7
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)