Hostname: page-component-7c8c6479df-hgkh8 Total loading time: 0 Render date: 2024-03-27T09:41:45.619Z Has data issue: false hasContentIssue false

Coefficients of Agreement

Published online by Cambridge University Press:  29 January 2018

M. E. Dewey*
Affiliation:
Department of Psychiatry, University of Liverpool, P.O. Box 147, Liverpool L69 3BX

Summary

Several coefficients have been suggested for the measurement of agreement between raters. Recently Maxwell (1977) has proposed, and Janes (1979) has extended, a new coefficient, which they have termed the random error coefficient (RE). This paper criticizes their proposal and suggests that Cohen's (1960) coefficient kappa (K) is still the measure of choice.

Type
Research Article
Copyright
Copyright © 1983 The Royal College of Psychiatrists 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Bishop, Y. M. M., Fienberg, S. E. & Holland, P. W. (1975) Discrete multivariate analysis. Cambridge, Mass.: MIT Press.Google Scholar
Cohen, J. (1960) A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 3746.CrossRefGoogle Scholar
Cohen, J. (1968) Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychological Bulletin, 70, 213–20.CrossRefGoogle ScholarPubMed
Fleiss, J. (1975) Measuring agreement between two judges on the presence or absence of a trait. Biometrics, 31, 651–9.CrossRefGoogle ScholarPubMed
Janes, C. (1979) An extension of the random error coefficient of agreement to NxN tables. British Journal of Psychiatry, 134, 617–19.CrossRefGoogle ScholarPubMed
Maxwell, A. E. (1977) Coefficients of agreement between observers and their interpretation. British Journal of Psychiatry, 130, 7983.CrossRefGoogle ScholarPubMed
Mellor, C. (1970) First rank symptoms of schizophrenia. British Journal of Psychiatry, 117, 1523.CrossRefGoogle ScholarPubMed
Robinson, M., Cookson, I. & White, K. (1982) The ‘consentiam’ effect: Are your joint ratings really independent? British Journal of Medical Psychology, 55, 285–6.CrossRefGoogle ScholarPubMed
Submit a response

eLetters

No eLetters have been published for this article.