A formal proof of a paradox associated with Cohen's kappa

DOI10.1007/s00357-010-9060-xzbMath1337.62143OpenAlexW2153942520MaRDI QIDQ286623

Matthijs J. Warrens

Publication date: 25 May 2016

Published in: Journal of Classification (Search for Journal in Brave)

Full work available at URL: http://hdl.handle.net/1887/16310

zbMATH Keywords

rearrangement inequalityinter-rater reliabilitymarginal asymmetrymarginal homogeneitynominal agreement

Mathematics Subject Classification ID

Classification and discrimination; cluster analysis (statistical aspects) (62H30) Applications of statistics to social sciences (62P25) Applications of statistics to psychology (62P15)

Related Items (14)

A family of multi-rater kappas that can always be increased and decreased by combining categories ⋮ The effect of combining categories on Bennett, Alpert and Goldstein's \(S\) ⋮ Equivalences of weighted kappas for multiple raters ⋮ Cohen's quadratically weighted kappa is higher than linearly weighted kappa for tridiagonal agreement tables ⋮ Conditional inequalities between Cohen's kappa and weighted kappas ⋮ Some paradoxical results for the quadratically weighted kappa ⋮ Inequalities between multi-rater kappas ⋮ Bayesian testing of agreement criteria under order constraints ⋮ Properties of Bangdiwala's \(B\) ⋮ Cohen's linearly weighted kappa is a weighted average ⋮ Cohen's kappa is a weighted average ⋮ Cohen's linearly weighted kappa is a weighted average of \(2\times 2\) kappas ⋮ Weighted kappa as a function of unweighted kappas ⋮ How to assess rater rankings? A theoretical and a simulation approach using the sum of the pairwise absolute row differences (PARDs)

Uses Software

• Delta

Cites Work

• Unnamed Item
• Unnamed Item
• \(k\)-adic similarity coefficients for binary (presence/absence) data
• On similarity coefficients for \(2\times2\) tables and correction for chance
• On the indeterminacy of resemblance measures for binary (presence/absence) data
• On the equivalence of Cohen's kappa and the Hubert-Arabie adjusted Rand index
• Bounds of resemblance measures for binary (presence/absence) variables
• A more powerful method for testing for agreement between a judge and a known standard
• Inequalities between kappa and kappa-like statistics for \(k\times k\) tables
• On association coefficients for \(2\times 2\) tables and properties that do not depend on the marginal distributions
• Ramifications of a population model for \(\kappa\) as a coefficient of reliability
• Maximum Likelihood Estimation of Agreement in the Constant Predictive Probability Model, and Its Relation to Cohen's Kappa
• Measures, Models, and Graphical Displays in the Analysis of Cross-Classified Data
• Simple Moment Estimates of the κ-Coefficient and Its Variance
• Statistical description of interrater variability in ordinal ratings
• Chance-Corrected Measures of Reliability and Validity in 2 × 2 Tables

This page was built for publication: A formal proof of a paradox associated with Cohen's kappa