Beyond kappa: A review of interrater agreement measures
From MaRDI portal
Publication:4262085
DOI10.2307/3315487zbMath0929.62117OpenAlexW2076898331WikidataQ59508937 ScholiaQ59508937MaRDI QIDQ4262085
Michelle Capozzoli, Debajyoti Sinha, Laura A. McSweeney, Mousumi Banerjee
Publication date: 31 January 2000
Published in: Canadian Journal of Statistics (Search for Journal in Brave)
Full work available at URL: https://semanticscholar.org/paper/7dc97e85652502ccfab37c549c671408ce94a94e
Measures of association (correlation, canonical correlation, etc.) (62H20) Applications of statistics to social sciences (62P25) Applications of statistics to psychology (62P15)
Related Items (25)
The effect of combining categories on Bennett, Alpert and Goldstein's \(S\) ⋮ Equivalences of weighted kappas for multiple raters ⋮ Cohen's quadratically weighted kappa is higher than linearly weighted kappa for tridiagonal agreement tables ⋮ Unnamed Item ⋮ Multi-rater delta: extending the delta nominal measure of agreement between two raters to many raters ⋮ Weighted inter-rater agreement measures for ordinal outcomes ⋮ The dependence of chance-corrected weighted agreement coefficients on the power parameter of the weighting scheme: analysis and measurement ⋮ On the equivalence of multirater kappas based on 2-agreement and 3-agreement with binary scores ⋮ Inequalities between multi-rater kappas ⋮ A new weighted rank coefficient of concordance ⋮ Scalable penalized spatiotemporal land-use regression for ground-level nitrogen dioxide ⋮ Sklar's Omega: A Gaussian Copula-Based Framework for Assessing Agreement ⋮ Statistical description of interrater variability in ordinal ratings ⋮ Bayesian Inference for Kappa from Single and Multiple Studies ⋮ kaphom: An R package for testing the homogeneity of intra-class kappa statistics ⋮ Weighted Least-Squares Approach for Comparing Correlated Kappa ⋮ A new approach to inter-rater agreement through stochastic orderings: the discrete case ⋮ Multivariate spatial outlier detection using robust geographically weighted methods ⋮ A Bayesian Method of Estimating Kappa Coefficient with Application to a Rheumatoid Arthritis Study ⋮ Fixed-Effects Modeling of Cohen's Kappa for Bivariate Multinomial Data ⋮ A comparison of reliability coefficients for ordinal rating scales ⋮ A local agreement pattern measure based on hazard functions for survival outcomes ⋮ On population‐based measures of agreement for binary classifications ⋮ Methods of assessing categorical agreement between correlated screening tests in clinical studies ⋮ Justification for the use of Cohen's kappa statistic in experimental studies of NLP and text mining
Cites Work
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Longitudinal data analysis using generalized linear models
- Maximum Likelihood Estimation of Agreement in the Constant Predictive Probability Model, and Its Relation to Cohen's Kappa
- 2 x 2 Kappa Coefficients: Measures of Agreement or Association
- A Concordance Correlation Coefficient to Evaluate Reproducibility
- The Maximum Likelihood Estimation of Correlation from Contingency Tables
- A Model for Agreement Between Ratings on an Ordinal Scale
- Extension of the Kappa Coefficient
- Measuring Agreement for Multinomial Data
- The Measurement of Observer Agreement for Categorical Data
- Measurement of Interrater Agreement with Adjustment for Covariates
- Testing the Homogeneity of Kappa Statistics
- A Weighted Concordance Correlation Coefficient for Repeated Measurement Designs
- Assessing Interrater Agreement from Dependent Data
- Latent Variable Models for Clustered Ordinal Data
- Measures of Association for Cross Classifications
This page was built for publication: Beyond kappa: A review of interrater agreement measures
