Ridit and exponential type scores for estimating the kappa statistic

Yılmaz A. E., Aktas S.

KUWAIT JOURNAL OF SCIENCE, vol.45, no.1, pp.89-99, 2018 (SCI-Expanded) identifier identifier

  • Publication Type: Article / Article
  • Volume: 45 Issue: 1
  • Publication Date: 2018
  • Journal Name: KUWAIT JOURNAL OF SCIENCE
  • Journal Indexes: Science Citation Index Expanded (SCI-EXPANDED), Scopus
  • Page Numbers: pp.89-99
  • Hacettepe University Affiliated: Yes

Abstract

Cohen's kappa coefficient is a commonly used method for estimating interrater agreement for nominal and/or ordinal data; thus agreement is adjusted for that expected by chance. The weighted kappa statistic is used as an agreement index for ordinal data. The weights quantify the degree of discrepancy between the two categories. The choice of this particular set of weights affects the value of kappa. The common scores are Cicchetti-Allison and Fleiss-Cohen weights. In this article, we discuss the use of ridit type and exponential scores to compute kappa statistics in general.