How to use adjusted degree of distinguishability and inter-rater reliability simultaneously?


Cumhuriyet Science Journal, vol.42, no.3, pp.743-744, 2021 (Peer-Reviewed Journal) identifier

  • Publication Type: Article / Article
  • Volume: 42 Issue: 3
  • Publication Date: 2021
  • Journal Name: Cumhuriyet Science Journal
  • Journal Indexes: Directory of Open Access Journals, TR DİZİN (ULAKBİM)
  • Page Numbers: pp.743-744
  • Hacettepe University Affiliated: Yes


When the categories of a square contingency table are ordinal, weighted kappa or Gwet’s AC2 coefficients are used to summarize the degree of reliability between two raters. In addition, investigating the reliability among raters, the term category distinguishability should be considered. The study aims to assess the inter-rater reliability and category distinguishability in ordinal rating scales together. The weighted kappa, AC2, and adjusted degree of distinguishability coefficients are applied to pathology data. The results are discussed over the pathologist pairs.