How to use adjusted degree of distinguishability and inter-rater reliability simultaneously?

YILMAZ A. E.

Cumhuriyet Science Journal, cilt.42, sa.3, ss.743-744, 2021 (Hakemli Dergi) identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 42 Sayı: 3
  • Basım Tarihi: 2021
  • Dergi Adı: Cumhuriyet Science Journal
  • Derginin Tarandığı İndeksler: Directory of Open Access Journals, TR DİZİN (ULAKBİM)
  • Sayfa Sayıları: ss.743-744
  • Hacettepe Üniversitesi Adresli: Evet

Özet

When the categories of a square contingency table are ordinal, weighted kappa or Gwet’s AC2 coefficients are used to summarize the degree of reliability between two raters. In addition, investigating the reliability among raters, the term category distinguishability should be considered. The study aims to assess the inter-rater reliability and category distinguishability in ordinal rating scales together. The weighted kappa, AC2, and adjusted degree of distinguishability coefficients are applied to pathology data. The results are discussed over the pathologist pairs.