A Comparison of Bookmark and Angoff Standard Setting Methods


ÇETİN S., GELBAL S.

KURAM VE UYGULAMADA EGITIM BILIMLERI, cilt.13, sa.4, ss.2169-2175, 2013 (SSCI) identifier identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 13 Sayı: 4
  • Basım Tarihi: 2013
  • Doi Numarası: 10.3352/jeehp.2018.15.32
  • Dergi Adı: KURAM VE UYGULAMADA EGITIM BILIMLERI
  • Derginin Tarandığı İndeksler: Social Sciences Citation Index (SSCI), Scopus, TR DİZİN (ULAKBİM)
  • Sayfa Sayıları: ss.2169-2175
  • Anahtar Kelimeler: Angoff Method, Bookmark Method, Cut Score, Response Probability, Standard Setting
  • Hacettepe Üniversitesi Adresli: Evet

Özet

In this research, the cut score of a foundation university was re-calculated with bookmark method and with Angoff method, each of which is a standard setting method; and the cut scores found were compared with the current proficiency score. Thus, the final cut score was found to be 27.87 with the cooperative work of 17 experts through the Angoff method. The cut scores derived by calculations using the bookmark method were found as 19.242 for 1 PLM and RP50, as 25.247 for 1 PLM and RP67, as 18.897 for 2 PLM and RP50, and as 25.102 for 2 PLM and RP67. Correlation coefficients are examined between probabilities of expert answers and real item difficulties to see relationship level between experts' determining probability of right answers and the real difficulty of the items. The correlation coefficient between experts' determining probability of right answers and the real difficulty of the items is determined as 0.60. It is find that there is a significant difference between the percent of students whose score is more than qualifying score determined by the foundation university which is 35 point and the percent of students whose score is more than cut scores determined by Bookmark Method for RP50, RP67 and Angoff Method; but it is also find out that there is no significant difference between the percent of students whose score is more than cut scores determined by the Bookmark Method with RP50 and RP67; and Bookmark method and Angoff method.