JOURNAL OF MEASUREMENT AND EVALUATION IN EDUCATION AND PSYCHOLOGY-EPOD, cilt.1, sa.1, ss.22-28, 2010 (ESCI)
In this study, according to generalizability theory (G theory) the variance components of the cutting scores obtained from Nedelsky and Angoff standards setting methods were compared. The data of this research were collected by using the 16 science and technology items which were asked on elementary 6th grade "Achievement Determination Exam (Seviye Belirleme Sinavi) (SBS)". These items were graded by 40 science and technology experts (raters) working in Ankara according to these two standards setting methods. The variance components of the cutting scores were obtained by using G theory. According to the results of the study, it is determined that the differences of the items can be revealed by using both Angoff and Nedelsky standards setting methods. While there is a rater consistency for the cutting scores obtained by Angoff method, rater consistency was not observed for the cutting scores obtained by Nedelsky method. In G study which both methods were taken in hand together, it was observed that the differences of the items could be revealed and there is a rater consistency for the cutting scores.