In this study, it was compared different item scoring methods which consist of unweighted item scoring method and weighted item scoring method, based on classical testing theory and probability item scoring methods, based on item response theory, and congeneric item scoring method based on congeneric test theory. It was investigated the effects of item scoring methods on reliability, unidimensionality, and model-data fitting of data set. As a result, the item scoring methods based on item response model and based on congeneric test theory were more satisfactory than the others. In addition to this, in this study, it was compared different test scoring. As known, the students who took an administered achievement tests is ranked according to their test scores. The obtained findings was reported and discussed in this context.