The effects of reverse items on psychometric properties and respondents' scale scores according to different item reversal strategies


Creative Commons License

İLHAN M., Guler N., TAŞDELEN TEKER G., Ergenekon O.

INTERNATIONAL JOURNAL OF ASSESSMENT TOOLS IN EDUCATION, cilt.11, sa.1, ss.20-38, 2024 (ESCI) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 11 Sayı: 1
  • Basım Tarihi: 2024
  • Doi Numarası: 10.21449/ijate.1345549
  • Dergi Adı: INTERNATIONAL JOURNAL OF ASSESSMENT TOOLS IN EDUCATION
  • Derginin Tarandığı İndeksler: Emerging Sources Citation Index (ESCI), Central & Eastern European Academic Source (CEEAS), ERIC (Education Resources Information Center), TR DİZİN (ULAKBİM)
  • Sayfa Sayıları: ss.20-38
  • Hacettepe Üniversitesi Adresli: Evet

Özet

This study aimed to examine the effects of reverse items created with different strategies on psychometric properties and respondents' scale scores. To this end, three versions of a 10 -item scale in the research were developed: 10 positive items were integrated in the first form (Form -P) and five positive and five reverse items in the other two forms. The reverse items in the second and third forms were crafted using antonyms (Form -RA) and negations (Form -RN), respectively. Based on the research results, Form -P was unidimensional, while other forms were two-dimensional. Moreover, although reliability coefficients of all forms were obtained as above .80, the lowest one was acquired for Form -RN. There were strong -positive relationships between students' scores in the three scale forms. However, the lowest one was estimated between Form -P and Form -RN. Finally, there was a significant difference between the students' mean scores obtained from Form-RN and other two versions, but the effect size of the said difference was small. In conclusion, all these results indicate that different types of reverse items influence psychometric properties and respondents' scale scores differently.