Methodological challenges in content-based citation analysis: Expertise, reliability, and the primacy of citance identification
Journal of the Association for Information Science and Technology, 2026 (SCI-Expanded, SSCI, Scopus)
- Yayın Türü: Makale / Tam Makale
- Basım Tarihi: 2026
- Doi Numarası: 10.1002/asi.70102
- Dergi Adı: Journal of the Association for Information Science and Technology
- Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Social Sciences Citation Index (SSCI), Scopus, Periodicals Index Online, ABI/INFORM, Aerospace Database, Agricultural & Environmental Science Database, Applied Science & Technology Source, CINAHL, Compendex, EBSCO Education Source, Education Abstracts, Information Science and Technology Abstracts, INSPEC, Library Literature and Information Science, Library, Information Science & Technology Abstracts (LISTA), MLA - Modern Language Association Database, Information Science & Technology Abstracts (LISTA), MLA International Bibliography, Academic Search Ultimate (EBSCO), Social Science Premium Collection (ProQuest), Business Source Ultimate (EBSCO), Education Collection (ProQuest), Education Source Ultimate (EBSCO), Engineering Source (EBSCO), Library & Information Science Collection (ProQuest), Technology Collection (ProQuest)
- Hacettepe Üniversitesi Adresli: Evet
Özet
Content-based citation analysis seeks to capture the meaning and functions of citations but continues to face unresolved methodological challenges. This study analyzes a stratified sample of library and information science publications to examine how citance segmentation and annotator expertise influence the consistency of classification. Using two annotators with different professional backgrounds, the findings show that agreement is high when citances are defined identically, but reliability decreases sharply once text boundaries diverge. Citance length, rather than subject category or citation density, emerges as the strongest predictor of disagreement. These results identify segmentation as a methodological rather than a purely technical issue, shaping both human and automated tagging outcomes. By highlighting the interplay between expertise effects and boundary definitions, the study underscores the need for clearer operational frameworks in citation analysis. The contribution lies in demonstrating that methodological refinements in citance identification are essential for improving reproducibility, enhancing hybrid human–machine approaches, and strengthening the validity of citation-based indicators in research evaluation.