Three Discovery Tools: A Comparative Analysis of Retrieval Scope, Ranking Effectiveness, and Topic Diversity
College and Research Libraries, cilt.87, sa.3, ss.357-375, 2026 (SSCI, Scopus)
- Yayın Türü: Makale / Tam Makale
- Cilt numarası: 87 Sayı: 3
- Basım Tarihi: 2026
- Doi Numarası: 10.5860/crl.87.3.357
- Dergi Adı: College and Research Libraries
- Derginin Tarandığı İndeksler: Social Sciences Citation Index (SSCI), Scopus, Education Abstracts, Educational research abstracts (ERA), ERIC (Education Resources Information Center), Information Science and Technology Abstracts, Library, Information Science & Technology Abstracts (LISTA), MLA - Modern Language Association Database, Public Affairs Index, Directory of Open Access Journals
- Sayfa Sayıları: ss.357-375
- Hacettepe Üniversitesi Adresli: Evet
Özet
Discovery tools facilitate access to large-scale academic collections, yet their retrieval performance varies. This study presents a comparative analysis of three discovery tools—EBSCO Discovery Services (EDS), EKUAL Discovery Services (EKUAL DS), and Piri Discovery Services (Piri DS)—evaluating retrieval scope, ranking quality, and topical diversity index. The iSearch test collection, derived from arXiv articles, was used with predefined search queries. To assess coverage, the full arXiv corpus was queried to identify indexing differences. A total of 63 queries were executed, and retrieved lists were analyzed for relevance and ranking distribution. Expert-evaluated relevant articles were used to assess retrieval accuracy. Ranking was measured using Discounted Cumulative Gain (DCG) and Normalized DCG (NDCG), and topical diversity was evaluated using the Shannon Diversity Index. EDS and EKUAL DS retrieved identical results, while Piri DS retrieved fewer records, affecting its retrieval completeness. Piri DS ranked relevant articles higher, but with broader distribution. While all tools exhibited comparable ranking performance, EDS and EKUAL DS demonstrated greater topical diversity. These findings offer empirical insight into the strengths and limitations of discovery tools and support libraries in improving search efficiency and retrieval strategies.