Can ChatGPT-4 Diagnose in Turkish: A Comparison of ChatGPT Responses to Health-Related Questions in English and Turkish

Yildiz M. S., ALPER A.

JOURNAL OF CONSUMER HEALTH ON THE INTERNET, vol.27, no.3, pp.294-307, 2023 (ESCI) identifier identifier

  • Publication Type: Article / Article
  • Volume: 27 Issue: 3
  • Publication Date: 2023
  • Doi Number: 10.1080/15398285.2023.2240652
  • Journal Name: JOURNAL OF CONSUMER HEALTH ON THE INTERNET
  • Journal Indexes: Emerging Sources Citation Index (ESCI), Scopus, Academic Search Premier, IBZ Online, Aerospace Database, Applied Science & Technology Source, CAB Abstracts, CINAHL, Communication Abstracts, Computer & Applied Sciences, Information Science and Technology Abstracts, INSPEC, Library and Information Science Abstracts, Library Literature and Information Science, Library, Information Science & Technology Abstracts (LISTA), Metadex, Public Affairs Index, Veterinary Science Database, Civil Engineering Abstracts
  • Page Numbers: pp.294-307
  • Hacettepe University Affiliated: Yes

Abstract

OpenAI's machine learning-based ChatGPT implementation has become a trending topic in the first quarter of 2023. Comparative assessment of the health information provided by ChatGPT in Turkish with the health information provided in English is the purpose of this study. Comparison between English answer to English question and English translation of Turkish answer to Turkish question is made by five gastroenterology specialists for their comprehensiveness and accuracy. Turkish responses of ChatGPT were assessed as correct as English responses and less comprehensive but not evaluated as "inadequate". It was found that ChatGPT could be used for online health information purposes in the Turkish language.