A Performance of Generative Pre-Trained Transformers (GPT) in Answering Questions on Anatomy in The Turkish Dentistry Specialization Exam
Article Sidebar
Main Article Content
Abstract
Artificial intelligence based programs are used in various fields of daily life, often without our awareness. With the increasing integration of artificial intelligence applications into the educational system, accessing information has become faster. As a result, chat programs that produce text-based answers similar to those of humans are being used as educational tools. The accuracy of the content generated by these programs has always been a topic of interest. In our study, we evaluated the success of ChatGPT, Gemini, and Copilot applications in answering dental specialty exam anatomy questions from 2012-2021. In the computer environment, free versions of ChatGpt-4, Google Gemini and Microsoft Copilot were accessed. The responses were recorded as either correct or incorrect. Out of 74 anatomy questions ChatGPT, Gemini and Copilot gave 2, 10, and 1 incorrect answers, respectively. Although the evaluated programs showed sufficient success in answering anatomy questions, their use was deemed limited due to errors in the supplementary information they provided.
Article Details
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
References
Büyükada, S.. Akademik Yazımda Yapay Zekâ Kullanımının Etik Açıdan İncelenmesi: Chatgpt Örneği. Rize İlahiyat Dergisi,; 1-12. (2024)
Gilson, A., Safranek, C., Huang, T., Socrates, V., Chi, L., Taylor, R. A. & Chartash, D. 2022. How Does Chatgpt Perform On The Medical Licensing Exams? The Implications Of Large Language Models For Medical Education And Knowledge Assessment. Medrxiv,.12. 23.22283901. (2022)
Yağar, S. D. Chatgpt’nin Sağlık Alanındaki Potansiyel Kullanımına Ilişkin Çıkarımlar. Table LegendsAygul, Y, Olucoglu, M And Alpkocak, A. Tipta Uzmanlik Sinavinda (Tus) Büyük Dil Modelleri Insanlardan Daha Mi Başarili Arxiv E-Prints, Arxiv: 2408.12305. (2024)
Şensoy, E. & Çıtırık, M. Okülofasiyal Plastik Ve Orbital Cerrahide İngilizce Ve Türkçe Dil Çeşitliliğinin Yapay Zeka Chatbot Performansına Etkisi: Chatgpt-3.5, Copilot Ve Gemini Üzerine Bir Çalışma. Osmangazi Tıp Dergisi,;46, 781-786. (2024)
Flores-Cohaila Ja, García-Vicente A, Vizcarra-Jiménez Sf, De La Cruz-Galán Jp, Gutiérrez-Arratia Jd, Torres Bgq And Taype-Rondan A. Performance Of Chatgpt On The Peruvian National Licensing Medical Examination: Cross-Sectional Study. Jmir Medical Education,;9, E48039. (2023)
Wang, X., Gong, Z., Wang, G., Jia, J., Xu, Y., Zhao, J., Fan, Q., Wu, S., Hu, W. & Li, X. Chatgpt Performs On The Chinese National Medical Licensing Examination. Journal Of Medical Systems,; 47, 86. (2023)
Çulhaoğlu, AK, Kiliçarslan, MA and Deniz, KZ. Diş Hekimliğinde Uzmanlik Sinavinin Farkli Eğitim Seviyelerdeki Algi Ve Tercih Durumlarinin Değerlendirilmesi. Atatürk Üniversitesi Diş Hekimliği Fakültesi Dergisi,;31, 420-426. (2021)
İncemen, S. & Öztürk, G. Farklı Eğitim Alanlarında Yapay Zekâ: Uygulama Örnekleri. International Journal Of Computers In Education. 7, 27-49. (2024)
Totlis, T., Natsis, K., Filos, D., Ediaroglou, V., Mantzou, N., Duparc, F. & Piagkou, M. The Potential Role Of Chatgpt And Artificial Intelligence In Anatomy Education: A Conversation With Chatgpt. Surgical And Radiologic Anatomy. 45, 1321-1329. (2023)
Uzun, Y., Tümtürk, A. Y. & Öztürk, H. Günümüzde Ve Gelecekte Eğitim Alanında Kullanılan Yapay Zeka. 1st International Conference On Applied Engineering And Natural Sciences,. 1-3. (2021)
Uzun, Arpacı, M. F., Kaya, A. & Aydın, M. Öğrencilerin Anatomi Dersine Ayırdıkları Zaman Ile Anatomi Dersi Hakkındaki Görüşlerinin Ilişkisinin Değerlendirilmesi. Journal Of Medical Topics And Updates.; 1, 20-27. (2022)
Leng, L. Challenge, Integration, And Change: Chatgpt And Future Anatomical Education. Medical Education Online,;29, 2304973. (2024)
Mantzou, N., Ediaroglou, V., Drakonaki, E., Syggelos, S. A., Karageorgos, F. F. & Totlis, T. Chatgpt Efficacy For Answering Musculoskeletal Anatomy Questions: A Study Evaluating Quality And Consistency Between Raters And Timepoints. Surgical And Radiologic Anatomy,;1-6. (2024)
Mogali, S. R. Initial Impressions Of Chatgpt For Anatomy Education. Anatomical Sciences Education,;7, 444-447. (2024)
Gilson, A., Safranek, C. W., Huang, T., Socrates, V., Chi, L., Taylor, R. A. & Chartash, D. How Does Chatgpt Perform On The United States Medical Licensing Examination (Usmle)? The Implications Of Large Language Models For Medical Education And Knowledge Assessment. Jmir Medical Education,;9, E45312. (2023)
Meral, G., Ateş, S., Günay, S., Öztürk, A. & Kuşdoğan, M. Comparative Analysis Of Chatgpt, Gemini And Emergency Medicine Specialist In Esi Triage Assessment. The American Journal Of Emergency Medicine,;81, 146-150. (2024)