The Use of ChatGPT to Assist in Diagnosing Glaucoma Based on Clinical Case Reports
- PMID: 37707707
- PMCID: PMC10640454
- DOI: 10.1007/s40123-023-00805-x
The Use of ChatGPT to Assist in Diagnosing Glaucoma Based on Clinical Case Reports
Abstract
Introduction: The purpose of this study was to evaluate the capabilities of large language models such as Chat Generative Pretrained Transformer (ChatGPT) to diagnose glaucoma based on specific clinical case descriptions with comparison to the performance of senior ophthalmology resident trainees.
Methods: We selected 11 cases with primary and secondary glaucoma from a publicly accessible online database of case reports. A total of four cases had primary glaucoma including open-angle, juvenile, normal-tension, and angle-closure glaucoma, while seven cases had secondary glaucoma including pseudo-exfoliation, pigment dispersion glaucoma, glaucomatocyclitic crisis, aphakic, neovascular, aqueous misdirection, and inflammatory glaucoma. We input the text of each case detail into ChatGPT and asked for provisional and differential diagnoses. We then presented the details of 11 cases to three senior ophthalmology residents and recorded their provisional and differential diagnoses. We finally evaluated the responses based on the correct diagnoses and evaluated agreements.
Results: The provisional diagnosis based on ChatGPT was correct in eight out of 11 (72.7%) cases and three ophthalmology residents were correct in six (54.5%), eight (72.7%), and eight (72.7%) cases, respectively. The agreement between ChatGPT and the first, second, and third ophthalmology residents were 9, 7, and 7, respectively.
Conclusions: The accuracy of ChatGPT in diagnosing patients with primary and secondary glaucoma, using specific case examples, was similar or better than senior ophthalmology residents. With further development, ChatGPT may have the potential to be used in clinical care settings, such as primary care offices, for triaging and in eye care clinical practices to provide objective and quick diagnoses of patients with glaucoma.
Keywords: Artificial intelligence (AI); ChatGPT; Differential diagnosis; Glaucoma; Large language models (LLM); Provisional diagnosis.
© 2023. The Author(s).
Conflict of interest statement
Mohammad Delsoz, Hina Raja, Yeganeh Madadi, Anthony A. Tang, and Malik Y. Kahook have nothing to disclose. Barbara M. Wirostko: Works for MyEyes LLC, and provides consultation for Qlaris Bio and iCare. Siamak Yousefi: Received prototype instruments from Remidio, M&S Technologies, and Visrtucal Fields. He gives consultations to the InsihgtAEye and Enolink.
Figures
Comment in
-
A Letter to the Editor Regarding "The Use of ChatGPT to Assist in Diagnosing Glaucoma Based on Clinical Case Reports".Ophthalmol Ther. 2024 Jun;13(6):1813-1815. doi: 10.1007/s40123-024-00934-x. Epub 2024 Apr 18. Ophthalmol Ther. 2024. PMID: 38637437 Free PMC article. No abstract available.
Similar articles
-
Performance of ChatGPT in Diagnosis of Corneal Eye Diseases.medRxiv [Preprint]. 2023 Aug 28:2023.08.25.23294635. doi: 10.1101/2023.08.25.23294635. medRxiv. 2023. Update in: Cornea. 2024 May 1;43(5):664-670. doi: 10.1097/ICO.0000000000003492 PMID: 37720035 Free PMC article. Updated. Preprint.
-
ChatGPT Assisting Diagnosis of Neuro-ophthalmology Diseases Based on Case Reports.medRxiv [Preprint]. 2023 Sep 14:2023.09.13.23295508. doi: 10.1101/2023.09.13.23295508. medRxiv. 2023. PMID: 37781591 Free PMC article. Preprint.
-
Performance of ChatGPT in Diagnosis of Corneal Eye Diseases.Cornea. 2024 May 1;43(5):664-670. doi: 10.1097/ICO.0000000000003492. Epub 2024 Feb 23. Cornea. 2024. PMID: 38391243
-
Utility of artificial intelligence-based large language models in ophthalmic care.Ophthalmic Physiol Opt. 2024 May;44(3):641-671. doi: 10.1111/opo.13284. Epub 2024 Feb 25. Ophthalmic Physiol Opt. 2024. PMID: 38404172 Review.
-
ChatGPT and large language model (LLM) chatbots: The current state of acceptability and a proposal for guidelines on utilization in academic medicine.J Pediatr Urol. 2023 Oct;19(5):598-604. doi: 10.1016/j.jpurol.2023.05.018. Epub 2023 Jun 2. J Pediatr Urol. 2023. PMID: 37328321 Review.
Cited by
-
A Response to: Letter to the Editor Regarding "The Use of ChatGPT to Assist in Diagnosing Glaucoma Based on Clinical Case Reports.".Ophthalmol Ther. 2024 Jun;13(6):1817-1819. doi: 10.1007/s40123-024-00937-8. Epub 2024 Apr 18. Ophthalmol Ther. 2024. PMID: 38637436 Free PMC article. No abstract available.
-
A Letter to the Editor Regarding "The Use of ChatGPT to Assist in Diagnosing Glaucoma Based on Clinical Case Reports".Ophthalmol Ther. 2024 Jun;13(6):1813-1815. doi: 10.1007/s40123-024-00934-x. Epub 2024 Apr 18. Ophthalmol Ther. 2024. PMID: 38637437 Free PMC article. No abstract available.
-
ChatGPT and BCI-VR: a new integrated diagnostic and therapeutic perspective for the accurate diagnosis and personalized treatment of mild cognitive impairment.Front Hum Neurosci. 2024 Jun 4;18:1426055. doi: 10.3389/fnhum.2024.1426055. eCollection 2024. Front Hum Neurosci. 2024. PMID: 38895167 Free PMC article. No abstract available.
-
Creating a biomedical knowledge base by addressing GPT inaccurate responses and benchmarking context.bioRxiv [Preprint]. 2024 Oct 21:2024.10.16.618663. doi: 10.1101/2024.10.16.618663. bioRxiv. 2024. PMID: 39463999 Free PMC article. Preprint.
-
Artificial Versus Human Intelligence in the Diagnostic Approach of Ophthalmic Case Scenarios: A Qualitative Evaluation of Performance and Consistency.Cureus. 2024 Jun 16;16(6):e62471. doi: 10.7759/cureus.62471. eCollection 2024 Jun. Cureus. 2024. PMID: 39015855 Free PMC article.
References
-
- Quigley HA, Vitale S. Models of open-angle glaucoma prevalence and incidence in the United States. Invest Ophthalmol Vis Sci. 1997;38(1):83–91. - PubMed
Grants and funding
LinkOut - more resources
Full Text Sources