Abstract
Investigators discuss new findings in artificial intelligence. According to news reporting from Royal Oak, Michigan, by NewsRx journalists, research stated, "To determine how often ChatGPT is able to provide accurate and comprehensive information regarding clinical vitreoretinal scenarios. To assess the types of sources ChatGPT primarily utilizes and to determine if they are hallucinated." Our news correspondents obtained a quote from the research from Department of Ophthalmology: "A retrospective cross-sectional study. We designed 40 open-ended clinical scenarios across 4 main topics in vitreoretinal disease. Responses were graded on correctness and comprehensiveness by two blinded retina specialists. The primary outcome was the number of clinical scenarios that ChatGPT answered correctly and comprehensively. Secondary outcomes included: theoretical harm to patients, the distribution of the type of references utilized by the chatbot, and the frequency of hallucinated references. In June 2023, ChatGPT answered 83% (33/40) of clinical scenarios correctly but provided a comprehensive answer in only 52.5% (21/40) of cases. Subgroup analysis demonstrated an average correct score of 86.7% in nAMD, 100% in DR, 76.7% in retinal vascular disease and 70% in the surgical domain. There were 6 incorrect responses with 1 (16.7%) case of no harm, 3 (50%) cases of possible harm and 2 (33.3%) cases of definitive harm."
NETL
NSTL