首页|Gazi University Reports Findings in Artificial Intelligence (ChatGPT for generating multiple-choice questions: Evidence on the use of ar- tificial intelligence in automatic item generation for a rational phar- macotherapy exam)
Gazi University Reports Findings in Artificial Intelligence (ChatGPT for generating multiple-choice questions: Evidence on the use of ar- tificial intelligence in automatic item generation for a rational phar- macotherapy exam)
扫码查看
点击上方二维码区域，可以放大扫码查看
原文链接
NETL
NSTL
2024 FEB 27 (NewsRx) – By a News Reporter-Staff News Editor at Robotics & Machine Learning Daily News Daily News – New research on Artificial Intelligence is the subject of a report. According to news origi- nating from Ankara, Turkey, by NewsRx correspondents, research stated, “Artificial intelligence, specifically large language models such as ChatGPT, offers valuable potential benefits in question (item) writing. This study aimed to determine the feasibility of generating case-based multiple-choice questions using ChatGPT in terms of item difficulty and discrimination levels.” Our news journalists obtained a quote from the research from Gazi University, “This study involved 99 fourth-year medical students who participated in a rational pharmacotherapy clerkship carried out based-on the WHO 6-Step Model. In response to a prompt that we provided, ChatGPT generated ten case-based multiple-choice questions on hypertension. Following an expert panel, two of these multiple- choice questions were incorporated into a medical school exam without making any changes in the questions. Based on the administration of the test, we evaluated their psychometric properties, including item difficulty, item discrimination (point-biserial correlation), and functionality of the options. Both questions exhibited acceptable levels of point-biserial correlation, which is higher than the threshold of 0.30 (0.41 and 0.39). However, one question had three non-functional options (options chosen by fewer than 5% of the exam participants) while the other question had none. The findings showed that the questions can effectively differentiate between students who perform at high and low levels, which also point out the potential of ChatGPT as an artificial intelligence tool in test development.”
AnkaraTurkeyEurasiaArtificial IntelligenceDrugs and TherapiesEmerging TechnologiesHealth and MedicineMachine LearningPharmacotherapyTherapy
NETL
NSTL
