Robotics & Machine Learning Daily News2024,Issue(Jun.28) :38-39.

Queen’s University Reports Findings in Artificial Intelligence (Performance of a rtificial intelligence on a simulated Canadian urology board exam: Is CHATGPT re ady for primetime?)

皇后大学报告人工智能的发现(人工智能在模拟加拿大泌尿外科委员会考试中的表现:CHATGPT准备好进入黄金时段了吗?)

Robotics & Machine Learning Daily News2024,Issue(Jun.28) :38-39.

Queen’s University Reports Findings in Artificial Intelligence (Performance of a rtificial intelligence on a simulated Canadian urology board exam: Is CHATGPT re ady for primetime?)

皇后大学报告人工智能的发现(人工智能在模拟加拿大泌尿外科委员会考试中的表现:CHATGPT准备好进入黄金时段了吗?)

扫码查看

摘要

一位新闻记者兼机器人与机器学习的工作人员新闻编辑每日新闻-人工智能的新研究是一篇报道的主题。根据NewsRx编辑在加拿大金斯敦的新闻报道,研究表明:“生成人工智能(AI)已被证明是一个强大的工具,在临床护理和医学教育中越来越多地应用。CHATGPT在许多专业认证和知识评估考试中表现良好。”我们的新闻记者从女王大学的研究中获得了一句话,“本研究的目的是评估CHATGPT 4在模拟加拿大泌尿外科委员会考试的多项选择考试中的表现。代表所有加拿大培训项目的泌尿外科毕业生每年都会聚集在一起,参加模拟即将到来的委员会认证考试的模拟考试。考试主持人包括书面多项选择题(MCQs)和口头客观结构化临床考试(OSCE)。2022年的考试由29名学生参加。”CHATGPT 4在MC Q考试中得分46%,而泌尿外科毕业生的平均得分和中位数得分分别为62.6%和62.7%,这将使CHATG PT的得分与中位数相差1.8个标准差。CHATG PT的百分位排名将在第六百分位。CHATGPT在EXAM不同主题上的得分如下:肿瘤学35%,男科/良性前列腺增生62%,生理/解剖学67%,失禁/女性泌尿外科23%,感染71%,尿路结石57%,创伤/重建17%,CHATGPT 4的肿瘤学表现明显低于研究生5年级居民。CHATGPT 4 U在模拟加拿大董事会考试的MCQ考试中表现良好。

Abstract

By a News Reporter-Staff News Editor at Robotics & Machine Learning Daily News Daily News – New research on Artificial Intelligenc e is the subject of a report. According to news reporting out of Kingston, Canad a, by NewsRx editors, research stated, “Generative artificial intelligence (AI) has proven to be a powerful tool with increasing applications in clinical care a nd medical education. CHATGPT has performed adequately on many specialty certifi cation and knowledge assessment exams.” Our news journalists obtained a quote from the research from Queen’s University, “The objective of this study was to assess the performance of CHATGPT 4 on a mu ltiple-choice exam meant to simulate the Canadian urology board exam. Graduating urology residents representing all Canadian training programs gather yearly for a mock exam that simulates their upcoming board-certifying exam. The exam consi sts of written multiple-choice questions (MCQs) and an oral objective structured clinical examination (OSCE). The 2022 exam was taken by 29 graduating residents and was administered to CHATGPT 4. CHATGPT 4 scored 46% on the MC Q exam, whereas the mean and median scores of graduating urology residents were 62.6%, and 62.7%, respectively. This would place CHATG PT’s score 1.8 standard deviations from the median. The percentile rank of CHATG PT would be in the sixth percentile. CHATGPT scores on different topics of the e xam were as follows: oncology 35%, andrology/benign prostatic hyper plasia 62 %, physiology/anatomy 67%, incontinence/femal e urology 23%, infections 71%, urolithiasis 57% , and trauma/reconstruction 17%, with ChatGPT 4’s oncology performa nce being significantly below that of postgraduate year 5 residents. CHATGPT 4 u nderperforms on an MCQ exam meant to simulate the Canadian board exam.”

Key words

Kingston/Canada/North and Central Amer ica/Artificial Intelligence/Emerging Technologies/Health and Medicine/Machin e Learning/Urology

引用本文复制引用

出版年

2024
Robotics & Machine Learning Daily News

Robotics & Machine Learning Daily News

ISSN:
段落导航相关论文