首页|Royal Orthopedic Hospital Reports Findings in Artificial Intelligence (Exploring the potential of ChatGPT in the peer review process: An observational study)

Royal Orthopedic Hospital Reports Findings in Artificial Intelligence (Exploring the potential of ChatGPT in the peer review process: An observational study)

扫码查看
New research on Artificial Intelligence is the subject of a report. According to news reporting from Birmingham, United Kingdom, by NewsRx journalists, research stated, “Peer review is the established method for evaluating the quality and validity of research manuscripts in scholarly publishing. However, scientific peer review faces challenges as the volume of submitted research has steadily increased in recent years.” The news correspondents obtained a quote from the research from Royal Orthopedic Hospital, “Time constraints and peer review quality assurance can place burdens on reviewers, potentially discouraging their participation. Some artificial intelligence (AI) tools might assist in relieving these pressures. This study explores the efficiency and effectiveness of one of the artificial intelligence (AI) chatbots, ChatGPT (Generative Pre-trained Transformer), in the peer review process. Twenty-one peer-reviewed research articles were anonymised to ensure unbiased evaluation. Each article was reviewed by two humans and by versions 3.5 and 4.0 of ChatGPT. The AI was instructed to provide three positive and three negative comments on the articles and recommend whether they should be accepted or rejected. The human and AI results were compared using a 5-point Likert scale to determine the level of agreement. The correlation between ChatGPT responses and the acceptance or rejection of the papers was also examined. Subjective review similarity between human reviewers and ChatGPT showed a mean score of 3.6/5 for ChatGPT 3.5 and 3.76/5 for ChatGPT 4.0. The correlation between human and AI review scores was statistically significant for ChatGPT 3.5, but not for ChatGPT 4.0. ChatGPT can complement human scientific peer review, enhancing efficiency and promptness in the editorial process.”

BirminghamUnited KingdomEuropeArtificial IntelligenceEmerging TechnologiesMachine Learning

2024

Robotics & Machine Learning Daily News

Robotics & Machine Learning Daily News

ISSN:
年,卷(期):2024.(Feb.26)