지원사업
학술연구/단체지원/교육 등 연구자 활동을 지속하도록 DBpia가 지원하고 있어요.
커뮤니티
연구자들이 자신의 연구와 전문성을 널리 알리고, 새로운 협력의 기회를 만들 수 있는 네트워킹 공간이에요.
논문 기본 정보
- 자료유형
- 학술저널
- 저자정보
- 저널정보
- 대한외과학회 Annals of Surgical Treatment and Research Annals of Surgical Treatment and Research Vol.104 No.5
- 발행연도
- 2023.5
- 수록면
- 269 - 273 (5page)
이용수
초록· 키워드
오류제보하기
Purpose: This study aimed to assess the performance of ChatGPT, specifically the GPT-3.5 and GPT-4 models, in understanding complex surgical clinical information and its potential implications for surgical education and training.
Methods: The dataset comprised 280 questions from the Korean general surgery board exams conducted between 2020 and 2022. Both GPT-3.5 and GPT-4 models were evaluated, and their performances were compared using McNemar test.
Results: GPT-3.5 achieved an overall accuracy of 46.8%, while GPT-4 demonstrated a significant improvement with an overall accuracy of 76.4%, indicating a notable difference in performance between the models (P ＜ 0.001). GPT-4 also exhibited consistent performance across all subspecialties, with accuracy rates ranging from 63.6% to 83.3%.
Conclusion: ChatGPT, particularly GPT-4, demonstrates a remarkable ability to understand complex surgical clinical information, achieving an accuracy rate of 76.4% on the Korean general surgery board exam. However, it is important to recognize the limitations of large language models and ensure that they are used in conjunction with human expertise and judgment.
Methods: The dataset comprised 280 questions from the Korean general surgery board exams conducted between 2020 and 2022. Both GPT-3.5 and GPT-4 models were evaluated, and their performances were compared using McNemar test.
Results: GPT-3.5 achieved an overall accuracy of 46.8%, while GPT-4 demonstrated a significant improvement with an overall accuracy of 76.4%, indicating a notable difference in performance between the models (P ＜ 0.001). GPT-4 also exhibited consistent performance across all subspecialties, with accuracy rates ranging from 63.6% to 83.3%.
Conclusion: ChatGPT, particularly GPT-4, demonstrates a remarkable ability to understand complex surgical clinical information, achieving an accuracy rate of 76.4% on the Korean general surgery board exam. However, it is important to recognize the limitations of large language models and ensure that they are used in conjunction with human expertise and judgment.
목차
INTRODUCTION
METHODS
RESULTS
DISCUSSION
REFERENCES
참고문헌 (0)
참고문헌 신청함께 읽어보면 좋을 논문
논문 유사도에 따라 DBpia 가 추천하는 논문입니다. 함께 보면 좋을 연관 논문을 확인해보세요!
-
Performance of a Large Language Model in the Generation of Clinical Guidelines for Antibiotic Prophylaxis in Spine Surgery
Neurospine
2024 .03
-
Predicting Chemical Compound Solubility and Toxicity Using GPT Models: A Comparative Analysis
환경독성보건학회 심포지엄 및 학술대회
2024 .10
-
ChatGPT Predicts In-Hospital All-Cause Mortality for Sepsis: In-Context Learning with the Korean Sepsis Alliance Database
Healthcare Informatics Research
2024 .07
-
Search for Medical Information and Treatment Options for Musculoskeletal Disorders through an Artificial Intelligence Chatbot: Focusing on Shoulder Impingement Syndrome
근골격계과학기술학회
2023 .06
-
인공지능 챗봇의 질병 진단 및 환자 치료에 대한 답변은 신뢰할 수 있는가?
대한의사협회지
2023 .04
-
Use of ChatGPT for Determining Clinical and Surgical Treatment of Lumbar Disc Herniation With Radiculopathy: A North American Spine Society Guideline Comparison
Neurospine
2024 .03
-
Perspectives on Surgical Education in Korea
대한외과학회 학술대회 초록집
2019 .10
-
Perspectives on Surgical Education in Korea
대한외과학회 학술대회 초록집
2017 .11
-
AR navigation tool for breast cancer localization
대한임상종양학회 학술대회지
2021 .06
-
Continuous surgical education : is it needed?
대한외과학회 학술대회 초록집
2016 .11
-
What I am learning during my surgical training in Korea?
대한외과학회 학술대회 초록집
2022 .11
-
ChatGPT는 한국작업치료사면허시험에 합격할 수 있을까?
재활치료과학
2024 .02
-
Surgical Skill Education in Korea
대한외과학회 학술대회 초록집
2022 .11
-
Performance evaluation of ChatGPT on the national nurse examinations in Korea
한국간호교육학회 학술대회
2024 .07
-
Surgical Treatment
대한외과학회 학술대회 초록집
2022 .11
-
연구 및 학술 글쓰기에 있어 ChatGPT의 올바른 활용
대한체질인류학회 학술대회 연제 초록
2024 .05
-
Utilization of desktop 3D printer-fabricated “Cost-Effective” 3D models in orthognathic surgery
Maxillofacial Plastic Reconstructive Surgery
2020 .01
-
Background to the introduction of subspecialty in the Korean Surgical Society
한국간담췌외과학회 학술대회지
2016 .04
-
치위생전공 학생들의 ChatGPT 이용경험 및 인식조사
대한치과의료관리학회지
2024 .12
-
ChatGPT 시대, 의료 인공지능이 의사를 대신할 수 있을까?
대한내과학회지
2023 .06
이 논문의 저자 정보
이 논문과 함께 이용한 논문
최근 본 자료
댓글(0)
0
UCI(KEPA) : I410-ECN-0101-2023-514-001360624