RT Journal Article
SR Electronic
T1 GPT-4 in Nuclear Medicine Education: Does It Outperform GPT-3.5?
JF Journal of Nuclear Medicine Technology
JO J. Nucl. Med. Technol.
FD Society of Nuclear Medicine
SP 314
OP 317
DO 10.2967/jnmt.123.266485
VO 51
IS 4
A1 Currie, Geoffrey M.
YR 2023
UL http://tech.snmjournals.org/content/51/4/314.abstract
AB The emergence of ChatGPT has challenged academic integrity in teaching institutions, including those providing nuclear medicine training. Although previous evaluations of ChatGPT have suggested a limited scope for academic writing, the March 2023 release of generative pretrained transformer (GPT)-4 promises enhanced capabilities that require evaluation. Methods: Examinations (final and calculation) and written assignments for nuclear medicine subjects were tested using GPT-3.5 and GPT-4. GPT-3.5 and GPT-4 responses were evaluated by Turnitin software for artificial intelligence scores, marked against standardized rubrics, and compared with the mean performance of student cohorts. Results: ChatGPT powered by GPT-3.5 performed poorly in calculation examinations (31.4%), compared with GPT-4 (59.1%). GPT-3.5 failed each of 3 written tasks (39.9%), whereas GPT-4 passed each task (56.3%). Conclusion: Although GPT-3.5 poses a minimal risk to academic integrity, its usefulness as a cheating tool can be significantly enhanced by GPT-4 but remains prone to hallucination and fabrication.