Performance of ChatGPT-4 in answering questions from the Brazilian National Examination for Medical Degree Revalidation

202350 citationsJournal Articlediamond Open Access

Authors

Mauro Gobira · Instituto Paulista de Ensino e Pesquisa

Luis Filipe Nakayama

Rodrigo Moreira · Instituto Paulista de Ensino e Pesquisa

Eric Pinheiro de Andrade · Universidade Federal de São Paulo

Caio V. Regatieri · Universidade Federal de São Paulo

Rubens Belfort · Universidade Federal de São Paulo

Abstract

ChatGPT-4.0 showed satisfactory performance for the 2022 Brazilian National Examination for Medical Degree Revalidation. The large language model exhibited worse performance on subjective questions and public healthcare themes. The results of this study suggested that the overall quality of the Revalida examination questions is satisfactory and corroborates the nullified questions.

Topics & Keywords

Artificial Intelligence in Healthcare and Education Clinical Reasoning and Diagnostic Skills COVID-19 diagnosis using AI

UN Sustainable Development Goals

Peace, Justice and strong institutions

Publication Details

Published in: Revista da Associação Médica Brasileira

Volume 69, Issue 10, pp. e20230848-e20230848

DOI: 10.1590/1806-9282.20230848

Field-Weighted Citation Impact: 1.91