RT Journal Article
T1 Application of Artificial Intelligence as an Aid for the Correction of the Objective Structured Clinical Examination (OSCE)
A1 Luordo, Davide
A1 Torres Arrese, Marta
A1 Tristan Calvo, Cristina
A1 Shani Shani, Kirti Dayal
A1 Rodríguez Cruz, Luis Miguel
A1 García Sánchez, Francisco Javier
A1 Lagares Gómez-Abascal, Alfonso
A1 Rubio García, Rafael
A1 Delgado Jiménez, Juan Francisco
A1 Pérez Carreras, Mercedes
A1 Díez Lobato, Ramiro
A1 Granizo Martinez, Juan José
A1 Tung-Chen, Yale
A1 Villena Garrido, María Victoria
AB The assessment of clinical competencies is essential in medical training, and the Objective Structured Clinical Examination (OSCE) is an essential tool in this process. There are multiple studies exploring the usefulness of artificial intelligence (AI) in medical education. This study explored the use of the GPT-4 AI model to grade clinical reports written by students during the OSCE at the Teaching Unit of the 12 de Octubre and Infanta Cristina University Hospitals, part of the Faculty of Medicine at the Complutense University of Madrid, comparing its results with those of human graders. Ninety-six (96) students participated, and their reports were evaluated by two experts, an inexperienced grader, and the AI using a checklist designed during the OSCE planning by the teaching team. The results show a significant correlation between the AI and human graders (ICC = 0.77 for single measures and 0.91 for average measures). AI was more stringent, assigning scores on an average of 3.51 points lower (t = −15.358, p < 0.001); its correction was considerably faster, completing the analysis in only 24 min compared to the 2–4 h required by human graders. These results suggest that AI could be a promising tool to enhance efficiency and objectivity in OSCE grading.
PB MDPI
SN 2076-3417
YR 2025
FD 2025-01-23
LK https://hdl.handle.net/20.500.14352/122244
UL https://hdl.handle.net/20.500.14352/122244
LA eng
NO Luordo, D., Torres Arrese, M., Tristán Calvo, C., Shani Shani, K. D., Rodríguez Cruz, L. M., García Sánchez, F. J., Lagares Gómez-Abascal, A., Rubio García, R., Delgado Jiménez, J., Pérez Carreras, M., Diez Lobato, R., Granizo Martínez, J. J., Tung-Chen, Y., & Villena Garrido, M. V. (2025). Application of Artificial Intelligence as an Aid for the Correction of the Objective Structured Clinical Examination (OSCE). Applied Sciences, 15(3), 1153. https://doi.org/10.3390/app15031153
NO Sociedad Española de Educación Médica
DS Docta Complutense
RD 8 jul 2025