Correlation of the scores on different comprehensive examinations and the Medical Competency Assessment Test for National License: a mixed methods study

Introduction: In-house comprehensive examinations for preclinical students from various Thai medical schools were provided. However, their quality has never been evaluated with a score correlation with NLE as the gold standard. This study aimed to assess the correlation of the scores as determined by three different comprehensive examinations and national license examination 1 (NLE step I) and to identify the positive learning strategies.

Method: A mixed methods sequential explanatory study was done to investigate the performances amongst four tests and to identify the potential factors affecting those scores using semi-structured interviews and focus groups with content analysis.

Result: All (n = 48) third-year medical students participated in our study. The majority were females (64.6%). Significantly positive correlations of NLE scores were: test A scores (r = 0.86), test B scores (r = 0.85), and WU test scores (r = 0.78). The highest accuracy index (AI = 0.87) was the WU test, where sensitivity, specificity were 20.0% and 97.1%, respectively. The WU test revealed that it was most helpful in preparing them for the NLE. Students who passed the exam used three study strategies; group study, tutorial sessions, and review by themselves.

Discussion and Conclusion: There were strong positive correlations between three different in-house developed comprehensive examinations and NLE. The WU test showed the highest accuracy index to predict the NLE result. Regular review of lessons was emphasized as a cornerstone.