:: Volume 9, Number 1 (4-2017) ::
Research in Medical Education 2017, 9(1): 26-18 Back to browse issues page
Relationship Between Residents’ Success on the Certifying Examinations With in – Training Exam and Internal Evaluation
M Yaghmaei, A Heidarzadeh, M M Jalali *
Otolaryngology, Head & Neck Surgery Dept, Nose & Sinus research center, Guilan University of Medical Sciences, Iran , mmjalali@gmail.com
Abstract:   (301 Views)
Introduction: In postgraduate training courses, the purpose is training to achieve an acceptable level of knowledge and clinical skills. Assessment of learning outcomes during residency is done by internal evaluation and annual in-training exams and in the end of residency course by the pre-board qualifying and board certification exams. The aim of this study was to evaluate the relationship between residents’ success on the certifying examinations and results of internal evaluation and in-training exam in different periods in Guilan University of Medical Sciences.
Methods: In this retrospective study, data of residents who participated in the certifying examinations in the years 2005-2013 were studied. Three evolutions in evaluation of residents occurred in this span. The first period in the years 2005-2007 which internal evaluation is added, the second period in the years of 2008 – 2010 which new methods of evaluation is added to internal evaluation and the third period during the years of 2011-2013 which the Pre-board exam was decentralized and awarded to the type 1 universities. In this study, in first period 188 residents, in second period 278 residents and in third priod 218 residents were evaluated respectively.  time pass rate was considered, and its relationship between these outcomes and standard scores of internal evaluation and in-training exams by t-test (or Mann Whitney U test in variables with non-normal distribution) and χ2 was determined. Also logistic regression analysis and cluster analysis for grouping residents in three periods were used. The statistical analysis has been done by SPSS and the significant level in the study was considered 0.05.
Results: totally, among 680 students, 366 of them were male and 314 subjects were female. In general, 64.2%  of male residents and 74.1%  of female residents passed the board exam. There was no significant difference in the success rate of male or female participants in the three periods. In first period, there was only difference between scores of internal evaluation in successful and unsuccessful residents groups (P>0.02). In second period, there was significant differences in scores of in-training exams in successful and unsuccessful residents (P<0.001). In third period, there was no significant differences between in-training exams of successful and unsuccessful residents .based on  the result of logistic regression analysis, there was only significant differences, in first priod, between standardized score of internal evaluation in senior residents, and in second period, there is significant relationship between standardized score of in-training exam and success on the certifying examination among senior and freshman residents and finally in third period, there was no relationship between standardized score of internal evaluation and in-training exam with success on the certifying examination.
Conclusion: The results showed a weak relationship between scores of internal evaluation and in-training exam with success rate of residents in the third period. In this period (2011-2013), pre-board exams removed from supervision of specialized medical Secretariat of the Council and was delegated to top rank universities.
Keywords: Education, Internship and residency, Educational measurement, Specialty boards, Iran
Full-Text [PDF 204 kb]   (107 Downloads)    
Type of Study: Research | Subject: Special
1. Frederick RC, Hafner JW, Schaefer TJ, Aldag JC. Outcome measures for emergency medicine residency graduates: do measures of academic and clinical performance during residency training correlate with American Board of Emergency Medicine test performance? Acad Emerg Med 2011; 18 )2(: 59-64.
2. Vice Chancellor for education, Ministry of Health and Medical Education.[Quality improvement of exama in Guilan University of Medical Sciences2014]. [Cited 2016 Mar 01] .Available from: http://www.gums.ac.ir/Upload/Modules/Contents/asset25/Takhasos.pdf [persian].
3. de Virgilio C, Yaghoubian A, Kaji A, Collins JC, Deveney K, Dolich M, et al. Predicting performance on the American Board of Surgery qualifying and certifying examinations: a multi-institutional study. Arch Surg 2010; 145(9): 852-856.
4. Johnson GA, Bloom JN, Szczotka-Flynn L, Zauner D, Tomsak RL. A comparative study of resident performance on standardized training examinations and the american board of ophthalmology written examination. Ophthalmology 2010; 117(12): 2435-2439.
5. Shellito JL, Osland JS, Helmer SD, Chang FC. American Board of Surgery examinations: can we identify surgery residency applicants and residents who will pass the examinations on the first attempt? Am J Surg 2010; 199(2): 216-222.
6. 6- Chierakul N. Relationship between outcome of written and clinical parts in Internal Medicine Board Certifying Examination. Siriraj Medical Journal 2009; 61(4): 194-196.
7. Bedno SA, Soltis MA, Mancuso JD, Burnett DG, Mallon TM. The in-service examination score as a predictor of success on the American Board of Preventive Medicine certification examination. Am J Prev Med 2011; 41(6): 641-4
8. Frischenschlager O, Haidinger G, Mitterauer L. Factors associated with academic success at Vienna Medical School: prospective survey. Croat Med J. 2005; 46(1):58-65.
9. McDonald FS, Zeger SL, Kolars JC. Associations between United States Medical Licensing Examination (USMLE) and Internal Medicine In-Training Examination (IM-ITE) scores. J Gen Intern Med 2008; 23: 1016 -1019.
10. Schmidt HG, Cohen-Schotanus J, Arends LR: Impact of problem-based, active learning on graduation rates for 10 generations of Dutch medical students. Med Educ 2009, 43: 211-218.
11. Parkhouse J. Intake, output, and drop out in United Kingdom medical schools. BMJ 1996; 312(7035): 885.

DOI: 10.18869/acadpub.rme.9.1.26

XML   Persian Abstract   Print

Volume 9, Number 1 (4-2017) Back to browse issues page