University of Birmingham Birmingham B15 2TT, UK
Correspondence to: Melanie J Calvert M.Calvert{at}bham.ac.uk
| SUMMARY |
|---|
|
|
|---|
Design Retrospective cohort study.
Setting University of Birmingham Medical School.
Participants Medical students on graduate entry/fast-track course and standard (5-year) course (mainstream).
Main outcome measures Examination marks from all assessments taken simultaneously by graduate entry course (GEC) and mainstream course students once the cohorts have combined: i.e. for the final three years of the programme. Honours awards for 2007 and 2008 graduates.
Results In total 19,263 examination results were analysed from 1547 students. Of these 161 were GEC students and 1386 were mainstream medical students. On average mainstream students, male students, overseas students and students of South Asian ethnicity obtained lower examination marks than graduate entry students, female students, home or EU students and students of non-South Asian ethnicity, respectively. Graduate entry students were significantly more likely to achieve honours degrees than mainstream students.
Conclusion On average the academic performance of Graduate Entry medical students at the University of Birmingham is better than mainstream medical students.
| Background |
|---|
|
|
|---|
Currently 16 medical schools in the UK offer graduate entry courses (GECs) but evaluation of the impact of previous tertiary education on academic performance during medical school training in the UK is extremely limited and is further complicated by the considerable differences in entry requirements. In Australia all graduate entry medical students must sit the Graduate Medical School Admissions Test (GAMSAT) which is a professionally designed and marked selection test developed by the Australian Council for Educational Research.7 In the UK this has been adopted by five UK medical schools offering GECs.8 Furthermore some medical schools accept a full range of non-science graduates whereas others require first degrees in life sciences. Evidence from Australia suggests that overall academic achievement (measured as award of medical school honours) and research careers between graduate entry candidates and school leavers is similar,2 while evidence from a Dutch University suggests that a one-year transitional programme increases knowledge to level sufficient for graduate entry students to enter into the fourth year of a 6-year medical curriculum.9 Early experience at Leicester/Warwick Medical Schools suggests that GEC students at Warwick and Leicester perform at least as well as those on the five-year Leicester course and that the overall pass rate of graduate entrants from bioscience backgrounds has been higher that that of school-leavers. There is, however, also preliminary evidence to suggest more school-leavers obtain distinctions, suggesting that really high-fliers may choose medicine at the stage of school-leaving.10
Evaluation of graduate entry programmes is necessary to determine whether mature students are able to meet learning objectives in this shortened course.10,11 In this study we aimed to assess whether GEC students attained academic standards that were at least as good as those achieved by mainstream or conventional entry medical students in the same institution.
| Methods |
|---|
|
|
|---|
top 20% graduates), although due to high demand all students accepted to the course to date attained first-class honours.12 The GEC at Birmingham is split into two phases. Phase 1 is one year of theory, provided predominantly through the medium of problem-based learning, plus clinical experience in primary care. At the end of Phase 1 GEC students should have met the same learning objectives and achieved the same level of knowledge and clinical skills as students completing their second year of the 5-year undergraduate MBChB course. In Phase 2 GEC students fully integrate with the main course, having the same opportunities and assessments over the remaining three, largely hospital-based years of the course.
Data source
Examination data were obtained for all GEC students in Phase 2 of their programme since the introduction of the course in 2003. Corresponding examination data for mainstream students in the cohorts into which GEC students were integrated over the same time period were obtained (Figure 1). The modular examinations included are shown in Table 1. The Medical School uses exam methods which have proven reliability with cut-off scores set by the Angoff method.13 All examinations have a standard setting process approved by the General Medical Council. External examiners are always present at OSCEs and MCQs, and external examiners are always involved in the setting of the examination papers. Scores from individual assessments from each of these modules (e.g. MCQ, OSCE) were used in the analyses.
|
|
Statistical analyses
Analyses were performed using SAS V9.1 (SAS Institute, Cary, North Carolina, USA). The relationship between examinations results and gender, South Asian ethnicity, overseas status and entry route (mainstream vs. GEC students) were assessed using a mixed model with identity link and normal error, with student as a repeated measure and examination sitting (year of exam and student cohort) as random effects. Interaction terms were assessed and Akaike's information criterion was used to determine the best model fit.15
Average examination marks were predicted for students with different demographics for GEC and mainstream based on model regression coefficients. The 95% CI were estimated using the predict statement in the SAS mixed procedure.
In secondary supportive exploratory analyses we evaluated whether the GEC students performed significantly better than mainstream students by assessment type, i.e. clinical, non-clinical or a combination.
The difference in the proportion of students obtaining honours degrees in the GEC compared to mainstream cohorts was examined using Fisher's exact test.
| Results |
|---|
|
|
|---|
|
|
|
Honours degrees
Of the 355 students graduating from medicine in 2007, 50 students (14.1%) were awarded the degree with honours. The proportion of students attaining honours was significantly higher in the GEC group compared to mainstream (37/313 mainstream students [11.8%] and 13/42 GEC students [31.0%]; p <0.01).
Similar results were observed with the 2008 graduates. Of the 403 graduates, 44 students (10.9%) were awarded honours degrees with 34 of the 361 mainstream students (9.4%) and 10 of the 42 graduate entry students (23.8%) attaining honours (p =0.01).
| Discussion |
|---|
|
|
|---|
Exploratory analysis suggests that GEC students performed significantly better than their mainstream counterparts in their clinical assessments. Such differences may reflect student maturity, motivation, previous learning experiences, approaches to studying and cooperativeness and lessened anxiety and greater preparedness for the transition to the clinical workplace possibly reflecting their learning experiences in Phase 1 of the programme.5,16 For our students, the main difference in their learning experience at medical school is that the GEC course in year 1 is largely PBL, while the mainstream course (years 1 and 2) is a mixture with more traditional forms of learning predominating.
Strengths and limitations
Strength of our study is that at Birmingham GEC students fully integrate with mainstream students in Phase 2 allowing comparison across multiple assessments. Our results clearly demonstrate that on average our GEC students perform better than their mainstream counterparts; however we would urge caution regarding the generalizability of the results to other graduate entry courses with different admission criteria. Currently, due to the popularity of the course, all students enrolled on the Birmingham GEC have at least first class honours degree in life sciences and are home/EU students. There is the potential that GEC students thrive because of the closer attention from/greater individual interaction with academic staff, both because of cohort size and because of the nature of PBL.
Self-recorded ethnicity may be regarded as preferable to the use of name recognition software, however, this is not without limitations17 and self-recorded ethnicity was not available to us for students at an individual level.
At the University of Birmingham Medical School, no overseas students have currently been admitted to the GEC due to difficulties in determining the equivalency of degree programmes and to high demand from home/EU students. In the mainstream cohort, overseas students on average have worse examination performance than home/EU students. This is consistent with work from Australia and may reflect previous learning experiences, barriers to communication and other challenges associated with living abroad.18 Students from ethnic minorities and male students have also been shown to perform less well in medical examinations on average than white students and female students and our findings are consistent with this.19–22 In the GEC cohort there were small numbers of students of South Asian ethnicity on which our results are based, however, a strength of our modelling approach is that we have considered all available examination results (GEC years 2–4) for each student by using repeated measures analysis. Reassuringly, the absolute differences in average marks between home/EU vs. overseas or those from different ethnic groups are relatively small, but may suggest additional support is required for some students. In addition further consideration needs to be given to student diversity in curricula and assessment development, and to ensure that differences do not arise due to negative stereotyping.23
| Conclusions |
|---|
|
|
|---|
Further research is required to explore whether this is a consistent effect in other medical schools with different admission criteria and whether students continue to excel during their career.
| Footnotes |
|---|
DECLARATIONS
Competing interests All of the authors are involved in the delivery of the MBChB and/or GEC programmesFunding This project was supported by the University of Birmingham
Ethical approval Ethical approval was sought from and given by the Medical School, University of Birmingham. Since this research involved analysis and publication of anonymized data, no significant ethical issues were considered to arise
Guarantors MJC
Contributorship MJC, JVP, NMR, NF and RZ conceived the idea.MJC and NF developed the statistical analysis plan and MJC undertook the analyses. NMR and YX formatted the data for analysis. NMR, JVP and RZ provided information on examination type and course structure. MJC produced the first draft of the paper. All authors reviewed and revised the paper and approved the final version
| Acknowledgements |
|---|
|
|
|---|
| References |
|---|
|
|
|---|
Read all Quick Comments
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||