|
|
|
Research
Introduction
Thousands of people around the world have an interest in our examinations and we work hard to keep everyone well informed. MRCP(UK) is actively engaged in research and ongoing development work in order to prove the examinations’ relevance and importance to training and medical education. It is committed to academically validating the examinations. The research and analysis of candidate performance, production of statistics and standard-setting MRCP(UK) carries out for the examinations is essential to maintain and improve quality of the exams.
Academic research publications
Those with an interest in medical education might like to follow developments in the peer-reviewed medical literature. The papers listed below are a good starting point and are available to view.
| Title |
Resitting a high-stakes postgraduate medical examination on multiple occasions: nonlinear multilevel modelling of performance in the MRCP(UK) examinations |
| Description |
The paper demonstrates that candidates continue to show evidence of true improvement in performance up to at least the 10th attempt at MRCP(UK) Part 1, although there are individual differences in the starting level, the rate of improvement and the maximum level that can be achieved. The authors point out that while this does not seem to support a fixed number of attempts at an examination, unlimited attempts are also difficult to justify because of the ever increasing role that luck must play with increasing numbers of resits. |
| Authors |
I C McManus and Katarzyna Ludka |
| Date published |
14 June 2012 |
| Download |
BioMed central medicine website |
| Title |
Changing PACES: developments to the examination in 2009 |
| Description |
As a consequence of change in medical, educational and regulatory practice, MRCP(UK) successfully modified the international PACES examination in 2009. This brief paper explains the rationale for change and summarises the development and implementation process. |
| Authors |
A Elder , L McAlpine, N Bateman, J Dacre, P. Kopelman, IC McManus |
| Date published |
June 2011 |
| Available |
Clinical Medicine 11: 231-234 |
| Title |
The relationship between ethnicity and academic performance in UK-trained doctors and medical students: a systematic review and meta-analysis. |
| Description |
A systematic review and meta-analysis of ethnicity and academic performance in UK-trained doctors and medical students, which includes and references MRCP(UK) data. The paper concludes that UK-trained doctors and medical students from minority ethnic groups tend to underperform academically compared with their white counterparts, but that it is not clear why this might be. |
| Authors |
Katherine Woolf, Henry W W Potts, I C McManus |
| Date published |
8 March 2011 |
| Download |
BMJ website |
| Title |
What skills are tested in the new PACES examination? |
| Description |
The MRCP(UK) PACES examination assesses skills of relevance to the practice and delivery of high quality clinical care and is the leading international postgraduate summative assessment of this kind. In 2009, the examination was revised, and this article describes those revisions, focussing on the clinical skills assessed. |
| Authors |
A Elder, I C McManus, L McAlpine, J Dacre |
| Date published |
3 March 2011 |
| Download |
Annals Academy of Medicine Singapore 40:119-125 |
| Title |
The standard error of measurement is a more appropriate measure of quality for postgraduate medical assessments than is reliability: An analysis of MRCP(UK) written examinations, 2002-2008, and Specialty Certificate Examinations. |
| Description |
The authors of this study tested the hypothesis that SEM is a better measure of the quality of an assessment, because it is unaffected by the ability range or number of candidates taking an examination. |
| Authors |
Jane Tighe, I C McManus, Neil G Dewhurst, Liliana Chis and John Mucklow |
| Date published |
2 June 2010 |
| Download |
BioMed central medicine website |
| Title |
An empirical examination of the impact of group discussion and examinee performance information on judgments made in the Angoff standard-setting procedure |
| Description |
This study examines the impact of group discussion and candidate performance data on the judgments made by experts during the process of standard-setting. The paper provides a detailed analysis of the relationship between question difficulty and the degree of changes experts make in their judgments after group discussion of discrepancies. |
| Authors |
Brian E Clauser, Polina Harik, Melissa J Margolis from National Board of Medical Examiners, I C McManus, University College London and Jennifer Mollon, Liliana Chis, Simon Williams from MRCP(UK) |
| Date published |
1 January 2009 |
| Available |
Applied Measurement in Education, v22 n1 p1-21 Jan 2009 - available with subscription. For more detail see Education Resources Information Center website. |
| Title |
Graduates of different UK medical schools show substantial differences in performance on MRCP(UK) Part 1, Part 2 and PACES examinations |
| Description |
The aim of this study is to assess the performance of UK graduates who have taken MRCP(UK) Part 1, Part 2 and PACES (Practical Assessment of Clinical Examination Skills) and explore the reasons for the differences between medical schools. |
| Authors |
I C McManus, Andrew T Elder, Andre de Champlain, Jane E Dacre, Jennifer Mollon and Liliana Chis |
| Date published |
14 February 2008 |
| Download |
BioMed central medicine website |
| Title |
Performance in the MRCP(UK) Examination 2003–4: analysis of pass rates of UK graduates in relation to self-declared ethnicity and gender |
| Description |
Male students and students from ethnic minorities have been reported to underperform in undergraduate medical examinations. The aim of this study was to assess effects of ethnicity and gender for UK medical graduates on pass rates in the MRCP(UK) Examination sat in the UK in 2003-4. |
| Authors |
Neil Dewhurst, I C McManus, Jennifer Mollon, Jane Dacre, A J Vale |
| Date published |
3 May 2007 |
| Download |
BioMed central medicine website |
| Title |
Assessment of examiner leniency and stringency ('hawk-dove effect') in the MRCP(UK) clinical examination (PACES) using multi-facet Rasch modelling |
| Description |
Clinical examinations require that judgements of candidates are made by experienced examiners. A potential vulnerability of any clinical examinations is that examiners differ in their relative leniency or stringency. This study looks at the paired judgements made by examiners in the MRCP(UK) Part 2 Clinical Examination (PACES) and calculates examiner stringency. |
| Authors |
I C McManus, Jennifer Mollon, Margaret Thompson |
| Date published |
18 August 2006 |
| Download |
BioMed central medicine website |
| Title |
Changes in standard of candidates taking the MRCP(UK) Part 1 Examination, 1985 to 2002: Analysis of marker questions |
| Description |
This paper looks at marker questions (questions re-used unchanged in several examinations) in the MRCP(UK) Part 1 Examination between 1985 and 2002 to assess whether standards have changed. The authors conclude that there was a sudden, relatively steep decline in the performance of graduates from UK medical schools taking the MRCP(UK) Part 1 examination. The reasons for this are not clear and are not an artefact of changes in the mix of overseas and UK candidates, or changes in the time after qualifying of first or subsequent sittings of the examination, but they do have implications for medical education. |
| Authors |
I C McManus, Jennifer Mollon, O L Duke, A J Vale |
| Date published |
18 July 2005 |
| Download |
BioMed central medicine website |
| Title |
Reliability of the MRCP(UK) Part I Examination, 1984–2001 |
| Description |
For an examination to be robust, it must be valid, reliable and practical. This review concludes that the reliability of the MRCP(UK) Examination was maintained over the period 1984–2001. |
| Authors |
I C McManus, J Mooney-Somers, J E Dacre, A J Vale |
| Date published |
27 June 2003 |
|
Download |
Medical Education 2003;37:609–611 |
|
|
|
|