SearchGo Search

Research

Introduction

Thousands of people around the world have an interest in our examinations and we work hard to keep everyone well informed.
 
MRCP(UK) is actively engaged in research and ongoing development work in order to prove the examinations’ relevance and importance to training and medical education. It is committed to academically validating the examinations. The research and analysis of candidate performance, production of statistics and standard-setting MRCP(UK) carries out for the examinations is essential to maintain and improve quality of the exams.

Academic research publications

Those with an interest in medical education might like to follow developments in the peer-reviewed medical literature. The papers listed below are a good starting point and are available to view.

Title

Resitting a high-stakes postgraduate medical examination on multiple occasions: nonlinear multilevel modelling of performance in the MRCP(UK) examinations

Description

The paper demonstrates that candidates continue to show evidence of true improvement in performance up to at least the 10th attempt at MRCP(UK) Part 1, although there are individual differences in the starting level, the rate of improvement and the maximum level that can be achieved. The authors point out that while this does not seem to support a fixed number of attempts at an examination, unlimited attempts are also difficult to justify because of the ever increasing role that luck must play with increasing numbers of resits.

Authors

 I C McManus and Katarzyna Ludka

Date published

14 June 2012

Download

BioMed central medicine website

Title

Changing PACES: developments to the examination in 2009

Description

As a consequence of change in medical, educational and regulatory practice, MRCP(UK) successfully modified the international PACES examination in 2009. This brief paper explains the rationale for change and summarises the development and implementation process.

Authors

A Elder , L McAlpine, N Bateman, J Dacre, P. Kopelman, IC McManus

Date published

June 2011

Available

Clinical Medicine 11: 231-234

Title

The relationship between ethnicity and academic performance in UK-trained doctors and medical students: a systematic review and meta-analysis.

Description

A systematic review and meta-analysis of ethnicity and academic performance in UK-trained doctors and medical students, which includes and references MRCP(UK) data. The paper concludes that UK-trained doctors and medical students from minority ethnic groups tend to underperform academically compared with their white counterparts, but that it is not clear why this might be.

Authors

Katherine Woolf, Henry W W Potts, I C McManus

Date published

8 March 2011

Download

BMJ website

Title

What skills are tested in the new PACES examination?

Description

The MRCP(UK) PACES examination assesses skills of relevance to the practice and delivery of high quality clinical care and is the leading international postgraduate summative assessment of this kind. In 2009, the examination was revised, and this article describes those revisions, focussing on the clinical skills assessed.

Authors

A Elder, I C McManus, L McAlpine, J Dacre

Date published

3 March 2011

Download

Annals Academy of Medicine Singapore 40:119-125

Title

The standard error of measurement is a more appropriate measure of quality for postgraduate medical assessments than is reliability: An analysis of MRCP(UK) written examinations, 2002-2008, and Specialty Certificate Examinations.

Description

The authors of this study tested the hypothesis that SEM is a better measure of the quality of an assessment, because it is unaffected by the ability range or number of candidates taking an examination.

Authors

Jane Tighe, I C McManus, Neil G Dewhurst, Liliana Chis and John Mucklow

Date published

2 June 2010

Download

BioMed central medicine website

Title

An empirical examination of the impact of group discussion and examinee performance information on judgments made in the Angoff standard-setting procedure

Description

This study examines the impact of group discussion and candidate performance data on the judgments made by experts during the process of standard-setting. The paper provides a detailed analysis of the relationship between question difficulty and the degree of changes experts make in their judgments after group discussion of discrepancies.

Authors

Brian E Clauser, Polina Harik, Melissa J Margolis from National Board of Medical Examiners, I C McManus, University College London and Jennifer Mollon, Liliana Chis, Simon Williams from MRCP(UK)

Date published

1 January 2009

Available

Applied Measurement in Education, v22 n1 p1-21 Jan 2009 - available with subscription. For more detail see Education Resources Information Center website.

Title 

Graduates of different UK medical schools show substantial differences in performance on MRCP(UK) Part 1, Part 2 and PACES examinations

 Description

The aim of this study is to assess the performance of UK graduates who have taken MRCP(UK) Part 1, Part 2 and PACES (Practical Assessment of Clinical Examination Skills) and explore the reasons for the differences between medical schools. 

Authors 

I C McManus, Andrew T Elder, Andre de Champlain, Jane E Dacre, Jennifer Mollon and Liliana Chis 

 Date published

14 February 2008 

 Download

BioMed central medicine website 

Title

Performance in the MRCP(UK) Examination 2003–4: analysis of pass rates of UK graduates in relation to self-declared ethnicity and gender

Description

Male students and students from ethnic minorities have been reported to underperform in undergraduate medical examinations. The aim of this study was to assess effects of ethnicity and gender for UK medical graduates on pass rates in the MRCP(UK) Examination sat in the UK in 2003-4.

Authors

Neil Dewhurst, I C McManus, Jennifer Mollon, Jane Dacre, A J Vale

Date published

3 May 2007

Download

BioMed central medicine website

Title

Assessment of examiner leniency and stringency ('hawk-dove effect') in the MRCP(UK) clinical examination (PACES) using multi-facet Rasch modelling

Description

Clinical examinations require that judgements of candidates are made by experienced examiners. A potential vulnerability of any clinical examinations is that examiners differ in their relative leniency or stringency. This study looks at the paired judgements made by examiners in the MRCP(UK) Part 2 Clinical Examination (PACES) and calculates examiner stringency.

Authors

I C McManus, Jennifer Mollon, Margaret Thompson

Date published

18 August 2006

Download

BioMed central medicine website

Title

Changes in standard of candidates taking the MRCP(UK) Part 1 Examination, 1985 to 2002: Analysis of marker questions

Description

This paper looks at marker questions (questions re-used unchanged in several examinations) in  the MRCP(UK) Part 1 Examination between 1985 and 2002 to assess whether standards have changed. The authors conclude that there was a sudden, relatively steep decline in the performance of graduates from UK medical schools taking the MRCP(UK) Part 1 examination. The reasons for this are not clear and are not an artefact of changes in the mix of overseas and UK candidates, or changes in the time after qualifying of first or subsequent sittings of the examination, but they do have implications for medical education.

Authors

I C McManus, Jennifer Mollon, O L Duke, A J Vale

Date published

18 July 2005

Download

BioMed central medicine website

Title

Reliability of the MRCP(UK) Part I Examination, 1984–2001

Description

For an examination to be robust, it must be valid, reliable and practical. This review concludes that the reliability of the MRCP(UK) Examination was maintained over the period 1984–2001.

Authors

I C McManus, J Mooney-Somers, J E Dacre, A J Vale

Date published

27 June 2003

Download

Medical Education 2003;37:609–611