1 Specialist Trainee in Public Health, Department of Primary Care and Social
Medicine, Imperial College, Reynolds Building, St Dunstan's Road, London W6
8RP, UK
2 Chadburn Clinical Lecturer in Primary Care Research, Department of Primary
Care and Social Medicine, Imperial College, Reynolds Building, St Dunstan's
Road, London W6 8RP, UK
3 Professor of Primary Care, Department of Primary Care and Social Medicine,
Imperial College, Reynolds Building, St Dunstan's Road, London W6 8RP,
UK
4 Statistical Advisor, Catchon, The Barn, Farnham Road, Surrey GU10 5BB,
UK
5 Senior Clinical Lecturer in Primary Care, Department of Health Sciences,
University of Leicester, Leicester General Hospital, Leicester LE5 4PW,
UK
6 Director of Research, Department of Family Medicine, Medical University of
South Carolina, 295 Calhoun St, Charleston, SC 29425, USA
Correspondence to: Christopher Millett E-mail: c.millett{at}imperial.ac.uk
| SUMMARY |
|---|
|
|
|---|
Design Population-based cross-sectional study using Quality and Outcomes Framework data.
Setting England and Scotland.
Participants 55 522 778 patients and 8970 general practices with 1 852 762 people with diabetes.
Interventions None.
Main outcome measures Seventeen process and surrogate outcome measures of diabetes care.
Results The prevalence of diabetes was 3.3%. Prevalence differed with practice list size and deprivation: smaller and more deprived practices had a higher mean prevalence than larger and more affluent practices (3.8% versus 2.8%). Practices with large patient list sizes had the highest quality of care scores, even after stratifying for deprivation. However, with the exception of retinal screening, peripheral pulses and neuropathy testing, differences in achievement between small and large practices were modest (<5%). Small practices performed nearly as well as the largest practices in achievement of intermediate outcome targets for HbA1c, blood pressure and cholesterol (smallest versus largest practices: 57.4% versus 58.7%; 70.7% versus 70.7%; and 69.5% versus 72.7%, respectively). Deprivation had a negative effect on the achieved scores and this was more pronounced for smaller practices.
Conclusion Our study provides some evidence of a volume-outcome association in the management of diabetes in primary care; this appears most pronounced in deprived areas.
| INTRODUCTION |
|---|
|
|
|---|
In April 2004, a new contract for General Practitioners (GPs) was introduced in the UK, in which a significant proportion of practice income is derived from performance against targets in a new Quality and Outcomes Framework (QOF).9 The new contract represents a major innovation in the organization of primary care services and the first time that pay for performance has been used on this scale in any health care system. It provides comparative information on the quality of care in general practices nationally and unique data to measure the quality of primary care experienced by the entire national population. These data allow examination of factors associated with higher quality of care and thus offer lessons about the organization of health services to primary health care systems in the UK and abroad.
We examined the association between general practice size and caseload, and outcomes for people with diabetes, in English and Scottish general practices using data from the new GP contract. Specifically, we considered whether prevalence and quality of care scores for diabetes were associated with practice size. Second, we examined the extent to which the association varied as a function of practice diabetes caseload. Finally, we determined whether the association between volume/size and outcome was influenced by deprivation. It is well known that deprivation influences health outcomes.10
| METHODS |
|---|
|
|
|---|
The source of QOF data is a national IT system called the Quality Management and Analysis System (QMAS).12 This single national system ensures consistency in the calculation of prevalence and quality achievement. Clinical QOF data is extracted from individual practice clinical computer systems and sent automatically to QMAS; organizational, access, patient experience and additional service indicators are entered by the practice directly into QMAS via a web-browser. Data from practices without QMAS-compliant computer systems are entered manually into QMAS. QOF information is collected at an aggregate level for each general practice and there is currently no patient-specific data within QMAS.
Selection of processes of care and outcomes measured
There are two types of data: disease prevalence information for each
disease within the clinical domain of the QOF, and data relating to QOF
indicator or domain scores. For diabetes, 18 process of care measures and
outcomes have been assessed, based on whether they were performed within the
last 15 months. Indicators are measured as the percentage of people with
diabetes who had a recording of a process of care or measurement, or achieved
the desired outcome (e.g. DM 9 is the percentage of patients with diabetes
with a record of presence or absence of peripheral pulses). The indicators for
diabetes are based on available evidence on the optimal management of diabetes
(Box 1). The indicators relate to children and adults with both type 1 and
type 2 diabetes. Although the care of patients with type 1 diabetes may be
shared with specialists, the GP would still be expected to ensure that
appropriate annual checks had been carried out and recorded in the patient's
primary care medical record.
Reaching optimal levels of control in people with diabetes is often
difficult. For this reason two HbA1c outcome indicators have been introduced
to encourage those working with patients with high HbA1c to bring the level to
10 and
7.4. The most commonly identified target level for blood
pressure in diabetes is 140/80. This is the level for which GPs should aim. A
slightly higher level (145/85) was used in the QOF as the audit standard. We
excluded the first indicatorthat the practice can produce a register of
all patients with diabetesas all practices have produced a register.
Without a register, the denominator would be unknown for the practice and it
would not be possible to calculate prevalence or quality of care scores.
Linking of practices to a measure of socio-economic status
Practices were assigned a measure of socio-economic status based on their
geographical location. We used the Index of Multiple Deprivation
(IMD, the standard measure of socio-economic status in the UK). Practices were
linked to postcodes using reference tables provided by the National Health
Service Information Centre for
England11 and by
the Information and Statistics Division for
Scotland.13 Both
data sets employed the same practice identifying codes used in the QOF and
thus enabled linking of data. Practices were mapped to postcode locations
using GIS software MapInfo Professional
7.814 and linked to
IMDs for England and
Scotland.15,16
Differences between IMDs for
England15 and
Scotland16 are
small (English geographic areas, called Lower Super Output Areas, are about
twice the size of Scottish, with a mean population of around
1500)17 and thus
combined analysis of data was possible. We grouped practices into
socio-economic tertiles based on the national rank of the geographic area in
which the practice is located (i.e. practices in deprivation group one are
located in the most deprived 33% of administrative regions nationally).
Practices were excluded from our analysis if they could not be matched to an IMD score via their postcode. Practices in Scotland that were not fully part of the contract were also excluded from the study. In total, we excluded 441 (4.1%) practices with 2 264 884 (3.5%) patients, leaving 8970 general practices with a total list size of 55 522 578, for analysis. We used Stata version 9 for analysis.18
Exception reporting
The QOF allows for exception reporting, which has been introduced to allow
practices not be penalized, where, for example, patients do not attend for
review, or where a medication cannot be prescribed due to a contraindication
or side-effect. The criteria for exception reporting include: patients who are
on maximum tolerated doses of medication whose levels remain sub-optimal;
where a patient does not agree to investigation or treatment (informed
dissent), and this has been recorded in their medical records; and where an
investigative service or secondary care service is unavailable. National data
on exception reporting is limited, which meant that we were unable to adjust
for this in our analyses.
| Box 1 Quality and Outcomes Framework (QOF) indicators for
diabetes care DM 1 A complete register of patients with diabetes for individual practices DM 2 The percentage of patients with diabetes whose notes record BMI in the previous 15 months DM 3 The percentage of patients with diabetes in whom there is a record of smoking status in the previous 15 months except those who have never smoked where smoking status should be recorded once DM 4 The percentage of patients with diabetes who smoke and whose notes contain a record that smoking cessation advice has been offered in the last 15 months DM 5 The percentage of diabetic patients who have a record of HbA1c or equivalent in the previous 15 months DM 6 The percentage of patients with diabetes in whom the last HbA1C is 7.4 or less (or equivalent test/reference range depending on local laboratory) in last 15 months DM 7 The percentage of patients with diabetes in whom the last HbA1C is 10 or less (or equivalent test/reference range depending on local laboratory) in last 15 months DM 8 The percentage of patients with diabetes who have a record of retinal screening in the previous 15 months DM 9 The percentage of patients with diabetes with a record of presence or absence of peripheral pulses in the previous 15 months DM 10 The percentage of patients with diabetes with a record of neuropathy testing in the previous 15 months DM 11 The percentage of patients with diabetes who have a record of the blood pressure in the past 15 months DM 12 The percentage of patients with diabetes in whom the last blood pressure is 145/85 or less DM 13 The percentage of patients with diabetes who have a record of micro-albuminuria testing in the previous 15 months (exception reporting for patients with proteinuria) DM 14 The percentage of patients with diabetes who have a record of serum creatinine testing in the previous 15 months DM 15 The percentage of patients with diabetes with proteinuria or micro-albuminuria who are treated with ACE inhibitors (or A2 antagonists) DM 16 The percentage of patients with diabetes who have a record of total cholesterol in the previous 15 months DM 17 The percentage of patients with diabetes whose last measured total cholesterol within previous 15 months is 5 or less DM 18 The percentage of patients with diabetes who have had influenza immunization in the preceding 1 September to 31 March period
|
Analyses
We studied the volume-outcome effect in two different ways. First, we
compared practices using the number of patients registered with a practice as
a measure of practice size. We grouped the practices into quintiles according
to number of patients registered with the practice. Secondly, we grouped the
practices into quintiles according to the number of cases (i.e. patients with
diabetes registered with the practice). Finally, we studied the effect of
deprivation on achievement scores. We present percentage achievement of
quality indicators in each group. Detailed statistical analysis was not
undertaken as our very large sample size compromises meaningful interpretation
of results as even very minor differences will be statistically
significant.
| RESULTS |
|---|
|
|
|---|
|
Association between practice size, number of diabetes cases and quality of care
Larger practices achieved the highest quality of care scores, particularly
for process of care measures (Tables
2a and
3a). However, with the
exception of retinal screening, peripheral pulses and neuropathy testing,
absolute differences in achievement between small and large practices was
modest (<5%). The performance of small practices was broadly similar to
larger practices in achievement of intermediate outcome targets for HbA1c,
blood pressure and cholesterol. For example, the same proportion of patients
achieved the treatment target for blood pressure (70.7%) in the smallest and
largest practices. There was only a 1.3% difference in the proportion of
patients reaching the treatment target for HbA1c (57.4 versus 58.7%). Similar
trends were evident between achievement of quality indicators and diabetes
caseload (i.e. number of diabetes cases per practice).
|
|
Association between deprivation and quality of care
Tables 2b and
3b show the association between
practice deprivation scores, patient list size and quality of care. Practices
located in deprived areas performed less well on quality measures than those
based in affluent areas. Differences in achievement between small practices in
deprived areas and large practices in affluent areas were considerable on some
indicators. For example, the percentage of patients with a record of
neuropathy testing differed by 15%. The general trend of higher achievement
with increasing practice size was less marked in affluent areas. For example,
smaller practices were more likely to achieve the lower treatment target for
HbA1c (
7.4%) than larger practices in affluent areas.
|
|
| DISCUSSION |
|---|
|
|
|---|
Strengths and weaknesses of the study
This is the largest study to examine the relationship between volume and
outcomes in primary care. The structure of primary care in the UK offers some
unique opportunities to examine this association. Unlike in many other
countries, almost the entire population is registered with a GP, who is
responsible for providing primary care services and arranging referrals for
specialist care. In addition, individuals can only be registered with one
general practice at any one time. This means that general practice has
well-defined denominator populations, which in turn allows the calculation of
accurate disease prevalence and treatment rates.
Our study has a number of limitations. First, the QMAS database contains no patient level data and thus it was not possible to adjust practice performance by the age, gender or ethnic profile of patients. Second, patients known to have diabetes but not coded on the computer record would not have been included. However, payments to general practices under the new contract are weighted by practice prevalence; hence, there is a direct financial incentive to identify and report on all cases. Third, at present there is limited national data about how many patients were exception coded. This may be a source of bias in this study if rates of exception reporting varied by practice size and deprivation. However, analysis of available data suggests that exception reporting by practices was not extensive and that this is unlikely to have a major bearing on our findings.19 Fourth, there is a risk of manipulation or gaming (e.g. recording a patient's blood pressure as being lower than it actually is), which will be difficult to detect. Although this may occur, practices are subject to an annual inspection and the penalties for making fraudulent claims are severe.9 Finally, defining and measuring quality care is not a simple process and the indicators examined in this study are proxies for total quality. The clinical significance of some of the quality measures used is uncertain. Within the clinical domain, the current QOF only covers conditions affecting a minority of patients and only some aspects of the care for these patients. However, it does provide valuable information (e.g. on prevalence, HbA1c levels and blood pressure) on a scale previously unavailable, and will provide a baseline against which to measure future levels of improvement in the delivery of care.12
Comparison with previous research
Although numerous studies have examined the volume-outcome relationship in
secondary care, very few previous studies have examined this relationship in
primary care. Hippisley-Cox and colleagues compared a number of areas of
practice activity in single-handed and group practices in the Trent region of
England.20 They
found no evidence that single-handed practices offered poorer quality of care
than group practices. Another smaller study in the Wandsworth area of London
also found no associations between practice size and quality of care for
patients with coronary heart
disease.21 Our
findings confirm previous research, which indicate that smaller practices are
more commonly located in deprived
areas.22
Policy implications
Elucidation of the reasons behind a volume-outcome association in the
management of diabetes in primary care is beyond the scope of this study.
However, differences in the organization of diabetes care (for example, the
presence of a diabetes nurse or special clinics for people with diabetes)
within small and large practices appear the most plausible explanation for the
quality of care variations
found.23 This would
explain why variations in diabetes management by practice size were more
apparent for process measures of care (such as the measurement of pulses),
which may be more responsive to highly structured
care,24 than for
intermediate outcomes. In contrast, volume-outcome associations in secondary
care, while complex, are often at least in part ascribed to clinicians'
expertise.25,26
Our finding that patients living in deprived areas are receiving poorer
quality of diabetes management compared with those living in areas that are
more affluent is worrying and deserves closer study. It is another example of
the inverse care
law.10
Our findings suggest it may be worth rethinking the remuneration of different aspects of diabetes care. Motivation for achieving high scores for diverse indicators may have differed in practices of varying size depending on who does what in the practice team. Some scores are easier to achieve with the help of auxiliary staff; for example, annual recording of presence or absence of peripheral pulses and of neuropathy testing. It may be more difficult for smaller practices to employ such staff to support GPs' work. Furthermore, it is common in larger practices for one of the physicians to develop a special interest in diabetes and for such practices to run dedicated diabetes clinics. At present, however, no national level data is available to support any of these hypotheses.
Our conclusions are limited to the management of diabetes and we cannot say whether similar volume-outcome relationships would occur in the management of other diseases in primary care. Our findings do not provide support for the amalgamation of practices into larger units because primary care manages a wide variety of disorders in which the volume-outcome association may not be present (or may even be reversed) for other conditions.27 Nevertheless, the findings warrant attention and consideration of how to best organize diabetes care in smaller practices. Initiatives that could accrue benefit comparable to volume-outcome effect, such as disease facilitators, nurse practitioners,28 diabetes clinics in primary care offering structured care, or GPs with a special interest in diabetes, need to be closely evaluated.
| Footnotes |
|---|
Ethical approval Not required.
Contributorship JC & AM had the initial idea for the study, which was later refined by all authors. DE analyzed the data. JC, AM & CM interpreted the data and wrote the first draft of the article. All authors revised the manuscript critically for important intellectual content and gave final approval of the version published.
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
G. M. Russell, S. Dahrouge, W. Hogg, R. Geneau, L. Muldoon, and M. Tuna Managing Chronic Disease in Ontario Primary Care: The Impact of Organizational Factors Ann. Fam. Med, July 1, 2009; 7(4): 309 - 318. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Calvert, A. Shankar, R. J McManus, H. Lester, and N. Freemantle Effect of the quality and outcomes framework on diabetes care in the United Kingdom: retrospective cohort study BMJ, May 26, 2009; 338(may26_2): b1870 - b1870. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. Crawley, A. Ng, A. G Mainous III, A. Majeed, and C. Millett Impact of pay for performance on quality of chronic disease management by social class group in England J R Soc Med, March 1, 2009; 102(3): 103 - 107. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. Millett, G. Netuveli, S. Saxena, and A. Majeed Impact of Pay for Performance on Ethnic Disparities in Intermediate Outcomes for Diabetes: A Longitudinal Study Diabetes Care, March 1, 2009; 32(3): 404 - 409. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. Koshy and C. Millett The 'Quality and Outcomes Framework': improving care, but are all patients benefiting? J R Soc Med, September 1, 2008; 101(9): 432 - 433. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||