15.04.2014 Views

Occasional Paper 10 - The Royal New Zealand College of General ...

Occasional Paper 10 - The Royal New Zealand College of General ...

Occasional Paper 10 - The Royal New Zealand College of General ...

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

<strong>The</strong> <strong>Royal</strong> <strong>New</strong> <strong>Zealand</strong><br />

<strong>College</strong> <strong>of</strong> <strong>General</strong> Practitioners<br />

RNZCGP Annual<br />

Quality Symposium<br />

1–2 February 2008<br />

Summary <strong>of</strong> Proceedings<br />

Quality Assurance, Quality Improvement and<br />

Quality Frameworks in general practice and<br />

primary care


Prepared by:<br />

Maureen Gillon (National Director Quality)<br />

Reviewed by Board <strong>of</strong> Quality:<br />

John Wellingham (Chair)<br />

Kenneth Tong<br />

Chris Fawcett<br />

Harry Pert<br />

Jim Vause (Te Akoranga a Maui)<br />

Published by <strong>The</strong> <strong>Royal</strong> <strong>New</strong> <strong>Zealand</strong> <strong>College</strong> <strong>of</strong> <strong>General</strong> Practitioners, <strong>New</strong> <strong>Zealand</strong>, 2008.<br />

ISBN: 978-0-9582772-4-2<br />

© <strong>The</strong> <strong>Royal</strong> <strong>New</strong> <strong>Zealand</strong> <strong>College</strong> <strong>of</strong> <strong>General</strong> Practitioners, <strong>New</strong> <strong>Zealand</strong>, 2008.<br />

<strong>The</strong> <strong>Royal</strong> <strong>New</strong> <strong>Zealand</strong> <strong>College</strong> <strong>of</strong> <strong>General</strong> Practitioners owns the copyright <strong>of</strong> this work and has exclusive rights in accordance with<br />

the Copyright Act 1994.<br />

In particular, prior written permission must be obtained from the <strong>Royal</strong> <strong>New</strong> <strong>Zealand</strong> <strong>College</strong> <strong>of</strong> <strong>General</strong> Practitioners for others<br />

(including business entities) to:<br />

• copy the work<br />

• issue copies <strong>of</strong> the work, whether by sale or otherwise<br />

• show the work in public<br />

• make an adaptation <strong>of</strong> the work<br />

as defined by the Copyright Act 1994.


Contents<br />

Introduction ....................................................................................................................................................................... 4<br />

Contributors: .......................................................................................................................................................... 5<br />

Summary <strong>of</strong> Proceedings: Overview ................................................................................................................................ 6<br />

Day 1 – Quality Measurement ............................................................................................................................... 6<br />

Day 2 – Quality Improvement ................................................................................................................................ 9<br />

Results ............................................................................................................................................................................. 12<br />

Masterclass .......................................................................................................................................................... 12<br />

Pat Snedden, Chair, MOH Quality Improvement Committee – key messages .................................................. 13<br />

Key points: Development <strong>of</strong> a quality environment for primary care in <strong>New</strong> <strong>Zealand</strong> ...................................... 13<br />

Conclusion – <strong>The</strong> way forward ............................................................................................................................ 18<br />

References ....................................................................................................................................................................... 19<br />

© THE ROYAL NEW ZEALAND COLLEGE OF GENERAL PRACTITIONERS / Summary <strong>of</strong> Proceedings 2008 3


Introduction<br />

<strong>New</strong> <strong>Zealand</strong> is a recognised world leader in quality in general practice through, its approach to supporting quality and<br />

safety in general practices through the Cornerstone programme where practices measure their quality <strong>of</strong> care against<br />

Aiming for Excellence, both based on internationally accepted best practice.<br />

<strong>The</strong>re are emerging issues in quality that require attention within the primary care quality networks, such as introduction<br />

<strong>of</strong> clinical indicators through the Performance Management Programme which will impact on practice systems<br />

and processes. <strong>The</strong> Annual RNZCGP Quality Symposium was a good starting point for the discussion.<br />

<strong>The</strong> symposium introduced the third edition <strong>of</strong> Aiming for Excellence, which provides an important contribution to<br />

existing frameworks to guide improvements in quality and safety in general practice primary care.<br />

Day 1 – Masterclass<br />

Pr<strong>of</strong>essor Martin Roland (UK) CBE conducted a master-class on day one <strong>of</strong> the Symposium. He is an expert commentator<br />

on the quality <strong>of</strong> international health systems, clinical governance and the UK Quality Outcomes Framework<br />

(QOF). His session covered what’s new in quality measurement and improvement and a comprehensive overview and<br />

discussion <strong>of</strong> the QOF.<br />

Bio:<br />

Martin Roland, Pr<strong>of</strong>essor <strong>of</strong> <strong>General</strong> Practice at the University and Director <strong>of</strong> the National Primary Care Research<br />

and Development Centre (NPCRDC) is the founding director <strong>of</strong> the NIHR School for Primary Care Research, a<br />

collaboration between the five leading departments <strong>of</strong> primary care in England. He is Head <strong>of</strong> the School <strong>of</strong><br />

Community Based Medicine within the Faculty <strong>of</strong> Medical and Human Sciences in Manchester. <strong>The</strong> School comprises<br />

<strong>of</strong> three research groups: Primary Care, Psychiatry, and Biostatistics, Informatics and Health Economics.<br />

His previous areas <strong>of</strong> research include back pain, hospital referrals, out <strong>of</strong> hours care, and nurse practitioners in<br />

general practice. Pr<strong>of</strong>essor Roland is also founding Director <strong>of</strong> the new National Institute for Health Research<br />

(NIHR) School for Primary Care Research, a funded collaboration established in 2006 between the academic<br />

departments <strong>of</strong> primary care at Manchester, Oxford, Cambridge, Bristol and Birmingham.<br />

Martin is an elected Fellow <strong>of</strong> the Academy <strong>of</strong> Medical Sciences with 25 years experience <strong>of</strong> working in general<br />

practice, most recently in the University’s practice at Rusholme Health Centre in central Manchester.<br />

Day 2<br />

Day two focused on What’s working, Why and How to make progress with quality improvement initiatives. Local<br />

experts highlighted the relevance <strong>of</strong> international quality frameworks and how existing processes in <strong>New</strong> <strong>Zealand</strong><br />

contribute to a culture <strong>of</strong> improvement in primary care.<br />

4 © THE ROYAL NEW ZEALAND COLLEGE OF GENERAL PRACTITIONERS / Summary <strong>of</strong> Proceedings 2008


<strong>The</strong> workshop established how interdependency <strong>of</strong> current initiatives that impact on general practice could produce a<br />

course <strong>of</strong> action that will contribute to a collective outcome through shared understanding and a coordinated quality agenda.<br />

Contributors:<br />

<strong>The</strong> <strong>Royal</strong> <strong>New</strong> <strong>Zealand</strong> <strong>College</strong> <strong>of</strong> <strong>General</strong> Practitioners, Jonathan Fox (President), Karen Thomas (CEO), and its<br />

Board <strong>of</strong> Quality (John Wellingham (Chair), Chris Fawcett, Harry Pert, Kenneth Tong, Jim Vause, and Maureen Gillon,<br />

acknowledge and thank those who contributed to the success <strong>of</strong> the symposium. In particular, Martin Roland (UK) and<br />

Pat Snedden provided valuable and thoughtful comments and facilitation throughout the two days.<br />

Thanks are due to:<br />

Tangata Whenua, Ngati Whatua<br />

Martin Roland (UK)<br />

Pat Snedden (MOH Quality Improvement Committee)<br />

Tane Taylor (RNZCGP Te Akoranga a Maui<br />

Dee Mangin (Otago University)<br />

Les Toop (Otago University)<br />

Jim Primrose (MOH)<br />

Verna Smith (ACC)<br />

Sue Dovey (RNZCGP)<br />

Andrew Holmes (MOH)<br />

Stephen Lillis (Board <strong>of</strong> Assessment)<br />

Denise Ward (Pinnacle)<br />

Chris Boberg (ProCare)<br />

Stephanie Pope (Te Wana)<br />

Stephen Buetow (Faculty <strong>of</strong> Medical and Health Sciences)<br />

Tim Malloy (Rural)<br />

Margie Apa (MOH)<br />

David Galler (Sector Quality Direction)<br />

Judi Strid (HDC)<br />

Jocelyn Tracey (Phocus)<br />

Michael Lamont (PHO Alliance)<br />

Jane Ayling (NZNO Practice Nurses)<br />

Kevin Hague (DHBs)<br />

<strong>The</strong> <strong>College</strong> would also like to thank those who facilitated the small group sessions during the two days and acknowledge<br />

participants for giving up time to attend. It was good to see the strength <strong>of</strong> the Quality network, with 140 participants<br />

from every level <strong>of</strong> primary care. <strong>The</strong> stimulating and challenging conversation throughout the symposium<br />

highlights a continuing passion to drive a high quality primary care sector and there is a keen interest in continuing to<br />

develop the quality agenda in <strong>New</strong> <strong>Zealand</strong>.<br />

Note: the material in the overview is extracted from Martin Roland’s preparatory work.<br />

© THE ROYAL NEW ZEALAND COLLEGE OF GENERAL PRACTITIONERS / Summary <strong>of</strong> Proceedings 2008 5


Summary <strong>of</strong> Proceedings: Overview<br />

Day 1 – Quality Measurement<br />

<strong>The</strong>mes:<br />

1. Why measure quality <strong>of</strong> care – How can it be defined?<br />

2. <strong>The</strong> characteristics <strong>of</strong> a good indicator<br />

3. Should quality assessment focus on process or outcome?<br />

4. Should indicators be evidence based?<br />

5. What are some <strong>of</strong> the problems in measuring quality?<br />

6. Frameworks: How to develop a set <strong>of</strong> quality indicators<br />

7. Debate: “Pay for performance is the answer to quality improvement”.<br />

Day one covered why quality needs to be measured and how it should be defined. <strong>The</strong> learning objective was to<br />

ensure participants would be able to describe the main reasons for measuring quality and develop an understanding<br />

<strong>of</strong> current international trends in quality measurement. As a conceptual framework, Donabedian’s structure, process<br />

and outcome were used to describe the relationship between frameworks, quality <strong>of</strong> care and why different stakeholders<br />

might have different perspectives on quality.<br />

Why measure quality?<br />

• As a basis for quality improvement<br />

• Comparisons can stimulate and motivate change<br />

• As part <strong>of</strong> pay for performance schemes e.g. QOF<br />

• As part <strong>of</strong> regulation e.g. <strong>of</strong> minimum standards<br />

• To assist with purchasing e.g. contracts which include minimum quality standards<br />

• To identify areas <strong>of</strong> need for future investment<br />

• To inform service users<br />

• Understand international trends in quality assessment<br />

6 © THE ROYAL NEW ZEALAND COLLEGE OF GENERAL PRACTITIONERS / Summary <strong>of</strong> Proceedings 2008


Frameworks <strong>of</strong> quality<br />

Defining quality can be difficult because <strong>of</strong> different perspectives. Patients and carers, clinicians and managers have<br />

different needs and expectations about which aspects <strong>of</strong> quality should be measured. ‘How can quality be measured’,<br />

<strong>of</strong>ten starts with a discussion <strong>of</strong> ‘What is quality’. A number <strong>of</strong> authors have described frameworks, including<br />

Donabedian 1 , O’Leary and O’Leary 2 and Maxwell 3 . Participants explored the conceptual framework described by<br />

Campbell et al 4 , and included notions <strong>of</strong> safety 5 . Group discussions explored the scope and adequacy <strong>of</strong> existing<br />

quality frameworks, identified aspects <strong>of</strong> care for which quality can’t be measured, and ways <strong>of</strong> measuring quality<br />

which might make care worse.<br />

Frameworks <strong>of</strong> quality must provide clear direction for what to measure and what is relevant to measure. <strong>The</strong> group<br />

explored the difference between indicators, guidelines, standards and targets, the characteristics <strong>of</strong> good indicators<br />

and how evidence is incorporated into quality measurement.<br />

<strong>The</strong>re has been considerable debate about the pros and cons <strong>of</strong> using process and outcome as measures <strong>of</strong> quality.<br />

However, it is important that the aspect <strong>of</strong> care being measured be under the control <strong>of</strong> the person/organisation whose<br />

care is being judged. In general practice, process measures are <strong>of</strong>ten better indicators <strong>of</strong> quality <strong>of</strong> care if the purpose<br />

<strong>of</strong> measurement is to influence the behaviour <strong>of</strong> those providing care. Processes are common, under the control <strong>of</strong><br />

health pr<strong>of</strong>essionals, and may be rapidly altered. Outcome measures are rare and may follow a change in process by<br />

up to <strong>10</strong> years. <strong>The</strong> group discussed whether process or outcome indicators were more useful, what aspects <strong>of</strong> care<br />

are important to measure and what can be controlled.<br />

Important considerations:<br />

1. Measuring quality can have drawbacks, with negative or unintended consequences as well as those that are<br />

intended:<br />

• Long lists <strong>of</strong> ‘primary care indicators’ that only indicate the level <strong>of</strong> activity that has taken place, not the<br />

quality with which that care has been given. Activity is sometimes synonymous with quality, but by no<br />

means always<br />

• Inspection <strong>of</strong> sets <strong>of</strong> quality indicators <strong>of</strong>ten highlights what is not being measured<br />

• Problems in comparing performance between areas with different populations<br />

• Perverse behaviours, which may be induced by incentives, associated with quality measurement<br />

2. Understand why there is a need to measure (macro or micro level) services and considerations before proceeding:<br />

• What indicators already exist?<br />

• What is the evidence for use?<br />

• What data is already available?<br />

• Is there a need to develop your own indicators?<br />

3. To measure quality <strong>of</strong> care in a range <strong>of</strong> different circumstances some general principles apply.<br />

• Be clear about why you want to measure quality<br />

• Consider the service and aspects <strong>of</strong> care you want to assess<br />

• Are they important to measure?<br />

© THE ROYAL NEW ZEALAND COLLEGE OF GENERAL PRACTITIONERS / Summary <strong>of</strong> Proceedings 2008 7


• If you use existing indicators, is there evidence for aspects <strong>of</strong> care that you want to measure If so, how will<br />

you access it to develop your quality indicators?<br />

• Decide what lengths to go to in order to collect data on quality <strong>of</strong> care<br />

A sample <strong>of</strong> quality frameworks (Table 1) provided examples in <strong>New</strong> <strong>Zealand</strong> and the UK QOF. 6 Each identified<br />

strengths and weaknesses <strong>of</strong> the different frameworks and the approaches taken to development.<br />

Debate: “Pay for performance is the answer to quality improvement”<br />

<strong>The</strong> UK Quality Outcomes Framework (QOF) contract, based on 146 outcome indicators, links income to performance. <strong>The</strong><br />

model has been challenged for changing general practice from an internal framework <strong>of</strong> pr<strong>of</strong>essionalism to an external<br />

framework that embraces a market model <strong>of</strong> healthcare with performance 7 . Based on their paper, Les Toop and Dee Mangin<br />

were invited to take the negative view and provided a view <strong>of</strong> the <strong>New</strong> <strong>Zealand</strong> context and the argument against a QOF<br />

framework being applied in <strong>New</strong> <strong>Zealand</strong>. Verna Smith (ACC), who is completing a Ph.D on Pay for Performance, took the<br />

affirmative perspective, along with Jim Vause, from the <strong>College</strong>’s Board <strong>of</strong> Quality, who agreed to participate.<br />

<strong>The</strong> debate provided clarity on the complex issue <strong>of</strong> Pay for Performance and highlighted the complex issues around<br />

quality measurement and monitoring discussed during the day. <strong>The</strong> real value was the argument for and against quality<br />

measurement in a Payment for Performance model. Policy, funder and general practice perspectives stressed the need<br />

for careful consideration <strong>of</strong> the impact before progressing and for all parties to move forward together on the issue.<br />

Table 1: Examples <strong>of</strong> frameworks:<br />

Standards National Programmes Local Programmes – PHOs Outcomes measurement<br />

RNZCGP Aiming for Cornerstone Pinnacle Q9<br />

Excellence<br />

HCA Te Wana standards Te Wana ProAc<br />

H&DC Health Sector HDC Complaints process ProExcellence<br />

Standards<br />

H&DC Code <strong>of</strong> Rights<br />

Ministry <strong>of</strong> Health<br />

International programmes<br />

DHBs PHO Performance<br />

Management Programme<br />

QOF (UK)<br />

8 © THE ROYAL NEW ZEALAND COLLEGE OF GENERAL PRACTITIONERS / Summary <strong>of</strong> Proceedings 2008


Day 2 – Quality Improvement<br />

<strong>The</strong>mes:<br />

1. Are indicators useful? What are the internationally transferable concepts? Frameworks: QOF and Aiming for<br />

Excellence – what are the benefits if any?<br />

2. So your results look bad: what to do next?<br />

3. Aiming for Excellence version 3<br />

4. Forum – Exploring the interdependency <strong>of</strong> quality initiatives that impact on general practice<br />

5. What’s in it for me?<br />

6. Martin Roland – reflections from the two days<br />

Quality Improvement<br />

Building on the lessons from day one, day two focused on quality measurement, and its application by a range <strong>of</strong><br />

organisations for the purpose <strong>of</strong> measurement and improvement. In particular, how the UK health system uses measurement<br />

for incentivisation, its limitations and relevance for <strong>New</strong> <strong>Zealand</strong>.<br />

Martin Roland led the second day with a presentation on the Quality and Outcomes Framework, covering development<br />

and how it was used to negotiate the UK GP contract. <strong>The</strong> framework focuses mainly on chronic disease management,<br />

with little on the clinical care <strong>of</strong> acute medical problems, or on communication between doctors and patients.<br />

It represents a major gap in the overall assessment <strong>of</strong> quality <strong>of</strong> care in general practice. He noted that NZ<br />

should consider the impact <strong>of</strong> a QOF type framework and identify important principles relevant to its own setting, as<br />

adoption <strong>of</strong> another framework may not apply or be relevant. <strong>The</strong> way forward should be a well considered pathway,<br />

to ensure important aspects toward improvement in the NZ setting are measured.<br />

Frameworks are important, and that each is unique. <strong>The</strong> group discussed the impact <strong>of</strong> QOF on NZ initiatives such as<br />

the PHO Performance Management Programme and the other frameworks such as the <strong>College</strong>’s Aiming for Excellence.<br />

<strong>The</strong>re are important lessons for NZ general practice and the health sector, for example:<br />

• Should the NZ <strong>College</strong> reconsider its structure for the Aiming for Excellence framework?<br />

• What are the pros and cons <strong>of</strong> including clinical outcome indicators in Aiming for Excellence?<br />

• What would a framework for NZ look like and how would we select/develop clinical indicators?<br />

Room for improvement? What do you do next?<br />

“So you’ve measured your chosen aspect <strong>of</strong> care, and there appear to be problems in your care.”<br />

<strong>The</strong> group was taken beyond the theory to the practical application <strong>of</strong> quality through people, processes and tools.<br />

Measuring quality using quality indicators is only the first step to improving quality. <strong>The</strong>re is no single method <strong>of</strong><br />

© THE ROYAL NEW ZEALAND COLLEGE OF GENERAL PRACTITIONERS / Summary <strong>of</strong> Proceedings 2008 9


improvement and sustained improvement is more likely to be successful if multiple approaches that align with pr<strong>of</strong>essional<br />

values are used. Practical approaches to quality improvement that are aligned to performance evaluation are<br />

key features <strong>of</strong> any improvement system.<br />

<strong>The</strong> group was asked to explore commonly used strategies and processes for quality improvement, their relative<br />

strengths and weaknesses, and identify which ones they would implement. In particular:<br />

• Which indicators, what they measure, and in particular any problems with recording<br />

• Standards – Who decides? What is good, bad or useful, and on what basis?<br />

• How robust is the data/information?<br />

• Clinical or organisational audit, including significant events<br />

• Feedback <strong>of</strong> results <strong>of</strong> audits on quality <strong>of</strong> care<br />

• Quality circles, assessment by peers<br />

• Release <strong>of</strong> information on quality <strong>of</strong> care to pr<strong>of</strong>essionals or to the public<br />

• Educational events: lectures, seminars and courses<br />

• Opinion leaders to promote change and quality improvement<br />

• Financial or employment penalties<br />

Applying theory to practice in the NZ setting<br />

<strong>The</strong> symposium identified how much <strong>of</strong> the theory is reflected in NZ general practice through strategies such as<br />

Cornerstone or other similar quality improvement processes. An understanding <strong>of</strong> the strengths and weaknesses <strong>of</strong><br />

such programmes in achieving success were discussed and which ones should be enhanced and which ones used<br />

less. A number <strong>of</strong> innovations or opportunities were identified where examples <strong>of</strong> teamwork were crucial in making<br />

progress. <strong>The</strong> Pinnacle experience <strong>of</strong> assisting their practices to prepare for Cornerstone <strong>General</strong> Practice Accreditation<br />

was provided as an example <strong>of</strong> a ‘win-win’ approach.<br />

Aiming for Excellence version 3 is an example <strong>of</strong> leadership to guide capability in NZ general practices. An overview <strong>of</strong><br />

development was provided. Martin Roland provided an independent opinion and messages for the future. He noted<br />

that Aiming for Excellence is a model that the UK considers good practice and is now looking to NZ for further advice.<br />

Forum – different perspectives<br />

<strong>The</strong> purpose <strong>of</strong> the forum at the close <strong>of</strong> day two was two-fold: to understand the perspective <strong>of</strong> sector organisations,<br />

their role in quality and how they link measurement with improvement in their own organisations. Each provided clear<br />

guidance about a primary health care quality with its complexity <strong>of</strong> people, pr<strong>of</strong>essionals, and systems, but there was<br />

clear agreement that; “…We have already come a long way, we are taking responsibility for leading quality in the health<br />

sector, and there is a sense <strong>of</strong> hope…”<br />

<strong>10</strong> © THE ROYAL NEW ZEALAND COLLEGE OF GENERAL PRACTITIONERS / Summary <strong>of</strong> Proceedings 2008


Main points:<br />

• <strong>The</strong>re is a need to identify linkages and interdependency <strong>of</strong> quality initiatives that impact on general practice at<br />

a national and regional level.<br />

• <strong>The</strong>re is a willingness to ensure that actions contribute to collectively improving outcomes for patients and<br />

developing effective methods <strong>of</strong> keeping them out <strong>of</strong> secondary care through utilisation <strong>of</strong> primary care resources.<br />

• Fostering a learning environment to reduce harm and the level <strong>of</strong> complaints is essential. A culture <strong>of</strong> preventing<br />

harm and learning from mistakes must be a feature <strong>of</strong> primary health care.<br />

• <strong>The</strong> importance <strong>of</strong> defining, standardising and linking measurement with improvement processes, that provider<br />

assurance <strong>of</strong> a high performing primary health care sector.<br />

• ‘<strong>The</strong> quality <strong>of</strong> the experience’ is an emerging theme and likely to be a challenge with diverse communities and<br />

expectations. How will general practice teams respond?<br />

Further discussion needed:<br />

• Quality frameworks, Clinical indicators, Safety, monitoring and feedback systems – NZ has most general practices<br />

participating in PHOs but there is no evidence that it adds value to quality in general practice, what would<br />

improve effectiveness and how would we know.<br />

• Pay for performance, target setting – does it make a difference?<br />

• How can we continue to learn from international experiences – opportunities and lessons?<br />

© THE ROYAL NEW ZEALAND COLLEGE OF GENERAL PRACTITIONERS / Summary <strong>of</strong> Proceedings 2008 11


Results<br />

1. Masterclass<br />

Martin Roland’s one day Masterclass contributed to a better understanding <strong>of</strong> the link between quality measurement<br />

and its components, quality improvement and processes, and the positive or negative impact <strong>of</strong><br />

incentivisation.<br />

<strong>The</strong> group identified and discussed limitations <strong>of</strong> measurement only and its reductionist aspect; that quality indicators<br />

only measure what can be measured. <strong>The</strong>y were concerned that measurement alone may exclude more important<br />

aspects <strong>of</strong> care and encourage minimalist approaches to the delivery <strong>of</strong> care.<br />

<strong>The</strong>re are existing lessons that result from the impact <strong>of</strong> a measurement only approach:<br />

• A ‘piecemeal’ approach to providing care at the expense <strong>of</strong> holistic care<br />

• Organisational/sector focus on measured aspects <strong>of</strong> care to the detriment <strong>of</strong> other areas<br />

• Decisions being made from poor quality data or that which is difficult to access<br />

• Differences between providers may be difficult to interpret<br />

• Quality measurement can be expensive (e.g. if review <strong>of</strong> individual patient records is needed)<br />

• May encourage a blame culture and reduce pr<strong>of</strong>essional motivation to improve<br />

• May lead to short-term, rather than longer term strategic planning<br />

• May introduce perverse incentives to gain or manipulate data<br />

Measurement must sit within an established framework that justifies why data is being collected and has agreement<br />

<strong>of</strong> those involved. <strong>The</strong>re are no magic bullets for quality improvement but the first steps toward quality<br />

improvement rely on the drivers having the right motivation. Pr<strong>of</strong>essionalism is identified as an important driver –<br />

‘doing the right thing right’, and measuring quality should always be for the right reason – why, who for, and the<br />

spirit <strong>of</strong> intent.<br />

Secondly the capacity to measure technical processes raised the question <strong>of</strong> fairness. Current structures are complex<br />

with many players including, large organisations with good capacity and small businesses with little capacity. Fairness<br />

and equity issues were raised as a caution to applying generic expectations.<br />

Finally there is agreement that there is a need for greater dependability in the health sector but, remaining to be solved,<br />

Who pays and What are they paying for? <strong>The</strong>re was a strong message that paying for pr<strong>of</strong>essionalism is more acceptable<br />

than paying for performance.<br />

12 © THE ROYAL NEW ZEALAND COLLEGE OF GENERAL PRACTITIONERS / Summary <strong>of</strong> Proceedings 2008


2. Pat Snedden, Chair, MOH Quality Improvement Committee – key messages<br />

<strong>The</strong> <strong>College</strong> is grateful to Pat Snedden, chair <strong>of</strong> the Ministry <strong>of</strong> Health’s Quality Improvement Committee, who<br />

provided valuable comment and reflection during the symposium. Its role is to provide leadership on quality in the<br />

NZ Health sector.<br />

Main points:<br />

• <strong>The</strong> QIC interest in primary health care is front line quality and the quality <strong>of</strong> the experience. Primary care has<br />

been exempt from the attention that secondary care has received and recent concerns from NZ and Australia<br />

highlight the need for attention. (NZ Health and Disability Commissioner – complaints system, ACC – harm<br />

panel for serious and sentinel events)<br />

• <strong>The</strong>re is a need to establish a Quality Agenda and Framework for NZ Healthcare. <strong>The</strong> area <strong>of</strong> focus needs to be<br />

on how to share information, and what information is needed to make progress.<br />

• QIC believes people most at risk should get what they need and more analysis on inequalities is essential. It will<br />

need to establish how to engage with communities to determine what should be measured and wish to develop<br />

a continuing relationship.<br />

• A relationship between QIC and the primary care sector is essential. QIC is responsible for providing oversight<br />

to ensure the sector improves the patient journey and includes consumer participation in decision making,<br />

keep people out <strong>of</strong> secondary care and manage primary care more effectively. It is interested in working with<br />

the collective interests and establishing rules <strong>of</strong> engagement in dialogue that includes respect for all views but<br />

also the ability to challenge if needed.<br />

• Management <strong>of</strong> healthcare incidents is acknowledged as a problem area. QIC is interested in the overall management<br />

<strong>of</strong> sentinel events and wish to begin an informed public debate that will identify a process to deal with<br />

sentinel events and serious safety issues. Those who have been hurt will be recognised and pr<strong>of</strong>essional<br />

innovation will be highlighted. <strong>The</strong>re is a commitment to honest dialogue.<br />

“<strong>The</strong> QIC Goal for 2008 – how can we bring our mutual excellence to citizens <strong>of</strong> Aotearoa?”<br />

* Mr Snedden is also chair <strong>of</strong> the Auckland District Health Board.<br />

3. Key points: Development <strong>of</strong> a quality environment<br />

for primary care in <strong>New</strong> <strong>Zealand</strong><br />

1. High level quality – culture <strong>of</strong> sector, what do we want the sector to do and why<br />

<strong>The</strong>re is a growing NZ quality network that is beginning to form in the primary care sector. This group is taking greater<br />

interest, ownership and leadership <strong>of</strong> quality and there are now established relationships developing that are having<br />

an impact on sector quality – pr<strong>of</strong>essional organisations, funders, service providers, teams, patients and communities.<br />

Sector quality will be successful if clinical governance relies on doctors being not only arbiter <strong>of</strong> quality but an essential<br />

participant in the process. All primary care clinicians should have access to all the information required to best manage<br />

patients; access to records, to secondary care management if appropriate, medication history, to diagnostics that help<br />

© THE ROYAL NEW ZEALAND COLLEGE OF GENERAL PRACTITIONERS / Summary <strong>of</strong> Proceedings 2008 13


assess the nature and severity <strong>of</strong> complaints and access to specialist services to advise and assist in management <strong>of</strong><br />

care in the community.<br />

System issues must focus on quality improvement interventions that address patient conditions. <strong>The</strong> essence <strong>of</strong> the<br />

primary health care strategy is to make connections and be more connected. This means there must be a robust<br />

integrity <strong>of</strong> the system in which primary care operates alongside other services, (whether health or other agencies),<br />

that impact on wellbeing such as housing or work and income. Does primary care have the infrastructure, information and<br />

connections to best help patients?<br />

Participants were asked to remember that the system is there for patients that access primary care for proactive or<br />

reactive reasons. Proactive reasons might include nutrition advice, screening, vaccinations, referral to WINZ, Housing<br />

NZ etc. Reactive reasons might include ‘unwellness’. If it is the latter, what is it that patients need and value? What does<br />

primary care do for them now; how might that be improved?<br />

For both parties, building a relationship would be a good start. Do we know and trust each other?<br />

<strong>The</strong>re are obvious workforce issues, not just numbers but stability <strong>of</strong> the workforce, after hours, training and recruitment.<br />

Secondly, a range <strong>of</strong> diagnostic and information based tools exist that assist clinicians to provide care for patients.<br />

Access to those resources varies around the country – this is an increasing challenge for quality in primary care.<br />

2. Frameworks <strong>of</strong> quality in NZ<br />

Leadership on quality in the <strong>New</strong> <strong>Zealand</strong> Health Sector by a number <strong>of</strong> organisations has already provided the<br />

beginning <strong>of</strong> an infrastructure for a quality framework. <strong>The</strong> forum reinforced the need to maintain and support local<br />

quality frameworks and foundation programmes. <strong>The</strong>ir contribution to improvement and transparency in primary health<br />

care quality is now apparent.<br />

<strong>The</strong> forum also acknowledged the value <strong>of</strong> national quality frameworks as an important benchmark for local quality<br />

programmes and their potential for improving patient outcomes. <strong>The</strong>se frameworks are complementary and the principle<br />

<strong>of</strong> alignment and collaboration where possible, was encouraged.<br />

<strong>The</strong> use <strong>of</strong> quality frameworks can be inspirational when they incentivise teamwork and reflection on clinical<br />

practices – quality committed teams make improvements and streamline redundant systems, processes, paperwork,<br />

duplication; so they can focus on improving patient outcomes.<br />

Existing quality frameworks have provided leadership by applying clinical governance approaches, and clear<br />

guidance for their use, particularly for establishing goals and setting targets. Examples provided by presenters<br />

noted that the ‘spirit <strong>of</strong> intent’ has strongly influenced ownership through principles, governance structures and<br />

buy in from those involved.<br />

3. Significant tools for quality<br />

Quality tools should be defined by the owners and users and be fit for their purpose. <strong>The</strong>y should identify the gap<br />

between current practice and ‘best practice’ and be able to influence and reinforce change.<br />

• Quality toolkits are useful; practices don’t want to reinvent the wheel. More assistance through greater access<br />

to a wide range <strong>of</strong> existing resources is required. Cost and time was identified as major barrier for some<br />

14 © THE ROYAL NEW ZEALAND COLLEGE OF GENERAL PRACTITIONERS / Summary <strong>of</strong> Proceedings 2008


• Define the owner – there was agreement that a shared vision and agenda will have an impact on which quality<br />

tools and methods are used in the sector<br />

• Measures – what should be measured? Development and use <strong>of</strong> indicators is dependent on the context and<br />

environment<br />

• Improvement – change depends on effective clinical leadership and governance, the culture <strong>of</strong> the sector, local<br />

networks, national and frameworks and supporting resources<br />

• Enhanced teams – the diversity <strong>of</strong> teams is changing in primary care and provides more scope to work differently<br />

with individuals and across populations<br />

• Practices – the building should provide the range <strong>of</strong> services and activities that support a quality learning<br />

environment – space, culture <strong>of</strong> teamwork, range <strong>of</strong> health pr<strong>of</strong>essionals, protected time, an IT infrastructure,<br />

PMS, guidelines integrated with PMS systems, linkages to other primary and secondary services, diagnostics,<br />

PDSA cycles <strong>of</strong> activity for monitoring<br />

• Patient focused – tracking the patient journey – the electronic patient record is identified as the key to improvement<br />

4. Pay for performance<br />

Pay for performance should be carefully established with principles and parameters within an established framework<br />

agreed to by the sector. An appropriate balance <strong>of</strong> incentives (financial, contractual, pr<strong>of</strong>essional) is essential. <strong>The</strong>re<br />

are different perspectives that make it important to develop rules before it is established.<br />

Pay for performance is not straightforward but the group was clear that payment should not be on the basis <strong>of</strong> data<br />

collection. It should be linked to service improvement; savings made, efficiencies in services and effective outcomes<br />

for patients. <strong>The</strong> group was not supportive <strong>of</strong> the approach taken by the UK where individual performance was resourced<br />

instead <strong>of</strong> systems. Although the group supported pay for pr<strong>of</strong>essionalism as an essential element to ensure health<br />

pr<strong>of</strong>essionals are properly resourced, performance must also be responsive to local needs.<br />

5. Mechanisms for driving quality<br />

Pre-requisites for quality – there are a range <strong>of</strong> mechanisms that the sector may identify. This should be in conjunction<br />

with QIC e.g. pr<strong>of</strong>essional standards, clinical governance, continuity/integration <strong>of</strong> care between primary/secondary.<br />

<strong>The</strong> H&DC has a strong interest in safe and high quality systems that are based on ‘learning, not lynching’ – the Code<br />

<strong>of</strong> Rights is cited as the best consumer framework and the principles are key. It is a good example <strong>of</strong> a simple framework<br />

that can and has been applied across the sector.<br />

Contracts are a powerful mechanism for driving quality but are dependent on the culture <strong>of</strong> sector. Contracts should<br />

note exclusions or inclusion clauses to explain reporting.<br />

6. Primary Care Health Workforce – pr<strong>of</strong>essionalism<br />

Recognition <strong>of</strong> the value <strong>of</strong> primary health care teams as a critical success factor in quality is essential. More health<br />

pr<strong>of</strong>essionals are working collaboratively and managing patient care as a team so increased clinical training opportu-<br />

© THE ROYAL NEW ZEALAND COLLEGE OF GENERAL PRACTITIONERS / Summary <strong>of</strong> Proceedings 2008 15


nities and protected teaching or learning opportunities are needed (complexity <strong>of</strong> evidence, information, IT systems,<br />

processes, pharmacology, diagnostic tests etc). For this to occur practices must be successful as businesses before<br />

they can be successful as quality teams: the system must first support the pr<strong>of</strong>essionals to do the work they need to<br />

do, and enable them to be clinicians.<br />

Characteristics <strong>of</strong> a high quality learning environment:<br />

• National framework <strong>of</strong> education<br />

• Pr<strong>of</strong>essional framework<br />

• Research and development<br />

• Clinical governance<br />

• Change management<br />

• Performance management<br />

• Teams<br />

• Feedback<br />

• Analysis <strong>of</strong> performance<br />

• Improvement purposes<br />

7. Make information publicly available<br />

<strong>The</strong> UK has been successful in developing publicly available, transparent outcomes information. Patients are able<br />

to access detailed information about health outcomes in their general practice and compare them with other<br />

practices. This is highly dependent on information capture, good IT systems, evidence based indicators and a<br />

willingness to participate.<br />

In <strong>New</strong> <strong>Zealand</strong> H&DC collect information about adverse outcomes, the MOH provide results for the sector. <strong>The</strong><br />

concern from general practice is about the robustness <strong>of</strong> data and how it will be used. <strong>The</strong> system relies heavily on<br />

good quality coordination and support. It is proposed that the PHO Performance Programme might be the precursor<br />

to a UK style <strong>of</strong> feedback to sector and patients about performance.<br />

8. Marketing success<br />

Patients are not aware <strong>of</strong> the benefit <strong>of</strong> quality programmes. Marketing success improves networking opportunities<br />

and provides an opportunity to showcase and build pride in the sector. Doing this at every level <strong>of</strong> the system can be<br />

difficult but building in celebration and including others must be part <strong>of</strong> the culture.<br />

16 © THE ROYAL NEW ZEALAND COLLEGE OF GENERAL PRACTITIONERS / Summary <strong>of</strong> Proceedings 2008


Key principles developed by participants<br />

• Quality must be driven from the front line (bottom up) but supported from the top<br />

• Formative approaches work best when quality comes from within. An externally driven compliance model<br />

it will not work<br />

• Only gather information that is useful to front line clinicians<br />

• Encourage diversity and team based approaches<br />

• Encourage communication <strong>of</strong> experiences – patients and clinicians<br />

• Allocate responsibility to lead and involve all sectors<br />

• Streamline and standardize data capture systems and methods to reduce variation and incorporate all<br />

essential requirements into one Practice Management System so it can be used for quality improvement<br />

• Prioritise important factors<br />

• CQI principles should be applied to all processes<br />

• Identify baseline standards & safety factors e.g. sterilisation, immunisation<br />

• Support external review by peers as an important part <strong>of</strong> quality improvement<br />

• Encourage primary health care teams to value and recognise quality team culture as critical<br />

• Practices must be successful as businesses before they can be successful as quality teams<br />

• Quality should be well resourced<br />

• <strong>The</strong> use <strong>of</strong> quality frameworks can be inspirational when they incentivise teamwork<br />

• National system – National standards or programmes e.g. Cornerstone, Te Wana, must align with the<br />

Primary Care Strategy<br />

• Make allowance for local variation – e.g. urban, rural, small. Regional systems – DHB/PHO/MSOs/IPAs,<br />

have the ability to prioritise enrolled populations<br />

• Involve everyone!<br />

© THE ROYAL NEW ZEALAND COLLEGE OF GENERAL PRACTITIONERS / Summary <strong>of</strong> Proceedings 2008 17


Conclusion – <strong>The</strong> way forward<br />

<strong>The</strong> growing leadership and knowledge base forming around primary care quality is apparent and the Quality Symposium<br />

has provided an opportunity to review emerging issues together. Considerable discussion during the course <strong>of</strong><br />

the two days produced important outcomes, in particular the discussion and principles identified on Pay for Performance<br />

is testimony to the level <strong>of</strong> thinking.<br />

While the obvious workforce and related issues are an underlying problem, there was a clear focus on refinements<br />

needed to make progress in the health sector. Clear agreement and understanding <strong>of</strong> the way forward emerged. One,<br />

that there is agreement that much has been achieved in recent years but there are particular needs for the sector if<br />

further improvements are to be made. A second is to make progress on a national Quality Improvement Agenda<br />

<strong>The</strong>re is clear support for a National Quality Framework for primary health care that includes prevention and learning<br />

approaches to improvement. Recognition that much <strong>of</strong> the structure is already in place reminds us just how far some<br />

aspects <strong>of</strong> the health reforms have changed the way care is <strong>of</strong>fered. In particular, investments in IT initiatives now<br />

support health practitioners to provide better integration <strong>of</strong> care through improved information and capacity in practice<br />

management systems.<br />

<strong>The</strong> next step is to improve practice team and primary care capability through development <strong>of</strong> integrated practice<br />

environments where learning is paramount. This is an important next step and where the value <strong>of</strong> previous investment<br />

is realised through research, education, practice, resources (including people), and quality tools can be utilised to<br />

contribute to reductions in disparity and improvements in patient outcomes. Learning environments rely on multiple<br />

interventions that are systematic and sustained. Some <strong>of</strong> this is achieved through policy, funding and contracting but<br />

relies heavily on relationships, teams, communication and interdisciplinary collaboration where new ideas can be<br />

generated and ‘the right’ attitude or culture is important.<br />

18 © THE ROYAL NEW ZEALAND COLLEGE OF GENERAL PRACTITIONERS / Summary <strong>of</strong> Proceedings 2008


References<br />

1<br />

Donabedian A. <strong>The</strong> seven pillars <strong>of</strong> quality. Arch Pathol Lab Med. 1990; 114: 1115–1118.<br />

2<br />

O’Leary D.S and O’Leary M.R. From quality assurance to quality improvement. <strong>The</strong> Joint Commission on Accreditation<br />

<strong>of</strong> Healthcare Organizations and Emergency Care. Emerg Med Clin North Am. 1992; <strong>10</strong>: 477–492<br />

3<br />

Maxwell R.J. Dimensions <strong>of</strong> quality revisited: from thought to action. Quality in Health Care. 1992; 1: 171–177.<br />

4<br />

Campbell S, Roland M, Buetow S. Defining Quality <strong>of</strong> Care. Social Science and Medicine. 2000; 51: 1611–1625.<br />

5<br />

Dovey S<br />

6<br />

UK QOF – Martin Roland, A4E – Kenneth Tong, Pinnacle – Q9 Stephen Lillis, Denise Ward, ProExcellence Chris Boberg,<br />

Te Wana – Stephanie Pope<br />

Martin Roland – Reply to Mangin and Toop – Roland M. <strong>The</strong> Quality and Outcomes Framework: too early for a final<br />

verdict. British Journal <strong>of</strong> <strong>General</strong> Practice. 2007 July; 57(540): 525–527<br />

7<br />

Mangin D, Toop L. <strong>The</strong> Quality and Outcomes Framework: What have you done to yourselves? British Journal <strong>of</strong><br />

<strong>General</strong> Practice. 2007 June; 57(539): 435–437<br />

Toop L, Mangin D. Industry funded patient information and the slippery slope to <strong>New</strong> <strong>Zealand</strong>. BMJ. 2007 6 Oct;<br />

335(7622): 694–695)<br />

© THE ROYAL NEW ZEALAND COLLEGE OF GENERAL PRACTITIONERS / Summary <strong>of</strong> Proceedings 2008 19

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!