24.07.2014 Views

NZ Report / Proposal Template - State Services Commission

NZ Report / Proposal Template - State Services Commission

NZ Report / Proposal Template - State Services Commission

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

<strong>Report</strong> of the <strong>State</strong> <strong>Services</strong> <strong>Commission</strong>er<br />

into the Cost Escalation in the Regional Prisons<br />

Development Project<br />

7 August 2006


<strong>State</strong> <strong>Services</strong> <strong>Commission</strong><br />

Review of Cost Escalation in Regional Prisons Development<br />

Project<br />

31 July 2006


Disclaimer<br />

In preparing this report, we have relied upon, and assumed the accuracy and<br />

completeness of, all the information made available to us from organisations that have<br />

provided information relevant to our report. We have been assured by the Department of<br />

Corrections that all information relevant to the completion of the review has been<br />

provided. We have evaluated that information through analysis, inquiry and review but<br />

have not sought to verify the accuracy or completeness of any such information. It<br />

should not be construed that we have conducted an audit of the information.<br />

The statements and opinions expressed in this report have been made in good faith.<br />

Accordingly, neither PricewaterhouseCoopers nor its partners, employees or agents,<br />

accept any responsibility or liability for any such information being inaccurate, incomplete,<br />

unreliable or not soundly based, or for any errors in the analysis, statements and opinions<br />

provided in this report resulting directly or indirectly from any such circumstances, or from<br />

any assumptions upon which this work is based, proving unjustified.<br />

We reserve the right, but are under no obligation, to revise or amend our report if any<br />

additional information which exists on the date of this report, subsequently comes to light.<br />

This report has been prepared solely for use by the <strong>State</strong> <strong>Services</strong> <strong>Commission</strong> and the<br />

Treasury for the purpose of assisting these organisations in their reporting back to<br />

Ministers regarding the processes, systems and contracting practices at the Spring Hill<br />

and Otago prisons. We accept no responsibility to any other party, unless specifically<br />

agreed by us in writing. Furthermore, we accept no responsibility for any reliance that<br />

may be placed on this report should it be used for any purpose other than that set out<br />

above.


Table of Contents<br />

1 Executive Summary .................................................................................................1<br />

2 Introduction ..............................................................................................................6<br />

3 Background..............................................................................................................9<br />

4 Key Drivers and Causes of Cost Escalation ..........................................................13<br />

Overview of Cost Increases 14<br />

General Comments Regarding Cost Increases 15<br />

Market Influences 16<br />

Consents and Regulatory Changes 19<br />

Design Finalisation 20<br />

Summary 20<br />

Lessons Learned 21<br />

5 Methodology and Processes: Design, Costing, Procurement and Scheduling ......22<br />

Introduction 24<br />

Design 24<br />

Costing 25<br />

Procurement and Scheduling 34<br />

Summary 43<br />

6 Governance and Project Management ..................................................................45<br />

Introduction 46<br />

Current RPDP Arrangements 48<br />

Development of Governance and Management of RPDP 50<br />

Issues and Challenges 51<br />

Summary 54<br />

Lessons Learned 55<br />

7 <strong>Report</strong>ing to Ministers ............................................................................................57<br />

Appendix A :<br />

Funding Approvals...................................................................................60<br />

Appendix B : CWA Best Practices ................................................................................62<br />

Appendix C :<br />

Overview of Governance and Project Management................................66<br />

iv


1 Executive Summary<br />

1.1 Construction of new prisons at Spring Hill in North Waikato (referred to as the<br />

Spring Hill project) and near Millburn in Otago (referred to as the Otago project) is<br />

underway. In December 2005, Ministers were advised that the cost of the projects had<br />

increased by $140.8 million compared to estimates provided earlier in the context of<br />

Budget 2005.<br />

1.2 In light of the added cost, the <strong>State</strong> <strong>Services</strong> <strong>Commission</strong>, in consultation with the<br />

Treasury, was asked to independently review the processes, systems and contracting<br />

practices used by the Department of Corrections (the Department) in connection with the<br />

two prisons.<br />

1.3 Consistent with the terms of reference for the review, the report which follows has<br />

been structured around the four primary questions:<br />

• What were the drivers and causes of the cost escalation?<br />

• What lessons can be learned from, and about, the Department’s methodology and<br />

process used to design, cost, procure and schedule (excluding commissioning) the<br />

Spring Hill and Otago projects?<br />

• What lessons can be learned in relation to the project management and<br />

governance of the projects?<br />

• What level of reporting to Ministers would be appropriate for projects of this size?<br />

Context<br />

1.4 The Spring Hill and Otago projects are part of a wider programme of increasing<br />

prison capacity. The Department has been building 325 beds per year on average since<br />

1996 into existing prisons. However, this is not sufficient to meet the expected growth in<br />

the prison population. New prisons have also been required and the Spring Hill and Otago<br />

projects are part of a wider programme referred to as the Regional Prisons Development<br />

Programme (RPDP).<br />

1.5 The RPDP was announced in 1997. It comprises two regional prisons in addition<br />

to Spring Hill and Otago, both of which are now operational; these are located at Ngawha<br />

in Northland and in Manukau (the recently opened Auckland Women’s facility).<br />

1.6 Several factors have had a significant bearing on the Spring Hill and Otago<br />

facilities (and RPDP more generally). Foremost among these is the expected growth in<br />

prison population. In 1999, the prison population forecast for 2008 was 6,800. The<br />

current forecast for 2008 is 8,600; a 26% increase. It is important to note that the<br />

Department depends on Ministry of Justice prison population forecasts. These forecasts<br />

have a five year horizon which is significantly shorter than the lead time for completing a<br />

new prison. As a result of this, and reflecting the revised forecasts, the RPDP has<br />

required considerable flexibility to adapt to changing circumstances. In particular, there<br />

have been changes to the bed numbers at three of the four regional prisons:<br />

Auckland Women’s ‣ 150 to 286<br />

Spring Hill ‣ 350 to 650<br />

Otago ‣ 220 to 335<br />

Executive Summary 1


1.7 The increases have impacted on planning, consents, design, construction and<br />

cost.<br />

1.8 A second key factor influencing the RPDP has been the process of obtaining<br />

consents under the Resource Management Act. The outcome of this process (which is<br />

not part of this review) has resulted in changes to the approach to design and<br />

construction. These changes have, in turn, contributed to the Department using a form of<br />

procurement – referred to as a Collaborative Working Arrangement or CWA – that is<br />

fundamentally different to the more traditional fixed price form of contracting. The change<br />

in procurement method has assisted the Department to deliver the regional prisons in time<br />

to meet growth in the prison population. However, the CWA methodology has also raised<br />

a number of issues and lessons.<br />

1.9 The third contextual consideration is the fact that the new prisons have been built<br />

during a heated construction market. As a result, substantial cost increases have been<br />

experienced in relation to labour and materials. Moreover, the sheer size of the RPDP<br />

project in relation to New Zealand’s construction, design and quantity surveyor capacity<br />

has stretched available resources.<br />

Key Findings<br />

1.10 Growth in the prison population has been a key driver for the RPDP. The<br />

Department has successfully responded to this, and the changes in forecasts, by<br />

delivering the Northland and Auckland Women’s prisons on time, within budget and to the<br />

standard required. It is on track to complete the Spring Hill and Otago facilities in time to<br />

meet requirements.<br />

1.11 The costs of the Spring Hill and Otago facilities have increased by $140.8 million<br />

compared to estimates presented as part of Budget 05. Several factors have contributed<br />

to the increase including:<br />

• market factors, including inflation in relation to input costs (e.g. steel) and labour,<br />

as well as the need to pay increased allowances to attract scarce labour<br />

resources. The remote location of the construction sites added to these<br />

pressures;<br />

• the outcome of consent processes and regulatory changes; and<br />

• design changes following the completion of Northland and additional work on a<br />

range of infrastructure services.<br />

1.12 It is important to note that the estimates provided as part of Budget 05 should have<br />

been clearly communicated as indicative only. In particular, the level of cost escalation<br />

incorporated into the Budget 05 numbers was based on external forecasts that are known<br />

to have limitations. Further, the estimates were based on traditional quantity surveyor<br />

data that did not sufficiently recognise the specific circumstances of the Spring Hill and<br />

Otago projects.<br />

1.13 It is also important to note that the CWA methodology used for the RPDP projects<br />

differs from traditional procurement methods in that the principal contractors do not submit<br />

fixed price quotes. Instead, the overall cost of the projects is a function of direct costs<br />

(labour and materials) plus agreed allowances for margins and overheads. There is a<br />

process – referred to as the development of the Target Outturn Cost (TOC) – that is<br />

fundamental to agreeing the level of overall costs. Various factors including, in particular,<br />

constraints around the availability of design and cost estimation resources, have delayed<br />

Executive Summary 2


the development of the TOC until much later in the construction phase than is desirable.<br />

This has exposed the Crown to cost risk, which the Department has managed through<br />

independent scrutiny of cost data presented by contractors.<br />

1.14 The CWA methodology has a number of inherent advantages compared to<br />

traditional forms of procurement and the Department has captured many of these:<br />

• there has been close integration of design, construction and commissioning teams<br />

which assists in achieving an optimal balance between design, construction and<br />

operational requirements;<br />

• several value management reviews have been undertaken to further optimise<br />

designs and take out unnecessary costs;<br />

• at a site level, resources have been mobilised to deal with day-to-day issues<br />

thereby increasing the efficiency of on-site resource utilisation;<br />

• the collaborative approach to dealing with issues has helped to maintain<br />

momentum with the projects, thereby enabling the timing of projects to be<br />

completed on, or near to, expectations;<br />

• high levels of transparency in relation to costs have been achieved at the project<br />

level consistent with the “open-book” philosophy that underpins CWA (with some<br />

opportunity for more transparency over margins – see Section 5); and<br />

• costs submitted by the commercial CWA partners have been exposed to extensive<br />

third party scrutiny and review.<br />

1.15 Overlaying all of these benefits, the methodology chosen by the Department<br />

means that it is on track to deliver Spring Hill and Otago in time to meet the expected<br />

growth in the prison population. There were sufficient indications to suggest that had the<br />

Department elected to follow a traditional procurement method, timeframes for completing<br />

the projects would probably not have been met.<br />

1.16 Projects of the size and complexity of Spring Hill and Otago need tight<br />

management. RPDP project governance and management arrangements have delivered<br />

(or will soon deliver) four regional prisons to accommodate the growth in prison<br />

population.<br />

1.17 Current arrangements for project governance, following a review during 2005,<br />

have resulted in improved governance and project management of RPDP. In particular,<br />

we consider desirable changes have included:<br />

• establishment of the Programme Management Office (PMO) and a specialist<br />

construction sub-committee;<br />

• separating responsibilities for direction of construction from commissioning; and<br />

• the inclusion of a Department employee on the CWA Principals Groups in Spring<br />

Hill and Otago.<br />

1.18 Under arrangements prior to late-2005, the Steering Group established for the<br />

RPDP was often constrained in its decision-making effectiveness through a lack of<br />

sufficient information to support decisions (notwithstanding the transparency of cost<br />

Executive Summary 3


information at the project level that was emerging from August 2005). Decisions were<br />

often taken with discussion, but before the provision of supporting information. The<br />

Steering Group comprised a majority of busy Departmental functional line managers, with<br />

heavy reliance on contractors for advice regarding large construction project decisions.<br />

These managers did address some knowledge gaps through the appointment of an<br />

independent member with construction, project and procurement methodology experience<br />

in 2004, and the conduct of internal and external audits to assess aspects of process.<br />

1.19 Prior to 2005, there was a lack of clarity amongst some, including Steering Group<br />

members, of the role of the Steering Group as to its role as an advisory group<br />

representing the different areas of Department endeavour, or a governance group. This<br />

may have affected the strength of the Steering Group to challenge the issues with<br />

reporting and information for key decisions.<br />

1.20 Due to the pressing nature of the growth in the projected prison population, the<br />

completion of the projects to the proposed schedule became a paramount factor in<br />

decision-making.<br />

1.21 Overall, these arrangements made it very challenging for the Steering Group to<br />

assess governance risks and to communicate these beyond the Steering Group. The<br />

Steering Group seemed surprised to learn of the actual size of the cost escalations in late<br />

2005.<br />

1.22 The nature and level of reporting to Ministers was also an issue. In our view, the<br />

information provided to Ministers as part of Budget 05 did not sufficiently or clearly signal<br />

the uncertainty around the estimates and the risk of cost increase. Further, the fiscal risks<br />

should have been on the radar for the pre-election fiscal update in mid-August 2005, at<br />

least in a qualitative sense.<br />

Lessons Learned<br />

1.23 Growth in the prison population drives the need for additional capacity. Given the<br />

long lead times involved with building new prisons, a longer term view of future capacity<br />

requirements is needed (than is provided by the Ministry of Justice five year forecasts) in<br />

order to enable the Department to appropriately plan, resource and schedule the delivery<br />

of additional greenfield capacity.<br />

1.24 The choice of CWA methodology has assisted the Department to deliver the<br />

required increase in capacity. However, CWA will not be suited to all projects. There is a<br />

need to identify the conditions under which CWA is likely to be preferred ahead of other<br />

forms of procurement. The methodology chosen should be justified on a project by<br />

project basis.<br />

1.25 The CWA methodology adopted by the Department requires careful and<br />

experienced management to protect the Crown’s interests. A blend of competencies and<br />

experience (commercial, construction and public sector management) is required for<br />

effective management. For future projects of this size and complexity, sponsoring<br />

agencies need to be confident that they have the appropriate mix of competencies and<br />

these are represented within the CWA Principal’s Group.<br />

1.26 The development of the TOC is a central part of the CWA methodology adopted by<br />

the Department. It needs to be finalised sooner than has been the case with respect to<br />

Spring Hill and Otago. Specifically, the TOC should ideally be completed at, or about, the<br />

time construction commences. However, appropriate time and resources need to be<br />

planned for to enable this. Until the draft TOC is well developed, estimates of construction<br />

Executive Summary 4


cost should be seen as indicative only. Pre-TOC estimates of cost involve significant<br />

levels of risk and uncertainty and this needs to be made clear. Once TOC estimates<br />

begin to emerge, there should be transparent reporting of these to provide the Department<br />

and, as appropriate, Ministers with opportunities to explore options for saving cost if<br />

budgets are under pressure.<br />

1.27 With respect to project management and governance, for projects of this size and<br />

importance, there is a need to ensure that:<br />

• project goals and objectives are agreed and clearly communicated to all parties at<br />

the commencement of the project, and that they encompass all three key elements<br />

of time, costs and quality, even in cases of ‘fast-tracking’;<br />

• the Steering Group has the appropriate mix of knowledge and skills to be able to<br />

represent the Department and the wider Government interests, and manage a<br />

large scale project;<br />

• the roles and accountabilities of the respective governance and management<br />

groups and individuals are clearly specified and communicated from the<br />

commencement of project planning;<br />

• there are independent quality assurance processes in place for oversight of<br />

governance and project management approaches, as well as the lower level<br />

project management processes for cost calculation and quantitative risk<br />

assessment;<br />

• the Steering Group is provided with adequate information in a timely fashion to<br />

assess and manage risks, support effective decision-making, and reporting to<br />

Ministers; and<br />

• project reporting not only assesses historical progress but also estimates future<br />

issues and progress remaining against all project objectives.<br />

1.28 In terms of reporting to Ministers, the following should be noted:<br />

• the regular discussions with the Minister should include clear reference to cost<br />

developments and associated risk estimates as work on the TOC proceeds;<br />

• where cost estimates are uncertain (as was the case with these projects), this<br />

needs to be clearly explained to Ministers. For the purposes of providing advice to<br />

Ministers, it would be appropriate to indicate a range of possible cost estimates<br />

and, moreover, indicate the level of uncertainty attaching to the estimates. Such<br />

estimates should be clearly distinguished from formal Budget processes and<br />

funding decisions (where point estimates specified to the nearest $1000 are<br />

required); and<br />

• on projects of this scale, reporting should be linked to significant project milestones<br />

rather than to the Budget cycle. For example, cost estimates developed for<br />

Budget 05 preceded the start of construction on Spring Hill and Otago. A report to<br />

Ministers at, or about, the start of construction would be better practice.<br />

Executive Summary 5


2 Introduction<br />

2.1 The Regional Prisons Development Project (RPDP) is a major construction<br />

programme undertaken by the Department of Corrections (the Department). The project<br />

involves the delivery of new prisons in Northland (referred as Northland Region<br />

Corrections Facility or Northland), Auckland (referred to as Auckland Women’s) North<br />

Waikato (referred to as the Spring Hill Corrections Facility or Spring Hill) and Otago<br />

(referred to as the Otago Region Corrections Facility or Otago).<br />

2.2 The focus of this review is on the Spring Hill and Otago facilities which are located<br />

near Meremere and Milburn respectively. The other two facilities (located at Ngawha and<br />

Manukau) have been considered to the extent that they have assisted understanding of<br />

the arrangements at the Spring Hill and Otago sites.<br />

2.3 Both the Spring Hill and Otago projects are still under construction. Spring Hill is<br />

due for completion by July 2007 and Otago by March 2007. A key driver for the review is<br />

the significant increase in the estimated cost for these projects. As part of Budget 04, the<br />

costs for Spring Hill and Otago were forecast to be $248 million and $161 million<br />

respectively. As part of Budget 05, these estimates were increased to $283 million and<br />

$175 million respectively. These estimates were revised further in light of detailed costing<br />

analysis and reported to Cabinet in December 2005. Spring Hill is expected to cost $380<br />

million and Otago’s cost has been estimated to be $218 million; a combined increase of<br />

approximately 31% over and above the Budget 05 estimates.<br />

2.4 In light of the cost increases, the Cabinet invited the <strong>State</strong> <strong>Services</strong> <strong>Commission</strong>er,<br />

in consultation with the Treasury, to independently review the processes, system and<br />

contracting practices at the Spring Hill and Otago prisons. PricewaterhouseCoopers has<br />

been engaged by the <strong>Commission</strong> to undertake the independent review.<br />

Review Objectives<br />

2.5 The primary objective of the review is to learn lessons from the Spring Hill and<br />

Otago projects for the benefit of future capital projects. To this end, the review is to<br />

recommend best future practices that can be applied to future projects in the Department<br />

and, if relevant, to the wider state sector.<br />

2.6 A second objective for the review is to identify the key drivers and causes of the<br />

cost escalation.<br />

Review Scope<br />

2.7 In order to meet the objectives for the review, its terms of reference have required:<br />

• an evaluation of the end-to-end process of designing, costing, procuring,<br />

scheduling and project management of the new facilities;<br />

• an assessment of the adequacy and quality of approach in these areas against<br />

best practices in the public and private sectors;<br />

• an assessment of project governance and management; and<br />

• a review of the quality and timeliness of reporting to Ministers for capital projects of<br />

this size.<br />

Introduction 6


2.8 As indicated above, the scope of the review includes the Spring Hill and Otago<br />

projects, but regard has been given to the other projects in the RPDP where appropriate.<br />

The scope of the review has also focused on events post completion of consent and<br />

related approvals up to the current day (which for the purposes of the review includes the<br />

period up to approximately March 2006). The scope of this review has specifically<br />

excluded:<br />

• consideration of the regional prisons policy (i.e. the policy has been taken as a<br />

given);<br />

• the commissioning of the facilities; and<br />

• the consents process.<br />

2.9 It should be noted that at the time of undertaking this review, several other, and<br />

related, reviews were also been undertaken in relation to the projects. This includes<br />

various reviews being undertaken by the Department into aspects of the projects’ costs<br />

(e.g. a review of the methodologies for establishing margins and reviews relating to<br />

preliminary and general costs). Where available, the findings of these reviews have been<br />

incorporated into this review. It has not been our intention to duplicate the other work<br />

being undertaken.<br />

Approach to the Review<br />

2.10 Our approach to this review has involved a process of documenting good practices<br />

and comparing actual practices against these. This has assisted in identifying areas<br />

where procurement and management of the projects has met the standards required as<br />

well as those areas where there are opportunities for improvement.<br />

2.11 The assessment of actual practices has relied heavily upon information provided to<br />

us by the Department and on interviews with a range of Department and other personnel<br />

involved with the projects. It is important to note that the interviews were conducted on a<br />

non-attribution basis. The process of reviewing relevant documentation and conducting<br />

interviews took place during April, May and June 2006. After several requests, and the<br />

subsequent receipt of information after completion of draft reports, we have now been<br />

assured by the Department of Corrections that all relevant information to enable us to<br />

complete the review as required has been provided. It is important to note, however, that<br />

the projects that are the focus for this review are still in the process of construction and,<br />

accordingly, fresh and updated information is continually coming to hand. As far as<br />

possible, we have sought to include information up to and including June 2006.<br />

2.12 Reflecting its nature and objectives, this review has not sought to independently<br />

verify the accuracy of the information provided to us. In this regard, the review should not<br />

be interpreted as an audit or inquiry.<br />

<strong>Report</strong> Structure<br />

2.13 The report is structured as follows:<br />

Section Three<br />

Section Four<br />

Section Five<br />

‣ provides some context within which the new prisons have been built.<br />

‣ discusses the causes and drivers of the cost increases.<br />

‣ assesses methodologies and processes in relation to design,<br />

costing, procurement and scheduling.<br />

Introduction 7


Section Six<br />

Section Seven<br />

‣ assesses project governance and management.<br />

‣ comments on reporting to Ministers.<br />

Introduction 8


3 Background<br />

3.1 Before discussing the processes, systems and contracting practices associated<br />

with the new facilities, it is important to outline some of the environmental and contextual<br />

factors bearing upon the prisons project. To varying extents, these factors have had a<br />

significant impact on the approach to, and cost of, the new prison builds.<br />

Prison Population Growth<br />

3.2 The Spring Hill and Otago projects are part of a wider programme of increasing<br />

prison capacity. The Department has been building 325 beds per year on average since<br />

1996 into existing prisons. However, this is not sufficient to meet the expected growth in<br />

the prison population. New prisons have also been required and the Spring Hill and Otago<br />

projects are part of a wider programme referred to as the Regional Prisons Development<br />

Programme (RPDP).<br />

3.3 The RPDP, which was announced in 1997, identified the need for four new<br />

regional corrections facilities, comprising two regional prisons in addition to Spring Hill and<br />

Otago. Both of the other prisons are operational; they are located at Ngawha in Northland<br />

and in Manukau (the recently opened Auckland Women’s facility).<br />

3.4 In 1999, the prison population forecast for 2008 was 6,800. The current forecast<br />

for 2008 is 8,600; a 26% increase. These forecasts are prepared by the Ministry of<br />

Justice. The Ministry’s forecast underpins the Department’s modelling of future prisoner<br />

demand and the optimal build programme to provide additional capacity to meet that<br />

demand. The forecasts have a five year horizon which is significantly shorter than the<br />

lead time for completing a new prison. As a result of this, and reflecting the revised<br />

forecasts, the RPDP has required considerable flexibility to adapt to changing<br />

circumstances. In particular, there have been significant changes to the originally-planned<br />

bed numbers at three of the four regional prisons:<br />

Auckland Women’s ‣ 150 to 286<br />

Spring Hill ‣ 350 to 650<br />

Otago ‣ 220 to 335<br />

3.5 Time pressure is a key issue affecting the RPDP because of the growth in the<br />

prison population. At the time decisions to proceed with the new prisons were taken, it<br />

was clear, and subsequently demonstrated, that new facilities had to be built in order to<br />

accommodate the increased numbers in the prison population. The timeline for<br />

completing the new prisons is tight and completion on time remains a high priority in order<br />

that the growing prison population can be appropriately housed. In recent years the<br />

Department has had to rely on police and court cells to manage the prison population<br />

overflow, a practice which is not desirable. Completing the construction of additional beds<br />

is therefore of utmost priority for the Department.<br />

3.6 In this regard, and notwithstanding many of the points made later in this review, it<br />

needs to be acknowledged that the programme of new prison builds has delivered, and is<br />

delivering, the additional capacity that is needed to meet growth in the prison population.<br />

Moreover, the programme is adding the new capacity more or less within the very tight<br />

deadlines that had to be achieved in order to avoid a situation of demand for beds<br />

Background 9


exceeding available capacity. The significance of this achievement should not be underestimated.<br />

Long Lead Times<br />

3.7 The need for new prisons was foreshadowed as part of the RPDP announcements<br />

in 1997. The Northland and Auckland Women’s facilities were the first two of a four-prison<br />

build programme. The table below indicates some of the milestones associated with the<br />

Spring Hill and Otago projects. As can be seen, the lead times for getting to the point<br />

where prisoners can be accepted is long; in the order of six to seven years.<br />

Design contracts let and site<br />

selection<br />

Spring Hill<br />

Otago<br />

December 2000 - May 2001 September 2001 - June 2002<br />

Construction RFP Issued September 2004 September 2004<br />

CWA Partner Selection October 2004 October 2004<br />

Environment Court Clearance June 2004 December 2004<br />

Earthworks Start November 2004 January 2005<br />

Construction Starts May 2005 April 2005<br />

Planned Construction Completion July 2007 March 2007<br />

Prisoner Induction Commences October 2007 June 2007<br />

Planned prisoner Capacity September 2008 November 2007<br />

3.8 As noted above, the Ministry of Justice provides a five-year forecast of the prison<br />

population. However, the typical consent and construction life-cycle for new facilities is<br />

significantly longer that this. The Department sees this lack of alignment of forecasting<br />

and construction lead-time periods as a constraint on its ability to appropriately plan,<br />

resource and schedule, and deliver capacity to meet demand.<br />

New Design<br />

3.9 Prior to the construction of Northland (which was the first of the four new prisons to<br />

get underway), it had been a relatively long period since the Department has constructed<br />

a new non-remand prison. As alluded to above, growth in prison capacity over prior years<br />

had been achieved through addition to existing facilities rather than “greenfields”<br />

development. Only one new facility (Auckland Central Remand Prison commissioned in<br />

1999) has been completed by the Department prior to the RPDP programme setup.<br />

3.10 By implication, the Department did not have a recent history of deep involvement<br />

in construction and certainly not on the scale of the four prisons which cumulatively have a<br />

cost in the region of $900 million (excluding commissioning).<br />

3.11 Moreover, compared to existing prisons, the facilities proposed for Northland,<br />

Auckland Women’s, Spring Hill and Otago reflected different design and operating<br />

philosophies. Although not part of the brief for this review to investigate these, the<br />

designs underpinning the four new facilities are quite different from what has gone before.<br />

The origins of the new design can be traced to facilities in Australia and Canada. The<br />

physical design of the new prisons in part reflects an intentional policy to promote greater<br />

self responsibility and, ultimately, reduce the incidence of recidivism.<br />

Background 10


3.12 While the merits of the new design are not part of the brief for this review, the new<br />

design is important for the reason that it represented a departure from what had gone<br />

before. Therefore, in terms of estimating the costs of the new prisons, the new design,<br />

coupled with the passage of time since the last major prison build, meant that<br />

benchmarking against the cost of earlier prisons was of limited assistance and relevance.<br />

Moreover, the new designs meant changes in operational policies and practices which, in<br />

turn, spurred considerable iteration between the requirements of the construction team<br />

and of the commissioning team within RPDP. It should be noted also that two main<br />

designs were developed for the four new prisons. In broad terms, the design for<br />

Northland and Spring Hill is comparable, as is that for Auckland Women’s and Otago<br />

(although being a women’s prison, some of the features of Auckland Women’s are specific<br />

to it).<br />

Resource Constraints<br />

3.13 By New Zealand standards, the RPDP projects are large construction projects.<br />

The sheer size of the RPDP project in relation to the New Zealand market has placed<br />

considerable demand on construction, design, and quantity surveyor capability and<br />

capacity. The lack of design capacity and costing capability and capacity had a direct<br />

impact on the timeframe for the development of early cost information in relation to Spring<br />

Hill and Otago.<br />

NIMBY<br />

3.14 The “not in my back yard” phenomenon applies with some force in the context of<br />

prison builds. NIMBY has several implications. In the case of Northland, Spring Hill and<br />

Otago it has been a contributing factor to the remote location of the facilities.<br />

Remoteness, as will be discussed later, has had a significant influence on cost. NIMBY<br />

also means that consent and other approval processes (often involving legal challenges)<br />

can be long-term and result in costs that were not originally planned. This has also been<br />

a factor contributing to the cost increases associated with Spring Hill and Otago.<br />

3.15 From a time perspective, uncertainty created by the NIMBY effect has also<br />

affected the speed with which projects have proceeded through the consenting and other<br />

approval processes. In turn, this has impacted upon the planning for, and management<br />

of, the projects. For example, the Otago project had an unexpectedly smooth run through<br />

the Environment Court which meant that construction was able to start eight months<br />

ahead of plan. While this outcome had several advantages, it also placed extra demands<br />

on the design team at a time when the design team was already stretched with other<br />

work. As discussed later, the time taken to complete detailed design work has important<br />

implications for the estimation of project costs and consequential implications for the<br />

actual cost of the project.<br />

Economic Conditions<br />

3.16 A further factor that has had significant bearing on the projects is the state of the<br />

economy. At the time the four prisons were being built, including, in particular, Spring Hill<br />

and Otago, the construction market was “heated” in the sense of demand outstripping<br />

supply. Prices (rates and margins) were increasing accordingly. Escalation of<br />

construction prices is factored into the estimated costs for the project but, with the<br />

advantage of hindsight, it is clear that the extent of escalation was under-estimated.<br />

3.17 Economic conditions, and the heated nature of the construction market in<br />

particular, have also influenced the procurement method used to construct the four<br />

prisons. Spring Hill and Otago have been constructed under what is referred to as a<br />

Background 11


“Collaborative Working Arrangement” (CWA) agreement. The CWA approach is<br />

discussed further in section 5.<br />

.<br />

Background 12


4 Key Drivers and Causes of Cost Escalation<br />

Key Findings:<br />

• Since Budget 05, further appropriations totalling $140.841 million have been approved in<br />

order to fund the completion of the Spring Hill and Otago projects. This reflected increased<br />

construction costs totalling $157.976 million, together with the off-setting impact of lower<br />

that expected expenditure in other areas (e.g. earthworks and reclassification of some<br />

commissioning costs) totalling $17.135 million.<br />

• The drivers and causes of the construction cost increases include market conditions, the<br />

impact of consent and regulatory requirements and the impact of finalising design.<br />

• Market influences accounted for about 57% of the increase and reflected:<br />

o the heated nature of the construction market which affected labour rates and<br />

margins; and<br />

o substantial increases in key commodities including, in particular, steel which<br />

increased in price by over 26% between June 2003 and June 2005; and<br />

o increased travel and accommodation allowances as a result of having to attract<br />

labour from areas located well away from the construction sites.<br />

• The outcome of the consents process and regulatory changes contributed to higher costs<br />

although the overall impact of these was relatively small (about 6% of the overall cost<br />

increase).<br />

• Design changes following the completion of Northland and additional work on a range of<br />

infrastructure services (drainage, water, roads etc) contributed to the balance of the cost<br />

increase (i.e. approximately 37%).<br />

Lessons Learned:<br />

• The estimates included as part of Budget 05 (and earlier in Budget 04) set expectations<br />

regarding the costs to construct Spring Hill and Otago. The estimates at that time were,<br />

however, based on relatively high-level assessments of possible construction costs given<br />

that detailed designs had not yet been completed. Furthermore, the cost indices relied<br />

upon to escalate costs between Budget 04 and Budget 05, while the best available, had<br />

several limitations. These factors meant that the cost estimates had significant risks and<br />

uncertainties attaching to them. It is important that the risks and uncertainties be<br />

emphasised and clearly communicated so as to avoid creating unrealistic expectations.<br />

• The remote location of the sites (especially Otago) put substantial pressure on local labour<br />

markets. Spring Hill and Otago are major projects. For projects of this size, there is a<br />

need to consider fully the impact on local markets and the upward pressure on resource<br />

costs that is likely to occur.<br />

• Projects of this size also put considerable pressure on local infrastructure which gives rise<br />

to the need for upgrades. These impacts need to be fully assessed and anticipated as part<br />

of initial cost estimates.<br />

• The form of procurement has implications for the Crown in terms of information regarding<br />

fiscal risks. Traditional fixed price forms of contract mean that the Crown is provided with a<br />

quoted price at the start of a project (although the eventual price paid depends on the<br />

extent, if any, of contract variations). In contrast, under the CWA methodology, the<br />

expected cost is not known until the Target Outturn Cost (TOC) is completed. The actual<br />

costs are not known until the project is completed, and any pain-share or gain share<br />

payments have been settled. Until the TOC is in place, there is risk of being exposed to<br />

cost increases relative to preliminary estimates. This highlights the need for timely<br />

completion of the TOC, particularly in a public sector setting where the Crown places a<br />

high premium on cost certainty.<br />

Key Drivers and Causes of Cost Escalation 13


Overview of Cost Increases<br />

4.1 Initial estimates for the cost of constructing Spring Hill and Otago were made as<br />

early as May 2000. However, substantive estimates were not made until late 2003.<br />

These estimates were included as part of the reporting to Ministers in the context of<br />

Budget 04. At that time, the costs associated with Spring Hill and Otago were expected to<br />

be approximately $248 million and $161 million respectively. The estimates indicated as<br />

part of Budget 04 were informed by the tenders submitted for the Northland project.<br />

4.2 The estimates were updated as part of Budget 05 and took account of escalation<br />

since the previous estimates made in 2003. The costs for Spring Hill and Otago reported<br />

as part of Budget 05 were revised upwards to $283 million and $175 million respectively.<br />

4.3 Since Budget 05, costs have risen further. In December 2005, approval was<br />

sought for additional appropriations totalling $140.841 million. This reflected the net effect<br />

of increased construction costs totalling $157.976 million, together with the off-setting<br />

impact of lower than expected expenditure in other areas (e.g. earthworks and<br />

reclassification of some commissioning costs) which totalled $17.135 million (giving a net<br />

increase of $140.841 million).<br />

4.4 The table below summarises the reasons provided to Ministers, as part of the<br />

December 2005 reporting package, behind the significant construction cost increases<br />

between Budget 05 and the numbers reported in December 2005.<br />

Spring Hill<br />

Cost Contributors<br />

($ million)<br />

Market Influences 53.773<br />

Consents and<br />

Regulatory Changes<br />

Escalation 16.640<br />

Labour rates and location 13.123<br />

Margins and overhead 13.570<br />

On-site construction cost increases 10.440<br />

Consents 5.740<br />

Holidays Act, Building Act 1.540<br />

7.280<br />

Design Finalisation 50.650<br />

Changes arising from Northland 13.600<br />

Site works requirements<br />

37.050<br />

• Drainage $11.3<br />

• Ducting $4.6<br />

• Water reticulation $2.9<br />

• Gas reticulation $0.6<br />

• Roading $6.0<br />

• Finishing works & landscaping $10.1<br />

Total Increase 111.703<br />

Key Drivers and Causes of Cost Escalation 14


Otago<br />

Cost Contributors<br />

($ million)<br />

Market Influences 36.635<br />

Consents and<br />

Regulatory Changes<br />

Escalation 11.660<br />

Labour rates and location 9.283<br />

Margins and overhead 7.910<br />

On-site construction cost increases 7.800<br />

Consents 1.570<br />

Holidays Act, Building Act 1.010<br />

2.580<br />

Design Finalisation 7.040<br />

Changes arising from Northland 7.040<br />

Total Increase 46.273<br />

General Comments Regarding Cost Increases<br />

4.5 Several general comments regarding the cost increases can be made. Later in<br />

this section, we comment further on each of the cost contributors.<br />

Supporting Information<br />

4.6 As part of this review, we have sought to assess the data and calculations<br />

underpinning the cost analysis included in the tables above (and which was reported to<br />

cabinet in December 2005). The assessment has been only partially completed. We<br />

have obtained, and been provided with, information that assists in explaining some<br />

aspects of the cost contributors outlined in the tables. This includes some high-level<br />

analysis developed in late November 2005 as retrospective explanation of cost<br />

movements. However, the information provided does not amount to an integrated set of<br />

working papers that assist in verifying the explanation of cost increases provided to<br />

Ministers. For example, while we have information relating to general construction cost<br />

inflation and inflation associated with some specific commodities (e.g. steel) used in the<br />

construction of the facilities, the Department has not been able to provide detailed working<br />

papers which show how the inflation data has been used to calculate the amount of<br />

escalation. Similarly, we have not seen detailed calculations underpinning the estimates<br />

of additional costs attributed to consents and regulatory changes or design finalisation.<br />

Accordingly, we have not been able to independently verify the information provided to<br />

Ministers. The analysis of the factors contributing to cost increases needs, therefore, to<br />

be treated with a reasonable degree of caution and should be regarded as indicative,<br />

rather than definitive.<br />

4.7 Notwithstanding the limited information to enable an assessment of the cost<br />

increases, this should not be interpreted as saying that the total estimated costs reported<br />

in December 2005 are inaccurate. As will be discussed more fully in section 6, the<br />

Key Drivers and Causes of Cost Escalation 15


Department has in place processes for reviewing the cost estimates prepared for each of<br />

the projects. This has involved use of external professional/expert advisers.<br />

Uncertainties With the Earlier Cost Estimates<br />

4.8 The information presented to Cabinet in December 2005 was intended to provide a<br />

link back to earlier cost estimates provided in the context of Budget 05 (and before that,<br />

Budget 04). It is important to appreciate that the earlier estimates were indicative only.<br />

4.9 The Budget 05 (and Budget 04) estimates were based on high-level assessments<br />

of construction cost. At the time of the earlier estimates, detailed designs had yet to be<br />

completed. Accordingly, the earlier estimates had high degrees of risk and uncertainty<br />

attaching to them. The initial estimates were also based on a traditional quantity surveyor<br />

approach to cost estimation which involves assessing the scope of work (e.g. m 2 of floor<br />

space) and attaching a generic rate ($/m 2 ). In contrast, the latest cost estimates reflect<br />

the outcome of applying the CWA methodology. This involves a detailed line by line<br />

assessment of all inputs and processes involved in constructing the facilities. This is a<br />

fundamentally different approach to estimating cost and, accordingly, there is an element<br />

of attempting to compare apples with oranges when comparing latest with earlier<br />

estimates.<br />

Market Influences<br />

4.10 Under the heading of market influences, the Department has apportioned the cost<br />

increases under four headings; escalation, labour rates and location, margins and<br />

overhead and on-site construction costs.<br />

Escalation<br />

4.11 The construction market has been heated over the time period during which Spring<br />

Hill and Otago have been being constructed. Estimated construction costs have been<br />

escalated with reference to the Capital Goods Price Index for Non-Residential Building<br />

(CGPI-NRB). Forecasts of the CGPI-NRB are prepared by the New Zealand Institute of<br />

Economic Research (<strong>NZ</strong>IER) and, as far as we are aware, the <strong>NZ</strong>IER forecasts are the<br />

only ones that are widely available and published quarterly. The CGPI-NRB is produced<br />

by Statistics New Zealand (S<strong>NZ</strong>) and is based on a basket of “model buildings”<br />

determined by S<strong>NZ</strong>. The prices associated with each model building are updated by S<strong>NZ</strong><br />

from the New Zealand Building Economist (<strong>NZ</strong>BE) publication.<br />

4.12 There are several limitations and caveats around the CGPI-NRB index that need<br />

to be taken into account.<br />

• There is considerable uncertainty regarding the degree to which margins and<br />

discounts are incorporated into the <strong>NZ</strong>BE prices.<br />

• S<strong>NZ</strong> seeks to adjust its index numbers to strip out the effect of quality changes.<br />

For example, if the quality of a new building is enhanced and costs are increased<br />

accordingly, the S<strong>NZ</strong> approach will attempt to strip out the quality dimension and<br />

lower the prices accordingly.<br />

• The models being used by S<strong>NZ</strong> were last revised in 2000 and are viewed as being<br />

out-of-date.<br />

Key Drivers and Causes of Cost Escalation 16


• The types of building included in the category of NRB are wide ranging and not<br />

necessarily comparable with penal institutions. Differences in cost escalation<br />

between building types is averaged out.<br />

• The data is not published on a regional basis.<br />

• The data is heavily influenced by trends in the Auckland market which accounts for<br />

35-40% of all building activity.<br />

4.13 <strong>NZ</strong>IER produces forecasts of the CGPI-NRB index using econometric techniques.<br />

The main drivers in their model are the level of non-residential building activity, wages,<br />

employment and producers’ input prices. Based on forecasts issued in December 2004,<br />

the rate of growth in the CGPI-NRB was forecast to be:<br />

• 6.1% for the year ending September 2005;<br />

• 3.2% for the year ending September 2006; and<br />

• 2.5% for the year ending September 2007.<br />

4.14 The forecasts issued in December 04 have, however, generally overstated the<br />

actual increase in CGPI-NRB as shown in the table below.<br />

Date<br />

Forecast Quarterly Change<br />

(issued December 2004)<br />

Actual Quarterly Change<br />

December 2004 1.7% 1.8%<br />

March 2005 1.6% 0.2%<br />

June 2005 1.4% 1.2%<br />

September 2005 1.3% 1.2%<br />

December 2005 1.0% 0.4%<br />

March 2006 0.8% 1.7%<br />

4.15 Notwithstanding that the CGPI-NRB forecasts over-estimated the actual change in<br />

the index at the aggregate level, there is some evidence to suggest that the increase in<br />

construction costs for the Spring Hill and Otago projects were well above the levels of<br />

increase recorded by the CGPI-NRB index. Over the period June 2003 to June 2005, the<br />

CGPI-NRB increased by 13.8%. However, independent advice 1 received by the<br />

Department in relation to Spring Hill indicated that over the period June 2003 to June<br />

2005:<br />

• rates per tonne of steel increased by 26.4%;<br />

• PVC products increased by up to 30%; and<br />

1 Peter Waterhouse - <strong>Report</strong> to RPDP on Construction Costs and Alternative Procurement<br />

Strategies 31 October 2005<br />

Key Drivers and Causes of Cost Escalation 17


• the cost of construction in the hospitals and health categories increased by<br />

between 16.9% and 18.5%.<br />

4.16 However, the same advice noted that concrete supply and concrete products<br />

generally increased by only 4% - 8% and timber framing by 4% - 5%.<br />

4.17 In addition to increases in commodity prices, there were also significant increases<br />

in labour costs (which are another component of the CGPI-NRB).<br />

Labour Rates and Location<br />

4.18 Advice received from Peter Waterhouse (an independent construction cost<br />

consultant) provided evidence of increased labour rates:<br />

• rates for carpenters in Auckland region increased by up to 35%;<br />

• rates for concrete workers increased by up to 29%; and<br />

• rates for labourers increased by up to 25%.<br />

4.19 The remoteness of the Spring Hill and Otago sites also contributed to increased<br />

direct costs.<br />

• In the case of Otago, up to a third of the workforce at peak levels has had to be<br />

imported from outside of the coastal Otago region. This increased the level of<br />

travel and accommodation allowances.<br />

• Additional travel costs added the equivalent of approximately one hour per person<br />

per day to labour costs on the Spring Hill project.<br />

• We understand that the normal level of construction activity in the coastal Otago<br />

area is around $90 million per annum. Clearly, therefore, the Otago project<br />

represents a substantial increase over and above this figure. It is not too<br />

surprising, therefore, that the Otago project has put considerable upward pressure<br />

on costs.<br />

4.20 There is scope for some overlap and, hence, double counting across the various<br />

factors. In particular, the escalation factor measures increases in the costs of completing<br />

buildings. Implicit within the escalation is increases in labour rates, margins, overheads,<br />

materials costs and so on. In theory, therefore, the increases attributed to labour rates,<br />

margins and overheads (and possibly on-site construction costs) in the context of Spring<br />

Hill should be over and above the increases captured by the escalation. We are not<br />

convinced that this is strictly the case, but have no way of verifying it because of the lack<br />

of detailed workings.<br />

Margins and Overhead<br />

4.21 In addition to upward pressure on direct costs, there have also been increases in<br />

margins (which leads to a compounding effect when applied to increased direct costs).<br />

CMS reported to the Department 2 that:<br />

2 Assessment of Profit and Overheads margins for CWA Members dated 4 November 2005<br />

Key Drivers and Causes of Cost Escalation 18


• sub-contractors’ margins have trended upwards by between 3% and 10% in the<br />

years 2002-2005; and<br />

• sub-contractors’ margins in the concrete, carpentry, roofing, painting, tiling and<br />

similar trends have increased by between 2% and 7% over the same period.<br />

4.22 It was also noted, however, that main contractors’ margins had remained relatively<br />

constant or fallen during this period.<br />

On-Site Construction Cost Increases<br />

4.23 This element of cost increase comprises two parts:<br />

• on-site management costs; and<br />

• the outcome of the first-principles approach to building up the TOC.<br />

4.24 Increased on-site management costs have stemmed from requirements to<br />

maintain standards in effectiveness and quality. The projects have involved large<br />

numbers of contractors and this has increased the amount of on-site management<br />

required accordingly. In the case of Otago, more so than Spring Hill, the net for<br />

contractors has had to be cast more widely than was originally anticipated. These costs<br />

have been offset in some measure through efficiency gains including economies gained<br />

through procurement on a whole-of-site, rather than individual contractor, basis (e.g. sitewide<br />

cranes and scaffolding).<br />

4.25 The second, and more general aspect to cost increases reflects the approach to<br />

determining the TOC and the fact that it is fundamentally different to that used in a<br />

traditional <strong>NZ</strong>S 3910 approach to procurement. The determination of the TOC is a<br />

bottom-up, line by line, build up of all the costs involved in the project. In our view, there<br />

is an inherent risk in this form of costing toward overstatement of costs compared to a<br />

more traditional fixed price approach which focuses on tendering a price that the supplier<br />

believes will be price competitive (notwithstanding any loading for a risk premium). In a<br />

sense, therefore, the increased cost attributed to on-site construction is a reflection of the<br />

inherent difference between CWA and traditional fixed price contracts. While the<br />

magnitude of this might not be known ahead of the TOC’s development, the risk of<br />

increased cost due to the different approach should be acknowledged. In this context, we<br />

note that the Treasury received advice in March 2004 from Opus which, among other<br />

matters, noted that CWA involves a new (compared to traditional fixed price contracts) risk<br />

assessment and cost estimate framework and that this needed to be allowed for in<br />

reporting and funding approvals.<br />

4.26 The risks associated with the “bottom-up” approach to costing are managed,<br />

however, through the process of exposing the cost estimates to review by all CWA<br />

members, including the Department and its advisers. In our view, while such processes<br />

can go a long way to mitigating the inherent risks associated with “bottom-up” approaches<br />

to costing, there is there is the potential for a residual element of cost bias compared to<br />

the situation of a competitive fixed price contract.<br />

Consents and Regulatory Changes<br />

4.27 Much of the cost associated with consent requirements involved additional<br />

investment in water and wastewater services. In general, the existing infrastructure of the<br />

relevant local authorities did not have the capacity to deal with the additional demands<br />

created by the new prison facilities. The level of investment required reflected the<br />

Key Drivers and Causes of Cost Escalation 19


outcome of negotiations with relevant local authorities. There were also some changes in<br />

Ministry of Health standards relating to water treatment and waste-water discharge.<br />

4.28 Other regulatory changes related to the Holidays Act. These changes resulted in<br />

additional labour costs. We note that the additional costs stemming from the Holidays Act<br />

should be reflected in the CGPI-NRB and so there is some risk that this element of the<br />

overall cost increase is being captured twice.<br />

Design Finalisation<br />

4.29 According to the advice presented to Cabinet in December 2005, completion of<br />

detailed design works at Spring Hill (which occurred subsequent to the reporting in April<br />

2005) identified a number of additional items, the total cost of which amounted to $37.050<br />

million or roughly 10% of the total project cost. These included:<br />

• site drainage ($11.3 million);<br />

• underground ducting and future proofing ($4.6 million);<br />

• water reticulation and management ($2.9 million);<br />

• gas reticulation ($0.6 million);<br />

• access roads and car parking ($6 million); and<br />

• finishing works and landscaping ($10.1 million).<br />

4.30 This is a significant amount. Although the reason behind these changes is<br />

referred to as being a function of completing detailed design work, we understand that<br />

some of the changes are also a function of the outcome of the consents process. In<br />

particular, the consent process lead to some significant design changes, including moving<br />

building platforms. This had flow-on consequences for infrastructural services such as<br />

drainage and utilities reticulation. A general difficulty facing the Department is that when<br />

such changes are being discussed/negotiated as part of the consents process, the cost<br />

impact is not necessarily known with any degree of precision.<br />

4.31 As far as we are aware, Ministers were not advised of these additional costs until<br />

the December 2005 report to Cabinet. In our view, the prospect of additional costs in<br />

these areas would have been known at the time of Budget 05 even though the scale of<br />

cost would not have been known at that stage. Given the scale of the additional cost,<br />

more forewarning of Ministers could have occurred.<br />

Summary<br />

4.32 Many factors have contributed to the increase in costs over and above those<br />

reported as part of Budget 05. The underlying drivers of these can be summarised as<br />

follows:<br />

• the heated nature of the construction market which resulted in higher input costs<br />

(materials and labour);<br />

• international trends for the price of steel;<br />

• the remote location of the sites which has given rise to additional allowances;<br />

Key Drivers and Causes of Cost Escalation 20


• the impact of the projects on local infrastructure;<br />

• the outcome of consent hearings and negotiations; and<br />

• the impact of various regulatory changes.<br />

Lessons Learned<br />

4.33 The Spring Hill and Otago projects have experienced substantial cost increases.<br />

Approximately 57% of the increase in costs since those reported in Budget 05 stems from<br />

the heated nature of the construction market; something that the Department had no<br />

control over.<br />

4.34 Notwithstanding this, there are several steps that can be taken to minimise large<br />

fiscal surprises. The first of these steps is to be clear as to the risk and uncertainty<br />

attaching to early cost estimates. The estimates included as part of Budget 05 (and<br />

earlier in Budget 04) set expectations regarding the costs to construct Spring Hill and<br />

Otago. The estimates at that time were, however, based on relatively high-level<br />

assessments of possible construction costs, given that detailed designs had not yet been<br />

completed. Furthermore, the cost indices relied upon to escalate costs between Budget<br />

04 and 05, while the best available, had several limitations. These factors meant that the<br />

cost estimates had significant risks and uncertainties attaching to them. There is a need<br />

to ensure that the risks and uncertainties involved are clearly identified and<br />

communicated, especially to Ministers who might otherwise think that the estimates are<br />

relatively certain.<br />

4.35 The remote location of the sites (especially Otago) put substantial pressure on<br />

local labour markets. This has added to cost in terms of having to pay more to attract<br />

labour and the cost of upgrading local infrastructure. In developing initial estimates of<br />

cost, there is a need to take into account, as far as possible, local impacts and conditions<br />

and assess the implications for high-level estimates of cost. Spring Hill and Otago are<br />

major projects. For projects of this size, there is a need to consider fully the impact on<br />

local markets and the upward pressure on resource costs that is likely to occur.<br />

4.36 Projects of this size also put considerable pressure on local infrastructure which<br />

gives rise to the need for upgrades. These impacts need to be fully assessed and<br />

anticipated as part of initial cost estimates.<br />

4.37 The form of procurement has implications for the Crown in terms of information<br />

regarding fiscal risks. Traditional fixed price forms of contract mean that the Crown is<br />

provided with a quoted price at the start of a project (although the eventual price paid<br />

depends on the extent, if any, of contract variations). In contrast, under the CWA<br />

methodology, the expected cost is not known until the Target Outturn Cost (TOC) is<br />

completed. The actual costs are not known until the project is completed, and any painshare<br />

or gain share payments have been settled. Until the TOC is in place, there is risk of<br />

being exposed to cost increases. This highlights the need for timely completion of the<br />

TOC, particularly in a public sector setting where the Crown places a high premium on<br />

cost certainty.<br />

4.38 Overall, the magnitude of the increases signals that large projects of this type<br />

involve significant levels of fiscal risk. In turn, this emphasises the need for robust<br />

procurement strategies and tight project governance, management and reporting. These<br />

requirements are assessed further in the following two sections of this report.<br />

Key Drivers and Causes of Cost Escalation 21


5 Methodology and Processes: Design, Costing,<br />

Procurement and Scheduling<br />

Key Findings:<br />

• A key feature of the Spring Hill and Otago projects is that they have involved the use of the<br />

Collaborative Working Approach (CWA) methodology. This methodology is relatively new<br />

to New Zealand, although it is used by Transit for some road projects.<br />

• A hybrid form of CWA was used for the Northland project and it was key to overcoming<br />

some issues that were threatening to disrupt progress with that project.<br />

• The collaborative approach implied by the CWA methodology, the advantages offered by<br />

CWA and the positive experience with CWA in the context of Northland led the Department<br />

to use CWA for the other regional prisons, including Spring Hill and Otago.<br />

• The way in which the Department has applied the CWA methodology has enabled it to<br />

benefit from many of the advantages inherent in the CWA approach. In particular:<br />

– there has been close integration of design, construction and commissioning teams<br />

which assists in achieving an optimal balance between design, construction and<br />

operational requirements;<br />

– several value management reviews have been undertaken to further optimise designs<br />

and take out unnecessary costs;<br />

– at a site level, resources have been mobilised to deal with day-to-day issues, thereby<br />

increasing the efficiency of on-site resource utilisation;<br />

– the collaborative approach to dealing with issues has helped to maintain momentum<br />

with the projects, thereby enabling the timing of projects to be completed on, or near<br />

to, expectations;<br />

– high levels of transparency in relation to costs have been achieved at the project level<br />

consistent with the “open-book” philosophy that underpins CWA (with some opportunity<br />

for more transparency over margins – see below); and<br />

– costs have been exposed to extensive third party scrutiny and review.<br />

• Overlaying all of these benefits, the methodology chosen by the Department means that it<br />

is on track to deliver Spring Hill and Otago in time to meet expected prison population<br />

requirements. There were sufficient indications to suggest that, had the Department<br />

elected to follow a traditional procurement method, timeframes for completing the projects<br />

would probably not have been met.<br />

• Notwithstanding these benefits, there are aspects of the way in which methodology and<br />

supporting processes have been applied that can be improved. In particular:<br />

– analysis of the reasons for preferring CWA ahead of other procurement options was<br />

not sufficiently documented;<br />

– the timing for completing the TOC has not conformed with good practice. However, key<br />

reasons behind this were delays in completing designs caused by changes in the<br />

scope of facilities, lack of design resource and shortage of experienced costing<br />

resources. To avoid delays to the projects (and the problems this would cause in<br />

terms of accommodating the increasing prison population), the Department decided to<br />

proceed with the projects; and<br />

– while there is good transparency over costs at the project level, the Department does<br />

not have visibility over margins. As a result, it is dependent on the advice of third<br />

parties.<br />

Methodology and Processes: Design, Costing, Procurement and Scheduling 22


Lessons Learned:<br />

• Notwithstanding the advantages offered by the CWA methodology, there are also some<br />

risks involved and the methodology requires considerable management resource.<br />

• CWA will not be suited to all projects. There is a need to identify the conditions under<br />

which CWA is likely to be preferred ahead of more traditional fixed price contracts. Factors<br />

to take into account include the size and complexity of project, the level of uncertainty (e.g.<br />

technological change and design requirements), and the timeframes for project completion.<br />

Projects should be evaluated against these, and other, factors before the choice of<br />

procurement method is made. The decision and underlying reasons should then be<br />

documented.<br />

• The CWA methodology requires careful and experienced management to protect the<br />

Crown’s interests. A blend of competencies and experience (commercial, construction and<br />

public sector management) are required for effective management. For future projects of<br />

this size and complexity, sponsoring agencies need to be confident that they have the<br />

appropriate mix of competencies and these are represented within the CWA Principal’s<br />

Group.<br />

• The way in which the Department has implemented CWA means that there has not been<br />

the usual market testing of prices through obtaining competitive quotes. The CWA<br />

methodology can be modified, however, by seeking indicative target costs as part of the<br />

CWA member selection process. This can go some way toward providing more<br />

information on likely costs. However, this modification to the selection process requires<br />

extra time and resources to complete the tender evaluation. Given the extra costs and<br />

time involved, it may not be appropriate in all circumstances to modify the selection<br />

process in this way, but at the least, consideration should be given to this option.<br />

• The development of the TOC is a central part of the CWA methodology. It needs to be<br />

finalised sooner than has been the case with respect to Spring Hill and Otago. Specifically,<br />

the TOC should ideally be completed at, or about, the time construction commences. In<br />

order to achieve this, there needs to be:<br />

o as much flexibility as possible over the lead time for constructing a prison;<br />

o appropriate levels of capacity to undertake detailed design work once CWA<br />

members have been agreed;<br />

o agreed standards against which to base designs; and<br />

o continual pressure on the commercial CWA members from the Department to<br />

achieve timely completion of the TOC.<br />

• Until the draft TOC is well developed, estimates of construction cost should be seen as<br />

indicative only. Pre-TOC estimates of cost involve significant levels of risk and uncertainty<br />

and this needs to be made clear.<br />

• Once TOC estimates begin to emerge, there should be transparent reporting of these to<br />

provide the Department and, as appropriate, Ministers with opportunities to explore options<br />

for saving cost if budgets are under pressure.<br />

Methodology and Processes: Design, Costing, Procurement and Scheduling 23


Introduction<br />

5.1 In this section, the methodology and processes employed by the Department to<br />

design, cost, procure and schedule the projects is reviewed. Relatively more emphasis is<br />

given to procurement. This is because the Department chose to use the CWA<br />

methodology for the procurement of Spring Hill and Otago. CWA is not a common form<br />

of procurement in New Zealand, although it is used by Transit on some road projects.<br />

Reflecting the relative newness of the CWA methodology in the New Zealand context, the<br />

Department’s experiences with it provide some valuable insights as to its advantages and<br />

disadvantages compared to more traditional forms of procurement.<br />

Design<br />

5.2 The origins of the design for the Spring Hill and Otago facilities have linkages with<br />

designs in Australia and Canada. As noted in section three, the design for Spring Hill was<br />

broadly aligned with that for Northland and the design for Otago was broadly based<br />

around that for Auckland Women’s. That said, however, there are significant differences.<br />

For example, Otago involves differences in heating, ventilation and insulation reflecting<br />

the cooler climate. Otago also has other design differences compared to Auckland<br />

Women’s which is a women’s prison. Similarly, the different scale of Spring Hill and<br />

Northland led to some design differences.<br />

5.3 We have not reviewed in any detail the approach to the development of the<br />

designs used for Spring Hill and Otago given that the origins of the designs pre-date both<br />

of these projects. Notwithstanding this, several points can be noted.<br />

• The CWA methodology has the advantage of promoting close interaction between<br />

the construction contractors, the design teams and the client in the development of<br />

detailed designs. In contrast, under traditional forms of procurement, it is not<br />

unusual for design contracts to be let, followed by construction contracts once<br />

designs are largely completed. The advantage of the more integrated approach<br />

under CWA is that there is greater scope for assessing the implications of design<br />

on construction and on operations and, hence, greater scope to adjust designs to<br />

achieve the optimal balance between design, construction and operational<br />

considerations.<br />

• The Northland project was the first of the prisons to use the new style of facility.<br />

Several lessons were learned from the construction of Northland that assisted in<br />

refining the design to achieve better outcomes from an operational viewpoint.<br />

Reflecting the relative newness of the design, the Department developed<br />

standards through the design process for Northland. It was only following the<br />

completion of Northland that standards were finalised and documented. The<br />

Department took advantage of these lessons by incorporating them into the Spring<br />

Hill and Otago projects.<br />

• The relative newness of the prison design also placed added pressure on design<br />

resources. These resources were, at times, stretched. In the case of Otago,<br />

pressure was incurred through the reallocation of design resources from Otago to<br />

Auckland Women’s (approx June – December 2004) to address the capacity<br />

increase from 150 beds to 286 beds.<br />

• Although outside the scope of this review, we note that there were issues around<br />

design in the case of the Northland project. As discussed later in this section, the<br />

Methodology and Processes: Design, Costing, Procurement and Scheduling 24


Costing<br />

CWA methodology provided a mechanism for addressing these issues and for<br />

ensuring those difficulties were not repeated for Spring Hill and Otago.<br />

5.4 The approach to costing has several phases:<br />

• various initial cost estimates, based on high level $/bed comparisons were made in<br />

2000 for Spring Hill and Otago. These were updated at various points over the<br />

period 2001 to 2003;<br />

• more substantive estimates were made as part of Budget 04. These were<br />

subsequently updated as part of Budget 05 to take into account construction price<br />

increases over the intervening period; and<br />

• the latest cost estimates were reported to Cabinet in December 2005. These<br />

estimates incorporate the outcome of the detailed work that has been undertaken<br />

as part of the development of the TOC for both projects.<br />

5.5 We focus on the second and third of these phases. The initial phase of cost<br />

estimates in 2000 – 2003 should be seen as preliminary only. They did not have any<br />

material bearing on whether or not to proceed with the Spring Hill and Otago projects (or<br />

to what specification) as the key funding decisions were taken as part of Budget 04 and<br />

Budget 05.<br />

Budget 04 Estimates<br />

5.6 The majority of the funding for Otago was approved as part of Budget 04 (and<br />

significant funding decisions were also taken with respect to Spring Hill). Accordingly, the<br />

estimated completion costs provided as part of Budget 04 took on considerable<br />

significance. At that time, the costs for Spring Hill and Otago were signalled to be $248<br />

million and $161 million respectively.<br />

5.7 Because of the importance attaching to the estimates provided at that time, it is<br />

important to understand the context within which the estimates were provided and the<br />

basis upon which they had been developed.<br />

• The outcome of the Northland tender was taken into account in developing the<br />

estimates of cost for Spring Hill and Otago. The tender was analysed and the<br />

rates were applied to an area schedule for Spring Hill and Otago. The significance<br />

of this is that the prices tendered for Northland were approximately $12 million<br />

above the estimates for Northland pre-tender. In the case of Otago, estimates<br />

developed in connection with Auckland Women’s were also used to inform the<br />

rates for Otago. Auckland Women’s was, at that time, at the “developed design”<br />

stage with several detailed estimates having been completed.<br />

• Northland was tendered as a traditional <strong>NZ</strong>S 3910 form of contract (only later did<br />

the procurement method for Northland modify into a hybrid form of CWA). By<br />

implication, while the tender prices for Northland were visible to the Department,<br />

the actual costs associated with the project were not transparent (as is always the<br />

case with <strong>NZ</strong>S 3910 contracts).<br />

• The estimates were made by the Department with input from its independent<br />

quantity surveyors – Rider Hunt. At the time of Budget 04, the RFP for the Spring<br />

Methodology and Processes: Design, Costing, Procurement and Scheduling 25


Hill and Otago projects had yet to be issued, so the estimates were made well in<br />

advance of the CWAs being formed.<br />

• The estimates made as part of Budget 04 were based on concept designs.<br />

Detailed design work had yet to occur. By implication, the Budget 04 estimates<br />

could only be indicative at best.<br />

• The approach to estimating costs at that time rested on applying $ rates per M 2 of<br />

gross floor area (taking into account the Northland tender prices). However,<br />

benchmarking the rates applied to Spring Hill and Otago with other projects,<br />

including Northland, was problematic because of the greenfield nature of the<br />

Spring Hill and Otago sites. With the advantage of hindsight, it is also apparent<br />

that the remoteness of the Spring Hill and Otago sites has played a significant part<br />

in explaining the differences between the latest estimates of cost and the<br />

estimates communicated in Budget 04.<br />

5.8 In short, the basis upon which the Budget 04 estimates rested were, at best,<br />

indicative only. Reflecting the basis upon which they had been developed, the estimates<br />

provided as part of Budget 04 had quite high levels of risk and uncertainty attaching to<br />

them. However, the indicative status of the cost estimates could have been made clearer<br />

in the business cases submitted to Cabinet as part of Budget 04. Because the cost<br />

estimates were presented to three decimal places consistent with Budget process<br />

requirements, there is a risk that Ministers would have interpreted the estimates as<br />

conveying a high degree of certainty. Any such perception needed to be corrected.<br />

5.9 The business cases submitted as part of Budget 04 noted that escalation was a<br />

significant risk for the Department (and, by implication, the Crown). However, the<br />

magnitude of the risk was not quantified. Ministers could not have gauged from the<br />

business case whether the risk amounted to a small amount or, as it turned out, tens of<br />

millions of dollars. In our view, there was a need to indicate more clearly the status of the<br />

cost estimates including, in particular, the level of certainty attaching to the estimates.<br />

5.10 We note that contingency funding was also provided for, but the interpretation of<br />

what the contingency represented was not made clear in the business case presented to<br />

Ministers.<br />

Budget 05 Estimates<br />

5.11 The next major reporting milestone to Cabinet was in April 2005 as part of Budget<br />

05. At that time, the costs associated with Spring Hill and Otago had been revised<br />

upwards to $283 million and $175 million respectively. In the case of Spring Hill, the<br />

explanation provided to Cabinet for the increase of approximately $34.5 million since<br />

Budget 04 was not particularly clear but appeared to be a function of adjustment for<br />

further escalation. With respect to Otago, the total estimated cost increased by<br />

approximately $13.8 million compared to Budget 04. Almost all of the increase was<br />

attributed to escalation (there was a further small amount relating to commissioning).<br />

5.12 At the time of Budget 05, work on Northland and Auckland Women’s was<br />

underway. However, both projects were of limited usefulness in terms of informing cost<br />

estimates for Spring Hill and Otago.<br />

• Northland has a hybrid form of CWA. As such, the project was being completed<br />

under fixed price conditions and the Department did not have visibility over the<br />

actual costs being incurred by the project.<br />

Methodology and Processes: Design, Costing, Procurement and Scheduling 26


• Auckland Women’s was a full CWA approach and progress reports indicated that<br />

costs were tracking according to plan and, accordingly, did not provide any earlywarning<br />

signals of impending cost issues that were to affect the Spring Hill and<br />

Otago projects.<br />

• The Auckland Women’s would not have provided detailed insights regarding<br />

Spring Hill in any event given the different designs between the two facilities (and<br />

to some extent the same point applied with respect to Otago which is a men’s<br />

prison).<br />

December 2005 Estimates<br />

5.13 During the period from April 2005 to October 2005, work on the TOC for Spring Hill<br />

and Otago proceeded (at the same time that construction was also proceeding).<br />

5.14 The TOC is, in effect, the agreed budget for the project. It is intended to include all<br />

project costs except those specifically defined and agreed as being excluded and, hence,<br />

the responsibility of others. The TOC is, in theory, a pre-construction estimate of the<br />

efficient level of cost to complete the project. It has the following components:<br />

• Direct costs. These comprise labour, materials and plant. Labour rates are<br />

“burdened” to reflect personnel-related costs such as ACC, sick leave, annual<br />

leave and, if appropriate, allowance for travel time, protective clothing and so on.<br />

In the context of the RPDP, the process of calculating burdened labour rates has<br />

been undertaken by CMS and reviewed by Sherwin, Chan & Walshe. There is<br />

also a burdened rate for plant that includes depreciation, repairs and maintenance<br />

and consumables (e.g. fuel).<br />

• Normalised Profit Margins. Each contractor (and sub-contractor) that is part of the<br />

CWA can expect to earn their “normalised” profit margins in addition to recovering<br />

their actual costs and overheads contribution. In the case of the RPDP projects,<br />

normalised profit margins have typically been established with reference to the<br />

previous three years financial accounts of the contractor. Adjustments have been<br />

made to smooth out unusual/abnormal profit results (either good or bad), the<br />

current state of the construction market and levels of risk involved. This work has<br />

also been performed by CMS and reviewed by Sherwin, Chan & Walshe. Once<br />

margins are determined, they are “ring-fenced”; that is, the dollar value assigned to<br />

margins does not change unless there is a substantial change to the scope of work<br />

involved.<br />

• On-site overheads (also referred to as Preliminary and General or P&G). This<br />

includes, for example, the costs associated with on-site project managers and<br />

management team, project offices, site stores, administration staff and so on.<br />

• Off-site overheads. This recognises that an element of the off-site corporate (e.g.<br />

head office) overhead is needed in order to support the project. As with the<br />

margins calculation, a normalisation process is involved with off-site overheads<br />

and once the level of off-site overhead is determined, it is “ring-fenced”.<br />

5.15 It is important to emphasise that the TOC focuses on cost. In contrast, under a<br />

traditional <strong>NZ</strong>S 3910 form of contract, the tender quoted is a price; that is, it is the amount<br />

the client pays for the project as distinct from what it actually costs to complete the project<br />

(subject to any agreed variations). Because the TOC focuses on cost as distinct from<br />

price, it implies a fundamentally different basis for the allocation of financial risk. Under a<br />

Methodology and Processes: Design, Costing, Procurement and Scheduling 27


strict fixed price contract, financial risk is substantially borne by the provider (although<br />

provisions relating to contract variations can result in sharing of financial risk). In contrast,<br />

under a CWA as adopted by the Department, it is not until the project has been completed<br />

and the final costs accounted for, that the client has certainty over the total amount<br />

payable for the project.<br />

5.16 Although not accepted by the Department at the time of preparing the report that<br />

went to Cabinet in December 2005, the TOCs were at an advanced stage. The draft<br />

TOCs indicated that costs had increased to $381 million and $218 million for Spring Hill<br />

and Otago respectively.<br />

5.17 The December 05 report to Cabinet included a description of the factors leading to<br />

the cost increases compared to the Budget 05 estimates. In brief, the contributing factors<br />

were grouped under the headings of market influences, regulatory and consent changes<br />

and omissions from earlier estimates (items seen by the Department as not previously<br />

included rather than items inadvertently overlooked). While the increases and underlying<br />

causes are site-specific, in the case of escalation, there is considerable overlap between<br />

the two sites and this issue is considered first.<br />

5.18 From the Crown’s perspective, it has a keen interest in achieving project<br />

completion on time, within budget and to specification. In normal fixed price contracts,<br />

price is established up front as part of the tender process (although actual price outturn is<br />

often the subject of contract variations). The way in which CWA has been used by the<br />

Department means that there is no price information arising from the selection process.<br />

Development of the TOC (and related QRA and gain/pain share arrangements) is,<br />

therefore, of critical importance, particularly from a fiscal management perspective.<br />

5.19 Building the TOC is not a straightforward process. In very general terms, the<br />

processes around its development are illustrated below.<br />

er<br />

Pre-tend<br />

phase<br />

Concept<br />

Scheme Design<br />

Detailed Design<br />

Negotiating Framework<br />

Agreement Phase<br />

Risk Identification<br />

Quantified Risk<br />

Assessment<br />

Direct Costs<br />

Margins<br />

Overheads<br />

Independent QS review<br />

Labour & Plant<br />

Burdening<br />

Independent<br />

Normalisation<br />

Audit<br />

Normalisation<br />

Draft Total Outturn Cost<br />

Value Management<br />

CWA<br />

Agreement<br />

Phase<br />

Agree TOC, QRA and<br />

Gain / Pain Share<br />

Agree CWA Agreement<br />

Methodology and Processes: Design, Costing, Procurement and Scheduling 28


5.20 Several points should be noted.<br />

• Detailed designs need to be in place before any serious attempt can be made at<br />

determining the TOC.<br />

• The time taken to develop the TOC once detailed designs are completed will<br />

depend on the size and complexity of the project. However, as a guide to good<br />

practice, a time frame of 2-4 months should be expected.<br />

• The process of determining the TOC is heavily dependent on transparency of<br />

financial and other data and on independent scrutiny of the numbers, assumptions<br />

and calculations. In general, CWA involves an “open book” approach to the<br />

determination of costs. Transparency and independent scrutiny are the<br />

mechanisms through which assurance is gained that costs are efficient (on the<br />

assumption that there is no market testing of the cost estimates through a tender).<br />

•<br />

estimates of the TOC may exceed this expectation in which case a process of<br />

•<br />

The process is very iterative. The client will (should) have a budget in mind. Initial<br />

value engineering is used to strip out unnecessary expenditure and explore more<br />

cost effective ways of achieving the client’s requirements and budget expectations.<br />

A lot hinges on getting the TOC in place as soon as possible. Until the TOC is<br />

agreed, the commercial CWA partners are remunerated according to the actual<br />

costs they incur. Until the process of independent scrutiny of direct costs, audit of<br />

margin, overhead and burdening calculations and value management is<br />

completed, the client does not have final assurance that the estimated costs<br />

represent an efficient level of costs. Moreover, until the TOC is in place, the gain<br />

and pain share arrangements cannot be finalised. The gain/pain share provide an<br />

important and further spur to efficiency and delivery of the project within, or in<br />

excess of, client expectations.<br />

5.21 In relation to this last point, a key point to understand with alliancing is that while it<br />

offers benefits over traditional contracting methodology, it raises new and different risks<br />

that have to be managed. In particular, there is a balance to be struck between having<br />

faith in the collaborative nature of alliancing and the need to protect the client’s financial<br />

interests. CWA does not involve a fixed price from the client’s perspective.<br />

TOC Development Timing<br />

5.22 The TOC plays a pivotal role in CWA agreements. At the time that the Spring Hill<br />

and Otago tenders were awarded (to Mainzeal and Hawkins respectively), there was an<br />

expectation that the CWA Agreement and TOC would be finalised within a matter of<br />

months. Negotiation Framework Agreements 3 (NFAs) were entered into with the CWA<br />

partners at both Spring Hill and Otago. In both cases, the NFA was agreed through to 15<br />

January 2005 during which the parties would work together to develop an accurate TOC.<br />

It is worth noting that, in the context of the Auckland Women’s project, it was expected<br />

that approximately nine weeks would be required to finalise the CWA (including TOC). 4<br />

3 NFAs are interim arrangement pending formalisation of the CWA Agreement. They do not<br />

represent the award of any contract, but signal the intention to enter into a CWA Agreement. NFAs<br />

set out various matters governing the negotiations leading toward a CWA Agreement.<br />

4 RPDP Steering Group meeting of 30 March 2004<br />

Methodology and Processes: Design, Costing, Procurement and Scheduling 29


5.23 In the event, the development of the TOC has taken considerably longer than the<br />

initial expectation. In respect of Spring Hill, the Steering Group accepted the TOC as<br />

presented on 21 June 2006 and the CWA Agreement is being finalised for execution. In<br />

the case of Otago, the TOC was approved by the CWA commercial members and the<br />

Department on 25 May 2006. The CWA Agreement is currently with the CWA members<br />

for execution.<br />

5.24 The NFAs for Spring Hill and Otago have been rolled over multiple times (at least<br />

7 times in the case of Spring Hill since October 2004). On several occasions, the roll-over<br />

of the NFA took place after the expiry of the preceding agreement. It is not clear what the<br />

legal position of the parties was on such occasions. At several points during 2005,<br />

revised timetables for completing the TOC were advised to the Steering Group. For<br />

example, in May 2005, it was expected that 30% of the Spring Hill project would be<br />

scoped into a TOC by mid-July 2005 with 80% scoped by mid-August. By implication,<br />

there was clear expectation that elements of the Spring Hill TOC would be progressively<br />

known through the middle of calendar-2005, but we note that the numbers around the<br />

TOC were not being communicated to the Steering Group during this time.<br />

5.25 In the case of Spring Hill, the Department considered in mid-May 2005 whether to<br />

delay construction work until the TOC was in place or to proceed on a fast-track basis.<br />

The latter option was taken on the understanding that the first TOC would be available in<br />

mid-July 2005. In the event, this deadline was not met. It was not until around late-<br />

September that the TOC for Spring Hill was beginning to be disclosed and slightly earlier<br />

in the case of Otago.<br />

5.26 The long period over which the TOC was developed created financial risk for the<br />

Department. During the period prior to completion of the TOC, the commercial CWA<br />

members are effectively reimbursed according to cost. While such costs are transparent<br />

and subject to review by the Department and independent advisers, the fact that critical<br />

TOC information did not emerge sooner meant that the Department (and Government<br />

more generally), was denied opportunities to consider options for reducing cost in light of<br />

the higher than expected cost. Moreover, prior to agreeing the TOC, it was not possible to<br />

agree the gain and pain share arrangements. As a result, the added incentives that these<br />

arrangements bring were missing. In the case of Otago and, to a somewhat lesser extent<br />

Spring Hill, the timing of the TOC meant that the projects were well underway before the<br />

TOC was agreed. This situation is not consistent with best practice CWA methodology.<br />

5.27 The fact of the substantial delay in getting the TOC in place obviously raises the<br />

question as to why the delay occurred. In this respect, we consider that there is a<br />

combination of factors.<br />

• The Department had no experience in CWA methodology. Experience in CWA<br />

was being gained as work on the RPDP projects progressed.<br />

• Pressure on design teams meant detailed designs took longer to finalise than was<br />

expected (detailed designs are a necessary prerequisite for TOC development).<br />

We understand that the issue around design related more to building services than<br />

to the buildings themselves (for example, designs for underfloor heating for Otago<br />

were not complete until August 2005).<br />

• The sheer volume of work involved in reviewing and independently verifying TOC<br />

estimates is considerable. We consider this was under-scoped by the Department<br />

and its advisers.<br />

Methodology and Processes: Design, Costing, Procurement and Scheduling 30


• The CWA methodology has been pushed down the supply chain to a very<br />

•<br />

•<br />

considerable extent. We understand that at the time of this review, approximately<br />

95% by value of the cost incurred and committed on Spring Hill was captured by<br />

the CWA methodology (i.e. only 5% or work was being performed under standard<br />

<strong>NZ</strong>S 3910 procurement). We question whether it is sensible to drive the level of<br />

CWA as far as this. A consequence of this approach is that it adds significantly to<br />

the workload involved in developing a TOC. Our understanding is that the<br />

successful Auckland Women’s project had around 60% of cost under a CWA<br />

arrangement.<br />

There is a large number of partners involved in the CWA (there are 17 CWA<br />

members on the Otago project). The remoteness of the sites, particularly in<br />

Otago, has meant that the net for contractors has had to be cast widely so much<br />

so that, at the peak, approximately a third of the workforce on the Otago site is<br />

“imported” from outside of the coastal Otago area. Increasing the number of<br />

contractors increases the number of margins and overheads that have to be<br />

calculated. More fundamentally, the larger the number of CWA members, the<br />

more training in CWA that needed to be undertaken.<br />

There was generally insufficient experienced estimation and cost planning<br />

expertise available in the market and who were capable of undertaking the first<br />

principles approach to cost determination that is characteristics of CWA.<br />

Moreover, the expertise that did exist was more used to short-term projects rather<br />

than the major and long-term nature of the prisons project.<br />

• Governance and project management arrangements prior to changes in mid – late<br />

2005 have not, in our view, been as tight as they needed to be. This point is<br />

discussed further in the next section. However, issues regarding project<br />

management meant that the range of factors that were impacting on the timeliness<br />

of the TOC were not being managed as closely as they warranted.<br />

• The commercial CWA members, who were being reimbursed for costs incurred,<br />

did not necessarily face strong incentives to expedite the development of the TOC.<br />

That said, however, we note that incentives can change. For example, we<br />

understand some of the CWA principals involved in the Otago project entered into<br />

an arrangement to underwrite risks faced by some of the sub-contractors,<br />

stemming from potential time delays. This may well have contributed to the more<br />

timely completion of the proposed TOC for the Otago project (taking into account<br />

the design issues noted above).<br />

5.28 In summary, several resource constraints impacted on the timeliness of the TOC.<br />

These included pressures on scarce design resources and a relative lack of experienced<br />

estimation and cost planning expertise. The timeliness of the TOC was also influenced by<br />

the hea vy demands being placed on management of the CWA in part reflecting the extent<br />

to which the CWA has been driven down the supply chain. The resource constraints and<br />

demand pressures are, however, matters that are capable of being anticipated and<br />

managed.<br />

5.29 Notwithstanding these points, the Department faced a difficult set of<br />

circumstances. The need to maintain progress with the projects so as to ensure their<br />

completion in time to meet expected prison population growth meant that the option of<br />

delaying the project pending completion of the TOC was not a realistic option.<br />

Methodology and Processes: Design, Costing, Procurement and Scheduling 31


5.30 In short, from a best practices perspective, it is not desirable to have the TOC<br />

being developed so far into the construction phase. A key lesson arising from the Spring<br />

Hill and Otago projects is the need to ensure that the TOC is developed much sooner in<br />

the process so as to minimise the amount of construction undertaken without there being<br />

an agreed TOC.<br />

TOC Development – Independent Assurance<br />

5.31 One of the guiding principles governing CWA is the need to ensure that costs are<br />

efficient and represent value for money. The Department is part of the TOC development<br />

process and, as part of this, it reviews and assesses the TOC with the objective of<br />

ensuring that it is receiving value for money and, consistent with this, that the TOC is<br />

based on an efficient level of prices.<br />

5.32 To assist in achieving these objectives, the Department obtains advice from a wide<br />

range of third parties as shown below.<br />

CMS<br />

Burdened rates<br />

SCW<br />

Independent<br />

review<br />

Direct Costs<br />

Labour costs<br />

Plant/eq<br />

uipment costs<br />

Materials costs<br />

Rider Hunt –<br />

independent review<br />

CMS<br />

Margins<br />

SCW<br />

Independent<br />

review<br />

Overheads<br />

5.33 While use of outside expertise is desirable, several points can be made.<br />

• There is a very heavy dependence on CMS. From a risk management<br />

perspective, having such a high proportion of the overall knowledge of the projects<br />

in one (small) firm needs careful management. The Department has sought to<br />

manage this through the roles performed by Sherwin, Chan & Walshe (a chartered<br />

accountancy firm). Their roles include review of margin calculations performed by,<br />

and the methodologies used by, CMS.<br />

• There is a need for high degree of independence because of the need to challenge<br />

the draft TOC numbers being prepared by the commercial CWA partners. The<br />

Methodology and Processes: Design, Costing, Procurement and Scheduling 32


•<br />

•<br />

Department engaged CMS in respect of this. CMS has a key role in facilitating the<br />

CWAs and, as part of its brief, takes responsibility for the quality of work going into<br />

the development of the TOC and plays a key role in determining margins and<br />

overheads which are key inputs to the overall determination of the TOC. In this<br />

regard we view CMS’ role as being very much on behalf of the CWA; not the<br />

Department. However, it is clear that the Department has placed considerable<br />

reliance on the advice of CMS. Notwithstanding the role performed by Sherwin,<br />

Chan & Walshe, we consider that the Department should seek to supplement<br />

CMS’ role with another adviser expert in CWA methodology in order to ensure the<br />

level of independence needed in order to effectively counter-balance and<br />

challenge the TOC estimates being submitted by the commercial CWA members.<br />

Rider Hunt has responsibility for reviewing the direct costs (labour, materials and<br />

plant). To undertake this role, Rider Hunt compares the quantities and values in<br />

the TOC against a database of information built up from many other projects. A<br />

difficulty that Rider Hunt faces is that it is being asked to review labour rates that<br />

do not include any element of profit or overhead. In traditional forms of<br />

contracting, labour rates do include profit and/or overhead (i.e. a builder’s hourly<br />

rate will normally include profit and a contribution to overhead). Rider Hunt does<br />

not, however, have access to margin or overhead data. While noting that there<br />

are commercial sensitivities around profit/overhead information, we consider that<br />

would be better to provide Rider Hunt with access to this information as it would<br />

provide a better basis for cost comparisons.<br />

More generally, the Department, as well as Rider Hunt, did not have full<br />

transparency over margins and, in this respect, the way in which CWA was<br />

implemented did not fully accord with the “open book” requirements of the CWA<br />

methodology. Only CMS had full transparency over margins.<br />

5.34 The process for determining margins and overheads involves extensive detailed<br />

unbundling of contractors’ accounts. There is potential for costs to be double counted.<br />

Considerable judgement needs to be applied by CMS in the process of trying to normalise<br />

the accounts and ensure that costs are counted only once. Sherwin, Chan & Walshe are<br />

retained by the Department as an independent check on the margin and overhead<br />

calculations performed by CMS. However, because the Department does not of itself have<br />

visibility over margins, it is totally reliant on the advice of third parties. Consistent with the<br />

open book principle upon which CWA is based, and recognising that the margin<br />

calculations are an important part of overall cost determination, we consider that the<br />

Department should have greater direct visibility over margins and their calculation.<br />

Development of the TOC – Lessons Learned<br />

5.35 Given the pivotal role played by the TOC, its development needs to be concluded<br />

much sooner in the overall process than has been the case for the regional prisons.<br />

Several factors need to combine in order for this to occur.<br />

• First and foremost, there needs to be more flexibility over the lead time for<br />

constructing the prison. A key issue affecting the regional prisons was the need to<br />

adhere to specified completion dates in order to accommodate the growing prison<br />

population. Realistically, the Department did not have the choice of deferring<br />

construction of Spring Hill and Otago to allow for the development of the TOC prior<br />

to starting construction.<br />

it<br />

Methodology and Processes: Design, Costing, Procurement and Scheduling 33


• Related to this last point, the Department needs to take steps to ensure that<br />

appropriate levels of design capability are available to take designs from concept<br />

status through to detailed plans status so as to provide the basis for detailed TOC<br />

development work. Design was a bottleneck in the prisons’ development.<br />

• Timely completion of the TOC depends on there being completed and agreed<br />

designs. In part, delays in completing designs were a function of scarce design<br />

resources but, in part, there were design changes late in the process (e.g. in<br />

relation to site services at Otago).<br />

• Pressure has to be maintained on the commercial CWA partners to ensure early<br />

development of the TOC. Under cost plus margins arrangements there is an<br />

inherent risk that the commercial partners do not necessarily have strong<br />

incentives to conclude early agreement on the TOC. The TOC is an iterative<br />

process and requires the client to be in a position to challenge elements of the<br />

TOC from an informed position. This requires appropriate levels of resource and<br />

flexibility and nimbleness in decision making. Structures and processes need to<br />

support this.<br />

5.36 The corollary of ensuring the early completion of the TOC is that the amount of<br />

work that is undertaken on fast-track basis should be minimised. Getting the TOC<br />

determined before work starts maximises the opportunity for Government to make<br />

changes if costs turn out higher than expected.<br />

Procurement and Scheduling<br />

5.37 The method under which the prisons have been constructed is a major part of this<br />

review. As will be discussed below, a hybrid form of CWA was adopted for the Northland<br />

project. A key reason behind this was the need to address some issues with that project<br />

that had the potential to adversely affect the timing of that project.<br />

5.38 Prior to the Northland project, prison construction in New Zealand had been<br />

procured by a fixed price form of contracting (more formally, procurement had been<br />

undertaken pursuant to the <strong>NZ</strong> standard <strong>NZ</strong>S 3910). This form of procurement is<br />

commonplace across a wide range of construction activity. In a sense, it is the traditional<br />

form of procurement.<br />

5.39 In contrast, Spring Hill and Otago have been procured using the CWA, or<br />

alliancing, form of procurement. There are major differences between the two forms of<br />

procurement. It has not been within the brief of this review to assess the merits or<br />

otherwise of the CWA versus more traditional forms of contracting. However, it is useful<br />

to have an appreciation of the differences involved and the key features of CWA<br />

methodology.<br />

Key Features of CWA Methodology<br />

5.40 CWA is one form of a more general form of procurement referred to as alliancing.<br />

Alliancing can take many forms, examples of which include:<br />

• Traditional joint ventures - until recently, the joint venture, in which two or more<br />

parent organisations join forces to create a separate legal entity, has been one of<br />

the most common type of alliance. In the traditional joint venture, organisations<br />

unite to obtain economies of scale and scope.<br />

Methodology and Processes: Design, Costing, Procurement and Scheduling 34


• Outsourcing arrangements - these are partnerships in which an organisation<br />

outsources a business process or function (e.g., human resources or information<br />

technology) that is not central to its business mission. This allows the organisation<br />

to concentrate on its primary business objectives.<br />

• Marketing alliances - marketing alliances bring together organisations that<br />

market different products or services to the same group of consumers. They can<br />

take many forms, including co-packing alliances and co-operative advertising.<br />

Under a co-packing alliance, an organisation licenses the use of its brand name<br />

and product formula to organisations that have production, packaging and<br />

distribution capabilities.<br />

• Supplier/vendor alliances - closely related to outsourcing arrangements are<br />

supplier (or vendor) alliances in which organisations partner with suppliers to<br />

enhance the service, each bringing its specific area of expertise to bear on the<br />

project or service.<br />

5.41<br />

The CWA is closely related to the last of these forms.<br />

5.42 A key feature of CWA (and alliancing more generally) is that all parties in the<br />

alliance have a shared interest in overall project outcomes. Alliancing approaches share<br />

a number of distinct features that set them apart from more traditional forms of<br />

procurement. Included among these are:<br />

• alignment of the business goals of all parties;<br />

• selection of parties in the CWA agreement is based on capability, approaches and<br />

systems (as in traditional evaluation processes) and more subjective assessment<br />

around the level of project commitment, the composition and nature of the sponsor<br />

team, the likelihood of the combined team delivering outstanding results;<br />

• a selection process that may not include price;<br />

• joint risk allocation and management;<br />

• joint and integrated project governance and management;<br />

•<br />

fully open book among the parties implying very high levels of financial and other<br />

disclosure;<br />

• a principles-based collaborative form of contract that seeks to avoid adversarial<br />

conduct. This means, for examples, that there are no disputes resolution<br />

processes in CWA agreements. Where problems arise, the parties work<br />

collaboratively to identify solutions rather than seeking to “point the finger of<br />

blame”;<br />

• a cost reimbursement process that is open and pays actual costs and agreed<br />

margins (profits and overheads);<br />

• an equitable and appropriate risk and reward scheme (referred to as pain share<br />

and gain share arrangements);<br />

• an active relationship development and maintenance regime; and<br />

Methodology and Processes: Design, Costing, Procurement and Scheduling 35


• high levels of support from parent companies in support of the contracting<br />

arrangement (as reflected by senior representation on what is referred to as the<br />

Principals Group).<br />

5.43 The CWA approach is aimed at fostering a best-for-project approach through a<br />

“no-blame-no-claim” culture where all parties have a unity of purpose to achieve a<br />

successful outcome. Decision making in regard to the project is conducted through a<br />

Principals Group. Decisions by the Principals Group are made on a unanimous basis;<br />

that is, all parties have to agree.<br />

5.44 In traditional fixed price contracts, the principal point of focus is the price that is<br />

paid for the services. Under the CWA approach, the focus is on the efficient level of costs<br />

because this is the amount that the client, in theory, pays for the services.<br />

Background To CWA for Prison Construction<br />

5.45 The CWA methodology has been used in the context of the Northland (albeit in<br />

hybrid form) and the recently opened Auckland Women’s prison. The Northland prison<br />

commenced as a traditional <strong>NZ</strong>S 3910 contract. However, by August 2003, several<br />

factors pointed toward the need to modify the contractual approach to construction:<br />

• financial pressure on one critical consultant was such that it was doubtful if they<br />

would continue;<br />

• there was evidence of on-site “man-marking” where significant effort was being<br />

directed toward allocating blame rather than resolving issues; and<br />

• the construction programme was not universally agreed among the parties<br />

involved.<br />

5.46 In considering the options open to the Department, CWA was raised as a potential<br />

way forward. Several points are worth noting in this regard.<br />

• We understand that Mainzeal had for some time been considering alternative<br />

forms of procurement including alliancing.<br />

• Stewart Rix (of CMS) had considerable experience of CWA from previous roles in<br />

the United Kingdom (where CWA and alliancing generally is more commonplace).<br />

A meeting between CMS and the RPDP Project Director (John Hamilton) to<br />

present on CWA was arranged at the instigation of the Chair of the Inmate<br />

Employment Advisory Committee. CMS also presented to Hawkins Construction<br />

Ltd (the main contractor on the Auckland Women’s and Otago projects).<br />

• When difficulties with Northland emerged, the RPDP Project Director approached<br />

CMS out of which came a suggestion to convert the contractual framework for<br />

Northland to a CWA agreement (the Northland project had been running on-site for<br />

approximately six months). Mainzeal were the prime contractors for the Northland<br />

project.<br />

5.47 At the August 2003 meeting of the RPDP Steering Group, the Project Director<br />

provided an oral briefing on the proposal to enter into a hybrid form of CWA (the hybrid<br />

arrangements retained an element of the former <strong>NZ</strong>S 3910 contract including, in<br />

particular, a cap on construction costs). The meeting approved in principle the change to<br />

Methodology and Processes: Design, Costing, Procurement and Scheduling 36


the hyb<br />

rid CWA subject to the condition that a formal paper for approval be tabled with the<br />

Steering Group.<br />

5.48 Following the decisions to adopt the hybrid methodology, the Department decided<br />

to retain CMS to assist with training and to provide advice on managing the transition to<br />

the new arrangements. Both aspects of CMS’ role were vital: the Department had no prior<br />

experience of CWA.<br />

Choice of Procurement Methodology<br />

5.49 Subsequent to the decisions taken with respect to Northland, the Department has<br />

moved to adopt CWA for the Spring Hill and Otago projects (as well as Auckland<br />

Women’s).<br />

5.50 CWA represents a fundamental shift in procurement method. Accordingly, we<br />

would have expected a first-principles analysis of this, and other, procurement options to<br />

have been considered and debated at length before moving toward its adoption across<br />

the other projects in the RPDP. As part of this review, we have not, however, sighted<br />

papers provided to, or minutes of, the Steering Group that explicitly affirm the choice of<br />

CWA ahead of <strong>NZ</strong>S 3910 (or any other form of contracting method) for either Spring Hill<br />

or Otago.<br />

5.51 In the context of the Northland project, the lack of in-depth analysis and<br />

consideration could perhaps be explained by the immediate and significant set of<br />

problems that needed to be addressed. CWA provided a framework to make progress<br />

with the project and avoid the time delay and cost implications that could have eventuated<br />

had the project either remained as a <strong>NZ</strong>S 3910 or been re-tendered.<br />

5.52 Notwithstanding these circumstances, however, the decision to adopt CWA for the<br />

Spring Hill and Otago projects should have been justified on a project by project basis.<br />

The analysis should have extended not just to the traditional <strong>NZ</strong>S 3910 contract but to the<br />

various forms of alliance arrangements and other options beyond alliancing such as:<br />

• reimbursable contracts under which the client pays for all of the work plus a<br />

margin to the supplier;<br />

• a construction management approach under which the client employs a<br />

construction manager who works for a fee which is applied to the value of the<br />

work;<br />

• design and build, and design, build and operate contracts; and<br />

• design, build, operate and finance contracts.<br />

profit<br />

5.53 It is not the purpose of this review to advocate these, or any other, forms of<br />

procurement. The point is that the Department chose to move away from <strong>NZ</strong>S 3910 to a<br />

fundamentally different form of procurement. This decision should have been based on<br />

detailed first principles analysis of CWA and other forms of procurement.<br />

5<br />

5 This form of procurement is increasingly common in Australia under the banner of pubic-private<br />

partnerships and in the United Kingdom under the banner of private finance initiatives (PFI). In<br />

New Zealand, such forms of contract would require, under the Public Finance Act, approval from<br />

the Minister of Finance.<br />

Methodology and Processes: Design, Costing, Procurement and Scheduling 37


5.54 This issue is not just a matter of good process for two main reasons. The first of<br />

these is that CWA potentially exposes the client to financial risk unless the CWA approach<br />

is well managed. To the extent that CWA was discussed with the Steering Group in the<br />

context of Northland, it is clear that the potential benefits of CWA were described. What<br />

is less clear is whether the risks and costs around CWA were explained along with the<br />

critical factors that must be achieved in order for a CWA to work well and in the client’s<br />

interests. The lack of paper trail makes this difficult to evaluate but our impression is that<br />

the benefits of CWA were emphasised to a much greater extent than the potential risks<br />

and costs involved.<br />

5.55 The second reason why the relative lack of consideration of procurement options<br />

is an issue is because prior to Northland, the Department had no knowledge or<br />

experience of alliancing. The need for rigorous consideration of this and other<br />

procurement options is even greater, the lesser is the knowledge and understanding of<br />

something new.<br />

5.56 These comments should not be interpreted as a criticism of the CWA<br />

methodology. Indeed, we note advice from the UK National Audit Office (NAO)<br />

recommending that departments not use traditional forms of procurement for construction<br />

projects unless it can be demonstrated that this form of procurement will provide better<br />

value for money ahead of design and build, or alliancing (the closest form of which is<br />

6<br />

described as “prime contracting” by the NAO) or PFI. Moreover, the comments should<br />

not be interpreted as saying that CWA was the wrong choice. In this regard, we note that<br />

the Auckland Women’s project appears to have been delivered on time and within budget.<br />

In the case of the Spring Hill and Otago projects, independent advice provided to the<br />

Department in October 2005 advised that the Department should not depart from the<br />

CWA path to another form of procurement unless as an absolute last resort (although this<br />

advice was tendered at the time when construction of Spring Hill and Otago was well<br />

underway). 7<br />

5.57 Notwithstanding these points, we consider that the choice of procurement<br />

approach for any given project should be made on a case-by-case basis. In this regard,<br />

there are several factors that need to be considered before choices regarding<br />

procurement method are made. Below, we set out some high-level characteristics that<br />

would tend to favour use of CWA in preference to traditional <strong>NZ</strong>S 3910 forms of<br />

procurement. CWA is more likely to be preferred when the following conditions are<br />

characteristics are present.<br />

• The best way of achieving desired outcomes, in terms of the choice of<br />

technologies and processes, is uncertain. In the context of the regional prisons,<br />

their design was markedly different to that which had gone before and reflected a<br />

desire for a different approach to the management of inmates. By implication,<br />

however, there was uncertainty around the details of design and how this would<br />

interface with operational requirements.<br />

• There is a high degree of complexity in design, construction, technology and/or<br />

development which cannot be satisfactorily scoped at project commencement.<br />

Complexity per se does not favour CWA over other forms of procurement, but<br />

6 National Audit Office (2005) “Improving Public <strong>Services</strong> Through Better Construction” , London,<br />

p23.<br />

7 Peter Waterhouse 31 October 2005 “<strong>Report</strong> to RPDP on Construction Costs and Alternative<br />

Procurement Strategies”<br />

Methodology and Processes: Design, Costing, Procurement and Scheduling 38


•<br />

•<br />

where complexity gives rise to risk and uncertainty CWA may provide a more<br />

flexible contracting methodology. In the context of the Spring Hill and Otago<br />

projects, it is generally the case that the construction techniques are not new or<br />

overly complex. While there is a considerable amount of technology that goes into<br />

prison buildings (security related), this is separable from overall construction (as<br />

indeed was the case with a separate CWA for security systems). Of themselves,<br />

the building designs do not appear to be overly complex although, as noted above,<br />

there was uncertainty around aspects of design.<br />

•<br />

project (at development and design stages). This is another way of saying that<br />

•<br />

there is uncertainty over the optimal design approach and, further, that the client<br />

wants to explore rather than getting locked into a particular approach under<br />

traditional <strong>NZ</strong>S 3910 procurement.<br />

There is a necessity for innovation and step-change developments in design,<br />

technology and construction methodology. CWAs create a better framework than<br />

traditional forms of contracting for such developments to take place. Arguably,<br />

elements of this requirement existed for the regional prisons in respect of design,<br />

but less so with respect to technology and construction methodology. As<br />

experience with the regional prisons design grows, this characteristic may become<br />

less relevant.<br />

• The projects are large. CWA has a significant management overlay because<br />

5.58 In addition to these points, comments by various Department and contractor<br />

personnel have suggested that CWA might be better suited to projects being undertaken<br />

in a heated construction market, but less appropriate when market conditions are benign<br />

or declining. Various reasons support this view:<br />

•<br />

Technology is rapidly evolving. This does not appear to be a characteristic<br />

relevant to prison buildings.<br />

Timeframes for completion of the project are tight and, accordingly, the project<br />

demands innovative and flexible approaches to ensure project completion. This<br />

clearly is a feature of the Spring Hill and Otago projects and, arguably, is the<br />

strongest reason for preferring a CWA methodology for these facilities.<br />

There is considerable scope for value engineering into the early stages of the<br />

many checks and balances have to be built into the procurement process to<br />

compensate for the lack of market testing of prices through competitive tender.<br />

Various people interviewed during the review have suggested that the minimum<br />

size of project that can support CWA is probably in the order of at least $100<br />

million. Clearly, the Spring Hill and Otago projects meet this condition.<br />

The CWA methodology provides transparency over margins and seeks to<br />

normalise margins. The process of agreeing margins under CWA therefore<br />

enables adjustments to be made to margins such that abnormally high margins<br />

experienced at the peak of the market are adjusted downwards.<br />

• Because the CWA methodology allows for the pass through of direct costs,<br />

suppliers are not as exposed as they would be to unexpected cost increases. This<br />

can also be advantageous from a client perspective in that in a heated market,<br />

fixed price contracts are likely to seek to guard against unexpected price increases<br />

by quoting higher prices to start with.<br />

Methodology and Processes: Design, Costing, Procurement and Scheduling 39


• From a practical perspective, and in the specific context of Spring Hill and Otago,<br />

the comment has been made to us by Department and contractor personnel that<br />

as the construction market grew tighter, there was less willingness on the part of<br />

the construction industry to enter into traditional fixed price contracts. The market<br />

was becoming a sellers market. Those in the market were increasingly being able<br />

to dictate their own terms and prices and this included, as noted earlier, a trend<br />

toward preferring CWA.<br />

5.59 In contrast to CWA, traditional <strong>NZ</strong>S 3910 approaches to procurement are suitable<br />

for projects where the scope and requirements of the project are well defined and where<br />

the risks are known, understood and capable of being appropriately factored into tender<br />

pric es . In our view, these characteristics are present across elements of the prisons<br />

construction programme and, accordingly, we do not consider that traditional forms of<br />

procurement should be automatically ruled out. Each project should be considered in its<br />

own rig ht and the business case made for preferring one form of procurement over others.<br />

5.60 On a related point, we consider that there are lessons arising from the Spring Hill<br />

and Otago projects in terms of how far down the supply chain to carry the CWA approach.<br />

As noted earlier, 95% of cost at Spring Hill is being incurred by CWA members. This is a<br />

very high ratio.<br />

5.61 CWA is management intensive. For those CWA members who are new to CWA,<br />

there is also a considerable learning curve and associated training requirements. The<br />

deeper CWA penetrates through the supply chain, the greater are the administrative and<br />

management overheads and at some point, the additional costs involved exceed the<br />

benefits that CWA might bring. In the case of Otago, we note that there are 17 CWA<br />

members. This is a large number of firms to manage. Where CWA is implemented, it<br />

makes sense to include the primary contractors as CWA members. However, application<br />

of CWA becomes increasingly questionable the further below this level the CWA seeks to<br />

probe. In our view, there may not be sufficient benefits over cost to drive down as far as<br />

the small and even medium sized businesses that supply trade services to the project.<br />

Selection Process<br />

5.62 Although not part of the original brief for this review, the <strong>Commission</strong> has<br />

requested that comment be made on the process for the selection and appointment of the<br />

main contractors involved with Spring Hill and Otago and the appointment of the Project<br />

Director and CMS (reflecting the key role that CMS has played in facilitating the CWA).<br />

5.63 In the case of Spring Hill, a Request for <strong>Proposal</strong> (RFP) for provider of building<br />

works was issued in September 2004 and Mainzeal was the preferred respondent. The<br />

Department and Mainzeal entered into a CWA Negotiation Framework Agreement (NFA)<br />

on 26 October 2004. Also in September 2004, the Department issued a RFP for building<br />

works in respect of Otago and Hawkins Construction was selected. A NFA with Hawkins<br />

was entered into also on 26 October 2004. The evaluation of the tenders was undertaken<br />

with particular focus on performance, culture and capability. Cost was not part of the<br />

evaluation criteria.<br />

5.64 The Department has documented procurement processes and tender procedures.<br />

The latest version of these is based on an original document prepared in 2002 and which,<br />

in turn, is based on the framework contained in the <strong>State</strong>ment of Good Practice issued by<br />

the Office of the Auditor General (that framework remains at the core of the current<br />

processes).<br />

Methodology and Processes: Design, Costing, Procurement and Scheduling 40


5.65 A probity audit of the selection processes for the construction contractors for<br />

Spring Hill and Otago was undertaken by Audit <strong>NZ</strong> in October 2004. Those reports<br />

concluded that:<br />

• generally, the RFP documentation and the processes surrounding its issue, the<br />

receipt, opening and evaluation of responses conform to good practice;<br />

• the evaluations were conducted fairly and impartially and in accordance with the<br />

documented process plan; and<br />

• Audit New Zealand was unaware of any probity issues outstanding.<br />

5.66 We also note that Sherwin, Chan & Walshe were engaged to undertake a financial<br />

due diligence of the main contractors.<br />

5.67 Notwithstanding the positive outcome of the review undertaken by Audit New<br />

Zealand, we note that there is an issue as to whether or not the evaluation criteria should<br />

include cost. We are aware that some CWA tenders do not include cost (as was the case<br />

for the RFPs issued by the Department), but equally it is possible to include cost as part of<br />

the evaluation process. However, in order to do this, a number of steps have to be<br />

completed. In particular, the client has to have undertaken some work to take design to a<br />

sta ge that can be used for costing purposes.<br />

5.68 As part of the tender process, the client can invite contractors to submit bids based<br />

on a reimbursable target-cost contracting basis. The benefits to the client are that<br />

contractors submit indicative target costs in a competitive environment. It is important to<br />

note, however, that where the scope of work is imprecisely defined, or there are particular<br />

features of the operating environment that create significant uncertainty, then assumptions<br />

need to be developed by the client regarding scope, specification and schedule. This<br />

enables bidders to submit indicative target costs based on shared and common<br />

understandings. We are unaware as to whether or not the Department considered<br />

approaching the tender on this basis. We note, however, that by late September 2004<br />

when the RFP’s were issued, the construction market was already heated. Based on<br />

discussions with industry and Department personnel, there is a view that the market would<br />

not have reacted favourably to such a tender approach given the amount of additional<br />

work involved in preparing a bid. Moreover, the time available to the Department to issue<br />

the RFP and then make a selection was very tight (a point noted by Audit New Zealand in<br />

its probity reviews). We doubt that the timeframes available would have allowed for<br />

indicative costs to be added into the tender process.<br />

5.69 The re-appointment of the Project Director position occurred in 2004. Prior to the<br />

re-appointment, the Project Director had been fulfilling project management and other<br />

roles within the Department and, accordingly, had acquired considerable institutional<br />

knowledge. A tender process for the Project Director position was initiated and managed<br />

by the then Chief Financial Officer. The CFO, together with two members of the Steering<br />

Group, formed the interview panel. We understand that four or five possible candidates<br />

were considered and this was refined to a short-list of two.<br />

5.70 In July 2004, Audit New Zealand provided some informal advice on an early draft<br />

of the Request for <strong>Proposal</strong> for the Project Director position. The appointment process<br />

had commenced in May 2004 and the appointment was made in October 2004. The<br />

review by Audit New Zealand raised a concern that the Project Director and the Manager,<br />

Administration and Contracting were involved in the renewal process for each other’s<br />

contracts. The Manager, Administration and Contracting had been involved in preparing<br />

the RFP for the Project Director position and the evaluation plan. We understand from<br />

Methodology and Processes: Design, Costing, Procurement and Scheduling 41


Audit New Zealand that there were also some minor issues around documentation. We<br />

agree with the comment by Audit New Zealand that the engagement of key personnel for<br />

RPDP should be managed by the Department alone as far as possible, or by using a<br />

completely independent recruitment specialist.<br />

Contracting Expertise<br />

5.71 At the time of entering into CWA for the construction of the regional prisons, the<br />

Department had very little knowledge and understanding of CWA. It was heavily<br />

dependent on a small number of key individuals including, in particular, Stewart Rix of<br />

CMS and John Hamilton (the Project Director). Neither are employees of the Department.<br />

As a general point, it is preferable, particularly on projects of the size, complexity and risk<br />

(financial, operational and reputation) of the RPDP projects, to avoid being too reliant on a<br />

small number of external advisers. That said, however, it is acknowledged that expertise,<br />

particularly in relation to the CWA methodology, was relatively scarce (in part, reflecting its<br />

limited use in New Zealand).<br />

5.72 Through the projects completed to date (and nearing completion), the Department<br />

has built significant organisational capability within the RPDP team. For future projects,<br />

the Department needs to ensure that it retains people who are able to advise, from a first<br />

principles perspective, on the choice of optimal procurement methodology and then, once<br />

the decision is taken, lead and advise on the implementation of the chosen procurement<br />

method. This includes the role of being a member on the Principal’s Group.<br />

5.73 A blend of competencies and experiences are required to undertake these tasks;<br />

commercial, construction as well as understanding of Government machinery and<br />

decision making processes. The range of competencies is unlikely to be found in one<br />

individual. We note, and support, the decision by the Department to add a department<br />

employee to the Principal’s Group at both Spring Hill and Otago. This initiative usefully<br />

supplemented the commercial and construction background and expertise of the Project<br />

Director notwithstanding his previous involvement with the Department since 1997 (as<br />

employee and as contractor).<br />

5.74 We note that the issue of having the right mix and level of expertise might apply<br />

more widely than just the Department of Corrections. For example, a unit has been<br />

established within the <strong>State</strong> <strong>Services</strong> <strong>Commission</strong> to assist with and advise on aspects of<br />

major IT investments. Although well beyond the scope of this review, it is worth<br />

considering whether there is a need for an equivalent group in respect of major building<br />

construction or even procurement more generally for the public sector. Although not<br />

appropriate for New Zealand given the much smaller size of our economy, we note the<br />

example from the United Kingdom which has established the Office of Government<br />

Commerce (OGC) which is an independent Office of the Treasury. The OGC is<br />

responsible for a wide ranging programme which focuses on improving the efficiency and<br />

effectiveness of procurement within central government.<br />

Market Testing of Costs<br />

5.75 The Department and Government more generally, needs assurance that the<br />

amounts being paid for the regional prisons are based on efficient levels of cost. The way<br />

in which CWA has been implemented by the Department means that such assurance is<br />

sought through a process of subjecting the development of the TOC to extensive<br />

independent review and audit. Under traditional <strong>NZ</strong>S 3910 contracts, prices are market<br />

tested through the competitive tendering process. As applied to Spring Hill and Otago,<br />

the CWA methodology has not provided this same market testing. Accordingly, under<br />

CWA, there needs to be exceptionally robust and transparent processes around<br />

Methodology and Processes: Design, Costing, Procurement and Scheduling 42


determination of TOC/QRA and the inputs to these – direct costs, margins, off-site and onsite<br />

overheads.<br />

5.76 Notwithstanding these processes, however, we consider that the option of<br />

providing further assurance by requesting potential CWA members to submit bids based<br />

on reimbursable target-cost contracts should be considered for future projects. Such a<br />

process would involve submitting indicative target costs in a competitive environment<br />

before the selection of CWA members is made (but would also require more time and<br />

resource to implement than was available in the context of Spring Hill and Otago).<br />

5.77 In the context of the regional prisons completed, or under construction, we doubt<br />

that there was the time to undertake this process. However, for future prison builds, we<br />

see no reason why consideration should not at least be given to modifying the tendering<br />

process in this manner. The key advantages are that this approach comes closer to<br />

providing a market test of likely cost, creates the opportunity to consider options if<br />

indicative costs exceed available funding and provides an improved ability to give<br />

Ministers a realistic view of potential costs.<br />

Summary<br />

5.78 A key feature of the methodology and processes employed in relation to Spring Hill<br />

and Otago is the adoption of the CWA approach to procurement. A hybrid form of this<br />

methodology was successfully utilised on the Northland project. In that particular case,<br />

use of CWA assisted in overcoming some issues that were threatening to disrupt progress<br />

with the facility.<br />

5.79 The CWA methodology has many potential advantages compared to traditional<br />

fixed price forms of contracting. The Department has captured many of these including:<br />

• close integration of design, construction and operational perspectives;<br />

• cost savings and other benefits through undertaking several value management<br />

reviews;<br />

• efficient use of resources at site-level;<br />

• collaborative approaches to resolving issues as they arise at a day-to-day level;<br />

and<br />

• high levels of transparency around project costs at the project level (although as<br />

discussed in the next section, this transparency did not always percolate up to the<br />

Steering Group to the extent needed).<br />

5.80 Overarching these benefits, there are sufficient indications to suggest that had the<br />

Department elected to follow a more traditional procurement method, timeframes for<br />

completing the projects may not have been met. Had that been the case, this review<br />

wo uld have had a fundamentally different focus and set of drivers.<br />

5.81 Notwithstanding the benefits that have arisen through the use of CWA, there are<br />

some<br />

lessons that can be learned in terms of design, costing, procurement and<br />

scheduling. Specifically:<br />

• CWA is not necessarily suited to all projects. There is a need to identify the<br />

conditions under which CWA is likely to be preferred ahead of other forms of<br />

Methodology and Processes: Design, Costing, Procurement and Scheduling 43


procurement. These considerations need to applied on a project-by-project basis<br />

and decisions documented.<br />

• The CWA methodology requires careful management and sound contracting<br />

experience. The Department entered the RPDP without recent major construction<br />

project experience. It is building that capability. This needs to continue if further<br />

new prisons are proposed. At a wider level, consideration may need to be given<br />

as to whether the public sector generally needs to build its contracting expertise for<br />

major projects (although this would depend on there being a sufficiently large<br />

scope of future projects).<br />

• CWA, along with any form of procurement, needs to be based on sound facility<br />

designs. In turn, this requires agreed standards and adequate design capacity.<br />

•<br />

As part of the CWA member selection process, it may be possible in some<br />

circumstances to seek indicative target costs. This would help to provide a degree<br />

of market testing of costs. However, to do this requires that the following<br />

conditions be met which, in the situation of Spring Hill and Otago, was not the<br />

case:<br />

– there be sufficient contractors prepared to engage in this process;<br />

– designs be developed to a stage sufficient to support estimation of costs<br />

– the Department have the resources to support the process; and<br />

– sufficient time be available for the process to work through.<br />

• The development of the TOC is a fundamental part of the CWA methodology and<br />

needs to be completed sooner than has been the case in the Spring Hill and Otago<br />

projects. This emphasises further the need for timely completion of designs and<br />

appropriate levels of project management resource.<br />

• Until the TOC is underway, cost estimates are indicative only. This needs to be<br />

made clear to decision makers. Once TOC estimates begin to emerge, they<br />

should be reported regularly so as to provide maximum opportunity to modify<br />

requirements if budgets are under pressure.<br />

Methodology and Processes: Design, Costing, Procurement and Scheduling 44


6 Governance and Project Management<br />

Key Findings:<br />

Achievements<br />

• New Zealand will have four regional prison projects completed in time to meet the growth<br />

in the prison population.<br />

• The Steering Group comprised senior management in the Department and this group<br />

recognised gaps in knowledge and expertise that needed to be filled, namely: experienced<br />

Project Director, Audit and Independent Review processes, acquisition of external large<br />

scale project management expertise, and Treasury representation.<br />

• Changes to project governance and management structures from late-2005 have greatly<br />

increased the quality of review, reporting and decision-making on the projects. This<br />

includes the establishment of a Programme Management Office (PMO) in February 2006<br />

to assist with the project and risk management dimensions at governance and project<br />

management levels.<br />

• Formation of the Construction Sub-committee comprising appropriate expertise and with<br />

responsibility for decision-making advice to the wider group on complex technical matters.<br />

• These arrangements and changes have made significant improvements to the quality of<br />

reporting, decision-making and potential for risk management. We note that the PMO has<br />

potential to significantly assist the programme governance, but that this is still early days<br />

for this role.<br />

• Mid-2005, a senior Department manager was appointed to each of the CWA Principals<br />

Groups at Otago and Spring Hill sites. This has provided opportunity for the Department to<br />

be represented on the Principals Group by one of its senior managers and to more directly<br />

support the role of the Project Director. This arrangement has also provided for a more<br />

direct link between the senior management team and the Principals Group.<br />

• At site project management level, the departmental interest has been represented by<br />

appointment of permanent departmental staff as CWA Manager at Otago and Auckland<br />

Women’s.<br />

• While it is outside of the scope of this review to assess the specific project management<br />

methodologies at respective sites, we observe that the project management approaches of<br />

the main CWA partners do employ expected tools for project management of planning,<br />

project risks, costing, progress monitoring, resource management. We also note that<br />

RPDP played a role in developing planning and reporting tools for the programme.<br />

Challenges<br />

• The Steering Group composition did not include personnel with strong large scale project<br />

management experience (mainly line managers) until January 2004 with the appointment<br />

of the independent project consultant to the Group.<br />

• Prior to review in 2005, the role of the Steering Group was not consistently clear to all<br />

members in terms of the Group’s advisory and/or governance responsibilities.<br />

• Prior to review in 2005, there was insufficient formal reporting to the Steering Group to<br />

support key decisions and to signal project risks adequately. Formal reporting tended to<br />

Governance and Project Management 45


e historical in nature, with little (or no) indication of future estimations of costs to<br />

completion.<br />

• Prior to 2005, the Department’s representation on the Principals Group did not include any<br />

of the Department’s senior employees. The challenge for the Department was to maintain<br />

the close link that is needed between the senior management team and the Principals<br />

Group.<br />

• Throughout the progress of the RPDP the risk of not having adequate capacity to meet the<br />

rapidly growing demand for prison accommodation, and the implications of this was a<br />

major imperative and driving factor behind governance and management decisions.<br />

Lessons Learned:<br />

• Ensure that the project goals and objectives are agreed and clearly communicated to all<br />

parties at the commencement of the project, and that they encompass all three key<br />

elements of time, costs and quality, even in cases of ‘fast-tracking’.<br />

• Ensure that the Steering Group has the appropriate mix of knowledge and skills to be able<br />

to represent the Department and the wider Government interests, and govern a large scale<br />

project.<br />

• Ensure that the roles and accountabilities of the respective governance and management<br />

groups and individuals are clearly specified and communicated from the commencement of<br />

project planning.<br />

• Ensure that the Department is represented on the Principals Group by a senior manager in<br />

any future CWA arrangement to complement the commercial skills of any contractors.<br />

• Ensure that there are independent quality assurance processes in place for oversight of<br />

governance and project management approaches (including decision-making and risk<br />

management), as well as for oversight of the lower level project management processes<br />

for cost calculation, and quantitative risk assessment. This will ensure independent<br />

reporting of any governance issues/ risks at various stages, including concerns re<br />

information provision.<br />

• Ensure that the Steering Group is provided with adequate information in a timely fashion to<br />

assess and manage risks, support effective decision-making, and reporting to Ministers.<br />

• Ensure project reporting not only assesses historical progress but also estimates future<br />

issues and progress remaining against all project objectives.<br />

Introduction<br />

6.1 Underpinning the method of construction of the prisons are the overall governance<br />

and project management arrangements for the programme. Effective governance and<br />

project management is required to ensure that goals are achieved, on time, to quality and<br />

to agreed budgets. This section revisits the context for governance and management of<br />

the RPDP programme, and assesses governance and project management arrangements<br />

in this context.<br />

Governance and Project Management 46


Public Sector Project Governance and Management<br />

6.2 In respect of public sector projects, there are specific requirements for<br />

transparency, accountability for decision-making in a broader public sector context, probity<br />

and independence. The interests of the Government, as stakeholder, must be recognised<br />

and managed through appropriate structures, planning, reporting and review processes.<br />

6.3 There is always a challenge when a public sector project is undertaken in a<br />

commercial environment, and when agents are themselves commercially focused.<br />

Project governance and management structures must be organised so as to ensure that<br />

commercial imperatives are balanced by the interests of the public sector agency and the<br />

wider public sector (particularly for projects involving large Government expenditure).<br />

6.4 This means clear definitions of roles and accountabilities, the early use of audit<br />

and review mechanisms, robust risk management, and effective reporting to support risk<br />

management and decision-making. Due attention must be given to project controlling and<br />

monitoring processes throughout.<br />

6.5 Ideal best practice for governance and project management is further outlined in<br />

Appendix C. Clearly the specific context for the RPDP project has meant challenges for<br />

achieving the ideal, and the discussion below recognises the Department’s successes and<br />

assesses issues in meeting these challenges.<br />

Context<br />

6.6 The context for the development of new prison facilities and the establishment of<br />

RPDP to implement the design, construction and commissioning of these facilities has<br />

been outlined in Section 3 of this report.<br />

6.7 The discussion of governance and management arrangements needs to recognise<br />

the specific nature of the environment within which the Department was operating.<br />

• The projected dramatic increase in the prison population according to Ministry of<br />

Justice forecasts, and the inability of existing facilities to cope.<br />

• Clearly substantial new facilities had to be built, and in a timely manner in order to<br />

house the growing prison population.<br />

• The RPDP project, encompassing often simultaneous design, construction and<br />

commissioning of four regional prisons, is a huge project by New Zealand and<br />

international standards ( around $900 million).<br />

• This project size means a significant challenge to manage the pressures on New<br />

Zealand’s construction, design and quantity surveyors capability and capacity.<br />

• The New Zealand Government had little recent experience in construction,<br />

particularly in projects of the scale of the RPDP project.<br />

• Prior to the RPDP project, the Department had managed the growth in prison<br />

population through addition to existing facilities, overseen by the Assets and<br />

Property Division. The most significant construction project overseen by this<br />

division was the successful completion of the Auckland Central Remand Prison<br />

(ACRP) in 2002.<br />

Governance and Project Management 47


Current RPDP Arrangements<br />

RPDP Programme Governance and Project Management Structure<br />

6.8 At a high level, the current governance and management structure for RPDP<br />

consists of:<br />

• a steering group, comprising Matrix Manager (Chief Finance Officer) supported by<br />

a Programme Steering Group. Steering Group members are senior line managers<br />

from the Department (GM Public Prison Service, GM Probation and Offender<br />

<strong>Services</strong>, GM Corporate Management, GM Strategic <strong>Services</strong>) and an<br />

independent external expert with large-scale construction project management<br />

experience. A Treasury Vote Manager attends the Steering Group as an observer.<br />

The governance group also has a Construction Sub Committee reporting to the<br />

steering committee. This committee comprises the Chief Financial Officer,<br />

independent Steering Group consultant, Construction Project Director,<br />

Department’s Manager Construction Management, and the Department’s National<br />

Property Manager. Internal Audit also attend sub-committee meetings.<br />

• a management team, comprising Construction Project Director, <strong>Commission</strong>ing<br />

Manager, and Programme Manager.<br />

6.9 According to the RPDP terms of reference, the Steering Group has key<br />

responsibilities including:<br />

• provision of advice and support to the Matrix Manager and the RPDP Management<br />

Team;<br />

• overall decision-making, including approval of scope, budgets, plans and delivery<br />

mechanisms;<br />

• monitoring of programme progress issues and risks;<br />

• ensuring integration with wider organisational activities; and<br />

• ensuring appropriate expertise and business as usual resources are available to<br />

the project.<br />

6.10 The Management Team has responsibilities including:<br />

• planning and management of day-to-day activity within their respective projects;<br />

• ensuring that their respective areas of responsibility produce agreed deliverables<br />

within approved timeframes, budget and specification; and<br />

• accountability for the management of risks and issues within their respective<br />

function and ensuring programme-wide risks and issues are managed in an<br />

integrated way.<br />

6.11 This programme structure, together with detailed statements of roles and<br />

responsibilities across key groups and management positions, is clearly documented in a<br />

detailed RPDP Charter and Terms of Reference. The Charter also contains key<br />

processes for financial and risk management.<br />

Governance and Project Management 48


6.12 It is noted that these arrangements also ensure Departmental representation on<br />

each of the Principals Groups at Spring Hill and Otago (through a senior management<br />

representative). This provides opportunity for Departmental staff to support the<br />

Construction Project Director in representing the Department’s interests at senior<br />

construction management level.<br />

6.13 This structure is illustrated below:<br />

Independent Advice<br />

6.14 There are a number of mechanisms for the RPDP programme to receive<br />

independent advice.<br />

• Review of project management processes for cost and margin development<br />

(Sherwin, Chan and Walshe, Rider Hunt).<br />

• Review of CWA methodology application (CMS).<br />

• Review of governance and management arrangements (Internal Audit unit, Audit<br />

New Zealand).<br />

• Reviews of TOC development (across a range of areas).<br />

Governance and Project Management 49


6.15 The CWA methodology as discussed earlier is one which requires the overhead of<br />

checks and balances to prompt for probity and project efficiencies. Overall, there now<br />

does appear to be adequate checking on the project at both governance and project<br />

management levels.<br />

Development of Governance and Management of RPDP<br />

Current Roles and Structures<br />

6.16 The course of the RPDP programme has seen a number of developments to<br />

strengthen and improve governance and management arrangements as the programme<br />

has progressed.<br />

6.17 Current arrangements have been in place since late 2005 . These arrangements<br />

were developed following a review of project risks (specific to Northland) commissioned<br />

by the Department’s Internal Audit Unit in late 2004. The present structure addresses a<br />

number of issues raised by Audit New Zealand, and which are reflected in the research for<br />

the current review, namely that prior to late 2005, there was:<br />

• inconsistent understandings amongst Steering Group members as to their role: as<br />

an advisory group (representing their area of the Department) and/ or as a<br />

governance group (with decision-making responsibilities);<br />

• insufficient formal reporting to the Steering Group;<br />

• the requirement of the Steering Group to make decisions under considerable time<br />

pressure (the CWA fast track approach means that often significant decisions are<br />

required to be made/ accepted with some urgency to enable ongoing project<br />

progress);<br />

• provision of documentation for supporting decisions ‘after the fact’;<br />

• the Steering Group often made decisions based on verbal updates from the<br />

Project Director;<br />

• Steering Group questions regarding risks and issues would sometimes be<br />

answered specifically, and elsewhere responded to with broad assurances; and<br />

• the scope of responsibility of the Project Director was extremely broad, and there<br />

was a sense that commissioning activities might suffer at the expense of<br />

construction activities.<br />

6.18 Current arrangements are generally considered to address all of these issues.<br />

Roles and responsibilities are clearly documented, the Programme Office is managing<br />

reporting effectively, and the establishment of separate workstreams for construction,<br />

commissioning and programme management has improved focus.<br />

6.19 We note that the Department initiated these improvements in the RPDP<br />

governance prior to becoming aware of the cost escalation at Spring Hill and Otago.<br />

8<br />

8<br />

Internal Memorandum from Matrix Manager 19 September 2005, TOR Papers SG Meeting<br />

19 December 2005. Arrangements were based on a review commissioned from Deloitte during<br />

2005.<br />

Governance and Project Management 50


Previous Arrangements<br />

6.20 While the Department’s Assets and Property Division continues to manage the<br />

additions to existing facilities, lessons learned from successful completion of ACRP and<br />

the significant size of the proposed new facilities construction motivated decisions to<br />

establish a different project management structure for the proposed new construction, and<br />

RPDP was established. Accordingly, the Department appointed a Project Director with<br />

large-scale construction project experience under the oversight of a Department<br />

governance group.<br />

6.21 Originally, the governance group comprised the Chief Finance Officer, and a<br />

Steering Group of Departmental senior managers. As the project progressed, decisions<br />

were made to complement the experience of the Steering Group with additional expertise<br />

(particularly in the construction area):<br />

• In mid-2001, a construction engineer was appointed advisor on materials<br />

production options and other building matters (for a 12 month period);<br />

• In January 2004, an independent consulting structural/civil engineer with wide<br />

experience in the building industry was appointed to the Steering Group; and<br />

• In 2004, a Treasury Vote Manager joined the Steering Group in an observer<br />

capacity.<br />

6.22 The Project Director reported directly to the Chief Financial Officer, and to the<br />

Steering Group. Initially, the Project Director had a wide responsibility for oversight over<br />

design, cont ract management, construction, procurement, commissioning (operational<br />

set-up) and security for all prisons projects.<br />

Issues and Challenges<br />

6.23 The governance and management of the RPDP programme has faced a number<br />

of issues and challenges, some of which have been recognised by the Department and<br />

addressed through review, structural and process change and the acquisition of additional<br />

capability (see above). The following sections discuss governance and management<br />

challenges faced over the course of the programme.<br />

Steering Group Decision-Making and Representation<br />

6.24 Steering Group members are senior managers with significant line responsibilities<br />

within the Department. The RPDP project was an additional responsibility to manage.<br />

One role for the CFO was to manage the Project Director and this on top of an already<br />

heavy workload.<br />

6.25 This situation and the specific functional and line management experience of the<br />

group members may explain the reported differences of understanding of the role of the<br />

Steering Group for the project at its inception (in review discussions). The role of the<br />

Steering Group was seen by many (including some Steering Group members) as an<br />

advisory one to the project, particularly regarding project impacts and interests for the<br />

respective functional areas of the Department, with a deferral to the Chair for project<br />

decision-making (often in consultation with the Project Director). Others (also including<br />

some Steering Group members) saw the role as more actively contributing to RPDP<br />

decisions.<br />

Governance and Project Management 51


6.26 The role of the Treasury Vote Manager (from 2004) was that of an observer,<br />

recognising Treasury’s role in monitoring government spending.<br />

6.27 The Chair/ CFO holds overall financial delegations for the programme, within<br />

limits set by the Department’s delegations.<br />

6.28 We note that the documented RPDP Terms of Reference from September 2005<br />

clearly states the roles and responsibilities of Steering Group members, as a mix of<br />

advisory and decision-making. Our discussions with Steering Group members indicate<br />

there is still some lack of common understanding amongst Steering Group members as to<br />

their role (e.g. advisory vs governance).<br />

6.29 Prior to 2005 changes, the Steering Group also appeared somewhat constrained<br />

in its ability to contribute effectively to decision-making through a lack of sufficient and<br />

timely information for decisions. Review of Steering Group minutes and discussions with<br />

department personnel indicates numerous requests for additional information, which was<br />

often not forthcoming.<br />

6.30 The Department’s Internal Audit Unit also raised concerns around the need for<br />

improved transparency of information to the Steering Group and better reporting to<br />

enhance its decision-making role. In particular, Internal Audit identified some risks posed<br />

by the newness of the CWA methodology, and the desirability of more documentation to<br />

support its adoption.<br />

6.31 There was a Treasury Vote Manager as observer at Steering Group from early<br />

2004. Treasury have commented on the lack of depth and timeliness of information<br />

provided to support decisions. Repeated queries for information were not always<br />

satisfied. Treasury did commission an independent report on the CWA revised<br />

procurement strategy in February/ March 2004, which provided some assurances on the<br />

CWA structure adopted (at a high level), but which also commented on the lack of detailed<br />

documented rationale for this methodology (Opus 18 March 2004).<br />

6.32 We note that these issues of information and reporting are now resolved or being<br />

managed through the revised governance and management structures for the RPDP<br />

programme.<br />

6.33 The challenge is to ensure that recommendations are understood, implemented<br />

and monitored. At the governance level, the PMO has a significant contribution to make<br />

in ensuring project integration, and that the roles of the Steering Group and advisors are<br />

discharged as envisaged.<br />

Project <strong>Report</strong>ing<br />

6.34 Project reporting at site level was conducted using the systems of the various main<br />

CWA partners. The Department required reporting across all projects to enable the<br />

project management team to gauge project progress overall. Accordingly, the project<br />

construction management team developed standardised project planning and reporting<br />

tools. The system used by the Department did have some initial issues of integration with<br />

site specific systems. This integration issue led to some early delays in aggregated<br />

reporting on progress to the Project Director and to the Steering Group. These issues<br />

have since been overcome.<br />

6.35 For future projects, the question of integration of reporting systems across multiple<br />

projects should continue to be addressed in the tender assessment stage, to ensure that<br />

overall project reporting is able to be implemented from early on in the project.<br />

the<br />

Governance and Project Management 52


Department ‘Client’ Representation<br />

6.36 Ensuring Departmental and Government interests are adequately represented at<br />

key programme levels has not been without challenge in a programme of this size and<br />

complexity.<br />

6.37 Below the Steering Group, prior to 2005, the three key project management roles<br />

of Project Director, Manager Administration and Contracting and the CWA Advisor were<br />

all filled by contractors. This is not surprising, given the lack of large scale construction<br />

project management expertise in the New Zealand public sector. Of these roles, the<br />

Project Director position had added significance due to the added responsibility of<br />

representing the Department on the Principals Group.<br />

6.38 We consider that representation on the Principals Group needs to include a senior<br />

department manager reflecting:<br />

• the senior level of representation on the principals Group (the commercial partners<br />

are represented by their CEOs);<br />

• the need for close links between the Principals Group and the Department’s senior<br />

management team; and<br />

• the need to ensure a public policy perspective complements the commercial<br />

expertise that is required for this role.<br />

6.39 For these reasons, we support the addition of one of the Department’s senior<br />

managers to each of the Principals Group in late-2005. 9 Notwithstanding, these<br />

individu als would still have a challenging job in “wearing two hats”, that of the CWA<br />

Principal and that of the Department (taking into account responsibilities to the wider<br />

public ).<br />

Effects of Project Fast Tracking<br />

6.40 The fast track nature of the prisons projects, particularly when the size of the<br />

projected prison muster was known, meant that there was often considerable pressure to<br />

make quick decisions at Steering Group level, again based on little information or on<br />

verbal representations from the Project Director. This often resulted in situations of so-<br />

to satisfy reporting<br />

called ‘no choice’ decisions presented to the Steering Group. Either the decision had<br />

already been taken, and the expectation was for Steering Group to endorse it, or there<br />

was insufficient time or information to allow appropriate assessment before decisionmaking.<br />

Documentation to support decisions would sometimes be provided after the fact,<br />

requirements.<br />

6.41 This was the situation regarding the decision to adopt the CWA methodology,<br />

where the idea was presented verbally, and followed up with some supporting<br />

documentation. By the time the documentation arrived, pressures of time and resource<br />

meant that the decision was considered inevitable.<br />

6.42 Another effect of fast tracking was the collapsing of project phases and processes.<br />

For example, in the case of the development of Otago, eight months was gained when<br />

9<br />

Audit).<br />

On the recommendation of Audit New Zealand (commissioned by Departmental Internal<br />

Governance and Project Management 53


planning progressed through the Environment Court faster than expected. The decision<br />

was taken to proceed with project implementation, even though the design team had not<br />

yet completed detailed design and was under considerable time pressure. This decision<br />

would have had implications for early development of the TOC estimates on the project,<br />

as completed design is a requirement for this.<br />

6.43 The decision to adopt a fast tracking approach was driven largely by the<br />

Department’s need to manage the significant risk that, according to projections, there<br />

would be lack of capacity to meet prisoner demand. In the absence of information to<br />

signal any significant cost issues until mid/late-2005, the Steering Group did focus on<br />

project time frames as a priority.<br />

Summary<br />

6.44 This review has identified a number of challenges in respect of governance and<br />

management of the RPDP project, and has recognised areas of good practice and<br />

positive contribution from the project.<br />

Positive Contributions<br />

6.45 There are a number of positives that should be recognised.<br />

• New Zealand will have four regional prison projects completed on time and to meet<br />

the growth in the prison population.<br />

• The Steering Group comprised senior management in the Department and this<br />

group recognised gaps in knowledge and expertise that needed to be filled,<br />

namely: experienced Project Director, Audit and Independent Review processes,<br />

acquisition of external large scale project management expertise, and Treasury<br />

representation.<br />

• Changes to project governance and management structures from late-2005 have<br />

greatly increased the quality of review, reporting and decision-making on the<br />

projects. This includes the establishment of a Programme Management Office<br />

(PMO) in February 2006 to assist with the project and risk management<br />

dimensions at governance and project management levels.<br />

• Formation of the Construction Sub-committee, comprising appropriate expertise<br />

and with responsibility for decision-making advice to the wider group on complex<br />

technical matters.<br />

• These arrangements and changes have made significant improvements to the<br />

quality of reporting, decision-making and potential for risk management. We note<br />

that the PMO has potential to significantly assist the programme governance, but<br />

that this is still early days for this role.<br />

• Mid-2005, a senior Department manager was appointed to each of the CWA<br />

Principals Groups at Otago and Spring Hill sites. This complemented the<br />

commercial skills of the Project Director and provides a more direct link between<br />

the Principals Group and the Department’s senior management team.<br />

• At site project management level, the departmental interest has been represented<br />

by appointment of permanent departmental staff as CWA Manager at Otago and<br />

Auckland Women’s.<br />

Governance and Project Management 54


• While it is outside of the scope of this review to assess the specific project<br />

Challenges<br />

management methodologies at respective sites, we observe that the project<br />

management approaches of the main CWA partners do employ expected tools for<br />

project management of planning, project risks, costing, progress monitoring,<br />

resource management. We note that RPDP played a role in developing planning<br />

and reporting tools for the programme.<br />

6.46 While the RPDP project is delivering regional prisons for New Zealand, this review<br />

has identified a number of challenges for governance and management of the project at<br />

varying times in the development of the overall RPDP programme.<br />

• The Steering Group composition did not include personnel with strong large scale<br />

project management experience (mainly line managers) until 2003 with the<br />

appointment of the independent project consultant to the Group.<br />

• Prior to the review in 2005, the role of the Steering Group was not consistently<br />

clear to all members in terms of its advisory and/or governance responsibilities.<br />

• There was little or no expertise amongst Steering Group members and Treasury<br />

as observer in respect of the CWA methodology, and therefore to provide a first-<br />

and<br />

hand appreciation of critical elements of the methodology to be managed,<br />

risks.<br />

•<br />

Prior to the review in 2005, there was insufficient formal reporting to Steering<br />

Group to support key decisions and to signal project risks adequately. <strong>Report</strong>ing<br />

tended to be historical in nature, with little indication of future estimations of costs<br />

to completion (against budget).<br />

• Prior to 2005, the Department did not have senior management representation on<br />

the Principals Group. This had the potential to weaken the linkage between the<br />

Group and the Department’s senior management team. Until mid 2005, the<br />

Department’s interests were represented directly at site CWA Manager level only.<br />

• Throughout the progress of the RPDP the risk of not having adequate capacity to<br />

meet the rapidly growing demand for prison accommodation, and the implications<br />

of this, was a major imperative and driving factor behind governance and<br />

management decisions.<br />

Lessons Learned<br />

6.47 The experience of the RPDP project development provides a number of lessons to<br />

be learned from a governance and management perspective.<br />

• Ensure that the project goals and objectives are agreed and clearly communicated<br />

to all parties at the commencement of the project, and that they encompass all<br />

three key elements of time, cost and quality – even in cases of ‘fast-tracking’.<br />

• Ensure that the roles and accountabilities of the respective governance and<br />

management groups and individuals are clearly specified and communicated from<br />

the commencement of project planning.<br />

Governance and Project Management 55


• Ensure that the Steering Group has the appropriate mix of knowledge and skills to<br />

be able to represent the Department and the wider Government interests, and<br />

govern a large scale project.<br />

• Ensure that there are regular independent quality assurance processes in place for<br />

oversight of governance and project management approaches (including decisionmaking<br />

and risk management), as well as for oversight of the lower level project<br />

management processes for cost calculation, and quantitative risk assessment.<br />

This will ensure independent reporting of any governance issues/ risks at various<br />

stages, including concerns re information provision.<br />

• Ensure that the Steering Group is provided with adequate information in a timely<br />

fashion to assess and manage risks, and support effective decision-making, and<br />

reporting to Ministers.<br />

•<br />

Ensure project reporting not only assesses historical progress but also estimates<br />

future issues and progress remaining against all project objectives.<br />

Governance and Project Management 56


7 <strong>Report</strong>ing to Ministers<br />

Key Findings<br />

• A key advantage of the CWA methodology is that it promotes very high levels of disclosure<br />

around project costs and risks as projects progress. Through its membership of the CWA,<br />

the Crown can directly benefit from this transparency.<br />

• The Department holds regular (at least weekly) meetings with its Minister. Progress with<br />

the RPDP was typically discussed at these meetings. However, we understand that<br />

discussions tended to focus on progress with the projects rather than costs and associated<br />

risks.<br />

• The information provided to Ministers as part of Budget 04 and 05 did not provide<br />

adequate indication of the uncertainties and risks surrounding the cost estimates at that<br />

time.<br />

• Initial indications of a substantial cost increase were first signalled to the Minister of<br />

Corrections in August 2005 at which point work on the TOCs was well underway. Further<br />

and higher revised estimates were reported to Treasury (and, by implication, the Minister of<br />

Finance) in October 2005 and to Cabinet in December 2005. The risk of cost increases<br />

was not incorporated into the pre-election economic and fiscal update (published on 18<br />

August 2005 and including data up to 8 August 2005).<br />

Lesson Learned<br />

• The regular discussions with the Minister should include clearer reference to cost<br />

developments and associated risk estimates as work on the TOC proceeds.<br />

• Where cost estimates are uncertain (as was the case with these projects), this needs to be<br />

clearly explained to Ministers. For the purposes of providing advice to Ministers, it would<br />

be appropriate to indicate a range of possible cost estimates and, moreover, indicate the<br />

level of uncertainty attaching to the estimates. Such estimates should be clearly<br />

distinguished from formal Budget processes and funding decisions (where point estimates<br />

specified to the nearest $1000 are required).<br />

• There was scope to indicate, in at least a qualitative sense, the prospect of significant fiscal<br />

risk as part of the pre-election economic and fiscal update.<br />

• On projects of this scale, reporting should be linked to significant project milestones rather<br />

than to the Budget cycle. For example, cost estimates developed for Budget 05 preceded<br />

the start of construction on Spring Hill and Otago. A report to Ministers at, or about, the<br />

start of construction would be better practice.<br />

7.1 Cabinet directed that officials should report back on estimated costs associated<br />

with the projects as part of Budget 04 and 05. This was done. However, the information<br />

provided to Ministers did not provide adequate indication of the uncertainties and risks<br />

surrounding the estimates. Ministers could reasonably have interpreted the Budget 05<br />

cost estimates (and earlier estimates) as being firm estimates with relatively narrow<br />

margins of error when in fact the estimates, at that time, still had significant uncertainty.<br />

7.2 Based on interviews with Department and other personnel, the cost implications<br />

stemming from the TOC development were becoming apparent in August 2005. In light<br />

of this, the fiscal situation was progressively reported to Ministers as follows:<br />

• to the Minister of Corrections via Briefing on 2006 Budget Process and Five Year<br />

Planning Projections (19 August 2005). Indicative capital costs of $21m signalled<br />

<strong>Report</strong>ing to Ministers 57


in a table attached to the Briefing. We note that it is not immediately apparent<br />

from the table as to exactly what is the composition of, or basis for, the $21m;<br />

• to the Minister of Corrections via Briefing on 2006 Budget Process and Five Year<br />

Planning Projections (27 October 2005). This briefing signals in the text that<br />

increased capital approval will be required for Spring Hill and Otago. This is<br />

quantified as $130m in an attached table. Again, it is not clearly apparent from the<br />

table exactly as what is the make up of the $130m. The text of this table contains<br />

a conflicting reference to $80m additional capital approval (which we understand to<br />

be an error);<br />

• via Steering Group minutes of 27 September 2005, (advised by Construction<br />

Project Director that Spring Hill TOC estimated to be $50m above current budget);<br />

• via Steering Group minutes of 25 October 2005 (advised by Construction Project<br />

Director that Otago TOC estimated to be $30m above funding)<br />

• via Steering Group minutes of 29 November 2005 (advised by Construction<br />

Project Director that Spring Hill and Otago TOC estimated to be $140m above<br />

funding)<br />

• to the Treasury on 4 October 2005; and<br />

• to Cabinet on 15 December 2005 (although drafts of this paper were circulating<br />

among officials during November).<br />

7.3 Moreover, elements of the TOC had been completed prior to August 2005 and,<br />

therefore, provided some initial, but incomplete, insights to the potential cost increases.<br />

7.4 We note that quantification of the financial impacts were not clearly evident in<br />

RPDP Programme <strong>Report</strong>s to the Steering Group until December 2005 (although financial<br />

risk was foreshadowed to the Steering Group over several of the preceding months as<br />

evidenced in minutes). Meeting minutes do not record discussion on the verbal updates<br />

of financial impacts that are recorded. Such discussion may have been recorded if<br />

financial impacts had been clearly signalled in Programme <strong>Report</strong>s provided in advance to<br />

the Steering Group.<br />

7.5 Given the heated nature of the construction market in 2004 and 2005, it should<br />

have been clear that the increase in costs due to escalation was expected to be<br />

substantial. Given this, we consider that the reports to Ministers could have been more<br />

forthcoming in terms of foreshadowing the magnitude of expected cost increase.<br />

7.6 <strong>Report</strong>ing on financial impact tended to be verbal updates to Steering Group (as<br />

minuted) or through attached tables to reports to the Minister (and not immediately<br />

transparent). There is a judgement involved on the timing of reporting. The reasons for<br />

reporting as early as possible include:<br />

• it maximises opportunity to review the project and assess options for reducing cost<br />

if budgets are under strain;<br />

• it provides the Government with as much opportunity as possible to adjust its fiscal<br />

priorities; and<br />

<strong>Report</strong>ing to Ministers 58


• it is a core expectation that public servants strive to operate on a “no surprises”<br />

basis with Ministers.<br />

7.7 The reason for deferring the reporting of the TOC is essentially a function of the<br />

required level of certainty. Earlier estimates of the TOC could have been communicated,<br />

but they would have had wider “error margins”. Estimates that involve a wide range of<br />

possible costs are not necessarily helpful from a fiscal management perspective although,<br />

that said, there is a more general point regarding the communication of risks attaching to<br />

numbers that are reported to Ministers.<br />

7.8 We note that on 18 August 2005, the Pre-election Economic and Fiscal Update<br />

(PREFU) was published and that included data up to 8 August 2005. We understand that<br />

the fiscal information relating to Spring Hill and Otago included in PREFU was based on<br />

the April 2005 cost estimates. The PREFU is a significant document. Given the size of<br />

the fiscal risks surrounding Spring Hill and Otago, we consider that the fiscal information<br />

incorporated into PREFU should have included more up-to-date Spring Hill and Otago<br />

data, although we understand that because the risk was not under active consideration by<br />

Ministers at that stage, strictly speaking there was not a technical requirement to include<br />

up-dated data. Notwithstanding this, the fiscal risks should have been under active<br />

consideration. In particular, the progress that had been made with the TOCs for both<br />

projects should have been taken into account and signalled as part of PREFU at least in a<br />

qualitative sense.<br />

<strong>Report</strong>ing to Ministers 59


Appendix A: Funding Approvals<br />

The table below summarises the dates at which funding approvals for Spring Hill and<br />

Otago were provided as well as the dates at which Ministers received advice regarding<br />

the estimated costs for the projects.<br />

Date<br />

New Funding<br />

Approved<br />

Spring Hill<br />

Estimated Total<br />

Cost<br />

New Funding<br />

Approved<br />

Otago<br />

Estimated Total<br />

Cost<br />

15 May 2000 $1.5m $114.245m* $3.4m $79m**<br />

23 April 2001 $15.16m $194.4m* - -<br />

1 October 2001 - $172.826m* $7.8m Not indicated<br />

28 January 2003 - $232.455m - $133.611m<br />

17 November 2003 - $248.127m - $162.191m<br />

15 December 2003 $7.5m No further update<br />

given<br />

- -<br />

26 April 2004 $42.815m $248.127m $144.591m $160.991m<br />

15 September 2004 $3.636m $248.127m - -<br />

11 April 2005 $211.968m $282.579m $19.022m $174.813m<br />

19 December 2005 $97.731m $380.310m $43.110m $217.923m<br />

* These estimates assumed a 350 bed capacity. Later estimates relate to a 650 bed facility<br />

** This estimate assumed a 220 bed facility. Later estimates relate to a 335 bed facility.<br />

Several points can be noted from the table above.<br />

• The estimates of total cost were presented as point-estimates rather than ranges.<br />

This is unhelpful as it could be interpreted as implying a level of precision and<br />

certainty which was not warranted (and not intended). It is only the latest of the<br />

estimates where there is a relatively high degree of certainty.<br />

• <strong>Report</strong>ing has been linked closely to the Budget cycle (Budget 04 and Budget 05<br />

in particular). We consider that reporting should more closely track the<br />

construction timelines for the projects (notwithstanding the need to link funding<br />

decisions in with Budget processes and timetables). The frequency of reporting<br />

given the size of, and fiscal risks around, the projects should be increased once<br />

project construction is underway (this could be as frequent as quarterly). <strong>Report</strong>ing<br />

could, in the first instance be to the Ministers of Finance and Corrections and then<br />

to Cabinet as required.<br />

• The estimated costs reported to the Cabinet Business Committee on 28 January<br />

2003 were included in a paper prepared by the Treasury and the <strong>State</strong> <strong>Services</strong><br />

<strong>Commission</strong>. The report did not provide any details as to the basis upon which the<br />

estimates had been prepared.<br />

: Funding Approvals 60


• The report prepared by the Department and considered by Cabinet on 17<br />

November 2003 provided further up-dating of the estimated costs for Spring Hill<br />

and Otago. This report provided little explanation regarding the basis for the cost<br />

estimates or how they link to earlier estimates. At that stage, however, Cabinet<br />

had not approved funding for the construction of Spring Hill and Otago. Fuller<br />

discussion of the cost estimates was held over, with the agreement of Cabinet,<br />

until Budget 04 (i.e. April 2004). Notwithstanding this, given that the numbers<br />

presented in early and late 2003 were substantially in excess of those previously<br />

reported, we would have expected there to be some discussion of the basis upon<br />

which the estimates were made. Further, although the report indicated fiscal risks<br />

stemming from the effects of escalation, the relative size of the risk was not<br />

articulated, even in general terms.<br />

In the case of Spring Hill, funding approvals were given on 15 December 2003, 26 April<br />

2004 and 15 September 2004. Each of the papers supporting the approvals included cost<br />

estimates expressed in 2003 dollars. Ministers were advised that escalation would push<br />

up the cost estimates and that additional funding in light of this would be sought as part of<br />

Budget 05. The heated nature of the construction market was increasingly evident over<br />

the period from December 2003 to September 2004. Accordingly, by September 2004, it<br />

should have been clear that the increase in costs due to escalation was expected to be<br />

substantial. Given this, we consider that the reports to Ministers could have been more<br />

forthcoming in terms of foreshadowing the magnitude of expected cost increase.<br />

: Funding Approvals 61


Appendix B: CWA Best Practices<br />

Objectives and Behaviours<br />

Clarity of objectives and shared understanding of those objectives is core to the success<br />

of any alliancing arrangement. Being able to describe and communicate objectives are<br />

not, of themselves, sufficient however. Actions need to be aligned with objectives and<br />

supported by behaviours that reflect and support the ethos of the alliance. Good CWA<br />

practice in this regard involves the following:<br />

• equity – sharing or rewards and penalties commensurate with performance but<br />

based around the goal of win/win rather than win/lose;<br />

• actions taken are best for project. This is required at many levels – for example,<br />

the PEG comprises personnel selected on the basis of best for project – not on the<br />

basis of which organisation employs them;<br />

• high levels of integration in terms of project management, governance, reporting,<br />

systems etc;<br />

• open and honest communication;<br />

• culture of no blame;<br />

• collective responsibility and accountability for project outcomes;<br />

• trust integrity and respect;<br />

• innovation; and<br />

• mutual support.<br />

CWA Partner Selection<br />

Irrespective of the form of procurement method used, getting the best mix of contractors<br />

and others is critical to project success. The process for selecting contractors and others<br />

is not part of the brief for this review (these matters have been reviewed by Audit <strong>NZ</strong>).<br />

Notwithstanding this, it is worth noting some of the similarities and differences between<br />

traditional procurement and procurement using CWA.<br />

Both forms of procurement for major projects tend to involve multi-stage selection<br />

processes involving Expression of Interest, Request for <strong>Proposal</strong>, shortlisting and then<br />

intensive negotiation with one or a small number of preferred bidders. Traditional<br />

procurement usually has price as a major, if not predominant, selection criterion. CWA, in<br />

contrast, may or may not have price as a criterion (but price does not have to be<br />

excluded).<br />

A further difference between procurement methods is that traditional procurement typically<br />

involves tendering several discrete contacts (for design, for construction, for civil works<br />

and so on) where as under alliancing, the objective is to build a team and the selection<br />

process needs to reflect this. Under CWA the selection process would normally involve<br />

workshops with shortlisted candidates. One of the objectives of the workshops is to build<br />

62


elationships and, as part of this, establish the ability of the parties to work collaboratively<br />

with one another in the spirit of alliancing.<br />

Leadership Structure<br />

Alliance projects have a single integrated project team. At the head of the alliance is the<br />

Principals Group. This group comprises the heads (typically CEOs) of the parties involved<br />

in the alliance. In a general sense, the roles of the Principals Group are to:<br />

• create the alliance vision, principles and objectives;<br />

• set policy and delegations;<br />

• appoint members of the PEG and empower it to perform the obligations under the<br />

CWA Agreement;<br />

• promote principles and objectives throughout the alliance team;<br />

• resolve issues that arise within the alliance; and<br />

• agree the TOC<br />

The Department is represented on the Principals Group. The Principals Group operates<br />

on the basis of collective responsibility and unanimous decision making. This creates<br />

some issues that are discussed in section six below because the Departmental<br />

representatives on the Principals Group have an obligation to the CWA as well as, of<br />

course, an accountability to the Department as client. This creates some complex<br />

dynamics that need to be carefully managed.<br />

Beneath the Principals Group is the alliance management team or, as it is referred to in<br />

the RPDP context, the PEG. PEG members are appointed on the basis of best for<br />

project. This means that in theory, a constructor could, for example, fill the position of<br />

design manager and vice versa. The roles of the PEG include:<br />

• delivering the project objectives;<br />

• day-to-day management;<br />

• providing leadership to the wider project teams;<br />

• appointing members of the wider project teams on a best for project basis; and<br />

• resolving issues.<br />

Beneath the PEG lie the various project teams.<br />

The structure and roles of the Principals Group and PEG are quite different to the<br />

structures and accountabilities that normally exist under a <strong>NZ</strong>S 3910 form of contract. For<br />

example, in traditional projects, a client engineer overviews and checks the designer’s<br />

engineers and there are cost controllers and schedulers in each organisation. In contrast,<br />

under a CWA, there is one team, one schedule, one cost control team and one design<br />

team. In theory, the benefits of having one integrated team is the cost saving from not<br />

having duplication of roles and what is referred to as man-to-man marking.<br />

63


CWA Agreement<br />

The CWA Agreement is a key reference point. Effective agreements are characterised as<br />

having:<br />

• project delivery and performance objectives that are collective;<br />

• unanimous decision making (which forces the parties to find alternative solutions if<br />

there is not universal agreement);<br />

• no fault, no blame and no dispute. There are no dispute resolution clauses. It is<br />

the role of the Principals Group to sort out issues;<br />

• commercial arrangements (TOC, QRA and gain/pain share) that support the<br />

alliance principles and create the right incentives for win/win outcomes; and<br />

• transparency and an audited open book approach (which is critical in terms of<br />

determining the commercial aspects referred to in the point above).<br />

Commercial Framework<br />

A fundamental design principle of the commercial framework within an alliance is equity in<br />

the sense that if one party gains, the others gain as well and, equally, if one party loses,<br />

the loss is shared with all. This principle translates into alliance agreements by<br />

incorporating the following features:<br />

• the commercial participants entitlement to payment is limited to their agreed direct<br />

costs, margins, overheads and gain/pain share;<br />

• the commercial participants will earn at least their direct costs (but may not earn<br />

any, or all, of their margins and overheads if performance falls short of that<br />

required). In general, the painshare for commercial participants is capped at 100%<br />

of the sum of margins and overheads;<br />

• any cost overrun is shared across the CWA members on the basis of pre-agreed<br />

formula;<br />

• the gain share arrangements provide for reward for superlative performance (in<br />

financial and/or non-financial terms). The performance measures which seek to<br />

define standards of performance are agreed by the CWA partners; and<br />

• there is a pre-agreed process for the determination and timing of gain/pain share<br />

payments.<br />

The commercial framework under CWA is quite different to that for a traditional contract.<br />

From the client’s perspective, a traditional (tendered) contract involves a pre-agreed price.<br />

The basis upon which price is determined is, at best, of only secondary interest. In<br />

contrast, under CWA the focus is on the transparency of costs and risks. CWA members<br />

assume collective ownership for costs and risks with an equitable sharing of the gain or<br />

pain depending on how actual outcomes compare with pre-agreed benchmarks.<br />

7.9 Once a TOC has been agreed, the gain/pain share arrangements take on special<br />

significance. Some of the design features that would expect to be observed in gain/pain<br />

share arrangements include:<br />

64


• the gain and pain is linked to real risks and benefits that affect the value of the<br />

project from the client’s perspective;<br />

• gainshare is only paid if performance exceeds expectations;<br />

• gain and pain share arrangements promote win/win rather than win/lose outcomes.<br />

In other words, one CWA partner cannot gain at the expense of another;<br />

• the client is committed to paying 100% of the potential gain share if the relevant<br />

thresholds are achieved;<br />

• if gain and pain share arrangements are conditional on a mix of performance<br />

measures and objectives, then they should structured in a way that avoids<br />

achieving one objective at the expense of another; and<br />

• there is complete transparency over gain and pain share arrangements.<br />

65


Appendix C: Overview of Governance and Project<br />

Management<br />

The governance role is one which complements that of management, and of ensuring that<br />

good management practice is observed. The governance role is one which enables a<br />

group to focus on the larger picture – in this case the broader requirements of the<br />

Department, and of the Government as a whole – and to take a more future looking view<br />

of a programme of activity. In this way an effective governance group is prompted to<br />

ensure the goals of the programme are clear and maintained, to ask the ‘hard questions’,<br />

to require justification for management actions and to ensure key decisions are made on<br />

adequate information.<br />

In the public sector context the governance role is required to ensure that projects are in<br />

alignment with Government goals, risks are identified and managed appropriately, that<br />

processes and decisions are transparent, and that the proper requirements of probity and<br />

independence are observed.<br />

Risk Management<br />

Risk management is fundamental to effective governance, decision-making and<br />

monitoring. Risk management can and should occur at the various levels of governance<br />

and project management. Effective risk management means the continuous identification,<br />

evaluation and management of risk.<br />

Effective risk management at the governance level requires two key elements: adequate<br />

information reported on progress and plans, and the competency of the governance group<br />

to assess the meaning of events, the implications of decisions and risks, and the<br />

significance of lack of progress on key milestones.<br />

Accountabilities and Competencies<br />

An effective governance group will contain the range of competencies required to ensure<br />

effective governance and management of the project involved. In the case of RPDP<br />

competencies required would include understanding of the ‘business’ of Corrections and<br />

of prisons, sound understandings of large-scale construction project management,<br />

understandings of risk management and cost management, a strategic perspective<br />

regarding fiscal implications of projected project costs for wider government decisionmaking,<br />

and a clear understanding of the governance and leadership role of the<br />

governance group.<br />

At different times in the development of the project or its external environment the<br />

emphasis on different strengths required may change. Effective governance bodies will<br />

recognise this and adapt, through changing or reconfiguring their membership and<br />

competency mix.<br />

Accountability involves the governance group demonstrating to stakeholders that the<br />

project is being governed and efficiently managed, is sustainable operationally, risks are<br />

managed and that project integrity and probity are ensured. A key role is to ensure that<br />

sound independent audit processes exist to raise issues for assessment and confirm good<br />

practice is being adhered to.<br />

66


Decision-making<br />

Effective decision-making requires the governance group to be as knowledgeable and<br />

fully informed as possible about the projects and what they are intended to achieve, and<br />

the key issues and risks that they face. In a typical governance decision-making situation<br />

decision-makers ‘must balance risk with opportunity, compliance being a given, but in the<br />

context of moving forward’ 10<br />

To enable this, decisions brought to the governance group should be supported by an<br />

appropriate amount of detailed background work, analysis and evaluation.<br />

In addition to background material, the governance group must receive enough material to<br />

enable it ‘to distinguish between fact and opinion’ 11 Many proposals will, by nature,<br />

contain both facts and opinions. The facts enable the governance group to assess the<br />

risks they are taking, possible opportunities and to make a sound judgement. With<br />

opinion, the assessment of risk and opportunity is not as clear and usually needs careful<br />

examination, discussion and consideration. With opinion, the governance group also<br />

need to consider the competence, the perspective or independence of the source of the<br />

opinion.<br />

To assist with the assessment of particularly complex materials, the governance group<br />

may decide to establish a committee or sub-group to examine proposals in detail and<br />

develop a recommendation for the governance group. At times it is also helpful, and<br />

important, to seek expert opinion on some matters.<br />

<strong>Report</strong>ing<br />

To support decision-making the governance group requires regular and appropriate<br />

reporting. <strong>Report</strong>ing needs to address not only progress on the project, but an indication<br />

of progress remaining, including an estimate of work to be completed. <strong>Report</strong>ing will also<br />

include an assessment of ongoing project risks and mitigation strategies.<br />

10 Doug Matheson, The Complete Guide to Good Governance in Organizations and Companies, 2004: p410<br />

11 Ibid: p410<br />

67


Project Goals and Objectives<br />

A successful project is one which delivers the results expected by key stakeholders, and<br />

specifically the paying client (in this case the Department of Corrections) and achieves a<br />

balance across quality (results), time, cost and customer satisfaction.<br />

This can be represented:<br />

Balancing Four Project Dimensions<br />

Results/ quality<br />

Customer satisfaction<br />

Time<br />

Resources/ costs<br />

A good foundation for a successful project will have agreed goals and objectives for each<br />

of these key dimensions. This represents the project definition and scope, which is used<br />

to guide project and governance decisions and test project progress against expected<br />

results.<br />

Project Management Phases and Processes<br />

A project will generally move through a series of distinct phases from concept<br />

development, through planning, to definition and design and next to implementation and<br />

finally acceptance. Throughout these phases there are a number of key project<br />

management processes that are applied across initiating, planning, organising, controlling<br />

and closing.<br />

The following diagram illustrates the project phases and processes:<br />

Project Management Processes<br />

Project management processes recur throughout the lifecycle:<br />

Organising<br />

processes<br />

Intensity<br />

Initiating<br />

processes<br />

Planning<br />

processes<br />

Controlling<br />

processes<br />

Closing<br />

processes<br />

Conceptual<br />

Phase<br />

Planning<br />

Phase<br />

Definition &<br />

Design Phase<br />

Implementation<br />

Phase<br />

Acceptance<br />

Phase<br />

68


The decision-making for each project phase is supported by project reporting (a key<br />

controlling process mechanism) against plans for progress, risks and projected project<br />

outturn.<br />

Project Management Tools and Techniques<br />

Each project phase requires the application of specific tools and techniques for effective<br />

project management. This includes tools and approaches for management of project<br />

integration (charter, planning and reporting tools), project timings, project costs, project<br />

quality, project risks, communications and procurement.<br />

Project Management Office<br />

For large scale projects it is often useful to adopt the approach of using a Project<br />

Management Office (PMO). The PMO is used to centralise and co-ordinate the projects<br />

under its domain. The PMO can operate on a continuum, from providing project<br />

management support functions (in the form of training, software, standardised policies and<br />

procedures), to actual direct management and responsibility for achieving the project<br />

objectives.<br />

Project Management and Line Management<br />

There are some fundamental differences between the orientation of line management and<br />

that of project management. Managing a project means making decisions around a<br />

unique programme of work (and which is often posing new challenges), working to defined<br />

deadlines and managing the resources and risks to achievement of the end result.<br />

Project management requires an approach of constantly thinking ahead for opportunities<br />

and risks, as well as monitoring progress.<br />

Line management is often about maintaining a flow of consistent business-as-usual work<br />

(which is generally familiar), in situations where the management of risk, while important,<br />

is not as volatile. Line management is a more continuous dynamic (although not without a<br />

need for planning).<br />

While line managers do get involved in managing projects, there is still a significant<br />

difference between the two disciplines. Therefore, it is important to ensure that the<br />

composition of a project governance group comprises individuals who have some<br />

experience of governance and project management as well as the specific technical<br />

competencies as their contribution.<br />

69

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!