NZ Report / Proposal Template - State Services Commission
NZ Report / Proposal Template - State Services Commission
NZ Report / Proposal Template - State Services Commission
You also want an ePaper? Increase the reach of your titles
YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.
<strong>Report</strong> of the <strong>State</strong> <strong>Services</strong> <strong>Commission</strong>er<br />
into the Cost Escalation in the Regional Prisons<br />
Development Project<br />
7 August 2006
<strong>State</strong> <strong>Services</strong> <strong>Commission</strong><br />
Review of Cost Escalation in Regional Prisons Development<br />
Project<br />
31 July 2006
Disclaimer<br />
In preparing this report, we have relied upon, and assumed the accuracy and<br />
completeness of, all the information made available to us from organisations that have<br />
provided information relevant to our report. We have been assured by the Department of<br />
Corrections that all information relevant to the completion of the review has been<br />
provided. We have evaluated that information through analysis, inquiry and review but<br />
have not sought to verify the accuracy or completeness of any such information. It<br />
should not be construed that we have conducted an audit of the information.<br />
The statements and opinions expressed in this report have been made in good faith.<br />
Accordingly, neither PricewaterhouseCoopers nor its partners, employees or agents,<br />
accept any responsibility or liability for any such information being inaccurate, incomplete,<br />
unreliable or not soundly based, or for any errors in the analysis, statements and opinions<br />
provided in this report resulting directly or indirectly from any such circumstances, or from<br />
any assumptions upon which this work is based, proving unjustified.<br />
We reserve the right, but are under no obligation, to revise or amend our report if any<br />
additional information which exists on the date of this report, subsequently comes to light.<br />
This report has been prepared solely for use by the <strong>State</strong> <strong>Services</strong> <strong>Commission</strong> and the<br />
Treasury for the purpose of assisting these organisations in their reporting back to<br />
Ministers regarding the processes, systems and contracting practices at the Spring Hill<br />
and Otago prisons. We accept no responsibility to any other party, unless specifically<br />
agreed by us in writing. Furthermore, we accept no responsibility for any reliance that<br />
may be placed on this report should it be used for any purpose other than that set out<br />
above.
Table of Contents<br />
1 Executive Summary .................................................................................................1<br />
2 Introduction ..............................................................................................................6<br />
3 Background..............................................................................................................9<br />
4 Key Drivers and Causes of Cost Escalation ..........................................................13<br />
Overview of Cost Increases 14<br />
General Comments Regarding Cost Increases 15<br />
Market Influences 16<br />
Consents and Regulatory Changes 19<br />
Design Finalisation 20<br />
Summary 20<br />
Lessons Learned 21<br />
5 Methodology and Processes: Design, Costing, Procurement and Scheduling ......22<br />
Introduction 24<br />
Design 24<br />
Costing 25<br />
Procurement and Scheduling 34<br />
Summary 43<br />
6 Governance and Project Management ..................................................................45<br />
Introduction 46<br />
Current RPDP Arrangements 48<br />
Development of Governance and Management of RPDP 50<br />
Issues and Challenges 51<br />
Summary 54<br />
Lessons Learned 55<br />
7 <strong>Report</strong>ing to Ministers ............................................................................................57<br />
Appendix A :<br />
Funding Approvals...................................................................................60<br />
Appendix B : CWA Best Practices ................................................................................62<br />
Appendix C :<br />
Overview of Governance and Project Management................................66<br />
iv
1 Executive Summary<br />
1.1 Construction of new prisons at Spring Hill in North Waikato (referred to as the<br />
Spring Hill project) and near Millburn in Otago (referred to as the Otago project) is<br />
underway. In December 2005, Ministers were advised that the cost of the projects had<br />
increased by $140.8 million compared to estimates provided earlier in the context of<br />
Budget 2005.<br />
1.2 In light of the added cost, the <strong>State</strong> <strong>Services</strong> <strong>Commission</strong>, in consultation with the<br />
Treasury, was asked to independently review the processes, systems and contracting<br />
practices used by the Department of Corrections (the Department) in connection with the<br />
two prisons.<br />
1.3 Consistent with the terms of reference for the review, the report which follows has<br />
been structured around the four primary questions:<br />
• What were the drivers and causes of the cost escalation?<br />
• What lessons can be learned from, and about, the Department’s methodology and<br />
process used to design, cost, procure and schedule (excluding commissioning) the<br />
Spring Hill and Otago projects?<br />
• What lessons can be learned in relation to the project management and<br />
governance of the projects?<br />
• What level of reporting to Ministers would be appropriate for projects of this size?<br />
Context<br />
1.4 The Spring Hill and Otago projects are part of a wider programme of increasing<br />
prison capacity. The Department has been building 325 beds per year on average since<br />
1996 into existing prisons. However, this is not sufficient to meet the expected growth in<br />
the prison population. New prisons have also been required and the Spring Hill and Otago<br />
projects are part of a wider programme referred to as the Regional Prisons Development<br />
Programme (RPDP).<br />
1.5 The RPDP was announced in 1997. It comprises two regional prisons in addition<br />
to Spring Hill and Otago, both of which are now operational; these are located at Ngawha<br />
in Northland and in Manukau (the recently opened Auckland Women’s facility).<br />
1.6 Several factors have had a significant bearing on the Spring Hill and Otago<br />
facilities (and RPDP more generally). Foremost among these is the expected growth in<br />
prison population. In 1999, the prison population forecast for 2008 was 6,800. The<br />
current forecast for 2008 is 8,600; a 26% increase. It is important to note that the<br />
Department depends on Ministry of Justice prison population forecasts. These forecasts<br />
have a five year horizon which is significantly shorter than the lead time for completing a<br />
new prison. As a result of this, and reflecting the revised forecasts, the RPDP has<br />
required considerable flexibility to adapt to changing circumstances. In particular, there<br />
have been changes to the bed numbers at three of the four regional prisons:<br />
Auckland Women’s ‣ 150 to 286<br />
Spring Hill ‣ 350 to 650<br />
Otago ‣ 220 to 335<br />
Executive Summary 1
1.7 The increases have impacted on planning, consents, design, construction and<br />
cost.<br />
1.8 A second key factor influencing the RPDP has been the process of obtaining<br />
consents under the Resource Management Act. The outcome of this process (which is<br />
not part of this review) has resulted in changes to the approach to design and<br />
construction. These changes have, in turn, contributed to the Department using a form of<br />
procurement – referred to as a Collaborative Working Arrangement or CWA – that is<br />
fundamentally different to the more traditional fixed price form of contracting. The change<br />
in procurement method has assisted the Department to deliver the regional prisons in time<br />
to meet growth in the prison population. However, the CWA methodology has also raised<br />
a number of issues and lessons.<br />
1.9 The third contextual consideration is the fact that the new prisons have been built<br />
during a heated construction market. As a result, substantial cost increases have been<br />
experienced in relation to labour and materials. Moreover, the sheer size of the RPDP<br />
project in relation to New Zealand’s construction, design and quantity surveyor capacity<br />
has stretched available resources.<br />
Key Findings<br />
1.10 Growth in the prison population has been a key driver for the RPDP. The<br />
Department has successfully responded to this, and the changes in forecasts, by<br />
delivering the Northland and Auckland Women’s prisons on time, within budget and to the<br />
standard required. It is on track to complete the Spring Hill and Otago facilities in time to<br />
meet requirements.<br />
1.11 The costs of the Spring Hill and Otago facilities have increased by $140.8 million<br />
compared to estimates presented as part of Budget 05. Several factors have contributed<br />
to the increase including:<br />
• market factors, including inflation in relation to input costs (e.g. steel) and labour,<br />
as well as the need to pay increased allowances to attract scarce labour<br />
resources. The remote location of the construction sites added to these<br />
pressures;<br />
• the outcome of consent processes and regulatory changes; and<br />
• design changes following the completion of Northland and additional work on a<br />
range of infrastructure services.<br />
1.12 It is important to note that the estimates provided as part of Budget 05 should have<br />
been clearly communicated as indicative only. In particular, the level of cost escalation<br />
incorporated into the Budget 05 numbers was based on external forecasts that are known<br />
to have limitations. Further, the estimates were based on traditional quantity surveyor<br />
data that did not sufficiently recognise the specific circumstances of the Spring Hill and<br />
Otago projects.<br />
1.13 It is also important to note that the CWA methodology used for the RPDP projects<br />
differs from traditional procurement methods in that the principal contractors do not submit<br />
fixed price quotes. Instead, the overall cost of the projects is a function of direct costs<br />
(labour and materials) plus agreed allowances for margins and overheads. There is a<br />
process – referred to as the development of the Target Outturn Cost (TOC) – that is<br />
fundamental to agreeing the level of overall costs. Various factors including, in particular,<br />
constraints around the availability of design and cost estimation resources, have delayed<br />
Executive Summary 2
the development of the TOC until much later in the construction phase than is desirable.<br />
This has exposed the Crown to cost risk, which the Department has managed through<br />
independent scrutiny of cost data presented by contractors.<br />
1.14 The CWA methodology has a number of inherent advantages compared to<br />
traditional forms of procurement and the Department has captured many of these:<br />
• there has been close integration of design, construction and commissioning teams<br />
which assists in achieving an optimal balance between design, construction and<br />
operational requirements;<br />
• several value management reviews have been undertaken to further optimise<br />
designs and take out unnecessary costs;<br />
• at a site level, resources have been mobilised to deal with day-to-day issues<br />
thereby increasing the efficiency of on-site resource utilisation;<br />
• the collaborative approach to dealing with issues has helped to maintain<br />
momentum with the projects, thereby enabling the timing of projects to be<br />
completed on, or near to, expectations;<br />
• high levels of transparency in relation to costs have been achieved at the project<br />
level consistent with the “open-book” philosophy that underpins CWA (with some<br />
opportunity for more transparency over margins – see Section 5); and<br />
• costs submitted by the commercial CWA partners have been exposed to extensive<br />
third party scrutiny and review.<br />
1.15 Overlaying all of these benefits, the methodology chosen by the Department<br />
means that it is on track to deliver Spring Hill and Otago in time to meet the expected<br />
growth in the prison population. There were sufficient indications to suggest that had the<br />
Department elected to follow a traditional procurement method, timeframes for completing<br />
the projects would probably not have been met.<br />
1.16 Projects of the size and complexity of Spring Hill and Otago need tight<br />
management. RPDP project governance and management arrangements have delivered<br />
(or will soon deliver) four regional prisons to accommodate the growth in prison<br />
population.<br />
1.17 Current arrangements for project governance, following a review during 2005,<br />
have resulted in improved governance and project management of RPDP. In particular,<br />
we consider desirable changes have included:<br />
• establishment of the Programme Management Office (PMO) and a specialist<br />
construction sub-committee;<br />
• separating responsibilities for direction of construction from commissioning; and<br />
• the inclusion of a Department employee on the CWA Principals Groups in Spring<br />
Hill and Otago.<br />
1.18 Under arrangements prior to late-2005, the Steering Group established for the<br />
RPDP was often constrained in its decision-making effectiveness through a lack of<br />
sufficient information to support decisions (notwithstanding the transparency of cost<br />
Executive Summary 3
information at the project level that was emerging from August 2005). Decisions were<br />
often taken with discussion, but before the provision of supporting information. The<br />
Steering Group comprised a majority of busy Departmental functional line managers, with<br />
heavy reliance on contractors for advice regarding large construction project decisions.<br />
These managers did address some knowledge gaps through the appointment of an<br />
independent member with construction, project and procurement methodology experience<br />
in 2004, and the conduct of internal and external audits to assess aspects of process.<br />
1.19 Prior to 2005, there was a lack of clarity amongst some, including Steering Group<br />
members, of the role of the Steering Group as to its role as an advisory group<br />
representing the different areas of Department endeavour, or a governance group. This<br />
may have affected the strength of the Steering Group to challenge the issues with<br />
reporting and information for key decisions.<br />
1.20 Due to the pressing nature of the growth in the projected prison population, the<br />
completion of the projects to the proposed schedule became a paramount factor in<br />
decision-making.<br />
1.21 Overall, these arrangements made it very challenging for the Steering Group to<br />
assess governance risks and to communicate these beyond the Steering Group. The<br />
Steering Group seemed surprised to learn of the actual size of the cost escalations in late<br />
2005.<br />
1.22 The nature and level of reporting to Ministers was also an issue. In our view, the<br />
information provided to Ministers as part of Budget 05 did not sufficiently or clearly signal<br />
the uncertainty around the estimates and the risk of cost increase. Further, the fiscal risks<br />
should have been on the radar for the pre-election fiscal update in mid-August 2005, at<br />
least in a qualitative sense.<br />
Lessons Learned<br />
1.23 Growth in the prison population drives the need for additional capacity. Given the<br />
long lead times involved with building new prisons, a longer term view of future capacity<br />
requirements is needed (than is provided by the Ministry of Justice five year forecasts) in<br />
order to enable the Department to appropriately plan, resource and schedule the delivery<br />
of additional greenfield capacity.<br />
1.24 The choice of CWA methodology has assisted the Department to deliver the<br />
required increase in capacity. However, CWA will not be suited to all projects. There is a<br />
need to identify the conditions under which CWA is likely to be preferred ahead of other<br />
forms of procurement. The methodology chosen should be justified on a project by<br />
project basis.<br />
1.25 The CWA methodology adopted by the Department requires careful and<br />
experienced management to protect the Crown’s interests. A blend of competencies and<br />
experience (commercial, construction and public sector management) is required for<br />
effective management. For future projects of this size and complexity, sponsoring<br />
agencies need to be confident that they have the appropriate mix of competencies and<br />
these are represented within the CWA Principal’s Group.<br />
1.26 The development of the TOC is a central part of the CWA methodology adopted by<br />
the Department. It needs to be finalised sooner than has been the case with respect to<br />
Spring Hill and Otago. Specifically, the TOC should ideally be completed at, or about, the<br />
time construction commences. However, appropriate time and resources need to be<br />
planned for to enable this. Until the draft TOC is well developed, estimates of construction<br />
Executive Summary 4
cost should be seen as indicative only. Pre-TOC estimates of cost involve significant<br />
levels of risk and uncertainty and this needs to be made clear. Once TOC estimates<br />
begin to emerge, there should be transparent reporting of these to provide the Department<br />
and, as appropriate, Ministers with opportunities to explore options for saving cost if<br />
budgets are under pressure.<br />
1.27 With respect to project management and governance, for projects of this size and<br />
importance, there is a need to ensure that:<br />
• project goals and objectives are agreed and clearly communicated to all parties at<br />
the commencement of the project, and that they encompass all three key elements<br />
of time, costs and quality, even in cases of ‘fast-tracking’;<br />
• the Steering Group has the appropriate mix of knowledge and skills to be able to<br />
represent the Department and the wider Government interests, and manage a<br />
large scale project;<br />
• the roles and accountabilities of the respective governance and management<br />
groups and individuals are clearly specified and communicated from the<br />
commencement of project planning;<br />
• there are independent quality assurance processes in place for oversight of<br />
governance and project management approaches, as well as the lower level<br />
project management processes for cost calculation and quantitative risk<br />
assessment;<br />
• the Steering Group is provided with adequate information in a timely fashion to<br />
assess and manage risks, support effective decision-making, and reporting to<br />
Ministers; and<br />
• project reporting not only assesses historical progress but also estimates future<br />
issues and progress remaining against all project objectives.<br />
1.28 In terms of reporting to Ministers, the following should be noted:<br />
• the regular discussions with the Minister should include clear reference to cost<br />
developments and associated risk estimates as work on the TOC proceeds;<br />
• where cost estimates are uncertain (as was the case with these projects), this<br />
needs to be clearly explained to Ministers. For the purposes of providing advice to<br />
Ministers, it would be appropriate to indicate a range of possible cost estimates<br />
and, moreover, indicate the level of uncertainty attaching to the estimates. Such<br />
estimates should be clearly distinguished from formal Budget processes and<br />
funding decisions (where point estimates specified to the nearest $1000 are<br />
required); and<br />
• on projects of this scale, reporting should be linked to significant project milestones<br />
rather than to the Budget cycle. For example, cost estimates developed for<br />
Budget 05 preceded the start of construction on Spring Hill and Otago. A report to<br />
Ministers at, or about, the start of construction would be better practice.<br />
Executive Summary 5
2 Introduction<br />
2.1 The Regional Prisons Development Project (RPDP) is a major construction<br />
programme undertaken by the Department of Corrections (the Department). The project<br />
involves the delivery of new prisons in Northland (referred as Northland Region<br />
Corrections Facility or Northland), Auckland (referred to as Auckland Women’s) North<br />
Waikato (referred to as the Spring Hill Corrections Facility or Spring Hill) and Otago<br />
(referred to as the Otago Region Corrections Facility or Otago).<br />
2.2 The focus of this review is on the Spring Hill and Otago facilities which are located<br />
near Meremere and Milburn respectively. The other two facilities (located at Ngawha and<br />
Manukau) have been considered to the extent that they have assisted understanding of<br />
the arrangements at the Spring Hill and Otago sites.<br />
2.3 Both the Spring Hill and Otago projects are still under construction. Spring Hill is<br />
due for completion by July 2007 and Otago by March 2007. A key driver for the review is<br />
the significant increase in the estimated cost for these projects. As part of Budget 04, the<br />
costs for Spring Hill and Otago were forecast to be $248 million and $161 million<br />
respectively. As part of Budget 05, these estimates were increased to $283 million and<br />
$175 million respectively. These estimates were revised further in light of detailed costing<br />
analysis and reported to Cabinet in December 2005. Spring Hill is expected to cost $380<br />
million and Otago’s cost has been estimated to be $218 million; a combined increase of<br />
approximately 31% over and above the Budget 05 estimates.<br />
2.4 In light of the cost increases, the Cabinet invited the <strong>State</strong> <strong>Services</strong> <strong>Commission</strong>er,<br />
in consultation with the Treasury, to independently review the processes, system and<br />
contracting practices at the Spring Hill and Otago prisons. PricewaterhouseCoopers has<br />
been engaged by the <strong>Commission</strong> to undertake the independent review.<br />
Review Objectives<br />
2.5 The primary objective of the review is to learn lessons from the Spring Hill and<br />
Otago projects for the benefit of future capital projects. To this end, the review is to<br />
recommend best future practices that can be applied to future projects in the Department<br />
and, if relevant, to the wider state sector.<br />
2.6 A second objective for the review is to identify the key drivers and causes of the<br />
cost escalation.<br />
Review Scope<br />
2.7 In order to meet the objectives for the review, its terms of reference have required:<br />
• an evaluation of the end-to-end process of designing, costing, procuring,<br />
scheduling and project management of the new facilities;<br />
• an assessment of the adequacy and quality of approach in these areas against<br />
best practices in the public and private sectors;<br />
• an assessment of project governance and management; and<br />
• a review of the quality and timeliness of reporting to Ministers for capital projects of<br />
this size.<br />
Introduction 6
2.8 As indicated above, the scope of the review includes the Spring Hill and Otago<br />
projects, but regard has been given to the other projects in the RPDP where appropriate.<br />
The scope of the review has also focused on events post completion of consent and<br />
related approvals up to the current day (which for the purposes of the review includes the<br />
period up to approximately March 2006). The scope of this review has specifically<br />
excluded:<br />
• consideration of the regional prisons policy (i.e. the policy has been taken as a<br />
given);<br />
• the commissioning of the facilities; and<br />
• the consents process.<br />
2.9 It should be noted that at the time of undertaking this review, several other, and<br />
related, reviews were also been undertaken in relation to the projects. This includes<br />
various reviews being undertaken by the Department into aspects of the projects’ costs<br />
(e.g. a review of the methodologies for establishing margins and reviews relating to<br />
preliminary and general costs). Where available, the findings of these reviews have been<br />
incorporated into this review. It has not been our intention to duplicate the other work<br />
being undertaken.<br />
Approach to the Review<br />
2.10 Our approach to this review has involved a process of documenting good practices<br />
and comparing actual practices against these. This has assisted in identifying areas<br />
where procurement and management of the projects has met the standards required as<br />
well as those areas where there are opportunities for improvement.<br />
2.11 The assessment of actual practices has relied heavily upon information provided to<br />
us by the Department and on interviews with a range of Department and other personnel<br />
involved with the projects. It is important to note that the interviews were conducted on a<br />
non-attribution basis. The process of reviewing relevant documentation and conducting<br />
interviews took place during April, May and June 2006. After several requests, and the<br />
subsequent receipt of information after completion of draft reports, we have now been<br />
assured by the Department of Corrections that all relevant information to enable us to<br />
complete the review as required has been provided. It is important to note, however, that<br />
the projects that are the focus for this review are still in the process of construction and,<br />
accordingly, fresh and updated information is continually coming to hand. As far as<br />
possible, we have sought to include information up to and including June 2006.<br />
2.12 Reflecting its nature and objectives, this review has not sought to independently<br />
verify the accuracy of the information provided to us. In this regard, the review should not<br />
be interpreted as an audit or inquiry.<br />
<strong>Report</strong> Structure<br />
2.13 The report is structured as follows:<br />
Section Three<br />
Section Four<br />
Section Five<br />
‣ provides some context within which the new prisons have been built.<br />
‣ discusses the causes and drivers of the cost increases.<br />
‣ assesses methodologies and processes in relation to design,<br />
costing, procurement and scheduling.<br />
Introduction 7
Section Six<br />
Section Seven<br />
‣ assesses project governance and management.<br />
‣ comments on reporting to Ministers.<br />
Introduction 8
3 Background<br />
3.1 Before discussing the processes, systems and contracting practices associated<br />
with the new facilities, it is important to outline some of the environmental and contextual<br />
factors bearing upon the prisons project. To varying extents, these factors have had a<br />
significant impact on the approach to, and cost of, the new prison builds.<br />
Prison Population Growth<br />
3.2 The Spring Hill and Otago projects are part of a wider programme of increasing<br />
prison capacity. The Department has been building 325 beds per year on average since<br />
1996 into existing prisons. However, this is not sufficient to meet the expected growth in<br />
the prison population. New prisons have also been required and the Spring Hill and Otago<br />
projects are part of a wider programme referred to as the Regional Prisons Development<br />
Programme (RPDP).<br />
3.3 The RPDP, which was announced in 1997, identified the need for four new<br />
regional corrections facilities, comprising two regional prisons in addition to Spring Hill and<br />
Otago. Both of the other prisons are operational; they are located at Ngawha in Northland<br />
and in Manukau (the recently opened Auckland Women’s facility).<br />
3.4 In 1999, the prison population forecast for 2008 was 6,800. The current forecast<br />
for 2008 is 8,600; a 26% increase. These forecasts are prepared by the Ministry of<br />
Justice. The Ministry’s forecast underpins the Department’s modelling of future prisoner<br />
demand and the optimal build programme to provide additional capacity to meet that<br />
demand. The forecasts have a five year horizon which is significantly shorter than the<br />
lead time for completing a new prison. As a result of this, and reflecting the revised<br />
forecasts, the RPDP has required considerable flexibility to adapt to changing<br />
circumstances. In particular, there have been significant changes to the originally-planned<br />
bed numbers at three of the four regional prisons:<br />
Auckland Women’s ‣ 150 to 286<br />
Spring Hill ‣ 350 to 650<br />
Otago ‣ 220 to 335<br />
3.5 Time pressure is a key issue affecting the RPDP because of the growth in the<br />
prison population. At the time decisions to proceed with the new prisons were taken, it<br />
was clear, and subsequently demonstrated, that new facilities had to be built in order to<br />
accommodate the increased numbers in the prison population. The timeline for<br />
completing the new prisons is tight and completion on time remains a high priority in order<br />
that the growing prison population can be appropriately housed. In recent years the<br />
Department has had to rely on police and court cells to manage the prison population<br />
overflow, a practice which is not desirable. Completing the construction of additional beds<br />
is therefore of utmost priority for the Department.<br />
3.6 In this regard, and notwithstanding many of the points made later in this review, it<br />
needs to be acknowledged that the programme of new prison builds has delivered, and is<br />
delivering, the additional capacity that is needed to meet growth in the prison population.<br />
Moreover, the programme is adding the new capacity more or less within the very tight<br />
deadlines that had to be achieved in order to avoid a situation of demand for beds<br />
Background 9
exceeding available capacity. The significance of this achievement should not be underestimated.<br />
Long Lead Times<br />
3.7 The need for new prisons was foreshadowed as part of the RPDP announcements<br />
in 1997. The Northland and Auckland Women’s facilities were the first two of a four-prison<br />
build programme. The table below indicates some of the milestones associated with the<br />
Spring Hill and Otago projects. As can be seen, the lead times for getting to the point<br />
where prisoners can be accepted is long; in the order of six to seven years.<br />
Design contracts let and site<br />
selection<br />
Spring Hill<br />
Otago<br />
December 2000 - May 2001 September 2001 - June 2002<br />
Construction RFP Issued September 2004 September 2004<br />
CWA Partner Selection October 2004 October 2004<br />
Environment Court Clearance June 2004 December 2004<br />
Earthworks Start November 2004 January 2005<br />
Construction Starts May 2005 April 2005<br />
Planned Construction Completion July 2007 March 2007<br />
Prisoner Induction Commences October 2007 June 2007<br />
Planned prisoner Capacity September 2008 November 2007<br />
3.8 As noted above, the Ministry of Justice provides a five-year forecast of the prison<br />
population. However, the typical consent and construction life-cycle for new facilities is<br />
significantly longer that this. The Department sees this lack of alignment of forecasting<br />
and construction lead-time periods as a constraint on its ability to appropriately plan,<br />
resource and schedule, and deliver capacity to meet demand.<br />
New Design<br />
3.9 Prior to the construction of Northland (which was the first of the four new prisons to<br />
get underway), it had been a relatively long period since the Department has constructed<br />
a new non-remand prison. As alluded to above, growth in prison capacity over prior years<br />
had been achieved through addition to existing facilities rather than “greenfields”<br />
development. Only one new facility (Auckland Central Remand Prison commissioned in<br />
1999) has been completed by the Department prior to the RPDP programme setup.<br />
3.10 By implication, the Department did not have a recent history of deep involvement<br />
in construction and certainly not on the scale of the four prisons which cumulatively have a<br />
cost in the region of $900 million (excluding commissioning).<br />
3.11 Moreover, compared to existing prisons, the facilities proposed for Northland,<br />
Auckland Women’s, Spring Hill and Otago reflected different design and operating<br />
philosophies. Although not part of the brief for this review to investigate these, the<br />
designs underpinning the four new facilities are quite different from what has gone before.<br />
The origins of the new design can be traced to facilities in Australia and Canada. The<br />
physical design of the new prisons in part reflects an intentional policy to promote greater<br />
self responsibility and, ultimately, reduce the incidence of recidivism.<br />
Background 10
3.12 While the merits of the new design are not part of the brief for this review, the new<br />
design is important for the reason that it represented a departure from what had gone<br />
before. Therefore, in terms of estimating the costs of the new prisons, the new design,<br />
coupled with the passage of time since the last major prison build, meant that<br />
benchmarking against the cost of earlier prisons was of limited assistance and relevance.<br />
Moreover, the new designs meant changes in operational policies and practices which, in<br />
turn, spurred considerable iteration between the requirements of the construction team<br />
and of the commissioning team within RPDP. It should be noted also that two main<br />
designs were developed for the four new prisons. In broad terms, the design for<br />
Northland and Spring Hill is comparable, as is that for Auckland Women’s and Otago<br />
(although being a women’s prison, some of the features of Auckland Women’s are specific<br />
to it).<br />
Resource Constraints<br />
3.13 By New Zealand standards, the RPDP projects are large construction projects.<br />
The sheer size of the RPDP project in relation to the New Zealand market has placed<br />
considerable demand on construction, design, and quantity surveyor capability and<br />
capacity. The lack of design capacity and costing capability and capacity had a direct<br />
impact on the timeframe for the development of early cost information in relation to Spring<br />
Hill and Otago.<br />
NIMBY<br />
3.14 The “not in my back yard” phenomenon applies with some force in the context of<br />
prison builds. NIMBY has several implications. In the case of Northland, Spring Hill and<br />
Otago it has been a contributing factor to the remote location of the facilities.<br />
Remoteness, as will be discussed later, has had a significant influence on cost. NIMBY<br />
also means that consent and other approval processes (often involving legal challenges)<br />
can be long-term and result in costs that were not originally planned. This has also been<br />
a factor contributing to the cost increases associated with Spring Hill and Otago.<br />
3.15 From a time perspective, uncertainty created by the NIMBY effect has also<br />
affected the speed with which projects have proceeded through the consenting and other<br />
approval processes. In turn, this has impacted upon the planning for, and management<br />
of, the projects. For example, the Otago project had an unexpectedly smooth run through<br />
the Environment Court which meant that construction was able to start eight months<br />
ahead of plan. While this outcome had several advantages, it also placed extra demands<br />
on the design team at a time when the design team was already stretched with other<br />
work. As discussed later, the time taken to complete detailed design work has important<br />
implications for the estimation of project costs and consequential implications for the<br />
actual cost of the project.<br />
Economic Conditions<br />
3.16 A further factor that has had significant bearing on the projects is the state of the<br />
economy. At the time the four prisons were being built, including, in particular, Spring Hill<br />
and Otago, the construction market was “heated” in the sense of demand outstripping<br />
supply. Prices (rates and margins) were increasing accordingly. Escalation of<br />
construction prices is factored into the estimated costs for the project but, with the<br />
advantage of hindsight, it is clear that the extent of escalation was under-estimated.<br />
3.17 Economic conditions, and the heated nature of the construction market in<br />
particular, have also influenced the procurement method used to construct the four<br />
prisons. Spring Hill and Otago have been constructed under what is referred to as a<br />
Background 11
“Collaborative Working Arrangement” (CWA) agreement. The CWA approach is<br />
discussed further in section 5.<br />
.<br />
Background 12
4 Key Drivers and Causes of Cost Escalation<br />
Key Findings:<br />
• Since Budget 05, further appropriations totalling $140.841 million have been approved in<br />
order to fund the completion of the Spring Hill and Otago projects. This reflected increased<br />
construction costs totalling $157.976 million, together with the off-setting impact of lower<br />
that expected expenditure in other areas (e.g. earthworks and reclassification of some<br />
commissioning costs) totalling $17.135 million.<br />
• The drivers and causes of the construction cost increases include market conditions, the<br />
impact of consent and regulatory requirements and the impact of finalising design.<br />
• Market influences accounted for about 57% of the increase and reflected:<br />
o the heated nature of the construction market which affected labour rates and<br />
margins; and<br />
o substantial increases in key commodities including, in particular, steel which<br />
increased in price by over 26% between June 2003 and June 2005; and<br />
o increased travel and accommodation allowances as a result of having to attract<br />
labour from areas located well away from the construction sites.<br />
• The outcome of the consents process and regulatory changes contributed to higher costs<br />
although the overall impact of these was relatively small (about 6% of the overall cost<br />
increase).<br />
• Design changes following the completion of Northland and additional work on a range of<br />
infrastructure services (drainage, water, roads etc) contributed to the balance of the cost<br />
increase (i.e. approximately 37%).<br />
Lessons Learned:<br />
• The estimates included as part of Budget 05 (and earlier in Budget 04) set expectations<br />
regarding the costs to construct Spring Hill and Otago. The estimates at that time were,<br />
however, based on relatively high-level assessments of possible construction costs given<br />
that detailed designs had not yet been completed. Furthermore, the cost indices relied<br />
upon to escalate costs between Budget 04 and Budget 05, while the best available, had<br />
several limitations. These factors meant that the cost estimates had significant risks and<br />
uncertainties attaching to them. It is important that the risks and uncertainties be<br />
emphasised and clearly communicated so as to avoid creating unrealistic expectations.<br />
• The remote location of the sites (especially Otago) put substantial pressure on local labour<br />
markets. Spring Hill and Otago are major projects. For projects of this size, there is a<br />
need to consider fully the impact on local markets and the upward pressure on resource<br />
costs that is likely to occur.<br />
• Projects of this size also put considerable pressure on local infrastructure which gives rise<br />
to the need for upgrades. These impacts need to be fully assessed and anticipated as part<br />
of initial cost estimates.<br />
• The form of procurement has implications for the Crown in terms of information regarding<br />
fiscal risks. Traditional fixed price forms of contract mean that the Crown is provided with a<br />
quoted price at the start of a project (although the eventual price paid depends on the<br />
extent, if any, of contract variations). In contrast, under the CWA methodology, the<br />
expected cost is not known until the Target Outturn Cost (TOC) is completed. The actual<br />
costs are not known until the project is completed, and any pain-share or gain share<br />
payments have been settled. Until the TOC is in place, there is risk of being exposed to<br />
cost increases relative to preliminary estimates. This highlights the need for timely<br />
completion of the TOC, particularly in a public sector setting where the Crown places a<br />
high premium on cost certainty.<br />
Key Drivers and Causes of Cost Escalation 13
Overview of Cost Increases<br />
4.1 Initial estimates for the cost of constructing Spring Hill and Otago were made as<br />
early as May 2000. However, substantive estimates were not made until late 2003.<br />
These estimates were included as part of the reporting to Ministers in the context of<br />
Budget 04. At that time, the costs associated with Spring Hill and Otago were expected to<br />
be approximately $248 million and $161 million respectively. The estimates indicated as<br />
part of Budget 04 were informed by the tenders submitted for the Northland project.<br />
4.2 The estimates were updated as part of Budget 05 and took account of escalation<br />
since the previous estimates made in 2003. The costs for Spring Hill and Otago reported<br />
as part of Budget 05 were revised upwards to $283 million and $175 million respectively.<br />
4.3 Since Budget 05, costs have risen further. In December 2005, approval was<br />
sought for additional appropriations totalling $140.841 million. This reflected the net effect<br />
of increased construction costs totalling $157.976 million, together with the off-setting<br />
impact of lower than expected expenditure in other areas (e.g. earthworks and<br />
reclassification of some commissioning costs) which totalled $17.135 million (giving a net<br />
increase of $140.841 million).<br />
4.4 The table below summarises the reasons provided to Ministers, as part of the<br />
December 2005 reporting package, behind the significant construction cost increases<br />
between Budget 05 and the numbers reported in December 2005.<br />
Spring Hill<br />
Cost Contributors<br />
($ million)<br />
Market Influences 53.773<br />
Consents and<br />
Regulatory Changes<br />
Escalation 16.640<br />
Labour rates and location 13.123<br />
Margins and overhead 13.570<br />
On-site construction cost increases 10.440<br />
Consents 5.740<br />
Holidays Act, Building Act 1.540<br />
7.280<br />
Design Finalisation 50.650<br />
Changes arising from Northland 13.600<br />
Site works requirements<br />
37.050<br />
• Drainage $11.3<br />
• Ducting $4.6<br />
• Water reticulation $2.9<br />
• Gas reticulation $0.6<br />
• Roading $6.0<br />
• Finishing works & landscaping $10.1<br />
Total Increase 111.703<br />
Key Drivers and Causes of Cost Escalation 14
Otago<br />
Cost Contributors<br />
($ million)<br />
Market Influences 36.635<br />
Consents and<br />
Regulatory Changes<br />
Escalation 11.660<br />
Labour rates and location 9.283<br />
Margins and overhead 7.910<br />
On-site construction cost increases 7.800<br />
Consents 1.570<br />
Holidays Act, Building Act 1.010<br />
2.580<br />
Design Finalisation 7.040<br />
Changes arising from Northland 7.040<br />
Total Increase 46.273<br />
General Comments Regarding Cost Increases<br />
4.5 Several general comments regarding the cost increases can be made. Later in<br />
this section, we comment further on each of the cost contributors.<br />
Supporting Information<br />
4.6 As part of this review, we have sought to assess the data and calculations<br />
underpinning the cost analysis included in the tables above (and which was reported to<br />
cabinet in December 2005). The assessment has been only partially completed. We<br />
have obtained, and been provided with, information that assists in explaining some<br />
aspects of the cost contributors outlined in the tables. This includes some high-level<br />
analysis developed in late November 2005 as retrospective explanation of cost<br />
movements. However, the information provided does not amount to an integrated set of<br />
working papers that assist in verifying the explanation of cost increases provided to<br />
Ministers. For example, while we have information relating to general construction cost<br />
inflation and inflation associated with some specific commodities (e.g. steel) used in the<br />
construction of the facilities, the Department has not been able to provide detailed working<br />
papers which show how the inflation data has been used to calculate the amount of<br />
escalation. Similarly, we have not seen detailed calculations underpinning the estimates<br />
of additional costs attributed to consents and regulatory changes or design finalisation.<br />
Accordingly, we have not been able to independently verify the information provided to<br />
Ministers. The analysis of the factors contributing to cost increases needs, therefore, to<br />
be treated with a reasonable degree of caution and should be regarded as indicative,<br />
rather than definitive.<br />
4.7 Notwithstanding the limited information to enable an assessment of the cost<br />
increases, this should not be interpreted as saying that the total estimated costs reported<br />
in December 2005 are inaccurate. As will be discussed more fully in section 6, the<br />
Key Drivers and Causes of Cost Escalation 15
Department has in place processes for reviewing the cost estimates prepared for each of<br />
the projects. This has involved use of external professional/expert advisers.<br />
Uncertainties With the Earlier Cost Estimates<br />
4.8 The information presented to Cabinet in December 2005 was intended to provide a<br />
link back to earlier cost estimates provided in the context of Budget 05 (and before that,<br />
Budget 04). It is important to appreciate that the earlier estimates were indicative only.<br />
4.9 The Budget 05 (and Budget 04) estimates were based on high-level assessments<br />
of construction cost. At the time of the earlier estimates, detailed designs had yet to be<br />
completed. Accordingly, the earlier estimates had high degrees of risk and uncertainty<br />
attaching to them. The initial estimates were also based on a traditional quantity surveyor<br />
approach to cost estimation which involves assessing the scope of work (e.g. m 2 of floor<br />
space) and attaching a generic rate ($/m 2 ). In contrast, the latest cost estimates reflect<br />
the outcome of applying the CWA methodology. This involves a detailed line by line<br />
assessment of all inputs and processes involved in constructing the facilities. This is a<br />
fundamentally different approach to estimating cost and, accordingly, there is an element<br />
of attempting to compare apples with oranges when comparing latest with earlier<br />
estimates.<br />
Market Influences<br />
4.10 Under the heading of market influences, the Department has apportioned the cost<br />
increases under four headings; escalation, labour rates and location, margins and<br />
overhead and on-site construction costs.<br />
Escalation<br />
4.11 The construction market has been heated over the time period during which Spring<br />
Hill and Otago have been being constructed. Estimated construction costs have been<br />
escalated with reference to the Capital Goods Price Index for Non-Residential Building<br />
(CGPI-NRB). Forecasts of the CGPI-NRB are prepared by the New Zealand Institute of<br />
Economic Research (<strong>NZ</strong>IER) and, as far as we are aware, the <strong>NZ</strong>IER forecasts are the<br />
only ones that are widely available and published quarterly. The CGPI-NRB is produced<br />
by Statistics New Zealand (S<strong>NZ</strong>) and is based on a basket of “model buildings”<br />
determined by S<strong>NZ</strong>. The prices associated with each model building are updated by S<strong>NZ</strong><br />
from the New Zealand Building Economist (<strong>NZ</strong>BE) publication.<br />
4.12 There are several limitations and caveats around the CGPI-NRB index that need<br />
to be taken into account.<br />
• There is considerable uncertainty regarding the degree to which margins and<br />
discounts are incorporated into the <strong>NZ</strong>BE prices.<br />
• S<strong>NZ</strong> seeks to adjust its index numbers to strip out the effect of quality changes.<br />
For example, if the quality of a new building is enhanced and costs are increased<br />
accordingly, the S<strong>NZ</strong> approach will attempt to strip out the quality dimension and<br />
lower the prices accordingly.<br />
• The models being used by S<strong>NZ</strong> were last revised in 2000 and are viewed as being<br />
out-of-date.<br />
Key Drivers and Causes of Cost Escalation 16
• The types of building included in the category of NRB are wide ranging and not<br />
necessarily comparable with penal institutions. Differences in cost escalation<br />
between building types is averaged out.<br />
• The data is not published on a regional basis.<br />
• The data is heavily influenced by trends in the Auckland market which accounts for<br />
35-40% of all building activity.<br />
4.13 <strong>NZ</strong>IER produces forecasts of the CGPI-NRB index using econometric techniques.<br />
The main drivers in their model are the level of non-residential building activity, wages,<br />
employment and producers’ input prices. Based on forecasts issued in December 2004,<br />
the rate of growth in the CGPI-NRB was forecast to be:<br />
• 6.1% for the year ending September 2005;<br />
• 3.2% for the year ending September 2006; and<br />
• 2.5% for the year ending September 2007.<br />
4.14 The forecasts issued in December 04 have, however, generally overstated the<br />
actual increase in CGPI-NRB as shown in the table below.<br />
Date<br />
Forecast Quarterly Change<br />
(issued December 2004)<br />
Actual Quarterly Change<br />
December 2004 1.7% 1.8%<br />
March 2005 1.6% 0.2%<br />
June 2005 1.4% 1.2%<br />
September 2005 1.3% 1.2%<br />
December 2005 1.0% 0.4%<br />
March 2006 0.8% 1.7%<br />
4.15 Notwithstanding that the CGPI-NRB forecasts over-estimated the actual change in<br />
the index at the aggregate level, there is some evidence to suggest that the increase in<br />
construction costs for the Spring Hill and Otago projects were well above the levels of<br />
increase recorded by the CGPI-NRB index. Over the period June 2003 to June 2005, the<br />
CGPI-NRB increased by 13.8%. However, independent advice 1 received by the<br />
Department in relation to Spring Hill indicated that over the period June 2003 to June<br />
2005:<br />
• rates per tonne of steel increased by 26.4%;<br />
• PVC products increased by up to 30%; and<br />
1 Peter Waterhouse - <strong>Report</strong> to RPDP on Construction Costs and Alternative Procurement<br />
Strategies 31 October 2005<br />
Key Drivers and Causes of Cost Escalation 17
• the cost of construction in the hospitals and health categories increased by<br />
between 16.9% and 18.5%.<br />
4.16 However, the same advice noted that concrete supply and concrete products<br />
generally increased by only 4% - 8% and timber framing by 4% - 5%.<br />
4.17 In addition to increases in commodity prices, there were also significant increases<br />
in labour costs (which are another component of the CGPI-NRB).<br />
Labour Rates and Location<br />
4.18 Advice received from Peter Waterhouse (an independent construction cost<br />
consultant) provided evidence of increased labour rates:<br />
• rates for carpenters in Auckland region increased by up to 35%;<br />
• rates for concrete workers increased by up to 29%; and<br />
• rates for labourers increased by up to 25%.<br />
4.19 The remoteness of the Spring Hill and Otago sites also contributed to increased<br />
direct costs.<br />
• In the case of Otago, up to a third of the workforce at peak levels has had to be<br />
imported from outside of the coastal Otago region. This increased the level of<br />
travel and accommodation allowances.<br />
• Additional travel costs added the equivalent of approximately one hour per person<br />
per day to labour costs on the Spring Hill project.<br />
• We understand that the normal level of construction activity in the coastal Otago<br />
area is around $90 million per annum. Clearly, therefore, the Otago project<br />
represents a substantial increase over and above this figure. It is not too<br />
surprising, therefore, that the Otago project has put considerable upward pressure<br />
on costs.<br />
4.20 There is scope for some overlap and, hence, double counting across the various<br />
factors. In particular, the escalation factor measures increases in the costs of completing<br />
buildings. Implicit within the escalation is increases in labour rates, margins, overheads,<br />
materials costs and so on. In theory, therefore, the increases attributed to labour rates,<br />
margins and overheads (and possibly on-site construction costs) in the context of Spring<br />
Hill should be over and above the increases captured by the escalation. We are not<br />
convinced that this is strictly the case, but have no way of verifying it because of the lack<br />
of detailed workings.<br />
Margins and Overhead<br />
4.21 In addition to upward pressure on direct costs, there have also been increases in<br />
margins (which leads to a compounding effect when applied to increased direct costs).<br />
CMS reported to the Department 2 that:<br />
2 Assessment of Profit and Overheads margins for CWA Members dated 4 November 2005<br />
Key Drivers and Causes of Cost Escalation 18
• sub-contractors’ margins have trended upwards by between 3% and 10% in the<br />
years 2002-2005; and<br />
• sub-contractors’ margins in the concrete, carpentry, roofing, painting, tiling and<br />
similar trends have increased by between 2% and 7% over the same period.<br />
4.22 It was also noted, however, that main contractors’ margins had remained relatively<br />
constant or fallen during this period.<br />
On-Site Construction Cost Increases<br />
4.23 This element of cost increase comprises two parts:<br />
• on-site management costs; and<br />
• the outcome of the first-principles approach to building up the TOC.<br />
4.24 Increased on-site management costs have stemmed from requirements to<br />
maintain standards in effectiveness and quality. The projects have involved large<br />
numbers of contractors and this has increased the amount of on-site management<br />
required accordingly. In the case of Otago, more so than Spring Hill, the net for<br />
contractors has had to be cast more widely than was originally anticipated. These costs<br />
have been offset in some measure through efficiency gains including economies gained<br />
through procurement on a whole-of-site, rather than individual contractor, basis (e.g. sitewide<br />
cranes and scaffolding).<br />
4.25 The second, and more general aspect to cost increases reflects the approach to<br />
determining the TOC and the fact that it is fundamentally different to that used in a<br />
traditional <strong>NZ</strong>S 3910 approach to procurement. The determination of the TOC is a<br />
bottom-up, line by line, build up of all the costs involved in the project. In our view, there<br />
is an inherent risk in this form of costing toward overstatement of costs compared to a<br />
more traditional fixed price approach which focuses on tendering a price that the supplier<br />
believes will be price competitive (notwithstanding any loading for a risk premium). In a<br />
sense, therefore, the increased cost attributed to on-site construction is a reflection of the<br />
inherent difference between CWA and traditional fixed price contracts. While the<br />
magnitude of this might not be known ahead of the TOC’s development, the risk of<br />
increased cost due to the different approach should be acknowledged. In this context, we<br />
note that the Treasury received advice in March 2004 from Opus which, among other<br />
matters, noted that CWA involves a new (compared to traditional fixed price contracts) risk<br />
assessment and cost estimate framework and that this needed to be allowed for in<br />
reporting and funding approvals.<br />
4.26 The risks associated with the “bottom-up” approach to costing are managed,<br />
however, through the process of exposing the cost estimates to review by all CWA<br />
members, including the Department and its advisers. In our view, while such processes<br />
can go a long way to mitigating the inherent risks associated with “bottom-up” approaches<br />
to costing, there is there is the potential for a residual element of cost bias compared to<br />
the situation of a competitive fixed price contract.<br />
Consents and Regulatory Changes<br />
4.27 Much of the cost associated with consent requirements involved additional<br />
investment in water and wastewater services. In general, the existing infrastructure of the<br />
relevant local authorities did not have the capacity to deal with the additional demands<br />
created by the new prison facilities. The level of investment required reflected the<br />
Key Drivers and Causes of Cost Escalation 19
outcome of negotiations with relevant local authorities. There were also some changes in<br />
Ministry of Health standards relating to water treatment and waste-water discharge.<br />
4.28 Other regulatory changes related to the Holidays Act. These changes resulted in<br />
additional labour costs. We note that the additional costs stemming from the Holidays Act<br />
should be reflected in the CGPI-NRB and so there is some risk that this element of the<br />
overall cost increase is being captured twice.<br />
Design Finalisation<br />
4.29 According to the advice presented to Cabinet in December 2005, completion of<br />
detailed design works at Spring Hill (which occurred subsequent to the reporting in April<br />
2005) identified a number of additional items, the total cost of which amounted to $37.050<br />
million or roughly 10% of the total project cost. These included:<br />
• site drainage ($11.3 million);<br />
• underground ducting and future proofing ($4.6 million);<br />
• water reticulation and management ($2.9 million);<br />
• gas reticulation ($0.6 million);<br />
• access roads and car parking ($6 million); and<br />
• finishing works and landscaping ($10.1 million).<br />
4.30 This is a significant amount. Although the reason behind these changes is<br />
referred to as being a function of completing detailed design work, we understand that<br />
some of the changes are also a function of the outcome of the consents process. In<br />
particular, the consent process lead to some significant design changes, including moving<br />
building platforms. This had flow-on consequences for infrastructural services such as<br />
drainage and utilities reticulation. A general difficulty facing the Department is that when<br />
such changes are being discussed/negotiated as part of the consents process, the cost<br />
impact is not necessarily known with any degree of precision.<br />
4.31 As far as we are aware, Ministers were not advised of these additional costs until<br />
the December 2005 report to Cabinet. In our view, the prospect of additional costs in<br />
these areas would have been known at the time of Budget 05 even though the scale of<br />
cost would not have been known at that stage. Given the scale of the additional cost,<br />
more forewarning of Ministers could have occurred.<br />
Summary<br />
4.32 Many factors have contributed to the increase in costs over and above those<br />
reported as part of Budget 05. The underlying drivers of these can be summarised as<br />
follows:<br />
• the heated nature of the construction market which resulted in higher input costs<br />
(materials and labour);<br />
• international trends for the price of steel;<br />
• the remote location of the sites which has given rise to additional allowances;<br />
Key Drivers and Causes of Cost Escalation 20
• the impact of the projects on local infrastructure;<br />
• the outcome of consent hearings and negotiations; and<br />
• the impact of various regulatory changes.<br />
Lessons Learned<br />
4.33 The Spring Hill and Otago projects have experienced substantial cost increases.<br />
Approximately 57% of the increase in costs since those reported in Budget 05 stems from<br />
the heated nature of the construction market; something that the Department had no<br />
control over.<br />
4.34 Notwithstanding this, there are several steps that can be taken to minimise large<br />
fiscal surprises. The first of these steps is to be clear as to the risk and uncertainty<br />
attaching to early cost estimates. The estimates included as part of Budget 05 (and<br />
earlier in Budget 04) set expectations regarding the costs to construct Spring Hill and<br />
Otago. The estimates at that time were, however, based on relatively high-level<br />
assessments of possible construction costs, given that detailed designs had not yet been<br />
completed. Furthermore, the cost indices relied upon to escalate costs between Budget<br />
04 and 05, while the best available, had several limitations. These factors meant that the<br />
cost estimates had significant risks and uncertainties attaching to them. There is a need<br />
to ensure that the risks and uncertainties involved are clearly identified and<br />
communicated, especially to Ministers who might otherwise think that the estimates are<br />
relatively certain.<br />
4.35 The remote location of the sites (especially Otago) put substantial pressure on<br />
local labour markets. This has added to cost in terms of having to pay more to attract<br />
labour and the cost of upgrading local infrastructure. In developing initial estimates of<br />
cost, there is a need to take into account, as far as possible, local impacts and conditions<br />
and assess the implications for high-level estimates of cost. Spring Hill and Otago are<br />
major projects. For projects of this size, there is a need to consider fully the impact on<br />
local markets and the upward pressure on resource costs that is likely to occur.<br />
4.36 Projects of this size also put considerable pressure on local infrastructure which<br />
gives rise to the need for upgrades. These impacts need to be fully assessed and<br />
anticipated as part of initial cost estimates.<br />
4.37 The form of procurement has implications for the Crown in terms of information<br />
regarding fiscal risks. Traditional fixed price forms of contract mean that the Crown is<br />
provided with a quoted price at the start of a project (although the eventual price paid<br />
depends on the extent, if any, of contract variations). In contrast, under the CWA<br />
methodology, the expected cost is not known until the Target Outturn Cost (TOC) is<br />
completed. The actual costs are not known until the project is completed, and any painshare<br />
or gain share payments have been settled. Until the TOC is in place, there is risk of<br />
being exposed to cost increases. This highlights the need for timely completion of the<br />
TOC, particularly in a public sector setting where the Crown places a high premium on<br />
cost certainty.<br />
4.38 Overall, the magnitude of the increases signals that large projects of this type<br />
involve significant levels of fiscal risk. In turn, this emphasises the need for robust<br />
procurement strategies and tight project governance, management and reporting. These<br />
requirements are assessed further in the following two sections of this report.<br />
Key Drivers and Causes of Cost Escalation 21
5 Methodology and Processes: Design, Costing,<br />
Procurement and Scheduling<br />
Key Findings:<br />
• A key feature of the Spring Hill and Otago projects is that they have involved the use of the<br />
Collaborative Working Approach (CWA) methodology. This methodology is relatively new<br />
to New Zealand, although it is used by Transit for some road projects.<br />
• A hybrid form of CWA was used for the Northland project and it was key to overcoming<br />
some issues that were threatening to disrupt progress with that project.<br />
• The collaborative approach implied by the CWA methodology, the advantages offered by<br />
CWA and the positive experience with CWA in the context of Northland led the Department<br />
to use CWA for the other regional prisons, including Spring Hill and Otago.<br />
• The way in which the Department has applied the CWA methodology has enabled it to<br />
benefit from many of the advantages inherent in the CWA approach. In particular:<br />
– there has been close integration of design, construction and commissioning teams<br />
which assists in achieving an optimal balance between design, construction and<br />
operational requirements;<br />
– several value management reviews have been undertaken to further optimise designs<br />
and take out unnecessary costs;<br />
– at a site level, resources have been mobilised to deal with day-to-day issues, thereby<br />
increasing the efficiency of on-site resource utilisation;<br />
– the collaborative approach to dealing with issues has helped to maintain momentum<br />
with the projects, thereby enabling the timing of projects to be completed on, or near<br />
to, expectations;<br />
– high levels of transparency in relation to costs have been achieved at the project level<br />
consistent with the “open-book” philosophy that underpins CWA (with some opportunity<br />
for more transparency over margins – see below); and<br />
– costs have been exposed to extensive third party scrutiny and review.<br />
• Overlaying all of these benefits, the methodology chosen by the Department means that it<br />
is on track to deliver Spring Hill and Otago in time to meet expected prison population<br />
requirements. There were sufficient indications to suggest that, had the Department<br />
elected to follow a traditional procurement method, timeframes for completing the projects<br />
would probably not have been met.<br />
• Notwithstanding these benefits, there are aspects of the way in which methodology and<br />
supporting processes have been applied that can be improved. In particular:<br />
– analysis of the reasons for preferring CWA ahead of other procurement options was<br />
not sufficiently documented;<br />
– the timing for completing the TOC has not conformed with good practice. However, key<br />
reasons behind this were delays in completing designs caused by changes in the<br />
scope of facilities, lack of design resource and shortage of experienced costing<br />
resources. To avoid delays to the projects (and the problems this would cause in<br />
terms of accommodating the increasing prison population), the Department decided to<br />
proceed with the projects; and<br />
– while there is good transparency over costs at the project level, the Department does<br />
not have visibility over margins. As a result, it is dependent on the advice of third<br />
parties.<br />
Methodology and Processes: Design, Costing, Procurement and Scheduling 22
Lessons Learned:<br />
• Notwithstanding the advantages offered by the CWA methodology, there are also some<br />
risks involved and the methodology requires considerable management resource.<br />
• CWA will not be suited to all projects. There is a need to identify the conditions under<br />
which CWA is likely to be preferred ahead of more traditional fixed price contracts. Factors<br />
to take into account include the size and complexity of project, the level of uncertainty (e.g.<br />
technological change and design requirements), and the timeframes for project completion.<br />
Projects should be evaluated against these, and other, factors before the choice of<br />
procurement method is made. The decision and underlying reasons should then be<br />
documented.<br />
• The CWA methodology requires careful and experienced management to protect the<br />
Crown’s interests. A blend of competencies and experience (commercial, construction and<br />
public sector management) are required for effective management. For future projects of<br />
this size and complexity, sponsoring agencies need to be confident that they have the<br />
appropriate mix of competencies and these are represented within the CWA Principal’s<br />
Group.<br />
• The way in which the Department has implemented CWA means that there has not been<br />
the usual market testing of prices through obtaining competitive quotes. The CWA<br />
methodology can be modified, however, by seeking indicative target costs as part of the<br />
CWA member selection process. This can go some way toward providing more<br />
information on likely costs. However, this modification to the selection process requires<br />
extra time and resources to complete the tender evaluation. Given the extra costs and<br />
time involved, it may not be appropriate in all circumstances to modify the selection<br />
process in this way, but at the least, consideration should be given to this option.<br />
• The development of the TOC is a central part of the CWA methodology. It needs to be<br />
finalised sooner than has been the case with respect to Spring Hill and Otago. Specifically,<br />
the TOC should ideally be completed at, or about, the time construction commences. In<br />
order to achieve this, there needs to be:<br />
o as much flexibility as possible over the lead time for constructing a prison;<br />
o appropriate levels of capacity to undertake detailed design work once CWA<br />
members have been agreed;<br />
o agreed standards against which to base designs; and<br />
o continual pressure on the commercial CWA members from the Department to<br />
achieve timely completion of the TOC.<br />
• Until the draft TOC is well developed, estimates of construction cost should be seen as<br />
indicative only. Pre-TOC estimates of cost involve significant levels of risk and uncertainty<br />
and this needs to be made clear.<br />
• Once TOC estimates begin to emerge, there should be transparent reporting of these to<br />
provide the Department and, as appropriate, Ministers with opportunities to explore options<br />
for saving cost if budgets are under pressure.<br />
Methodology and Processes: Design, Costing, Procurement and Scheduling 23
Introduction<br />
5.1 In this section, the methodology and processes employed by the Department to<br />
design, cost, procure and schedule the projects is reviewed. Relatively more emphasis is<br />
given to procurement. This is because the Department chose to use the CWA<br />
methodology for the procurement of Spring Hill and Otago. CWA is not a common form<br />
of procurement in New Zealand, although it is used by Transit on some road projects.<br />
Reflecting the relative newness of the CWA methodology in the New Zealand context, the<br />
Department’s experiences with it provide some valuable insights as to its advantages and<br />
disadvantages compared to more traditional forms of procurement.<br />
Design<br />
5.2 The origins of the design for the Spring Hill and Otago facilities have linkages with<br />
designs in Australia and Canada. As noted in section three, the design for Spring Hill was<br />
broadly aligned with that for Northland and the design for Otago was broadly based<br />
around that for Auckland Women’s. That said, however, there are significant differences.<br />
For example, Otago involves differences in heating, ventilation and insulation reflecting<br />
the cooler climate. Otago also has other design differences compared to Auckland<br />
Women’s which is a women’s prison. Similarly, the different scale of Spring Hill and<br />
Northland led to some design differences.<br />
5.3 We have not reviewed in any detail the approach to the development of the<br />
designs used for Spring Hill and Otago given that the origins of the designs pre-date both<br />
of these projects. Notwithstanding this, several points can be noted.<br />
• The CWA methodology has the advantage of promoting close interaction between<br />
the construction contractors, the design teams and the client in the development of<br />
detailed designs. In contrast, under traditional forms of procurement, it is not<br />
unusual for design contracts to be let, followed by construction contracts once<br />
designs are largely completed. The advantage of the more integrated approach<br />
under CWA is that there is greater scope for assessing the implications of design<br />
on construction and on operations and, hence, greater scope to adjust designs to<br />
achieve the optimal balance between design, construction and operational<br />
considerations.<br />
• The Northland project was the first of the prisons to use the new style of facility.<br />
Several lessons were learned from the construction of Northland that assisted in<br />
refining the design to achieve better outcomes from an operational viewpoint.<br />
Reflecting the relative newness of the design, the Department developed<br />
standards through the design process for Northland. It was only following the<br />
completion of Northland that standards were finalised and documented. The<br />
Department took advantage of these lessons by incorporating them into the Spring<br />
Hill and Otago projects.<br />
• The relative newness of the prison design also placed added pressure on design<br />
resources. These resources were, at times, stretched. In the case of Otago,<br />
pressure was incurred through the reallocation of design resources from Otago to<br />
Auckland Women’s (approx June – December 2004) to address the capacity<br />
increase from 150 beds to 286 beds.<br />
• Although outside the scope of this review, we note that there were issues around<br />
design in the case of the Northland project. As discussed later in this section, the<br />
Methodology and Processes: Design, Costing, Procurement and Scheduling 24
Costing<br />
CWA methodology provided a mechanism for addressing these issues and for<br />
ensuring those difficulties were not repeated for Spring Hill and Otago.<br />
5.4 The approach to costing has several phases:<br />
• various initial cost estimates, based on high level $/bed comparisons were made in<br />
2000 for Spring Hill and Otago. These were updated at various points over the<br />
period 2001 to 2003;<br />
• more substantive estimates were made as part of Budget 04. These were<br />
subsequently updated as part of Budget 05 to take into account construction price<br />
increases over the intervening period; and<br />
• the latest cost estimates were reported to Cabinet in December 2005. These<br />
estimates incorporate the outcome of the detailed work that has been undertaken<br />
as part of the development of the TOC for both projects.<br />
5.5 We focus on the second and third of these phases. The initial phase of cost<br />
estimates in 2000 – 2003 should be seen as preliminary only. They did not have any<br />
material bearing on whether or not to proceed with the Spring Hill and Otago projects (or<br />
to what specification) as the key funding decisions were taken as part of Budget 04 and<br />
Budget 05.<br />
Budget 04 Estimates<br />
5.6 The majority of the funding for Otago was approved as part of Budget 04 (and<br />
significant funding decisions were also taken with respect to Spring Hill). Accordingly, the<br />
estimated completion costs provided as part of Budget 04 took on considerable<br />
significance. At that time, the costs for Spring Hill and Otago were signalled to be $248<br />
million and $161 million respectively.<br />
5.7 Because of the importance attaching to the estimates provided at that time, it is<br />
important to understand the context within which the estimates were provided and the<br />
basis upon which they had been developed.<br />
• The outcome of the Northland tender was taken into account in developing the<br />
estimates of cost for Spring Hill and Otago. The tender was analysed and the<br />
rates were applied to an area schedule for Spring Hill and Otago. The significance<br />
of this is that the prices tendered for Northland were approximately $12 million<br />
above the estimates for Northland pre-tender. In the case of Otago, estimates<br />
developed in connection with Auckland Women’s were also used to inform the<br />
rates for Otago. Auckland Women’s was, at that time, at the “developed design”<br />
stage with several detailed estimates having been completed.<br />
• Northland was tendered as a traditional <strong>NZ</strong>S 3910 form of contract (only later did<br />
the procurement method for Northland modify into a hybrid form of CWA). By<br />
implication, while the tender prices for Northland were visible to the Department,<br />
the actual costs associated with the project were not transparent (as is always the<br />
case with <strong>NZ</strong>S 3910 contracts).<br />
• The estimates were made by the Department with input from its independent<br />
quantity surveyors – Rider Hunt. At the time of Budget 04, the RFP for the Spring<br />
Methodology and Processes: Design, Costing, Procurement and Scheduling 25
Hill and Otago projects had yet to be issued, so the estimates were made well in<br />
advance of the CWAs being formed.<br />
• The estimates made as part of Budget 04 were based on concept designs.<br />
Detailed design work had yet to occur. By implication, the Budget 04 estimates<br />
could only be indicative at best.<br />
• The approach to estimating costs at that time rested on applying $ rates per M 2 of<br />
gross floor area (taking into account the Northland tender prices). However,<br />
benchmarking the rates applied to Spring Hill and Otago with other projects,<br />
including Northland, was problematic because of the greenfield nature of the<br />
Spring Hill and Otago sites. With the advantage of hindsight, it is also apparent<br />
that the remoteness of the Spring Hill and Otago sites has played a significant part<br />
in explaining the differences between the latest estimates of cost and the<br />
estimates communicated in Budget 04.<br />
5.8 In short, the basis upon which the Budget 04 estimates rested were, at best,<br />
indicative only. Reflecting the basis upon which they had been developed, the estimates<br />
provided as part of Budget 04 had quite high levels of risk and uncertainty attaching to<br />
them. However, the indicative status of the cost estimates could have been made clearer<br />
in the business cases submitted to Cabinet as part of Budget 04. Because the cost<br />
estimates were presented to three decimal places consistent with Budget process<br />
requirements, there is a risk that Ministers would have interpreted the estimates as<br />
conveying a high degree of certainty. Any such perception needed to be corrected.<br />
5.9 The business cases submitted as part of Budget 04 noted that escalation was a<br />
significant risk for the Department (and, by implication, the Crown). However, the<br />
magnitude of the risk was not quantified. Ministers could not have gauged from the<br />
business case whether the risk amounted to a small amount or, as it turned out, tens of<br />
millions of dollars. In our view, there was a need to indicate more clearly the status of the<br />
cost estimates including, in particular, the level of certainty attaching to the estimates.<br />
5.10 We note that contingency funding was also provided for, but the interpretation of<br />
what the contingency represented was not made clear in the business case presented to<br />
Ministers.<br />
Budget 05 Estimates<br />
5.11 The next major reporting milestone to Cabinet was in April 2005 as part of Budget<br />
05. At that time, the costs associated with Spring Hill and Otago had been revised<br />
upwards to $283 million and $175 million respectively. In the case of Spring Hill, the<br />
explanation provided to Cabinet for the increase of approximately $34.5 million since<br />
Budget 04 was not particularly clear but appeared to be a function of adjustment for<br />
further escalation. With respect to Otago, the total estimated cost increased by<br />
approximately $13.8 million compared to Budget 04. Almost all of the increase was<br />
attributed to escalation (there was a further small amount relating to commissioning).<br />
5.12 At the time of Budget 05, work on Northland and Auckland Women’s was<br />
underway. However, both projects were of limited usefulness in terms of informing cost<br />
estimates for Spring Hill and Otago.<br />
• Northland has a hybrid form of CWA. As such, the project was being completed<br />
under fixed price conditions and the Department did not have visibility over the<br />
actual costs being incurred by the project.<br />
Methodology and Processes: Design, Costing, Procurement and Scheduling 26
• Auckland Women’s was a full CWA approach and progress reports indicated that<br />
costs were tracking according to plan and, accordingly, did not provide any earlywarning<br />
signals of impending cost issues that were to affect the Spring Hill and<br />
Otago projects.<br />
• The Auckland Women’s would not have provided detailed insights regarding<br />
Spring Hill in any event given the different designs between the two facilities (and<br />
to some extent the same point applied with respect to Otago which is a men’s<br />
prison).<br />
December 2005 Estimates<br />
5.13 During the period from April 2005 to October 2005, work on the TOC for Spring Hill<br />
and Otago proceeded (at the same time that construction was also proceeding).<br />
5.14 The TOC is, in effect, the agreed budget for the project. It is intended to include all<br />
project costs except those specifically defined and agreed as being excluded and, hence,<br />
the responsibility of others. The TOC is, in theory, a pre-construction estimate of the<br />
efficient level of cost to complete the project. It has the following components:<br />
• Direct costs. These comprise labour, materials and plant. Labour rates are<br />
“burdened” to reflect personnel-related costs such as ACC, sick leave, annual<br />
leave and, if appropriate, allowance for travel time, protective clothing and so on.<br />
In the context of the RPDP, the process of calculating burdened labour rates has<br />
been undertaken by CMS and reviewed by Sherwin, Chan & Walshe. There is<br />
also a burdened rate for plant that includes depreciation, repairs and maintenance<br />
and consumables (e.g. fuel).<br />
• Normalised Profit Margins. Each contractor (and sub-contractor) that is part of the<br />
CWA can expect to earn their “normalised” profit margins in addition to recovering<br />
their actual costs and overheads contribution. In the case of the RPDP projects,<br />
normalised profit margins have typically been established with reference to the<br />
previous three years financial accounts of the contractor. Adjustments have been<br />
made to smooth out unusual/abnormal profit results (either good or bad), the<br />
current state of the construction market and levels of risk involved. This work has<br />
also been performed by CMS and reviewed by Sherwin, Chan & Walshe. Once<br />
margins are determined, they are “ring-fenced”; that is, the dollar value assigned to<br />
margins does not change unless there is a substantial change to the scope of work<br />
involved.<br />
• On-site overheads (also referred to as Preliminary and General or P&G). This<br />
includes, for example, the costs associated with on-site project managers and<br />
management team, project offices, site stores, administration staff and so on.<br />
• Off-site overheads. This recognises that an element of the off-site corporate (e.g.<br />
head office) overhead is needed in order to support the project. As with the<br />
margins calculation, a normalisation process is involved with off-site overheads<br />
and once the level of off-site overhead is determined, it is “ring-fenced”.<br />
5.15 It is important to emphasise that the TOC focuses on cost. In contrast, under a<br />
traditional <strong>NZ</strong>S 3910 form of contract, the tender quoted is a price; that is, it is the amount<br />
the client pays for the project as distinct from what it actually costs to complete the project<br />
(subject to any agreed variations). Because the TOC focuses on cost as distinct from<br />
price, it implies a fundamentally different basis for the allocation of financial risk. Under a<br />
Methodology and Processes: Design, Costing, Procurement and Scheduling 27
strict fixed price contract, financial risk is substantially borne by the provider (although<br />
provisions relating to contract variations can result in sharing of financial risk). In contrast,<br />
under a CWA as adopted by the Department, it is not until the project has been completed<br />
and the final costs accounted for, that the client has certainty over the total amount<br />
payable for the project.<br />
5.16 Although not accepted by the Department at the time of preparing the report that<br />
went to Cabinet in December 2005, the TOCs were at an advanced stage. The draft<br />
TOCs indicated that costs had increased to $381 million and $218 million for Spring Hill<br />
and Otago respectively.<br />
5.17 The December 05 report to Cabinet included a description of the factors leading to<br />
the cost increases compared to the Budget 05 estimates. In brief, the contributing factors<br />
were grouped under the headings of market influences, regulatory and consent changes<br />
and omissions from earlier estimates (items seen by the Department as not previously<br />
included rather than items inadvertently overlooked). While the increases and underlying<br />
causes are site-specific, in the case of escalation, there is considerable overlap between<br />
the two sites and this issue is considered first.<br />
5.18 From the Crown’s perspective, it has a keen interest in achieving project<br />
completion on time, within budget and to specification. In normal fixed price contracts,<br />
price is established up front as part of the tender process (although actual price outturn is<br />
often the subject of contract variations). The way in which CWA has been used by the<br />
Department means that there is no price information arising from the selection process.<br />
Development of the TOC (and related QRA and gain/pain share arrangements) is,<br />
therefore, of critical importance, particularly from a fiscal management perspective.<br />
5.19 Building the TOC is not a straightforward process. In very general terms, the<br />
processes around its development are illustrated below.<br />
er<br />
Pre-tend<br />
phase<br />
Concept<br />
Scheme Design<br />
Detailed Design<br />
Negotiating Framework<br />
Agreement Phase<br />
Risk Identification<br />
Quantified Risk<br />
Assessment<br />
Direct Costs<br />
Margins<br />
Overheads<br />
Independent QS review<br />
Labour & Plant<br />
Burdening<br />
Independent<br />
Normalisation<br />
Audit<br />
Normalisation<br />
Draft Total Outturn Cost<br />
Value Management<br />
CWA<br />
Agreement<br />
Phase<br />
Agree TOC, QRA and<br />
Gain / Pain Share<br />
Agree CWA Agreement<br />
Methodology and Processes: Design, Costing, Procurement and Scheduling 28
5.20 Several points should be noted.<br />
• Detailed designs need to be in place before any serious attempt can be made at<br />
determining the TOC.<br />
• The time taken to develop the TOC once detailed designs are completed will<br />
depend on the size and complexity of the project. However, as a guide to good<br />
practice, a time frame of 2-4 months should be expected.<br />
• The process of determining the TOC is heavily dependent on transparency of<br />
financial and other data and on independent scrutiny of the numbers, assumptions<br />
and calculations. In general, CWA involves an “open book” approach to the<br />
determination of costs. Transparency and independent scrutiny are the<br />
mechanisms through which assurance is gained that costs are efficient (on the<br />
assumption that there is no market testing of the cost estimates through a tender).<br />
•<br />
estimates of the TOC may exceed this expectation in which case a process of<br />
•<br />
The process is very iterative. The client will (should) have a budget in mind. Initial<br />
value engineering is used to strip out unnecessary expenditure and explore more<br />
cost effective ways of achieving the client’s requirements and budget expectations.<br />
A lot hinges on getting the TOC in place as soon as possible. Until the TOC is<br />
agreed, the commercial CWA partners are remunerated according to the actual<br />
costs they incur. Until the process of independent scrutiny of direct costs, audit of<br />
margin, overhead and burdening calculations and value management is<br />
completed, the client does not have final assurance that the estimated costs<br />
represent an efficient level of costs. Moreover, until the TOC is in place, the gain<br />
and pain share arrangements cannot be finalised. The gain/pain share provide an<br />
important and further spur to efficiency and delivery of the project within, or in<br />
excess of, client expectations.<br />
5.21 In relation to this last point, a key point to understand with alliancing is that while it<br />
offers benefits over traditional contracting methodology, it raises new and different risks<br />
that have to be managed. In particular, there is a balance to be struck between having<br />
faith in the collaborative nature of alliancing and the need to protect the client’s financial<br />
interests. CWA does not involve a fixed price from the client’s perspective.<br />
TOC Development Timing<br />
5.22 The TOC plays a pivotal role in CWA agreements. At the time that the Spring Hill<br />
and Otago tenders were awarded (to Mainzeal and Hawkins respectively), there was an<br />
expectation that the CWA Agreement and TOC would be finalised within a matter of<br />
months. Negotiation Framework Agreements 3 (NFAs) were entered into with the CWA<br />
partners at both Spring Hill and Otago. In both cases, the NFA was agreed through to 15<br />
January 2005 during which the parties would work together to develop an accurate TOC.<br />
It is worth noting that, in the context of the Auckland Women’s project, it was expected<br />
that approximately nine weeks would be required to finalise the CWA (including TOC). 4<br />
3 NFAs are interim arrangement pending formalisation of the CWA Agreement. They do not<br />
represent the award of any contract, but signal the intention to enter into a CWA Agreement. NFAs<br />
set out various matters governing the negotiations leading toward a CWA Agreement.<br />
4 RPDP Steering Group meeting of 30 March 2004<br />
Methodology and Processes: Design, Costing, Procurement and Scheduling 29
5.23 In the event, the development of the TOC has taken considerably longer than the<br />
initial expectation. In respect of Spring Hill, the Steering Group accepted the TOC as<br />
presented on 21 June 2006 and the CWA Agreement is being finalised for execution. In<br />
the case of Otago, the TOC was approved by the CWA commercial members and the<br />
Department on 25 May 2006. The CWA Agreement is currently with the CWA members<br />
for execution.<br />
5.24 The NFAs for Spring Hill and Otago have been rolled over multiple times (at least<br />
7 times in the case of Spring Hill since October 2004). On several occasions, the roll-over<br />
of the NFA took place after the expiry of the preceding agreement. It is not clear what the<br />
legal position of the parties was on such occasions. At several points during 2005,<br />
revised timetables for completing the TOC were advised to the Steering Group. For<br />
example, in May 2005, it was expected that 30% of the Spring Hill project would be<br />
scoped into a TOC by mid-July 2005 with 80% scoped by mid-August. By implication,<br />
there was clear expectation that elements of the Spring Hill TOC would be progressively<br />
known through the middle of calendar-2005, but we note that the numbers around the<br />
TOC were not being communicated to the Steering Group during this time.<br />
5.25 In the case of Spring Hill, the Department considered in mid-May 2005 whether to<br />
delay construction work until the TOC was in place or to proceed on a fast-track basis.<br />
The latter option was taken on the understanding that the first TOC would be available in<br />
mid-July 2005. In the event, this deadline was not met. It was not until around late-<br />
September that the TOC for Spring Hill was beginning to be disclosed and slightly earlier<br />
in the case of Otago.<br />
5.26 The long period over which the TOC was developed created financial risk for the<br />
Department. During the period prior to completion of the TOC, the commercial CWA<br />
members are effectively reimbursed according to cost. While such costs are transparent<br />
and subject to review by the Department and independent advisers, the fact that critical<br />
TOC information did not emerge sooner meant that the Department (and Government<br />
more generally), was denied opportunities to consider options for reducing cost in light of<br />
the higher than expected cost. Moreover, prior to agreeing the TOC, it was not possible to<br />
agree the gain and pain share arrangements. As a result, the added incentives that these<br />
arrangements bring were missing. In the case of Otago and, to a somewhat lesser extent<br />
Spring Hill, the timing of the TOC meant that the projects were well underway before the<br />
TOC was agreed. This situation is not consistent with best practice CWA methodology.<br />
5.27 The fact of the substantial delay in getting the TOC in place obviously raises the<br />
question as to why the delay occurred. In this respect, we consider that there is a<br />
combination of factors.<br />
• The Department had no experience in CWA methodology. Experience in CWA<br />
was being gained as work on the RPDP projects progressed.<br />
• Pressure on design teams meant detailed designs took longer to finalise than was<br />
expected (detailed designs are a necessary prerequisite for TOC development).<br />
We understand that the issue around design related more to building services than<br />
to the buildings themselves (for example, designs for underfloor heating for Otago<br />
were not complete until August 2005).<br />
• The sheer volume of work involved in reviewing and independently verifying TOC<br />
estimates is considerable. We consider this was under-scoped by the Department<br />
and its advisers.<br />
Methodology and Processes: Design, Costing, Procurement and Scheduling 30
• The CWA methodology has been pushed down the supply chain to a very<br />
•<br />
•<br />
considerable extent. We understand that at the time of this review, approximately<br />
95% by value of the cost incurred and committed on Spring Hill was captured by<br />
the CWA methodology (i.e. only 5% or work was being performed under standard<br />
<strong>NZ</strong>S 3910 procurement). We question whether it is sensible to drive the level of<br />
CWA as far as this. A consequence of this approach is that it adds significantly to<br />
the workload involved in developing a TOC. Our understanding is that the<br />
successful Auckland Women’s project had around 60% of cost under a CWA<br />
arrangement.<br />
There is a large number of partners involved in the CWA (there are 17 CWA<br />
members on the Otago project). The remoteness of the sites, particularly in<br />
Otago, has meant that the net for contractors has had to be cast widely so much<br />
so that, at the peak, approximately a third of the workforce on the Otago site is<br />
“imported” from outside of the coastal Otago area. Increasing the number of<br />
contractors increases the number of margins and overheads that have to be<br />
calculated. More fundamentally, the larger the number of CWA members, the<br />
more training in CWA that needed to be undertaken.<br />
There was generally insufficient experienced estimation and cost planning<br />
expertise available in the market and who were capable of undertaking the first<br />
principles approach to cost determination that is characteristics of CWA.<br />
Moreover, the expertise that did exist was more used to short-term projects rather<br />
than the major and long-term nature of the prisons project.<br />
• Governance and project management arrangements prior to changes in mid – late<br />
2005 have not, in our view, been as tight as they needed to be. This point is<br />
discussed further in the next section. However, issues regarding project<br />
management meant that the range of factors that were impacting on the timeliness<br />
of the TOC were not being managed as closely as they warranted.<br />
• The commercial CWA members, who were being reimbursed for costs incurred,<br />
did not necessarily face strong incentives to expedite the development of the TOC.<br />
That said, however, we note that incentives can change. For example, we<br />
understand some of the CWA principals involved in the Otago project entered into<br />
an arrangement to underwrite risks faced by some of the sub-contractors,<br />
stemming from potential time delays. This may well have contributed to the more<br />
timely completion of the proposed TOC for the Otago project (taking into account<br />
the design issues noted above).<br />
5.28 In summary, several resource constraints impacted on the timeliness of the TOC.<br />
These included pressures on scarce design resources and a relative lack of experienced<br />
estimation and cost planning expertise. The timeliness of the TOC was also influenced by<br />
the hea vy demands being placed on management of the CWA in part reflecting the extent<br />
to which the CWA has been driven down the supply chain. The resource constraints and<br />
demand pressures are, however, matters that are capable of being anticipated and<br />
managed.<br />
5.29 Notwithstanding these points, the Department faced a difficult set of<br />
circumstances. The need to maintain progress with the projects so as to ensure their<br />
completion in time to meet expected prison population growth meant that the option of<br />
delaying the project pending completion of the TOC was not a realistic option.<br />
Methodology and Processes: Design, Costing, Procurement and Scheduling 31
5.30 In short, from a best practices perspective, it is not desirable to have the TOC<br />
being developed so far into the construction phase. A key lesson arising from the Spring<br />
Hill and Otago projects is the need to ensure that the TOC is developed much sooner in<br />
the process so as to minimise the amount of construction undertaken without there being<br />
an agreed TOC.<br />
TOC Development – Independent Assurance<br />
5.31 One of the guiding principles governing CWA is the need to ensure that costs are<br />
efficient and represent value for money. The Department is part of the TOC development<br />
process and, as part of this, it reviews and assesses the TOC with the objective of<br />
ensuring that it is receiving value for money and, consistent with this, that the TOC is<br />
based on an efficient level of prices.<br />
5.32 To assist in achieving these objectives, the Department obtains advice from a wide<br />
range of third parties as shown below.<br />
CMS<br />
Burdened rates<br />
SCW<br />
Independent<br />
review<br />
Direct Costs<br />
Labour costs<br />
Plant/eq<br />
uipment costs<br />
Materials costs<br />
Rider Hunt –<br />
independent review<br />
CMS<br />
Margins<br />
SCW<br />
Independent<br />
review<br />
Overheads<br />
5.33 While use of outside expertise is desirable, several points can be made.<br />
• There is a very heavy dependence on CMS. From a risk management<br />
perspective, having such a high proportion of the overall knowledge of the projects<br />
in one (small) firm needs careful management. The Department has sought to<br />
manage this through the roles performed by Sherwin, Chan & Walshe (a chartered<br />
accountancy firm). Their roles include review of margin calculations performed by,<br />
and the methodologies used by, CMS.<br />
• There is a need for high degree of independence because of the need to challenge<br />
the draft TOC numbers being prepared by the commercial CWA partners. The<br />
Methodology and Processes: Design, Costing, Procurement and Scheduling 32
•<br />
•<br />
Department engaged CMS in respect of this. CMS has a key role in facilitating the<br />
CWAs and, as part of its brief, takes responsibility for the quality of work going into<br />
the development of the TOC and plays a key role in determining margins and<br />
overheads which are key inputs to the overall determination of the TOC. In this<br />
regard we view CMS’ role as being very much on behalf of the CWA; not the<br />
Department. However, it is clear that the Department has placed considerable<br />
reliance on the advice of CMS. Notwithstanding the role performed by Sherwin,<br />
Chan & Walshe, we consider that the Department should seek to supplement<br />
CMS’ role with another adviser expert in CWA methodology in order to ensure the<br />
level of independence needed in order to effectively counter-balance and<br />
challenge the TOC estimates being submitted by the commercial CWA members.<br />
Rider Hunt has responsibility for reviewing the direct costs (labour, materials and<br />
plant). To undertake this role, Rider Hunt compares the quantities and values in<br />
the TOC against a database of information built up from many other projects. A<br />
difficulty that Rider Hunt faces is that it is being asked to review labour rates that<br />
do not include any element of profit or overhead. In traditional forms of<br />
contracting, labour rates do include profit and/or overhead (i.e. a builder’s hourly<br />
rate will normally include profit and a contribution to overhead). Rider Hunt does<br />
not, however, have access to margin or overhead data. While noting that there<br />
are commercial sensitivities around profit/overhead information, we consider that<br />
would be better to provide Rider Hunt with access to this information as it would<br />
provide a better basis for cost comparisons.<br />
More generally, the Department, as well as Rider Hunt, did not have full<br />
transparency over margins and, in this respect, the way in which CWA was<br />
implemented did not fully accord with the “open book” requirements of the CWA<br />
methodology. Only CMS had full transparency over margins.<br />
5.34 The process for determining margins and overheads involves extensive detailed<br />
unbundling of contractors’ accounts. There is potential for costs to be double counted.<br />
Considerable judgement needs to be applied by CMS in the process of trying to normalise<br />
the accounts and ensure that costs are counted only once. Sherwin, Chan & Walshe are<br />
retained by the Department as an independent check on the margin and overhead<br />
calculations performed by CMS. However, because the Department does not of itself have<br />
visibility over margins, it is totally reliant on the advice of third parties. Consistent with the<br />
open book principle upon which CWA is based, and recognising that the margin<br />
calculations are an important part of overall cost determination, we consider that the<br />
Department should have greater direct visibility over margins and their calculation.<br />
Development of the TOC – Lessons Learned<br />
5.35 Given the pivotal role played by the TOC, its development needs to be concluded<br />
much sooner in the overall process than has been the case for the regional prisons.<br />
Several factors need to combine in order for this to occur.<br />
• First and foremost, there needs to be more flexibility over the lead time for<br />
constructing the prison. A key issue affecting the regional prisons was the need to<br />
adhere to specified completion dates in order to accommodate the growing prison<br />
population. Realistically, the Department did not have the choice of deferring<br />
construction of Spring Hill and Otago to allow for the development of the TOC prior<br />
to starting construction.<br />
it<br />
Methodology and Processes: Design, Costing, Procurement and Scheduling 33
• Related to this last point, the Department needs to take steps to ensure that<br />
appropriate levels of design capability are available to take designs from concept<br />
status through to detailed plans status so as to provide the basis for detailed TOC<br />
development work. Design was a bottleneck in the prisons’ development.<br />
• Timely completion of the TOC depends on there being completed and agreed<br />
designs. In part, delays in completing designs were a function of scarce design<br />
resources but, in part, there were design changes late in the process (e.g. in<br />
relation to site services at Otago).<br />
• Pressure has to be maintained on the commercial CWA partners to ensure early<br />
development of the TOC. Under cost plus margins arrangements there is an<br />
inherent risk that the commercial partners do not necessarily have strong<br />
incentives to conclude early agreement on the TOC. The TOC is an iterative<br />
process and requires the client to be in a position to challenge elements of the<br />
TOC from an informed position. This requires appropriate levels of resource and<br />
flexibility and nimbleness in decision making. Structures and processes need to<br />
support this.<br />
5.36 The corollary of ensuring the early completion of the TOC is that the amount of<br />
work that is undertaken on fast-track basis should be minimised. Getting the TOC<br />
determined before work starts maximises the opportunity for Government to make<br />
changes if costs turn out higher than expected.<br />
Procurement and Scheduling<br />
5.37 The method under which the prisons have been constructed is a major part of this<br />
review. As will be discussed below, a hybrid form of CWA was adopted for the Northland<br />
project. A key reason behind this was the need to address some issues with that project<br />
that had the potential to adversely affect the timing of that project.<br />
5.38 Prior to the Northland project, prison construction in New Zealand had been<br />
procured by a fixed price form of contracting (more formally, procurement had been<br />
undertaken pursuant to the <strong>NZ</strong> standard <strong>NZ</strong>S 3910). This form of procurement is<br />
commonplace across a wide range of construction activity. In a sense, it is the traditional<br />
form of procurement.<br />
5.39 In contrast, Spring Hill and Otago have been procured using the CWA, or<br />
alliancing, form of procurement. There are major differences between the two forms of<br />
procurement. It has not been within the brief of this review to assess the merits or<br />
otherwise of the CWA versus more traditional forms of contracting. However, it is useful<br />
to have an appreciation of the differences involved and the key features of CWA<br />
methodology.<br />
Key Features of CWA Methodology<br />
5.40 CWA is one form of a more general form of procurement referred to as alliancing.<br />
Alliancing can take many forms, examples of which include:<br />
• Traditional joint ventures - until recently, the joint venture, in which two or more<br />
parent organisations join forces to create a separate legal entity, has been one of<br />
the most common type of alliance. In the traditional joint venture, organisations<br />
unite to obtain economies of scale and scope.<br />
Methodology and Processes: Design, Costing, Procurement and Scheduling 34
• Outsourcing arrangements - these are partnerships in which an organisation<br />
outsources a business process or function (e.g., human resources or information<br />
technology) that is not central to its business mission. This allows the organisation<br />
to concentrate on its primary business objectives.<br />
• Marketing alliances - marketing alliances bring together organisations that<br />
market different products or services to the same group of consumers. They can<br />
take many forms, including co-packing alliances and co-operative advertising.<br />
Under a co-packing alliance, an organisation licenses the use of its brand name<br />
and product formula to organisations that have production, packaging and<br />
distribution capabilities.<br />
• Supplier/vendor alliances - closely related to outsourcing arrangements are<br />
supplier (or vendor) alliances in which organisations partner with suppliers to<br />
enhance the service, each bringing its specific area of expertise to bear on the<br />
project or service.<br />
5.41<br />
The CWA is closely related to the last of these forms.<br />
5.42 A key feature of CWA (and alliancing more generally) is that all parties in the<br />
alliance have a shared interest in overall project outcomes. Alliancing approaches share<br />
a number of distinct features that set them apart from more traditional forms of<br />
procurement. Included among these are:<br />
• alignment of the business goals of all parties;<br />
• selection of parties in the CWA agreement is based on capability, approaches and<br />
systems (as in traditional evaluation processes) and more subjective assessment<br />
around the level of project commitment, the composition and nature of the sponsor<br />
team, the likelihood of the combined team delivering outstanding results;<br />
• a selection process that may not include price;<br />
• joint risk allocation and management;<br />
• joint and integrated project governance and management;<br />
•<br />
fully open book among the parties implying very high levels of financial and other<br />
disclosure;<br />
• a principles-based collaborative form of contract that seeks to avoid adversarial<br />
conduct. This means, for examples, that there are no disputes resolution<br />
processes in CWA agreements. Where problems arise, the parties work<br />
collaboratively to identify solutions rather than seeking to “point the finger of<br />
blame”;<br />
• a cost reimbursement process that is open and pays actual costs and agreed<br />
margins (profits and overheads);<br />
• an equitable and appropriate risk and reward scheme (referred to as pain share<br />
and gain share arrangements);<br />
• an active relationship development and maintenance regime; and<br />
Methodology and Processes: Design, Costing, Procurement and Scheduling 35
• high levels of support from parent companies in support of the contracting<br />
arrangement (as reflected by senior representation on what is referred to as the<br />
Principals Group).<br />
5.43 The CWA approach is aimed at fostering a best-for-project approach through a<br />
“no-blame-no-claim” culture where all parties have a unity of purpose to achieve a<br />
successful outcome. Decision making in regard to the project is conducted through a<br />
Principals Group. Decisions by the Principals Group are made on a unanimous basis;<br />
that is, all parties have to agree.<br />
5.44 In traditional fixed price contracts, the principal point of focus is the price that is<br />
paid for the services. Under the CWA approach, the focus is on the efficient level of costs<br />
because this is the amount that the client, in theory, pays for the services.<br />
Background To CWA for Prison Construction<br />
5.45 The CWA methodology has been used in the context of the Northland (albeit in<br />
hybrid form) and the recently opened Auckland Women’s prison. The Northland prison<br />
commenced as a traditional <strong>NZ</strong>S 3910 contract. However, by August 2003, several<br />
factors pointed toward the need to modify the contractual approach to construction:<br />
• financial pressure on one critical consultant was such that it was doubtful if they<br />
would continue;<br />
• there was evidence of on-site “man-marking” where significant effort was being<br />
directed toward allocating blame rather than resolving issues; and<br />
• the construction programme was not universally agreed among the parties<br />
involved.<br />
5.46 In considering the options open to the Department, CWA was raised as a potential<br />
way forward. Several points are worth noting in this regard.<br />
• We understand that Mainzeal had for some time been considering alternative<br />
forms of procurement including alliancing.<br />
• Stewart Rix (of CMS) had considerable experience of CWA from previous roles in<br />
the United Kingdom (where CWA and alliancing generally is more commonplace).<br />
A meeting between CMS and the RPDP Project Director (John Hamilton) to<br />
present on CWA was arranged at the instigation of the Chair of the Inmate<br />
Employment Advisory Committee. CMS also presented to Hawkins Construction<br />
Ltd (the main contractor on the Auckland Women’s and Otago projects).<br />
• When difficulties with Northland emerged, the RPDP Project Director approached<br />
CMS out of which came a suggestion to convert the contractual framework for<br />
Northland to a CWA agreement (the Northland project had been running on-site for<br />
approximately six months). Mainzeal were the prime contractors for the Northland<br />
project.<br />
5.47 At the August 2003 meeting of the RPDP Steering Group, the Project Director<br />
provided an oral briefing on the proposal to enter into a hybrid form of CWA (the hybrid<br />
arrangements retained an element of the former <strong>NZ</strong>S 3910 contract including, in<br />
particular, a cap on construction costs). The meeting approved in principle the change to<br />
Methodology and Processes: Design, Costing, Procurement and Scheduling 36
the hyb<br />
rid CWA subject to the condition that a formal paper for approval be tabled with the<br />
Steering Group.<br />
5.48 Following the decisions to adopt the hybrid methodology, the Department decided<br />
to retain CMS to assist with training and to provide advice on managing the transition to<br />
the new arrangements. Both aspects of CMS’ role were vital: the Department had no prior<br />
experience of CWA.<br />
Choice of Procurement Methodology<br />
5.49 Subsequent to the decisions taken with respect to Northland, the Department has<br />
moved to adopt CWA for the Spring Hill and Otago projects (as well as Auckland<br />
Women’s).<br />
5.50 CWA represents a fundamental shift in procurement method. Accordingly, we<br />
would have expected a first-principles analysis of this, and other, procurement options to<br />
have been considered and debated at length before moving toward its adoption across<br />
the other projects in the RPDP. As part of this review, we have not, however, sighted<br />
papers provided to, or minutes of, the Steering Group that explicitly affirm the choice of<br />
CWA ahead of <strong>NZ</strong>S 3910 (or any other form of contracting method) for either Spring Hill<br />
or Otago.<br />
5.51 In the context of the Northland project, the lack of in-depth analysis and<br />
consideration could perhaps be explained by the immediate and significant set of<br />
problems that needed to be addressed. CWA provided a framework to make progress<br />
with the project and avoid the time delay and cost implications that could have eventuated<br />
had the project either remained as a <strong>NZ</strong>S 3910 or been re-tendered.<br />
5.52 Notwithstanding these circumstances, however, the decision to adopt CWA for the<br />
Spring Hill and Otago projects should have been justified on a project by project basis.<br />
The analysis should have extended not just to the traditional <strong>NZ</strong>S 3910 contract but to the<br />
various forms of alliance arrangements and other options beyond alliancing such as:<br />
• reimbursable contracts under which the client pays for all of the work plus a<br />
margin to the supplier;<br />
• a construction management approach under which the client employs a<br />
construction manager who works for a fee which is applied to the value of the<br />
work;<br />
• design and build, and design, build and operate contracts; and<br />
• design, build, operate and finance contracts.<br />
profit<br />
5.53 It is not the purpose of this review to advocate these, or any other, forms of<br />
procurement. The point is that the Department chose to move away from <strong>NZ</strong>S 3910 to a<br />
fundamentally different form of procurement. This decision should have been based on<br />
detailed first principles analysis of CWA and other forms of procurement.<br />
5<br />
5 This form of procurement is increasingly common in Australia under the banner of pubic-private<br />
partnerships and in the United Kingdom under the banner of private finance initiatives (PFI). In<br />
New Zealand, such forms of contract would require, under the Public Finance Act, approval from<br />
the Minister of Finance.<br />
Methodology and Processes: Design, Costing, Procurement and Scheduling 37
5.54 This issue is not just a matter of good process for two main reasons. The first of<br />
these is that CWA potentially exposes the client to financial risk unless the CWA approach<br />
is well managed. To the extent that CWA was discussed with the Steering Group in the<br />
context of Northland, it is clear that the potential benefits of CWA were described. What<br />
is less clear is whether the risks and costs around CWA were explained along with the<br />
critical factors that must be achieved in order for a CWA to work well and in the client’s<br />
interests. The lack of paper trail makes this difficult to evaluate but our impression is that<br />
the benefits of CWA were emphasised to a much greater extent than the potential risks<br />
and costs involved.<br />
5.55 The second reason why the relative lack of consideration of procurement options<br />
is an issue is because prior to Northland, the Department had no knowledge or<br />
experience of alliancing. The need for rigorous consideration of this and other<br />
procurement options is even greater, the lesser is the knowledge and understanding of<br />
something new.<br />
5.56 These comments should not be interpreted as a criticism of the CWA<br />
methodology. Indeed, we note advice from the UK National Audit Office (NAO)<br />
recommending that departments not use traditional forms of procurement for construction<br />
projects unless it can be demonstrated that this form of procurement will provide better<br />
value for money ahead of design and build, or alliancing (the closest form of which is<br />
6<br />
described as “prime contracting” by the NAO) or PFI. Moreover, the comments should<br />
not be interpreted as saying that CWA was the wrong choice. In this regard, we note that<br />
the Auckland Women’s project appears to have been delivered on time and within budget.<br />
In the case of the Spring Hill and Otago projects, independent advice provided to the<br />
Department in October 2005 advised that the Department should not depart from the<br />
CWA path to another form of procurement unless as an absolute last resort (although this<br />
advice was tendered at the time when construction of Spring Hill and Otago was well<br />
underway). 7<br />
5.57 Notwithstanding these points, we consider that the choice of procurement<br />
approach for any given project should be made on a case-by-case basis. In this regard,<br />
there are several factors that need to be considered before choices regarding<br />
procurement method are made. Below, we set out some high-level characteristics that<br />
would tend to favour use of CWA in preference to traditional <strong>NZ</strong>S 3910 forms of<br />
procurement. CWA is more likely to be preferred when the following conditions are<br />
characteristics are present.<br />
• The best way of achieving desired outcomes, in terms of the choice of<br />
technologies and processes, is uncertain. In the context of the regional prisons,<br />
their design was markedly different to that which had gone before and reflected a<br />
desire for a different approach to the management of inmates. By implication,<br />
however, there was uncertainty around the details of design and how this would<br />
interface with operational requirements.<br />
• There is a high degree of complexity in design, construction, technology and/or<br />
development which cannot be satisfactorily scoped at project commencement.<br />
Complexity per se does not favour CWA over other forms of procurement, but<br />
6 National Audit Office (2005) “Improving Public <strong>Services</strong> Through Better Construction” , London,<br />
p23.<br />
7 Peter Waterhouse 31 October 2005 “<strong>Report</strong> to RPDP on Construction Costs and Alternative<br />
Procurement Strategies”<br />
Methodology and Processes: Design, Costing, Procurement and Scheduling 38
•<br />
•<br />
where complexity gives rise to risk and uncertainty CWA may provide a more<br />
flexible contracting methodology. In the context of the Spring Hill and Otago<br />
projects, it is generally the case that the construction techniques are not new or<br />
overly complex. While there is a considerable amount of technology that goes into<br />
prison buildings (security related), this is separable from overall construction (as<br />
indeed was the case with a separate CWA for security systems). Of themselves,<br />
the building designs do not appear to be overly complex although, as noted above,<br />
there was uncertainty around aspects of design.<br />
•<br />
project (at development and design stages). This is another way of saying that<br />
•<br />
there is uncertainty over the optimal design approach and, further, that the client<br />
wants to explore rather than getting locked into a particular approach under<br />
traditional <strong>NZ</strong>S 3910 procurement.<br />
There is a necessity for innovation and step-change developments in design,<br />
technology and construction methodology. CWAs create a better framework than<br />
traditional forms of contracting for such developments to take place. Arguably,<br />
elements of this requirement existed for the regional prisons in respect of design,<br />
but less so with respect to technology and construction methodology. As<br />
experience with the regional prisons design grows, this characteristic may become<br />
less relevant.<br />
• The projects are large. CWA has a significant management overlay because<br />
5.58 In addition to these points, comments by various Department and contractor<br />
personnel have suggested that CWA might be better suited to projects being undertaken<br />
in a heated construction market, but less appropriate when market conditions are benign<br />
or declining. Various reasons support this view:<br />
•<br />
Technology is rapidly evolving. This does not appear to be a characteristic<br />
relevant to prison buildings.<br />
Timeframes for completion of the project are tight and, accordingly, the project<br />
demands innovative and flexible approaches to ensure project completion. This<br />
clearly is a feature of the Spring Hill and Otago projects and, arguably, is the<br />
strongest reason for preferring a CWA methodology for these facilities.<br />
There is considerable scope for value engineering into the early stages of the<br />
many checks and balances have to be built into the procurement process to<br />
compensate for the lack of market testing of prices through competitive tender.<br />
Various people interviewed during the review have suggested that the minimum<br />
size of project that can support CWA is probably in the order of at least $100<br />
million. Clearly, the Spring Hill and Otago projects meet this condition.<br />
The CWA methodology provides transparency over margins and seeks to<br />
normalise margins. The process of agreeing margins under CWA therefore<br />
enables adjustments to be made to margins such that abnormally high margins<br />
experienced at the peak of the market are adjusted downwards.<br />
• Because the CWA methodology allows for the pass through of direct costs,<br />
suppliers are not as exposed as they would be to unexpected cost increases. This<br />
can also be advantageous from a client perspective in that in a heated market,<br />
fixed price contracts are likely to seek to guard against unexpected price increases<br />
by quoting higher prices to start with.<br />
Methodology and Processes: Design, Costing, Procurement and Scheduling 39
• From a practical perspective, and in the specific context of Spring Hill and Otago,<br />
the comment has been made to us by Department and contractor personnel that<br />
as the construction market grew tighter, there was less willingness on the part of<br />
the construction industry to enter into traditional fixed price contracts. The market<br />
was becoming a sellers market. Those in the market were increasingly being able<br />
to dictate their own terms and prices and this included, as noted earlier, a trend<br />
toward preferring CWA.<br />
5.59 In contrast to CWA, traditional <strong>NZ</strong>S 3910 approaches to procurement are suitable<br />
for projects where the scope and requirements of the project are well defined and where<br />
the risks are known, understood and capable of being appropriately factored into tender<br />
pric es . In our view, these characteristics are present across elements of the prisons<br />
construction programme and, accordingly, we do not consider that traditional forms of<br />
procurement should be automatically ruled out. Each project should be considered in its<br />
own rig ht and the business case made for preferring one form of procurement over others.<br />
5.60 On a related point, we consider that there are lessons arising from the Spring Hill<br />
and Otago projects in terms of how far down the supply chain to carry the CWA approach.<br />
As noted earlier, 95% of cost at Spring Hill is being incurred by CWA members. This is a<br />
very high ratio.<br />
5.61 CWA is management intensive. For those CWA members who are new to CWA,<br />
there is also a considerable learning curve and associated training requirements. The<br />
deeper CWA penetrates through the supply chain, the greater are the administrative and<br />
management overheads and at some point, the additional costs involved exceed the<br />
benefits that CWA might bring. In the case of Otago, we note that there are 17 CWA<br />
members. This is a large number of firms to manage. Where CWA is implemented, it<br />
makes sense to include the primary contractors as CWA members. However, application<br />
of CWA becomes increasingly questionable the further below this level the CWA seeks to<br />
probe. In our view, there may not be sufficient benefits over cost to drive down as far as<br />
the small and even medium sized businesses that supply trade services to the project.<br />
Selection Process<br />
5.62 Although not part of the original brief for this review, the <strong>Commission</strong> has<br />
requested that comment be made on the process for the selection and appointment of the<br />
main contractors involved with Spring Hill and Otago and the appointment of the Project<br />
Director and CMS (reflecting the key role that CMS has played in facilitating the CWA).<br />
5.63 In the case of Spring Hill, a Request for <strong>Proposal</strong> (RFP) for provider of building<br />
works was issued in September 2004 and Mainzeal was the preferred respondent. The<br />
Department and Mainzeal entered into a CWA Negotiation Framework Agreement (NFA)<br />
on 26 October 2004. Also in September 2004, the Department issued a RFP for building<br />
works in respect of Otago and Hawkins Construction was selected. A NFA with Hawkins<br />
was entered into also on 26 October 2004. The evaluation of the tenders was undertaken<br />
with particular focus on performance, culture and capability. Cost was not part of the<br />
evaluation criteria.<br />
5.64 The Department has documented procurement processes and tender procedures.<br />
The latest version of these is based on an original document prepared in 2002 and which,<br />
in turn, is based on the framework contained in the <strong>State</strong>ment of Good Practice issued by<br />
the Office of the Auditor General (that framework remains at the core of the current<br />
processes).<br />
Methodology and Processes: Design, Costing, Procurement and Scheduling 40
5.65 A probity audit of the selection processes for the construction contractors for<br />
Spring Hill and Otago was undertaken by Audit <strong>NZ</strong> in October 2004. Those reports<br />
concluded that:<br />
• generally, the RFP documentation and the processes surrounding its issue, the<br />
receipt, opening and evaluation of responses conform to good practice;<br />
• the evaluations were conducted fairly and impartially and in accordance with the<br />
documented process plan; and<br />
• Audit New Zealand was unaware of any probity issues outstanding.<br />
5.66 We also note that Sherwin, Chan & Walshe were engaged to undertake a financial<br />
due diligence of the main contractors.<br />
5.67 Notwithstanding the positive outcome of the review undertaken by Audit New<br />
Zealand, we note that there is an issue as to whether or not the evaluation criteria should<br />
include cost. We are aware that some CWA tenders do not include cost (as was the case<br />
for the RFPs issued by the Department), but equally it is possible to include cost as part of<br />
the evaluation process. However, in order to do this, a number of steps have to be<br />
completed. In particular, the client has to have undertaken some work to take design to a<br />
sta ge that can be used for costing purposes.<br />
5.68 As part of the tender process, the client can invite contractors to submit bids based<br />
on a reimbursable target-cost contracting basis. The benefits to the client are that<br />
contractors submit indicative target costs in a competitive environment. It is important to<br />
note, however, that where the scope of work is imprecisely defined, or there are particular<br />
features of the operating environment that create significant uncertainty, then assumptions<br />
need to be developed by the client regarding scope, specification and schedule. This<br />
enables bidders to submit indicative target costs based on shared and common<br />
understandings. We are unaware as to whether or not the Department considered<br />
approaching the tender on this basis. We note, however, that by late September 2004<br />
when the RFP’s were issued, the construction market was already heated. Based on<br />
discussions with industry and Department personnel, there is a view that the market would<br />
not have reacted favourably to such a tender approach given the amount of additional<br />
work involved in preparing a bid. Moreover, the time available to the Department to issue<br />
the RFP and then make a selection was very tight (a point noted by Audit New Zealand in<br />
its probity reviews). We doubt that the timeframes available would have allowed for<br />
indicative costs to be added into the tender process.<br />
5.69 The re-appointment of the Project Director position occurred in 2004. Prior to the<br />
re-appointment, the Project Director had been fulfilling project management and other<br />
roles within the Department and, accordingly, had acquired considerable institutional<br />
knowledge. A tender process for the Project Director position was initiated and managed<br />
by the then Chief Financial Officer. The CFO, together with two members of the Steering<br />
Group, formed the interview panel. We understand that four or five possible candidates<br />
were considered and this was refined to a short-list of two.<br />
5.70 In July 2004, Audit New Zealand provided some informal advice on an early draft<br />
of the Request for <strong>Proposal</strong> for the Project Director position. The appointment process<br />
had commenced in May 2004 and the appointment was made in October 2004. The<br />
review by Audit New Zealand raised a concern that the Project Director and the Manager,<br />
Administration and Contracting were involved in the renewal process for each other’s<br />
contracts. The Manager, Administration and Contracting had been involved in preparing<br />
the RFP for the Project Director position and the evaluation plan. We understand from<br />
Methodology and Processes: Design, Costing, Procurement and Scheduling 41
Audit New Zealand that there were also some minor issues around documentation. We<br />
agree with the comment by Audit New Zealand that the engagement of key personnel for<br />
RPDP should be managed by the Department alone as far as possible, or by using a<br />
completely independent recruitment specialist.<br />
Contracting Expertise<br />
5.71 At the time of entering into CWA for the construction of the regional prisons, the<br />
Department had very little knowledge and understanding of CWA. It was heavily<br />
dependent on a small number of key individuals including, in particular, Stewart Rix of<br />
CMS and John Hamilton (the Project Director). Neither are employees of the Department.<br />
As a general point, it is preferable, particularly on projects of the size, complexity and risk<br />
(financial, operational and reputation) of the RPDP projects, to avoid being too reliant on a<br />
small number of external advisers. That said, however, it is acknowledged that expertise,<br />
particularly in relation to the CWA methodology, was relatively scarce (in part, reflecting its<br />
limited use in New Zealand).<br />
5.72 Through the projects completed to date (and nearing completion), the Department<br />
has built significant organisational capability within the RPDP team. For future projects,<br />
the Department needs to ensure that it retains people who are able to advise, from a first<br />
principles perspective, on the choice of optimal procurement methodology and then, once<br />
the decision is taken, lead and advise on the implementation of the chosen procurement<br />
method. This includes the role of being a member on the Principal’s Group.<br />
5.73 A blend of competencies and experiences are required to undertake these tasks;<br />
commercial, construction as well as understanding of Government machinery and<br />
decision making processes. The range of competencies is unlikely to be found in one<br />
individual. We note, and support, the decision by the Department to add a department<br />
employee to the Principal’s Group at both Spring Hill and Otago. This initiative usefully<br />
supplemented the commercial and construction background and expertise of the Project<br />
Director notwithstanding his previous involvement with the Department since 1997 (as<br />
employee and as contractor).<br />
5.74 We note that the issue of having the right mix and level of expertise might apply<br />
more widely than just the Department of Corrections. For example, a unit has been<br />
established within the <strong>State</strong> <strong>Services</strong> <strong>Commission</strong> to assist with and advise on aspects of<br />
major IT investments. Although well beyond the scope of this review, it is worth<br />
considering whether there is a need for an equivalent group in respect of major building<br />
construction or even procurement more generally for the public sector. Although not<br />
appropriate for New Zealand given the much smaller size of our economy, we note the<br />
example from the United Kingdom which has established the Office of Government<br />
Commerce (OGC) which is an independent Office of the Treasury. The OGC is<br />
responsible for a wide ranging programme which focuses on improving the efficiency and<br />
effectiveness of procurement within central government.<br />
Market Testing of Costs<br />
5.75 The Department and Government more generally, needs assurance that the<br />
amounts being paid for the regional prisons are based on efficient levels of cost. The way<br />
in which CWA has been implemented by the Department means that such assurance is<br />
sought through a process of subjecting the development of the TOC to extensive<br />
independent review and audit. Under traditional <strong>NZ</strong>S 3910 contracts, prices are market<br />
tested through the competitive tendering process. As applied to Spring Hill and Otago,<br />
the CWA methodology has not provided this same market testing. Accordingly, under<br />
CWA, there needs to be exceptionally robust and transparent processes around<br />
Methodology and Processes: Design, Costing, Procurement and Scheduling 42
determination of TOC/QRA and the inputs to these – direct costs, margins, off-site and onsite<br />
overheads.<br />
5.76 Notwithstanding these processes, however, we consider that the option of<br />
providing further assurance by requesting potential CWA members to submit bids based<br />
on reimbursable target-cost contracts should be considered for future projects. Such a<br />
process would involve submitting indicative target costs in a competitive environment<br />
before the selection of CWA members is made (but would also require more time and<br />
resource to implement than was available in the context of Spring Hill and Otago).<br />
5.77 In the context of the regional prisons completed, or under construction, we doubt<br />
that there was the time to undertake this process. However, for future prison builds, we<br />
see no reason why consideration should not at least be given to modifying the tendering<br />
process in this manner. The key advantages are that this approach comes closer to<br />
providing a market test of likely cost, creates the opportunity to consider options if<br />
indicative costs exceed available funding and provides an improved ability to give<br />
Ministers a realistic view of potential costs.<br />
Summary<br />
5.78 A key feature of the methodology and processes employed in relation to Spring Hill<br />
and Otago is the adoption of the CWA approach to procurement. A hybrid form of this<br />
methodology was successfully utilised on the Northland project. In that particular case,<br />
use of CWA assisted in overcoming some issues that were threatening to disrupt progress<br />
with the facility.<br />
5.79 The CWA methodology has many potential advantages compared to traditional<br />
fixed price forms of contracting. The Department has captured many of these including:<br />
• close integration of design, construction and operational perspectives;<br />
• cost savings and other benefits through undertaking several value management<br />
reviews;<br />
• efficient use of resources at site-level;<br />
• collaborative approaches to resolving issues as they arise at a day-to-day level;<br />
and<br />
• high levels of transparency around project costs at the project level (although as<br />
discussed in the next section, this transparency did not always percolate up to the<br />
Steering Group to the extent needed).<br />
5.80 Overarching these benefits, there are sufficient indications to suggest that had the<br />
Department elected to follow a more traditional procurement method, timeframes for<br />
completing the projects may not have been met. Had that been the case, this review<br />
wo uld have had a fundamentally different focus and set of drivers.<br />
5.81 Notwithstanding the benefits that have arisen through the use of CWA, there are<br />
some<br />
lessons that can be learned in terms of design, costing, procurement and<br />
scheduling. Specifically:<br />
• CWA is not necessarily suited to all projects. There is a need to identify the<br />
conditions under which CWA is likely to be preferred ahead of other forms of<br />
Methodology and Processes: Design, Costing, Procurement and Scheduling 43
procurement. These considerations need to applied on a project-by-project basis<br />
and decisions documented.<br />
• The CWA methodology requires careful management and sound contracting<br />
experience. The Department entered the RPDP without recent major construction<br />
project experience. It is building that capability. This needs to continue if further<br />
new prisons are proposed. At a wider level, consideration may need to be given<br />
as to whether the public sector generally needs to build its contracting expertise for<br />
major projects (although this would depend on there being a sufficiently large<br />
scope of future projects).<br />
• CWA, along with any form of procurement, needs to be based on sound facility<br />
designs. In turn, this requires agreed standards and adequate design capacity.<br />
•<br />
As part of the CWA member selection process, it may be possible in some<br />
circumstances to seek indicative target costs. This would help to provide a degree<br />
of market testing of costs. However, to do this requires that the following<br />
conditions be met which, in the situation of Spring Hill and Otago, was not the<br />
case:<br />
– there be sufficient contractors prepared to engage in this process;<br />
– designs be developed to a stage sufficient to support estimation of costs<br />
– the Department have the resources to support the process; and<br />
– sufficient time be available for the process to work through.<br />
• The development of the TOC is a fundamental part of the CWA methodology and<br />
needs to be completed sooner than has been the case in the Spring Hill and Otago<br />
projects. This emphasises further the need for timely completion of designs and<br />
appropriate levels of project management resource.<br />
• Until the TOC is underway, cost estimates are indicative only. This needs to be<br />
made clear to decision makers. Once TOC estimates begin to emerge, they<br />
should be reported regularly so as to provide maximum opportunity to modify<br />
requirements if budgets are under pressure.<br />
Methodology and Processes: Design, Costing, Procurement and Scheduling 44
6 Governance and Project Management<br />
Key Findings:<br />
Achievements<br />
• New Zealand will have four regional prison projects completed in time to meet the growth<br />
in the prison population.<br />
• The Steering Group comprised senior management in the Department and this group<br />
recognised gaps in knowledge and expertise that needed to be filled, namely: experienced<br />
Project Director, Audit and Independent Review processes, acquisition of external large<br />
scale project management expertise, and Treasury representation.<br />
• Changes to project governance and management structures from late-2005 have greatly<br />
increased the quality of review, reporting and decision-making on the projects. This<br />
includes the establishment of a Programme Management Office (PMO) in February 2006<br />
to assist with the project and risk management dimensions at governance and project<br />
management levels.<br />
• Formation of the Construction Sub-committee comprising appropriate expertise and with<br />
responsibility for decision-making advice to the wider group on complex technical matters.<br />
• These arrangements and changes have made significant improvements to the quality of<br />
reporting, decision-making and potential for risk management. We note that the PMO has<br />
potential to significantly assist the programme governance, but that this is still early days<br />
for this role.<br />
• Mid-2005, a senior Department manager was appointed to each of the CWA Principals<br />
Groups at Otago and Spring Hill sites. This has provided opportunity for the Department to<br />
be represented on the Principals Group by one of its senior managers and to more directly<br />
support the role of the Project Director. This arrangement has also provided for a more<br />
direct link between the senior management team and the Principals Group.<br />
• At site project management level, the departmental interest has been represented by<br />
appointment of permanent departmental staff as CWA Manager at Otago and Auckland<br />
Women’s.<br />
• While it is outside of the scope of this review to assess the specific project management<br />
methodologies at respective sites, we observe that the project management approaches of<br />
the main CWA partners do employ expected tools for project management of planning,<br />
project risks, costing, progress monitoring, resource management. We also note that<br />
RPDP played a role in developing planning and reporting tools for the programme.<br />
Challenges<br />
• The Steering Group composition did not include personnel with strong large scale project<br />
management experience (mainly line managers) until January 2004 with the appointment<br />
of the independent project consultant to the Group.<br />
• Prior to review in 2005, the role of the Steering Group was not consistently clear to all<br />
members in terms of the Group’s advisory and/or governance responsibilities.<br />
• Prior to review in 2005, there was insufficient formal reporting to the Steering Group to<br />
support key decisions and to signal project risks adequately. Formal reporting tended to<br />
Governance and Project Management 45
e historical in nature, with little (or no) indication of future estimations of costs to<br />
completion.<br />
• Prior to 2005, the Department’s representation on the Principals Group did not include any<br />
of the Department’s senior employees. The challenge for the Department was to maintain<br />
the close link that is needed between the senior management team and the Principals<br />
Group.<br />
• Throughout the progress of the RPDP the risk of not having adequate capacity to meet the<br />
rapidly growing demand for prison accommodation, and the implications of this was a<br />
major imperative and driving factor behind governance and management decisions.<br />
Lessons Learned:<br />
• Ensure that the project goals and objectives are agreed and clearly communicated to all<br />
parties at the commencement of the project, and that they encompass all three key<br />
elements of time, costs and quality, even in cases of ‘fast-tracking’.<br />
• Ensure that the Steering Group has the appropriate mix of knowledge and skills to be able<br />
to represent the Department and the wider Government interests, and govern a large scale<br />
project.<br />
• Ensure that the roles and accountabilities of the respective governance and management<br />
groups and individuals are clearly specified and communicated from the commencement of<br />
project planning.<br />
• Ensure that the Department is represented on the Principals Group by a senior manager in<br />
any future CWA arrangement to complement the commercial skills of any contractors.<br />
• Ensure that there are independent quality assurance processes in place for oversight of<br />
governance and project management approaches (including decision-making and risk<br />
management), as well as for oversight of the lower level project management processes<br />
for cost calculation, and quantitative risk assessment. This will ensure independent<br />
reporting of any governance issues/ risks at various stages, including concerns re<br />
information provision.<br />
• Ensure that the Steering Group is provided with adequate information in a timely fashion to<br />
assess and manage risks, support effective decision-making, and reporting to Ministers.<br />
• Ensure project reporting not only assesses historical progress but also estimates future<br />
issues and progress remaining against all project objectives.<br />
Introduction<br />
6.1 Underpinning the method of construction of the prisons are the overall governance<br />
and project management arrangements for the programme. Effective governance and<br />
project management is required to ensure that goals are achieved, on time, to quality and<br />
to agreed budgets. This section revisits the context for governance and management of<br />
the RPDP programme, and assesses governance and project management arrangements<br />
in this context.<br />
Governance and Project Management 46
Public Sector Project Governance and Management<br />
6.2 In respect of public sector projects, there are specific requirements for<br />
transparency, accountability for decision-making in a broader public sector context, probity<br />
and independence. The interests of the Government, as stakeholder, must be recognised<br />
and managed through appropriate structures, planning, reporting and review processes.<br />
6.3 There is always a challenge when a public sector project is undertaken in a<br />
commercial environment, and when agents are themselves commercially focused.<br />
Project governance and management structures must be organised so as to ensure that<br />
commercial imperatives are balanced by the interests of the public sector agency and the<br />
wider public sector (particularly for projects involving large Government expenditure).<br />
6.4 This means clear definitions of roles and accountabilities, the early use of audit<br />
and review mechanisms, robust risk management, and effective reporting to support risk<br />
management and decision-making. Due attention must be given to project controlling and<br />
monitoring processes throughout.<br />
6.5 Ideal best practice for governance and project management is further outlined in<br />
Appendix C. Clearly the specific context for the RPDP project has meant challenges for<br />
achieving the ideal, and the discussion below recognises the Department’s successes and<br />
assesses issues in meeting these challenges.<br />
Context<br />
6.6 The context for the development of new prison facilities and the establishment of<br />
RPDP to implement the design, construction and commissioning of these facilities has<br />
been outlined in Section 3 of this report.<br />
6.7 The discussion of governance and management arrangements needs to recognise<br />
the specific nature of the environment within which the Department was operating.<br />
• The projected dramatic increase in the prison population according to Ministry of<br />
Justice forecasts, and the inability of existing facilities to cope.<br />
• Clearly substantial new facilities had to be built, and in a timely manner in order to<br />
house the growing prison population.<br />
• The RPDP project, encompassing often simultaneous design, construction and<br />
commissioning of four regional prisons, is a huge project by New Zealand and<br />
international standards ( around $900 million).<br />
• This project size means a significant challenge to manage the pressures on New<br />
Zealand’s construction, design and quantity surveyors capability and capacity.<br />
• The New Zealand Government had little recent experience in construction,<br />
particularly in projects of the scale of the RPDP project.<br />
• Prior to the RPDP project, the Department had managed the growth in prison<br />
population through addition to existing facilities, overseen by the Assets and<br />
Property Division. The most significant construction project overseen by this<br />
division was the successful completion of the Auckland Central Remand Prison<br />
(ACRP) in 2002.<br />
Governance and Project Management 47
Current RPDP Arrangements<br />
RPDP Programme Governance and Project Management Structure<br />
6.8 At a high level, the current governance and management structure for RPDP<br />
consists of:<br />
• a steering group, comprising Matrix Manager (Chief Finance Officer) supported by<br />
a Programme Steering Group. Steering Group members are senior line managers<br />
from the Department (GM Public Prison Service, GM Probation and Offender<br />
<strong>Services</strong>, GM Corporate Management, GM Strategic <strong>Services</strong>) and an<br />
independent external expert with large-scale construction project management<br />
experience. A Treasury Vote Manager attends the Steering Group as an observer.<br />
The governance group also has a Construction Sub Committee reporting to the<br />
steering committee. This committee comprises the Chief Financial Officer,<br />
independent Steering Group consultant, Construction Project Director,<br />
Department’s Manager Construction Management, and the Department’s National<br />
Property Manager. Internal Audit also attend sub-committee meetings.<br />
• a management team, comprising Construction Project Director, <strong>Commission</strong>ing<br />
Manager, and Programme Manager.<br />
6.9 According to the RPDP terms of reference, the Steering Group has key<br />
responsibilities including:<br />
• provision of advice and support to the Matrix Manager and the RPDP Management<br />
Team;<br />
• overall decision-making, including approval of scope, budgets, plans and delivery<br />
mechanisms;<br />
• monitoring of programme progress issues and risks;<br />
• ensuring integration with wider organisational activities; and<br />
• ensuring appropriate expertise and business as usual resources are available to<br />
the project.<br />
6.10 The Management Team has responsibilities including:<br />
• planning and management of day-to-day activity within their respective projects;<br />
• ensuring that their respective areas of responsibility produce agreed deliverables<br />
within approved timeframes, budget and specification; and<br />
• accountability for the management of risks and issues within their respective<br />
function and ensuring programme-wide risks and issues are managed in an<br />
integrated way.<br />
6.11 This programme structure, together with detailed statements of roles and<br />
responsibilities across key groups and management positions, is clearly documented in a<br />
detailed RPDP Charter and Terms of Reference. The Charter also contains key<br />
processes for financial and risk management.<br />
Governance and Project Management 48
6.12 It is noted that these arrangements also ensure Departmental representation on<br />
each of the Principals Groups at Spring Hill and Otago (through a senior management<br />
representative). This provides opportunity for Departmental staff to support the<br />
Construction Project Director in representing the Department’s interests at senior<br />
construction management level.<br />
6.13 This structure is illustrated below:<br />
Independent Advice<br />
6.14 There are a number of mechanisms for the RPDP programme to receive<br />
independent advice.<br />
• Review of project management processes for cost and margin development<br />
(Sherwin, Chan and Walshe, Rider Hunt).<br />
• Review of CWA methodology application (CMS).<br />
• Review of governance and management arrangements (Internal Audit unit, Audit<br />
New Zealand).<br />
• Reviews of TOC development (across a range of areas).<br />
Governance and Project Management 49
6.15 The CWA methodology as discussed earlier is one which requires the overhead of<br />
checks and balances to prompt for probity and project efficiencies. Overall, there now<br />
does appear to be adequate checking on the project at both governance and project<br />
management levels.<br />
Development of Governance and Management of RPDP<br />
Current Roles and Structures<br />
6.16 The course of the RPDP programme has seen a number of developments to<br />
strengthen and improve governance and management arrangements as the programme<br />
has progressed.<br />
6.17 Current arrangements have been in place since late 2005 . These arrangements<br />
were developed following a review of project risks (specific to Northland) commissioned<br />
by the Department’s Internal Audit Unit in late 2004. The present structure addresses a<br />
number of issues raised by Audit New Zealand, and which are reflected in the research for<br />
the current review, namely that prior to late 2005, there was:<br />
• inconsistent understandings amongst Steering Group members as to their role: as<br />
an advisory group (representing their area of the Department) and/ or as a<br />
governance group (with decision-making responsibilities);<br />
• insufficient formal reporting to the Steering Group;<br />
• the requirement of the Steering Group to make decisions under considerable time<br />
pressure (the CWA fast track approach means that often significant decisions are<br />
required to be made/ accepted with some urgency to enable ongoing project<br />
progress);<br />
• provision of documentation for supporting decisions ‘after the fact’;<br />
• the Steering Group often made decisions based on verbal updates from the<br />
Project Director;<br />
• Steering Group questions regarding risks and issues would sometimes be<br />
answered specifically, and elsewhere responded to with broad assurances; and<br />
• the scope of responsibility of the Project Director was extremely broad, and there<br />
was a sense that commissioning activities might suffer at the expense of<br />
construction activities.<br />
6.18 Current arrangements are generally considered to address all of these issues.<br />
Roles and responsibilities are clearly documented, the Programme Office is managing<br />
reporting effectively, and the establishment of separate workstreams for construction,<br />
commissioning and programme management has improved focus.<br />
6.19 We note that the Department initiated these improvements in the RPDP<br />
governance prior to becoming aware of the cost escalation at Spring Hill and Otago.<br />
8<br />
8<br />
Internal Memorandum from Matrix Manager 19 September 2005, TOR Papers SG Meeting<br />
19 December 2005. Arrangements were based on a review commissioned from Deloitte during<br />
2005.<br />
Governance and Project Management 50
Previous Arrangements<br />
6.20 While the Department’s Assets and Property Division continues to manage the<br />
additions to existing facilities, lessons learned from successful completion of ACRP and<br />
the significant size of the proposed new facilities construction motivated decisions to<br />
establish a different project management structure for the proposed new construction, and<br />
RPDP was established. Accordingly, the Department appointed a Project Director with<br />
large-scale construction project experience under the oversight of a Department<br />
governance group.<br />
6.21 Originally, the governance group comprised the Chief Finance Officer, and a<br />
Steering Group of Departmental senior managers. As the project progressed, decisions<br />
were made to complement the experience of the Steering Group with additional expertise<br />
(particularly in the construction area):<br />
• In mid-2001, a construction engineer was appointed advisor on materials<br />
production options and other building matters (for a 12 month period);<br />
• In January 2004, an independent consulting structural/civil engineer with wide<br />
experience in the building industry was appointed to the Steering Group; and<br />
• In 2004, a Treasury Vote Manager joined the Steering Group in an observer<br />
capacity.<br />
6.22 The Project Director reported directly to the Chief Financial Officer, and to the<br />
Steering Group. Initially, the Project Director had a wide responsibility for oversight over<br />
design, cont ract management, construction, procurement, commissioning (operational<br />
set-up) and security for all prisons projects.<br />
Issues and Challenges<br />
6.23 The governance and management of the RPDP programme has faced a number<br />
of issues and challenges, some of which have been recognised by the Department and<br />
addressed through review, structural and process change and the acquisition of additional<br />
capability (see above). The following sections discuss governance and management<br />
challenges faced over the course of the programme.<br />
Steering Group Decision-Making and Representation<br />
6.24 Steering Group members are senior managers with significant line responsibilities<br />
within the Department. The RPDP project was an additional responsibility to manage.<br />
One role for the CFO was to manage the Project Director and this on top of an already<br />
heavy workload.<br />
6.25 This situation and the specific functional and line management experience of the<br />
group members may explain the reported differences of understanding of the role of the<br />
Steering Group for the project at its inception (in review discussions). The role of the<br />
Steering Group was seen by many (including some Steering Group members) as an<br />
advisory one to the project, particularly regarding project impacts and interests for the<br />
respective functional areas of the Department, with a deferral to the Chair for project<br />
decision-making (often in consultation with the Project Director). Others (also including<br />
some Steering Group members) saw the role as more actively contributing to RPDP<br />
decisions.<br />
Governance and Project Management 51
6.26 The role of the Treasury Vote Manager (from 2004) was that of an observer,<br />
recognising Treasury’s role in monitoring government spending.<br />
6.27 The Chair/ CFO holds overall financial delegations for the programme, within<br />
limits set by the Department’s delegations.<br />
6.28 We note that the documented RPDP Terms of Reference from September 2005<br />
clearly states the roles and responsibilities of Steering Group members, as a mix of<br />
advisory and decision-making. Our discussions with Steering Group members indicate<br />
there is still some lack of common understanding amongst Steering Group members as to<br />
their role (e.g. advisory vs governance).<br />
6.29 Prior to 2005 changes, the Steering Group also appeared somewhat constrained<br />
in its ability to contribute effectively to decision-making through a lack of sufficient and<br />
timely information for decisions. Review of Steering Group minutes and discussions with<br />
department personnel indicates numerous requests for additional information, which was<br />
often not forthcoming.<br />
6.30 The Department’s Internal Audit Unit also raised concerns around the need for<br />
improved transparency of information to the Steering Group and better reporting to<br />
enhance its decision-making role. In particular, Internal Audit identified some risks posed<br />
by the newness of the CWA methodology, and the desirability of more documentation to<br />
support its adoption.<br />
6.31 There was a Treasury Vote Manager as observer at Steering Group from early<br />
2004. Treasury have commented on the lack of depth and timeliness of information<br />
provided to support decisions. Repeated queries for information were not always<br />
satisfied. Treasury did commission an independent report on the CWA revised<br />
procurement strategy in February/ March 2004, which provided some assurances on the<br />
CWA structure adopted (at a high level), but which also commented on the lack of detailed<br />
documented rationale for this methodology (Opus 18 March 2004).<br />
6.32 We note that these issues of information and reporting are now resolved or being<br />
managed through the revised governance and management structures for the RPDP<br />
programme.<br />
6.33 The challenge is to ensure that recommendations are understood, implemented<br />
and monitored. At the governance level, the PMO has a significant contribution to make<br />
in ensuring project integration, and that the roles of the Steering Group and advisors are<br />
discharged as envisaged.<br />
Project <strong>Report</strong>ing<br />
6.34 Project reporting at site level was conducted using the systems of the various main<br />
CWA partners. The Department required reporting across all projects to enable the<br />
project management team to gauge project progress overall. Accordingly, the project<br />
construction management team developed standardised project planning and reporting<br />
tools. The system used by the Department did have some initial issues of integration with<br />
site specific systems. This integration issue led to some early delays in aggregated<br />
reporting on progress to the Project Director and to the Steering Group. These issues<br />
have since been overcome.<br />
6.35 For future projects, the question of integration of reporting systems across multiple<br />
projects should continue to be addressed in the tender assessment stage, to ensure that<br />
overall project reporting is able to be implemented from early on in the project.<br />
the<br />
Governance and Project Management 52
Department ‘Client’ Representation<br />
6.36 Ensuring Departmental and Government interests are adequately represented at<br />
key programme levels has not been without challenge in a programme of this size and<br />
complexity.<br />
6.37 Below the Steering Group, prior to 2005, the three key project management roles<br />
of Project Director, Manager Administration and Contracting and the CWA Advisor were<br />
all filled by contractors. This is not surprising, given the lack of large scale construction<br />
project management expertise in the New Zealand public sector. Of these roles, the<br />
Project Director position had added significance due to the added responsibility of<br />
representing the Department on the Principals Group.<br />
6.38 We consider that representation on the Principals Group needs to include a senior<br />
department manager reflecting:<br />
• the senior level of representation on the principals Group (the commercial partners<br />
are represented by their CEOs);<br />
• the need for close links between the Principals Group and the Department’s senior<br />
management team; and<br />
• the need to ensure a public policy perspective complements the commercial<br />
expertise that is required for this role.<br />
6.39 For these reasons, we support the addition of one of the Department’s senior<br />
managers to each of the Principals Group in late-2005. 9 Notwithstanding, these<br />
individu als would still have a challenging job in “wearing two hats”, that of the CWA<br />
Principal and that of the Department (taking into account responsibilities to the wider<br />
public ).<br />
Effects of Project Fast Tracking<br />
6.40 The fast track nature of the prisons projects, particularly when the size of the<br />
projected prison muster was known, meant that there was often considerable pressure to<br />
make quick decisions at Steering Group level, again based on little information or on<br />
verbal representations from the Project Director. This often resulted in situations of so-<br />
to satisfy reporting<br />
called ‘no choice’ decisions presented to the Steering Group. Either the decision had<br />
already been taken, and the expectation was for Steering Group to endorse it, or there<br />
was insufficient time or information to allow appropriate assessment before decisionmaking.<br />
Documentation to support decisions would sometimes be provided after the fact,<br />
requirements.<br />
6.41 This was the situation regarding the decision to adopt the CWA methodology,<br />
where the idea was presented verbally, and followed up with some supporting<br />
documentation. By the time the documentation arrived, pressures of time and resource<br />
meant that the decision was considered inevitable.<br />
6.42 Another effect of fast tracking was the collapsing of project phases and processes.<br />
For example, in the case of the development of Otago, eight months was gained when<br />
9<br />
Audit).<br />
On the recommendation of Audit New Zealand (commissioned by Departmental Internal<br />
Governance and Project Management 53
planning progressed through the Environment Court faster than expected. The decision<br />
was taken to proceed with project implementation, even though the design team had not<br />
yet completed detailed design and was under considerable time pressure. This decision<br />
would have had implications for early development of the TOC estimates on the project,<br />
as completed design is a requirement for this.<br />
6.43 The decision to adopt a fast tracking approach was driven largely by the<br />
Department’s need to manage the significant risk that, according to projections, there<br />
would be lack of capacity to meet prisoner demand. In the absence of information to<br />
signal any significant cost issues until mid/late-2005, the Steering Group did focus on<br />
project time frames as a priority.<br />
Summary<br />
6.44 This review has identified a number of challenges in respect of governance and<br />
management of the RPDP project, and has recognised areas of good practice and<br />
positive contribution from the project.<br />
Positive Contributions<br />
6.45 There are a number of positives that should be recognised.<br />
• New Zealand will have four regional prison projects completed on time and to meet<br />
the growth in the prison population.<br />
• The Steering Group comprised senior management in the Department and this<br />
group recognised gaps in knowledge and expertise that needed to be filled,<br />
namely: experienced Project Director, Audit and Independent Review processes,<br />
acquisition of external large scale project management expertise, and Treasury<br />
representation.<br />
• Changes to project governance and management structures from late-2005 have<br />
greatly increased the quality of review, reporting and decision-making on the<br />
projects. This includes the establishment of a Programme Management Office<br />
(PMO) in February 2006 to assist with the project and risk management<br />
dimensions at governance and project management levels.<br />
• Formation of the Construction Sub-committee, comprising appropriate expertise<br />
and with responsibility for decision-making advice to the wider group on complex<br />
technical matters.<br />
• These arrangements and changes have made significant improvements to the<br />
quality of reporting, decision-making and potential for risk management. We note<br />
that the PMO has potential to significantly assist the programme governance, but<br />
that this is still early days for this role.<br />
• Mid-2005, a senior Department manager was appointed to each of the CWA<br />
Principals Groups at Otago and Spring Hill sites. This complemented the<br />
commercial skills of the Project Director and provides a more direct link between<br />
the Principals Group and the Department’s senior management team.<br />
• At site project management level, the departmental interest has been represented<br />
by appointment of permanent departmental staff as CWA Manager at Otago and<br />
Auckland Women’s.<br />
Governance and Project Management 54
• While it is outside of the scope of this review to assess the specific project<br />
Challenges<br />
management methodologies at respective sites, we observe that the project<br />
management approaches of the main CWA partners do employ expected tools for<br />
project management of planning, project risks, costing, progress monitoring,<br />
resource management. We note that RPDP played a role in developing planning<br />
and reporting tools for the programme.<br />
6.46 While the RPDP project is delivering regional prisons for New Zealand, this review<br />
has identified a number of challenges for governance and management of the project at<br />
varying times in the development of the overall RPDP programme.<br />
• The Steering Group composition did not include personnel with strong large scale<br />
project management experience (mainly line managers) until 2003 with the<br />
appointment of the independent project consultant to the Group.<br />
• Prior to the review in 2005, the role of the Steering Group was not consistently<br />
clear to all members in terms of its advisory and/or governance responsibilities.<br />
• There was little or no expertise amongst Steering Group members and Treasury<br />
as observer in respect of the CWA methodology, and therefore to provide a first-<br />
and<br />
hand appreciation of critical elements of the methodology to be managed,<br />
risks.<br />
•<br />
Prior to the review in 2005, there was insufficient formal reporting to Steering<br />
Group to support key decisions and to signal project risks adequately. <strong>Report</strong>ing<br />
tended to be historical in nature, with little indication of future estimations of costs<br />
to completion (against budget).<br />
• Prior to 2005, the Department did not have senior management representation on<br />
the Principals Group. This had the potential to weaken the linkage between the<br />
Group and the Department’s senior management team. Until mid 2005, the<br />
Department’s interests were represented directly at site CWA Manager level only.<br />
• Throughout the progress of the RPDP the risk of not having adequate capacity to<br />
meet the rapidly growing demand for prison accommodation, and the implications<br />
of this, was a major imperative and driving factor behind governance and<br />
management decisions.<br />
Lessons Learned<br />
6.47 The experience of the RPDP project development provides a number of lessons to<br />
be learned from a governance and management perspective.<br />
• Ensure that the project goals and objectives are agreed and clearly communicated<br />
to all parties at the commencement of the project, and that they encompass all<br />
three key elements of time, cost and quality – even in cases of ‘fast-tracking’.<br />
• Ensure that the roles and accountabilities of the respective governance and<br />
management groups and individuals are clearly specified and communicated from<br />
the commencement of project planning.<br />
Governance and Project Management 55
• Ensure that the Steering Group has the appropriate mix of knowledge and skills to<br />
be able to represent the Department and the wider Government interests, and<br />
govern a large scale project.<br />
• Ensure that there are regular independent quality assurance processes in place for<br />
oversight of governance and project management approaches (including decisionmaking<br />
and risk management), as well as for oversight of the lower level project<br />
management processes for cost calculation, and quantitative risk assessment.<br />
This will ensure independent reporting of any governance issues/ risks at various<br />
stages, including concerns re information provision.<br />
• Ensure that the Steering Group is provided with adequate information in a timely<br />
fashion to assess and manage risks, and support effective decision-making, and<br />
reporting to Ministers.<br />
•<br />
Ensure project reporting not only assesses historical progress but also estimates<br />
future issues and progress remaining against all project objectives.<br />
Governance and Project Management 56
7 <strong>Report</strong>ing to Ministers<br />
Key Findings<br />
• A key advantage of the CWA methodology is that it promotes very high levels of disclosure<br />
around project costs and risks as projects progress. Through its membership of the CWA,<br />
the Crown can directly benefit from this transparency.<br />
• The Department holds regular (at least weekly) meetings with its Minister. Progress with<br />
the RPDP was typically discussed at these meetings. However, we understand that<br />
discussions tended to focus on progress with the projects rather than costs and associated<br />
risks.<br />
• The information provided to Ministers as part of Budget 04 and 05 did not provide<br />
adequate indication of the uncertainties and risks surrounding the cost estimates at that<br />
time.<br />
• Initial indications of a substantial cost increase were first signalled to the Minister of<br />
Corrections in August 2005 at which point work on the TOCs was well underway. Further<br />
and higher revised estimates were reported to Treasury (and, by implication, the Minister of<br />
Finance) in October 2005 and to Cabinet in December 2005. The risk of cost increases<br />
was not incorporated into the pre-election economic and fiscal update (published on 18<br />
August 2005 and including data up to 8 August 2005).<br />
Lesson Learned<br />
• The regular discussions with the Minister should include clearer reference to cost<br />
developments and associated risk estimates as work on the TOC proceeds.<br />
• Where cost estimates are uncertain (as was the case with these projects), this needs to be<br />
clearly explained to Ministers. For the purposes of providing advice to Ministers, it would<br />
be appropriate to indicate a range of possible cost estimates and, moreover, indicate the<br />
level of uncertainty attaching to the estimates. Such estimates should be clearly<br />
distinguished from formal Budget processes and funding decisions (where point estimates<br />
specified to the nearest $1000 are required).<br />
• There was scope to indicate, in at least a qualitative sense, the prospect of significant fiscal<br />
risk as part of the pre-election economic and fiscal update.<br />
• On projects of this scale, reporting should be linked to significant project milestones rather<br />
than to the Budget cycle. For example, cost estimates developed for Budget 05 preceded<br />
the start of construction on Spring Hill and Otago. A report to Ministers at, or about, the<br />
start of construction would be better practice.<br />
7.1 Cabinet directed that officials should report back on estimated costs associated<br />
with the projects as part of Budget 04 and 05. This was done. However, the information<br />
provided to Ministers did not provide adequate indication of the uncertainties and risks<br />
surrounding the estimates. Ministers could reasonably have interpreted the Budget 05<br />
cost estimates (and earlier estimates) as being firm estimates with relatively narrow<br />
margins of error when in fact the estimates, at that time, still had significant uncertainty.<br />
7.2 Based on interviews with Department and other personnel, the cost implications<br />
stemming from the TOC development were becoming apparent in August 2005. In light<br />
of this, the fiscal situation was progressively reported to Ministers as follows:<br />
• to the Minister of Corrections via Briefing on 2006 Budget Process and Five Year<br />
Planning Projections (19 August 2005). Indicative capital costs of $21m signalled<br />
<strong>Report</strong>ing to Ministers 57
in a table attached to the Briefing. We note that it is not immediately apparent<br />
from the table as to exactly what is the composition of, or basis for, the $21m;<br />
• to the Minister of Corrections via Briefing on 2006 Budget Process and Five Year<br />
Planning Projections (27 October 2005). This briefing signals in the text that<br />
increased capital approval will be required for Spring Hill and Otago. This is<br />
quantified as $130m in an attached table. Again, it is not clearly apparent from the<br />
table exactly as what is the make up of the $130m. The text of this table contains<br />
a conflicting reference to $80m additional capital approval (which we understand to<br />
be an error);<br />
• via Steering Group minutes of 27 September 2005, (advised by Construction<br />
Project Director that Spring Hill TOC estimated to be $50m above current budget);<br />
• via Steering Group minutes of 25 October 2005 (advised by Construction Project<br />
Director that Otago TOC estimated to be $30m above funding)<br />
• via Steering Group minutes of 29 November 2005 (advised by Construction<br />
Project Director that Spring Hill and Otago TOC estimated to be $140m above<br />
funding)<br />
• to the Treasury on 4 October 2005; and<br />
• to Cabinet on 15 December 2005 (although drafts of this paper were circulating<br />
among officials during November).<br />
7.3 Moreover, elements of the TOC had been completed prior to August 2005 and,<br />
therefore, provided some initial, but incomplete, insights to the potential cost increases.<br />
7.4 We note that quantification of the financial impacts were not clearly evident in<br />
RPDP Programme <strong>Report</strong>s to the Steering Group until December 2005 (although financial<br />
risk was foreshadowed to the Steering Group over several of the preceding months as<br />
evidenced in minutes). Meeting minutes do not record discussion on the verbal updates<br />
of financial impacts that are recorded. Such discussion may have been recorded if<br />
financial impacts had been clearly signalled in Programme <strong>Report</strong>s provided in advance to<br />
the Steering Group.<br />
7.5 Given the heated nature of the construction market in 2004 and 2005, it should<br />
have been clear that the increase in costs due to escalation was expected to be<br />
substantial. Given this, we consider that the reports to Ministers could have been more<br />
forthcoming in terms of foreshadowing the magnitude of expected cost increase.<br />
7.6 <strong>Report</strong>ing on financial impact tended to be verbal updates to Steering Group (as<br />
minuted) or through attached tables to reports to the Minister (and not immediately<br />
transparent). There is a judgement involved on the timing of reporting. The reasons for<br />
reporting as early as possible include:<br />
• it maximises opportunity to review the project and assess options for reducing cost<br />
if budgets are under strain;<br />
• it provides the Government with as much opportunity as possible to adjust its fiscal<br />
priorities; and<br />
<strong>Report</strong>ing to Ministers 58
• it is a core expectation that public servants strive to operate on a “no surprises”<br />
basis with Ministers.<br />
7.7 The reason for deferring the reporting of the TOC is essentially a function of the<br />
required level of certainty. Earlier estimates of the TOC could have been communicated,<br />
but they would have had wider “error margins”. Estimates that involve a wide range of<br />
possible costs are not necessarily helpful from a fiscal management perspective although,<br />
that said, there is a more general point regarding the communication of risks attaching to<br />
numbers that are reported to Ministers.<br />
7.8 We note that on 18 August 2005, the Pre-election Economic and Fiscal Update<br />
(PREFU) was published and that included data up to 8 August 2005. We understand that<br />
the fiscal information relating to Spring Hill and Otago included in PREFU was based on<br />
the April 2005 cost estimates. The PREFU is a significant document. Given the size of<br />
the fiscal risks surrounding Spring Hill and Otago, we consider that the fiscal information<br />
incorporated into PREFU should have included more up-to-date Spring Hill and Otago<br />
data, although we understand that because the risk was not under active consideration by<br />
Ministers at that stage, strictly speaking there was not a technical requirement to include<br />
up-dated data. Notwithstanding this, the fiscal risks should have been under active<br />
consideration. In particular, the progress that had been made with the TOCs for both<br />
projects should have been taken into account and signalled as part of PREFU at least in a<br />
qualitative sense.<br />
<strong>Report</strong>ing to Ministers 59
Appendix A: Funding Approvals<br />
The table below summarises the dates at which funding approvals for Spring Hill and<br />
Otago were provided as well as the dates at which Ministers received advice regarding<br />
the estimated costs for the projects.<br />
Date<br />
New Funding<br />
Approved<br />
Spring Hill<br />
Estimated Total<br />
Cost<br />
New Funding<br />
Approved<br />
Otago<br />
Estimated Total<br />
Cost<br />
15 May 2000 $1.5m $114.245m* $3.4m $79m**<br />
23 April 2001 $15.16m $194.4m* - -<br />
1 October 2001 - $172.826m* $7.8m Not indicated<br />
28 January 2003 - $232.455m - $133.611m<br />
17 November 2003 - $248.127m - $162.191m<br />
15 December 2003 $7.5m No further update<br />
given<br />
- -<br />
26 April 2004 $42.815m $248.127m $144.591m $160.991m<br />
15 September 2004 $3.636m $248.127m - -<br />
11 April 2005 $211.968m $282.579m $19.022m $174.813m<br />
19 December 2005 $97.731m $380.310m $43.110m $217.923m<br />
* These estimates assumed a 350 bed capacity. Later estimates relate to a 650 bed facility<br />
** This estimate assumed a 220 bed facility. Later estimates relate to a 335 bed facility.<br />
Several points can be noted from the table above.<br />
• The estimates of total cost were presented as point-estimates rather than ranges.<br />
This is unhelpful as it could be interpreted as implying a level of precision and<br />
certainty which was not warranted (and not intended). It is only the latest of the<br />
estimates where there is a relatively high degree of certainty.<br />
• <strong>Report</strong>ing has been linked closely to the Budget cycle (Budget 04 and Budget 05<br />
in particular). We consider that reporting should more closely track the<br />
construction timelines for the projects (notwithstanding the need to link funding<br />
decisions in with Budget processes and timetables). The frequency of reporting<br />
given the size of, and fiscal risks around, the projects should be increased once<br />
project construction is underway (this could be as frequent as quarterly). <strong>Report</strong>ing<br />
could, in the first instance be to the Ministers of Finance and Corrections and then<br />
to Cabinet as required.<br />
• The estimated costs reported to the Cabinet Business Committee on 28 January<br />
2003 were included in a paper prepared by the Treasury and the <strong>State</strong> <strong>Services</strong><br />
<strong>Commission</strong>. The report did not provide any details as to the basis upon which the<br />
estimates had been prepared.<br />
: Funding Approvals 60
• The report prepared by the Department and considered by Cabinet on 17<br />
November 2003 provided further up-dating of the estimated costs for Spring Hill<br />
and Otago. This report provided little explanation regarding the basis for the cost<br />
estimates or how they link to earlier estimates. At that stage, however, Cabinet<br />
had not approved funding for the construction of Spring Hill and Otago. Fuller<br />
discussion of the cost estimates was held over, with the agreement of Cabinet,<br />
until Budget 04 (i.e. April 2004). Notwithstanding this, given that the numbers<br />
presented in early and late 2003 were substantially in excess of those previously<br />
reported, we would have expected there to be some discussion of the basis upon<br />
which the estimates were made. Further, although the report indicated fiscal risks<br />
stemming from the effects of escalation, the relative size of the risk was not<br />
articulated, even in general terms.<br />
In the case of Spring Hill, funding approvals were given on 15 December 2003, 26 April<br />
2004 and 15 September 2004. Each of the papers supporting the approvals included cost<br />
estimates expressed in 2003 dollars. Ministers were advised that escalation would push<br />
up the cost estimates and that additional funding in light of this would be sought as part of<br />
Budget 05. The heated nature of the construction market was increasingly evident over<br />
the period from December 2003 to September 2004. Accordingly, by September 2004, it<br />
should have been clear that the increase in costs due to escalation was expected to be<br />
substantial. Given this, we consider that the reports to Ministers could have been more<br />
forthcoming in terms of foreshadowing the magnitude of expected cost increase.<br />
: Funding Approvals 61
Appendix B: CWA Best Practices<br />
Objectives and Behaviours<br />
Clarity of objectives and shared understanding of those objectives is core to the success<br />
of any alliancing arrangement. Being able to describe and communicate objectives are<br />
not, of themselves, sufficient however. Actions need to be aligned with objectives and<br />
supported by behaviours that reflect and support the ethos of the alliance. Good CWA<br />
practice in this regard involves the following:<br />
• equity – sharing or rewards and penalties commensurate with performance but<br />
based around the goal of win/win rather than win/lose;<br />
• actions taken are best for project. This is required at many levels – for example,<br />
the PEG comprises personnel selected on the basis of best for project – not on the<br />
basis of which organisation employs them;<br />
• high levels of integration in terms of project management, governance, reporting,<br />
systems etc;<br />
• open and honest communication;<br />
• culture of no blame;<br />
• collective responsibility and accountability for project outcomes;<br />
• trust integrity and respect;<br />
• innovation; and<br />
• mutual support.<br />
CWA Partner Selection<br />
Irrespective of the form of procurement method used, getting the best mix of contractors<br />
and others is critical to project success. The process for selecting contractors and others<br />
is not part of the brief for this review (these matters have been reviewed by Audit <strong>NZ</strong>).<br />
Notwithstanding this, it is worth noting some of the similarities and differences between<br />
traditional procurement and procurement using CWA.<br />
Both forms of procurement for major projects tend to involve multi-stage selection<br />
processes involving Expression of Interest, Request for <strong>Proposal</strong>, shortlisting and then<br />
intensive negotiation with one or a small number of preferred bidders. Traditional<br />
procurement usually has price as a major, if not predominant, selection criterion. CWA, in<br />
contrast, may or may not have price as a criterion (but price does not have to be<br />
excluded).<br />
A further difference between procurement methods is that traditional procurement typically<br />
involves tendering several discrete contacts (for design, for construction, for civil works<br />
and so on) where as under alliancing, the objective is to build a team and the selection<br />
process needs to reflect this. Under CWA the selection process would normally involve<br />
workshops with shortlisted candidates. One of the objectives of the workshops is to build<br />
62
elationships and, as part of this, establish the ability of the parties to work collaboratively<br />
with one another in the spirit of alliancing.<br />
Leadership Structure<br />
Alliance projects have a single integrated project team. At the head of the alliance is the<br />
Principals Group. This group comprises the heads (typically CEOs) of the parties involved<br />
in the alliance. In a general sense, the roles of the Principals Group are to:<br />
• create the alliance vision, principles and objectives;<br />
• set policy and delegations;<br />
• appoint members of the PEG and empower it to perform the obligations under the<br />
CWA Agreement;<br />
• promote principles and objectives throughout the alliance team;<br />
• resolve issues that arise within the alliance; and<br />
• agree the TOC<br />
The Department is represented on the Principals Group. The Principals Group operates<br />
on the basis of collective responsibility and unanimous decision making. This creates<br />
some issues that are discussed in section six below because the Departmental<br />
representatives on the Principals Group have an obligation to the CWA as well as, of<br />
course, an accountability to the Department as client. This creates some complex<br />
dynamics that need to be carefully managed.<br />
Beneath the Principals Group is the alliance management team or, as it is referred to in<br />
the RPDP context, the PEG. PEG members are appointed on the basis of best for<br />
project. This means that in theory, a constructor could, for example, fill the position of<br />
design manager and vice versa. The roles of the PEG include:<br />
• delivering the project objectives;<br />
• day-to-day management;<br />
• providing leadership to the wider project teams;<br />
• appointing members of the wider project teams on a best for project basis; and<br />
• resolving issues.<br />
Beneath the PEG lie the various project teams.<br />
The structure and roles of the Principals Group and PEG are quite different to the<br />
structures and accountabilities that normally exist under a <strong>NZ</strong>S 3910 form of contract. For<br />
example, in traditional projects, a client engineer overviews and checks the designer’s<br />
engineers and there are cost controllers and schedulers in each organisation. In contrast,<br />
under a CWA, there is one team, one schedule, one cost control team and one design<br />
team. In theory, the benefits of having one integrated team is the cost saving from not<br />
having duplication of roles and what is referred to as man-to-man marking.<br />
63
CWA Agreement<br />
The CWA Agreement is a key reference point. Effective agreements are characterised as<br />
having:<br />
• project delivery and performance objectives that are collective;<br />
• unanimous decision making (which forces the parties to find alternative solutions if<br />
there is not universal agreement);<br />
• no fault, no blame and no dispute. There are no dispute resolution clauses. It is<br />
the role of the Principals Group to sort out issues;<br />
• commercial arrangements (TOC, QRA and gain/pain share) that support the<br />
alliance principles and create the right incentives for win/win outcomes; and<br />
• transparency and an audited open book approach (which is critical in terms of<br />
determining the commercial aspects referred to in the point above).<br />
Commercial Framework<br />
A fundamental design principle of the commercial framework within an alliance is equity in<br />
the sense that if one party gains, the others gain as well and, equally, if one party loses,<br />
the loss is shared with all. This principle translates into alliance agreements by<br />
incorporating the following features:<br />
• the commercial participants entitlement to payment is limited to their agreed direct<br />
costs, margins, overheads and gain/pain share;<br />
• the commercial participants will earn at least their direct costs (but may not earn<br />
any, or all, of their margins and overheads if performance falls short of that<br />
required). In general, the painshare for commercial participants is capped at 100%<br />
of the sum of margins and overheads;<br />
• any cost overrun is shared across the CWA members on the basis of pre-agreed<br />
formula;<br />
• the gain share arrangements provide for reward for superlative performance (in<br />
financial and/or non-financial terms). The performance measures which seek to<br />
define standards of performance are agreed by the CWA partners; and<br />
• there is a pre-agreed process for the determination and timing of gain/pain share<br />
payments.<br />
The commercial framework under CWA is quite different to that for a traditional contract.<br />
From the client’s perspective, a traditional (tendered) contract involves a pre-agreed price.<br />
The basis upon which price is determined is, at best, of only secondary interest. In<br />
contrast, under CWA the focus is on the transparency of costs and risks. CWA members<br />
assume collective ownership for costs and risks with an equitable sharing of the gain or<br />
pain depending on how actual outcomes compare with pre-agreed benchmarks.<br />
7.9 Once a TOC has been agreed, the gain/pain share arrangements take on special<br />
significance. Some of the design features that would expect to be observed in gain/pain<br />
share arrangements include:<br />
64
• the gain and pain is linked to real risks and benefits that affect the value of the<br />
project from the client’s perspective;<br />
• gainshare is only paid if performance exceeds expectations;<br />
• gain and pain share arrangements promote win/win rather than win/lose outcomes.<br />
In other words, one CWA partner cannot gain at the expense of another;<br />
• the client is committed to paying 100% of the potential gain share if the relevant<br />
thresholds are achieved;<br />
• if gain and pain share arrangements are conditional on a mix of performance<br />
measures and objectives, then they should structured in a way that avoids<br />
achieving one objective at the expense of another; and<br />
• there is complete transparency over gain and pain share arrangements.<br />
65
Appendix C: Overview of Governance and Project<br />
Management<br />
The governance role is one which complements that of management, and of ensuring that<br />
good management practice is observed. The governance role is one which enables a<br />
group to focus on the larger picture – in this case the broader requirements of the<br />
Department, and of the Government as a whole – and to take a more future looking view<br />
of a programme of activity. In this way an effective governance group is prompted to<br />
ensure the goals of the programme are clear and maintained, to ask the ‘hard questions’,<br />
to require justification for management actions and to ensure key decisions are made on<br />
adequate information.<br />
In the public sector context the governance role is required to ensure that projects are in<br />
alignment with Government goals, risks are identified and managed appropriately, that<br />
processes and decisions are transparent, and that the proper requirements of probity and<br />
independence are observed.<br />
Risk Management<br />
Risk management is fundamental to effective governance, decision-making and<br />
monitoring. Risk management can and should occur at the various levels of governance<br />
and project management. Effective risk management means the continuous identification,<br />
evaluation and management of risk.<br />
Effective risk management at the governance level requires two key elements: adequate<br />
information reported on progress and plans, and the competency of the governance group<br />
to assess the meaning of events, the implications of decisions and risks, and the<br />
significance of lack of progress on key milestones.<br />
Accountabilities and Competencies<br />
An effective governance group will contain the range of competencies required to ensure<br />
effective governance and management of the project involved. In the case of RPDP<br />
competencies required would include understanding of the ‘business’ of Corrections and<br />
of prisons, sound understandings of large-scale construction project management,<br />
understandings of risk management and cost management, a strategic perspective<br />
regarding fiscal implications of projected project costs for wider government decisionmaking,<br />
and a clear understanding of the governance and leadership role of the<br />
governance group.<br />
At different times in the development of the project or its external environment the<br />
emphasis on different strengths required may change. Effective governance bodies will<br />
recognise this and adapt, through changing or reconfiguring their membership and<br />
competency mix.<br />
Accountability involves the governance group demonstrating to stakeholders that the<br />
project is being governed and efficiently managed, is sustainable operationally, risks are<br />
managed and that project integrity and probity are ensured. A key role is to ensure that<br />
sound independent audit processes exist to raise issues for assessment and confirm good<br />
practice is being adhered to.<br />
66
Decision-making<br />
Effective decision-making requires the governance group to be as knowledgeable and<br />
fully informed as possible about the projects and what they are intended to achieve, and<br />
the key issues and risks that they face. In a typical governance decision-making situation<br />
decision-makers ‘must balance risk with opportunity, compliance being a given, but in the<br />
context of moving forward’ 10<br />
To enable this, decisions brought to the governance group should be supported by an<br />
appropriate amount of detailed background work, analysis and evaluation.<br />
In addition to background material, the governance group must receive enough material to<br />
enable it ‘to distinguish between fact and opinion’ 11 Many proposals will, by nature,<br />
contain both facts and opinions. The facts enable the governance group to assess the<br />
risks they are taking, possible opportunities and to make a sound judgement. With<br />
opinion, the assessment of risk and opportunity is not as clear and usually needs careful<br />
examination, discussion and consideration. With opinion, the governance group also<br />
need to consider the competence, the perspective or independence of the source of the<br />
opinion.<br />
To assist with the assessment of particularly complex materials, the governance group<br />
may decide to establish a committee or sub-group to examine proposals in detail and<br />
develop a recommendation for the governance group. At times it is also helpful, and<br />
important, to seek expert opinion on some matters.<br />
<strong>Report</strong>ing<br />
To support decision-making the governance group requires regular and appropriate<br />
reporting. <strong>Report</strong>ing needs to address not only progress on the project, but an indication<br />
of progress remaining, including an estimate of work to be completed. <strong>Report</strong>ing will also<br />
include an assessment of ongoing project risks and mitigation strategies.<br />
10 Doug Matheson, The Complete Guide to Good Governance in Organizations and Companies, 2004: p410<br />
11 Ibid: p410<br />
67
Project Goals and Objectives<br />
A successful project is one which delivers the results expected by key stakeholders, and<br />
specifically the paying client (in this case the Department of Corrections) and achieves a<br />
balance across quality (results), time, cost and customer satisfaction.<br />
This can be represented:<br />
Balancing Four Project Dimensions<br />
Results/ quality<br />
Customer satisfaction<br />
Time<br />
Resources/ costs<br />
A good foundation for a successful project will have agreed goals and objectives for each<br />
of these key dimensions. This represents the project definition and scope, which is used<br />
to guide project and governance decisions and test project progress against expected<br />
results.<br />
Project Management Phases and Processes<br />
A project will generally move through a series of distinct phases from concept<br />
development, through planning, to definition and design and next to implementation and<br />
finally acceptance. Throughout these phases there are a number of key project<br />
management processes that are applied across initiating, planning, organising, controlling<br />
and closing.<br />
The following diagram illustrates the project phases and processes:<br />
Project Management Processes<br />
Project management processes recur throughout the lifecycle:<br />
Organising<br />
processes<br />
Intensity<br />
Initiating<br />
processes<br />
Planning<br />
processes<br />
Controlling<br />
processes<br />
Closing<br />
processes<br />
Conceptual<br />
Phase<br />
Planning<br />
Phase<br />
Definition &<br />
Design Phase<br />
Implementation<br />
Phase<br />
Acceptance<br />
Phase<br />
68
The decision-making for each project phase is supported by project reporting (a key<br />
controlling process mechanism) against plans for progress, risks and projected project<br />
outturn.<br />
Project Management Tools and Techniques<br />
Each project phase requires the application of specific tools and techniques for effective<br />
project management. This includes tools and approaches for management of project<br />
integration (charter, planning and reporting tools), project timings, project costs, project<br />
quality, project risks, communications and procurement.<br />
Project Management Office<br />
For large scale projects it is often useful to adopt the approach of using a Project<br />
Management Office (PMO). The PMO is used to centralise and co-ordinate the projects<br />
under its domain. The PMO can operate on a continuum, from providing project<br />
management support functions (in the form of training, software, standardised policies and<br />
procedures), to actual direct management and responsibility for achieving the project<br />
objectives.<br />
Project Management and Line Management<br />
There are some fundamental differences between the orientation of line management and<br />
that of project management. Managing a project means making decisions around a<br />
unique programme of work (and which is often posing new challenges), working to defined<br />
deadlines and managing the resources and risks to achievement of the end result.<br />
Project management requires an approach of constantly thinking ahead for opportunities<br />
and risks, as well as monitoring progress.<br />
Line management is often about maintaining a flow of consistent business-as-usual work<br />
(which is generally familiar), in situations where the management of risk, while important,<br />
is not as volatile. Line management is a more continuous dynamic (although not without a<br />
need for planning).<br />
While line managers do get involved in managing projects, there is still a significant<br />
difference between the two disciplines. Therefore, it is important to ensure that the<br />
composition of a project governance group comprises individuals who have some<br />
experience of governance and project management as well as the specific technical<br />
competencies as their contribution.<br />
69