Whose fault is it? Vendor, Client or End User ?? - Pikom
Whose fault is it? Vendor, Client or End User ?? - Pikom
Whose fault is it? Vendor, Client or End User ?? - Pikom
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
<strong>Vend<strong>or</strong></strong>, <strong>Client</strong> <strong>or</strong> <strong>End</strong> <strong>User</strong> ??<br />
Lam Wei Choong<br />
weichoong@veros.us<br />
25 October 2012
The Perfect Project<br />
Case Study of a Failed IT Project<br />
Cobb’s Paradox<br />
Complex<strong>it</strong>y of IT Projects<br />
So How do we prevent failure?<br />
What to do when project failure <strong>is</strong> imminent?<br />
Arb<strong>it</strong>rate <strong>or</strong> L<strong>it</strong>igate?<br />
Veros’ Recommendations in Summary
2008 CNET
S<strong>it</strong>uation:<br />
Sky wanted a "w<strong>or</strong>ld class“ customer relationship management system at <strong>it</strong>s contact centres<br />
in Scotland<br />
November 2000, EDS awarded Systems Integrat<strong>or</strong> contract to design, build and implement on<br />
a T&M bas<strong>is</strong><br />
Project implementation period was estimated to be 18 months<br />
Two years after project start, Sky subsidiary took over EDS’s role as system integrat<strong>or</strong><br />
responsibil<strong>it</strong>ies<br />
Another 6 months later, EDS pulled out completely & contract ended.<br />
In<strong>it</strong>ial baseline budget of around £48 million<br />
Upon termination, £170 million spent on software, systems integration, infrastructure costs, &<br />
remodeling of contact centre facil<strong>it</strong>ies<br />
Sky ultimately took another six years & spent £265 million to complete the project.<br />
Sky sued EDS in 2004 … eventually f<strong>or</strong> a sum of £709 million<br />
Case Study references: Profess<strong>or</strong> June Verner Uof NSW; Bill Molloy, Partner, Teacher Stern LLP, Herbert Sm<strong>it</strong>h LLP IT and outsourcing e-bulletin Feb2010
SKY CLAIMED<br />
M<strong>is</strong>representaion and Dece<strong>it</strong><br />
EDS overstated <strong>or</strong> oversold their capabil<strong>it</strong>ies & unreal<strong>is</strong>tically<br />
estimated resources required; I.e. Incompetent !<br />
EDS falsely represented that they had a proper WBS and eff<strong>or</strong>t / time<br />
scoping and had reasonable grounds f<strong>or</strong> believing they could and<br />
would meet the project deadlines as set out in both the tender<br />
response and the subsequent contract.<br />
Negligence<br />
EDS falsely represented that they "had a programme plan that was<br />
achievable and the product of proper analys<strong>is</strong> and re-planning<br />
Breach of contract<br />
Failed to provide sufficiently experienced personnel<br />
Failed to deliver services & documentation as per contract<br />
Failed to exerc<strong>is</strong>e reasonable skill and care, <strong>or</strong> to conf<strong>or</strong>m w<strong>it</strong>h good<br />
industry practice.<br />
EDS DEFENCE<br />
BSkyB did not know what <strong>it</strong> wanted from the system<br />
and attributed overruns to undefined project scope<br />
BSkyB's requirements "kept on emerging like<br />
handkerchiefs from a magician's sleeve" during the<br />
roll-out.<br />
Furtherm<strong>or</strong>e, Liabil<strong>it</strong>y to BSkyB f<strong>or</strong> non-fraudulent<br />
m<strong>is</strong>representation by EDS was excluded by the<br />
entire agreement clause<br />
EDS denied that there was indeed a representation<br />
that <strong>it</strong> had carried out a “proper analys<strong>is</strong>” in relation<br />
to time <strong>or</strong> had “reasonable grounds” f<strong>or</strong> an opinion<br />
that they could and would deliver w<strong>it</strong>hin the<br />
timescales in the EDS response.<br />
No duty of care was owed by EDS to Sky in respect<br />
of pre-Prime Contract representations<br />
The entire Sky claims were "absurd and<br />
extravagant”
Cobb’s Paradox :<br />
“We know why (programs) fail”<br />
“We know how to prevent their failure - ”<br />
“So why do they still fail?”<br />
Background<br />
Martin Cobb –CIO, Secretariat of the Treasury Board of Canada<br />
The Stand<strong>is</strong>h Group’s CHAOS Univers<strong>it</strong>y 1995<br />
Studied the 10 most complex IT projects in 1994<br />
All were all in trouble: eight over schedule, by an average fact<strong>or</strong> of 1.6; over budget by<br />
a fact<strong>or</strong> of 1.9 and the final two were cancelled w<strong>it</strong>h nothing delivered.
Judgment passed on 26 January 2010<br />
Judge Ramsey agreed w<strong>it</strong>h Sky’s claim of ‘m<strong>is</strong>representation const<strong>it</strong>uted dece<strong>it</strong>’ because:<br />
• EDS knew the representation was untrue, <strong>or</strong> was reckless as to whether <strong>it</strong> was true;<br />
• EDS intended Sky to rely on the representation<br />
• Sky relied on the representation to <strong>it</strong>s detriment.<br />
The court accepted Sky's argument and held EDS liable f<strong>or</strong> negligent m<strong>is</strong>statement<br />
• court also re<strong>it</strong>erated that suppliers owe customers a duty of care in relation to pre-contractual representations<br />
Entire agreement clause does not exclude claims f<strong>or</strong> negligent m<strong>is</strong>representation <strong>or</strong> m<strong>is</strong>statement<br />
Court found that EDS:<br />
• "failed properly to resource the project“; did not adhere to contractual deadlines, and ultimately made minimal progress.<br />
• failed to exerc<strong>is</strong>e reasonable skill and care <strong>or</strong> conf<strong>or</strong>m to good industry practice.<br />
• there was no effective project management, the planning was not properly documented<br />
• there were insufficient technical and managerial resources.<br />
Th<strong>is</strong> 7 year legal battle <strong>is</strong> the most expensive court case in the h<strong>is</strong>t<strong>or</strong>y of the IT industry<br />
HP paid out £318 million in damages and legal costs<br />
Case Study references: Profess<strong>or</strong> June Verner Uof NSW; Bill Molloy, Partner, Teacher Stern LLP, Herbert Sm<strong>it</strong>h LLP IT and outsourcing e-bulletin Feb2010
Drivers of<br />
IT Project Complex<strong>it</strong>y & Failure Propens<strong>it</strong>y<br />
PROJECT TYPE<br />
• DEVELOPMENT<br />
• ENHANCEMENT<br />
• COTS<br />
• ERP / CORE BANKING<br />
• OUTSOURCING<br />
• BPO<br />
• HYBRID<br />
VENDOR ROLES<br />
• NONE<br />
• CONSULTANT<br />
• APPLICATION DEVELOPER<br />
• PRODUCT IMPLEMENTOR<br />
• SYSTEMS INTEGRATOR<br />
• OUTSOURCER<br />
• CLOUD/SaaS PROVIDER<br />
• HYBRID<br />
• Via ON‐SHORE / OFF‐SHORE<br />
IT PROJECT<br />
MANAGEMENT<br />
FUNDAMENTALS<br />
• SCOPE<br />
• TIME<br />
• COST<br />
• QUALITY<br />
• HUMAN RESOURCE<br />
• COMMUNICATIONS<br />
• RISK<br />
• PROCUREMENT<br />
GEOGRAPHIC SPREAD<br />
• LOCAL – SINGLE OFFICE<br />
• LOCAL –MULTI OFFICES<br />
• LOCAL –MULTI CITIES<br />
• REGIONAL<br />
–MULTI COUNTRIES<br />
• GLOBAL<br />
–MANY COUNTRIES<br />
ENTERPRISE CAPABILITY<br />
• LOCAL SME<br />
• LOCAL LARGE ENTERPRISE<br />
• REGIONAL MNC, LOCAL SITE<br />
• REGIONAL MNC, HQ<br />
• GLOBAL MNC, LOCAL SITE<br />
• GLOBAL MNC, REGIONAL HQ<br />
• GLOBAL MNC, GLOBAL HQ<br />
10
1. A project <strong>is</strong> NOT any project (aka classify them<br />
acc<strong>or</strong>ding to the drivers of IT complex<strong>it</strong>y and<br />
failure propens<strong>it</strong>y)<br />
2. Select your PMs (client and vend<strong>or</strong>) acc<strong>or</strong>dingly<br />
(and appropriately)<br />
3. Manage the Services Sourcing Life Cycle<br />
4. It <strong>is</strong> OK to marry but please have a Prenupt !<br />
5. Trust but Verify !
Drivers of<br />
IT Project Complex<strong>it</strong>y & Failure Propens<strong>it</strong>y<br />
PROJECT TYPE<br />
• DEVELOPMENT<br />
• ENHANCEMENT<br />
• COTS<br />
• ERP / CORE BANKING<br />
• OUTSOURCING<br />
• BPO<br />
• HYBRID<br />
VENDOR ROLES<br />
• NONE<br />
• CONSULTANT<br />
• APPLICATION DEVELOPER<br />
• PRODUCT IMPLEMENTOR<br />
• SYSTEMS INTEGRATOR<br />
• OUTSOURCER<br />
• CLOUD/SaaS PROVIDER<br />
• HYBRID<br />
• Via ON‐SHORE / OFF‐SHORE<br />
IT PROJECT<br />
MANAGEMENT<br />
FUNDAMENTALS<br />
• SCOPE<br />
• TIME<br />
• COST<br />
• QUALITY<br />
• HUMAN RESOURCE<br />
• COMMUNICATIONS<br />
• RISK<br />
• PROCUREMENT<br />
GEOGRAPHIC SPREAD<br />
• LOCAL – SINGLE OFFICE<br />
• LOCAL –MULTI OFFICES<br />
• LOCAL –MULTI CITIES<br />
• REGIONAL<br />
–MULTI COUNTRIES<br />
• GLOBAL<br />
–MANY COUNTRIES<br />
ENTERPRISE CAPABILITY<br />
• LOCAL SME<br />
• LOCAL LARGE ENTERPRISE<br />
• REGIONAL MNC, LOCAL SITE<br />
• REGIONAL MNC, HQ<br />
• GLOBAL MNC, LOCAL SITE<br />
• GLOBAL MNC, REGIONAL HQ<br />
• GLOBAL MNC, GLOBAL HQ<br />
12
Gartner: Key Issues f<strong>or</strong> Services <strong>Vend<strong>or</strong></strong> Selection and Contracting, March 2010
Of Failed implementation, 75% of root causes can be traced to<br />
pre‐project kick‐off stage<br />
Th<strong>is</strong> <strong>is</strong> mainly due to lack of proper expectation management<br />
and <strong>or</strong>ganizational readiness ( both client’s and vend<strong>or</strong>’s):<br />
1. Th<strong>is</strong> <strong>is</strong> a Business Process implementation, not just technical<br />
2. Project Scope unclear and not agreed<br />
3. Stakeholders (Business & <strong>Vend<strong>or</strong></strong>) not actively involved<br />
4. Roles & Responsibil<strong>it</strong>ies of both parties not clearly laid out<br />
5. Deliverables ill-defined & managed<br />
6. No R<strong>is</strong>k & Issues M<strong>it</strong>igation processes agreed & adhered to<br />
7. No planned independent expert reviews & assessments
Preventing Pre‐Contracting Issues<br />
Inadequate Business Case<br />
po<strong>or</strong>ly defined requirements<br />
no r<strong>is</strong>k analys<strong>is</strong> & m<strong>it</strong>igation (e.g. lack of adequate skills & experience)<br />
underestimated complex<strong>it</strong>y, cost and schedule<br />
Upper Management expects m<strong>or</strong>e w<strong>it</strong>h less<br />
Lacking Project Spons<strong>or</strong>ship & Leadership<br />
Weak Tendering Process<br />
pre‐RFP, RFP<br />
po<strong>or</strong> / ill‐defined scope<br />
cr<strong>it</strong>eria f<strong>or</strong> Selection (POC, Technical, Business, Ts&Cs etc)<br />
evaluation m<strong>is</strong>alignment w<strong>it</strong>h Selection Cr<strong>it</strong>eria<br />
No clearly defined (documented) expectations of <strong>Vend<strong>or</strong></strong>s<br />
roles & responsibil<strong>it</strong>ies – individual, joint (between / among vend<strong>or</strong>s)<br />
accountabil<strong>it</strong>y, measurement and mon<strong>it</strong><strong>or</strong>ing<br />
no regular reviews & assessments of vend<strong>or</strong>’s perf<strong>or</strong>mance<br />
Internal Pol<strong>it</strong>ics<br />
unclear responsibil<strong>it</strong>ies & accountabil<strong>it</strong>y of <strong>End</strong> <strong>User</strong>s vs IT<br />
differing (conflicting) Un<strong>it</strong> / Departmental Objectives / Goals<br />
undefined r<strong>is</strong>ks vs (joint) rewards
Business impetus (biz case; project charter)<br />
Project Goals<br />
Deliverables<br />
Functional Requirements<br />
Processes<br />
Non‐functional Requirements<br />
Regulat<strong>or</strong>y Requirements<br />
Data Requirements<br />
Interfaces<br />
Training<br />
Timeframe<br />
Arch<strong>it</strong>ectures<br />
Geographical Coverage<br />
Business ent<strong>it</strong>ies<br />
People …<br />
AND<br />
What <strong>is</strong> NOT in Scope !!!
1. What are the root causes of the IT Project(s) that did not meet <strong>End</strong> <strong>User</strong><br />
expectations and / <strong>or</strong> Project Charter and / <strong>or</strong> Business Case?<br />
2. What are the strengths and weaknesses in the current pool of project managers?<br />
3. What are key <strong>End</strong>-<strong>User</strong> expectations not met currently?<br />
4. What <strong>is</strong> the impact of cultural differences on the outcome of our IT Projects?<br />
5. What profiles of Project Manager are required f<strong>or</strong> different classes of IT Projects?<br />
6. What are the developmental needs to meet current and future Project<br />
projected requirements?
1. Hope … that you have a good Prenupt (i.e. a good contract) !<br />
2. Seriously – two concurrent <strong>is</strong>sues must be answered and activ<strong>it</strong>ies in<strong>it</strong>iated :<br />
i. Where do you stand Contractually ?<br />
ii. Where do you stand Project-w<strong>is</strong>e?<br />
3. Real<strong>it</strong>y - while IT experts are not lawyers, Lawyers cannot possibly provide a<br />
proper recommendation w<strong>it</strong>hout an independent expert project assessment<br />
4. Be prepared f<strong>or</strong> the w<strong>or</strong>st – in m<strong>or</strong>e ways than ONE !<br />
5. Arb<strong>it</strong>rate <strong>or</strong> L<strong>it</strong>igate?<br />
Answer: look into your Prenupt! But ….<br />
6. Hang tight and Be prepared f<strong>or</strong> a loooooong roller-coaster ride !!
1. What are the key contractual (and pre-contractual) requirements and<br />
deliverables?<br />
2. Where <strong>is</strong> the Project on each of these key requirements, deliverables?<br />
3. F<strong>or</strong> maj<strong>or</strong> <strong>is</strong>sues d<strong>is</strong>covered - ascertain root causes.<br />
4. <strong>Whose</strong> <strong>fault</strong> <strong>or</strong> which party (parties) <strong>is</strong> m<strong>or</strong>e at <strong>fault</strong> ?<br />
5. Can they be remedied? I.e. can the project be salvaged – eff<strong>or</strong>t, time, cost<br />
and r<strong>is</strong>ks<br />
6. What are the immediate steps to prepare f<strong>or</strong> possible arb<strong>it</strong>ration <strong>or</strong><br />
l<strong>it</strong>igation? War-room !
• What exactly <strong>is</strong> Independence ?<br />
• How about separating roles and<br />
responsibil<strong>it</strong>ies?<br />
• Different incentives; m<strong>or</strong>e control w<strong>it</strong>h<br />
direct contracting vs main contract<strong>or</strong> w<strong>it</strong>h<br />
sub‐contract<strong>or</strong>s?
1. Assess and know which of your business-cr<strong>it</strong>ical projects belong to the extra-complex<br />
and super-r<strong>is</strong>ky categ<strong>or</strong>y (use Veros complex<strong>it</strong>y template) to single out f<strong>or</strong> special care<br />
and attention.<br />
2. Do you have the right Project Manager(s) f<strong>or</strong> the right Project?<br />
3. Plan f<strong>or</strong> (anti-) Failure !<br />
a. Seek (independent) advice and mon<strong>it</strong><strong>or</strong> (assessments) f<strong>or</strong> proper sourcing procurement<br />
b. Engage experienced (IT savvy) lawyers to prepare (if possible) earthquake-proof contracts<br />
c. Do not be penny-w<strong>is</strong>e and pound fool<strong>is</strong>h – better to try and be healthy rather than rely on being<br />
able to find a good doct<strong>or</strong><br />
4. Trust but verify : periodic outside assessments of your consultants, software providers<br />
and / <strong>or</strong> systems integrat<strong>or</strong> (i.e. aud<strong>it</strong> your aud<strong>it</strong><strong>or</strong>s)<br />
5. Legal and IT experts must be a team!<br />
6. Documentation, documentation … documentation!<br />
GOOD LUCK !!
Veros Consulting <strong>is</strong> a boutique inf<strong>or</strong>mation technology and management consulting<br />
firm that specializes in:<br />
IT Aud<strong>it</strong> & Review<br />
IT Project Failure Analys<strong>is</strong> , Prevention & Recovery<br />
IT D<strong>is</strong>pute Resolution<br />
e-Financial Services Strategy & Implementation<br />
Complex Project Management<br />
Program Office setup and management
M<strong>or</strong>e than thirty two years in the Inf<strong>or</strong>mation Technology industry w<strong>it</strong>h 20 years of executive<br />
management experience across countries in the Asia Pacific (including Japan) region.<br />
Insights and Experiences primarily in:<br />
•Financial Services<br />
•Public Sect<strong>or</strong> (e-Government)<br />
Also has a broad background in many functional areas of IT including:<br />
•Highly Complex Project and Program Management<br />
•Management Consulting & Systems Integration<br />
•Applications Development<br />
•Software Package Selection & Implementation<br />
•Qual<strong>it</strong>y Assurance & R<strong>is</strong>k Management<br />
On the business front, has diverse experiences including:<br />
•IT Aud<strong>it</strong> and D<strong>is</strong>pute Resolution<br />
•M&A Integration<br />
•Organizational Transf<strong>or</strong>mation<br />
•Contracts & Negotiations<br />
•Troubled Systems Integration Projects / Cr<strong>it</strong>ical S<strong>it</strong>uation Management<br />
Pos<strong>it</strong>ions Held include:<br />
•General Manager, Consulting & Systems Integration, Financial Services Sect<strong>or</strong>, IBM Asia Pacific region<br />
•Managing Partner, IBM Global Business Services (GBS), ASEAN/South Asia region<br />
•Managing Principal, Mergers & Acqu<strong>is</strong><strong>it</strong>ions , Financial Services Sect<strong>or</strong>, IBM Asia Pacific region<br />
•IBM Asia Pacific Leader, Applications Management Services (Outsourcing)<br />
•General Manager, IBM China (East Region)<br />
•Direct<strong>or</strong> of Operations, Financial Services Sect<strong>or</strong>, IBM Asia Pacific region<br />
•Adjunct faculty, Singap<strong>or</strong>e Management Univers<strong>it</strong>y’s Masters in IT (Financial & Services) program
<strong>Vend<strong>or</strong></strong>, <strong>Client</strong> , <strong>End</strong> <strong>User</strong> ??<br />
Lam Wei Choong<br />
weichoong@veros.us<br />
25 October 2012