Warren S. Reid - Center for Software Engineering

Contracting for Computer Services:
A Case Study for Systems & SW Engineers
For USC CS-510 November 14 & 17, 2008
1.
2.
3.
4.
5.
When IT goes All Wrong!
Why Systems Fail?
Known Risks: Business, Technology & Contract
Purpose of “Fair” Contracts & Your Part in It?
Introduce the Case & Assignments
Warren S. Reid, Managing Director
WSR Consulting Group, LLC
PH: 818/986-8832
Fax: 818/986-7955
E-mail: wsreid@wsrcg.com
Website: www.wsrcg.com
Blog: blog.wsrcg.com
© 2006-2008 Warren S. Reid All Rights Reserved
This model will change and be updated over time
1
IT Industry Continues to Struggle
Chaos Report (Standish Group)
2004
Challenged
(on
average):
Time Overruns: 84%
$$ Overruns: 56%
Rqmts delivery: ~67%
© 2006-2008 Warren S. Reid All Rights Reserved
This model will change and be updated over time
2
When IT Goes All Wrong (2004-08)


FBI Terror/Crime Sys $170MM –
mismanagement, poor planning, design
changes
Student Loan Interest – Lost $8mm
interest in sw calc.




UK Pension Sys Crash – 80,000 pub

ICI


oil-funded account (3/20/07)”
serv couldn’t pay checks
– Chem Industry Giant – inabil to fulfill
cust orders due to botched impl re BPR –
Customers defect --39% Stock value wiped
out

UK Air Traffic Control – sys down –

cancel/delays hit 200K passengers




MESDAQ – day 1; yrs later halts w
upgrade errors


London Stock Exchange – on last tax


day, cap gains issues

Barclays – small piece of hw brings down
whole bank sys for 18hrs – 5mm cust can
do nothing
$3.8bb Hosp Sys in trouble (3/07)
Another Mars explorer (4/07)
NA Blackberrys down – 4hrs (4/07)
$38bb – “Oops! Techie Wipes Out $38B
Fund”: Keystroke mistake deletes data for Alaska’s
LAUSD; Giant Sanitation Company
Singapore Higher Education
Hospitals (missing/incorrect data; death)
State Highway Patrol
Pizza, Pizza; Soft Drink Co
U.S. government student (privacy)
Outsourcing to India
Major NA bank: millions of accts thrown –
poor sw tests; 2wks to fix; but mo probs
w email phish; > $100mm to fix
© 2006-2008 Warren S. Reid All Rights Reserved
This model will change and be updated over time
3
It’s the Same in Every Case!
“He Said … She Said”
# Category
He Said (Customer)…
She Said (Vend’r, Integ, Consult, OS)…
1 Feasible
Sys doesn’t work; Not what wanted
U chgd mind; Don’t know want/need
2 Capable
Limited functionality
U changed scope
3 Compatible
Sys failed in field
U d/not do req’d Biz Proc Reengineer
4 Credible
SW, services & expertise oversold
U conducted ref checks/ due diligence
5 Usable
No one can use it! Poor training
“Right staff” never did train/refresh
6 Stable
Sys is “fundamentally flawed”
Only 2 more months to test/fix probs
7 Culpable
Never told us that/poor advice!
U d/not follow recs; Bad decis-makers
8 Reliable
Sys is full of bugs
Bad data conver/i’faces; Always bugs!
9 Responsible
U failed as Sys Integ. Proj. Mgr.
No! U failed as Sys Integ. Proj. Mgr.
10 Available
Un-qual/stable/commit Ee, PM, SC
Un-qual/-stable/-commit staff, PM, SC
11 Suitable
Quit good PM & SDLC meth; Risk up
Unwilling 2 comply w prom/need meth
© 2006-2008 Warren S. Reid All Rights Reserved
This model will change and be updated over time
4
Risks Known B4 Project Starts


People/Resource Risks
 Turnover, culture, x-comm.
 Top Mgt Commit; Proj Champ
 Partner; Ref. Chks/Ref’s Refs
Requirements Risks
 Poor Project Charter







Incompl, Misunderst, Gallop
Security; Privacy




C – Correctness
I – Integrity
A – Available


Shortcuts to SDLC on the fly


Product & Other Risks


Tool avail? mature? train? use?
Unclear Leadership – SIPM
Project under- or mis-estimated
SEI-CMMi level; ETC &EVM Stds
Sched, $$, estimates, change control
Not enough time for testing

I’faces, Data Convers’n
Client, Depts, Users, IT, Vend, O/S consults,
attys, custs, analyst, mkt “expectations”
Process Risks

Technology
 HW, SW, Net, D/B, I’net,

Project & Tech Mgmt Risks


Performance, testedness & readiness
-abilities (scale, use, test, port, maint)
Competent T/O proc, supt, maint?
compet; economy; org; regulatory
© 2006-2008 Warren S. Reid All Rights Reserved
This model will change and be updated over time
5
Requirements: Why So Difficult!
© 2006-2008 Warren S. Reid All Rights Reserved
This model will change and be updated over time
6
Requirements: Why So Hard – Still?
© 2006-2008 Warren S. Reid All Rights Reserved
This model will change and be updated over time
7
What Can Possibly Be Misunderstood?!
Everything!


People are different
People have different:










Objectives; Goals
Experience, education, expertise
Styles of understanding and communicating
Cultural training and biases
Understanding of priorities
Fears: spoken and unspoken
Abilities, talents, logic, creativity
Understanding of what is subjective v objective
Implied/understood without being spoken (needs, reqmts, sizzle)
What won’t be misunderstood?
© 2006-2008 Warren S. Reid All Rights Reserved
This model will change and be updated over time
8
What Can Possibly Be Misunderstood?! Everything!
“We Thought … Contract Says”
# Category
What the Contract Says
What They Understood: Cust/Prov
1 Suitable?
System description
Bounds scope; Uber-theme
2 What Works?
Functional Requirements
… as per specs dated ____?
3 How Well?
Performance Reqmts
Scal-? Port-? Avail-? Maint-? Use-? SMART?
4 Who Does what?
Roles & Responsibilities
RM? Dispute escal/resol? HR reqts?
5 How We Do It?
Conduct of Project
WBS, est, staff, delivs, PM, SDLC, bugs
6 Just for Me?
Custom Programming Services
Config, SDLC, PM, est, test, I’face, maint-?
7 U Prove it 1st!
Sys. Integ; I’facing; Testing; Convert
Results NOT Resources; “Success” def
8 Min Reqmts
Acceptance Testing Process
Who? How? When? Where? Criteria?
9 More Min Reqs
Key Delivs: QA; Train; Doc; Sys Works
Exist? Depth? Maintainable? S/O proc
10 & Tomorrow?
Maint, upgrades, fixes, enhancem’ts
T/Over stds? Work stds? LTCO? Metrics
11 $$ = Mouth?
All proposals/work-prod/proms up to K
“Parole evidence” rule; 4 corners only
12 Go-Live
ALL Systems Go!
What’s acceptable? Checklist? Vote?
13 Other Key Issues
Costs/Pymts; ADR; TERMination; Renew; Title; There’s more to the Sys than a sys (SOS):
$$ limits; penalties; ownership; holdbacks;
X-hire; Site prep; Install hw, sw, nw, BPR;
confid; $ protect; Liability limits/exclusions
remedies; limits of liab; privacy; hot sites
© 2006-2008 Warren S. Reid All Rights Reserved
This model will change and be updated over time
9
Why Are Contracts (K) So Important,
& Why Must YOU Know About Them?


They offer clear & explicit delineation of rights, obligations & expectations of the parties
Generally produce:










much better working relationship
much > prospect of proj success ($, Sch, F&F, QA, SH, Risk; < costs, staff, inv; > cust serv, mkt share)
less chance for either major disputes or total disinteg of relat bet parties s/unexpect probs arise
Honeymoon: forces identification, negotiation, appreciation of others’ views, beliefs &
objectives before you do your deal
Must be a living document – able/willing to adapt to changes
An understanding of risks (id & allocation), financial responsibility, knowledge of law, strong
sense of value beats size for good contracting
Computer lawyer, tech advisor, business advisor/consult, domain advisor
“Standard K form” favors vendor/large Cs & freq used as sub for good mgt/K activ
K language often incomplete & ambiguous; Drafters are gone; shelf death
Matters of:





Facts
Law
Evidence
Risk
Technology
© 2006-2008 Warren S. Reid All Rights Reserved
This model will change and be updated over time
10
CONTRACTING AGREEMENTS FOR SYSTEMS SERVICES: A Case Study
©2008 by Warren S. Reid & Michael D. Scott, Esq.
All Rights Reserved
For USC Graduate School for Systems Engineering (CS 510)
Basic Fact Situation





"ItsYourBid.com" ("IYB") well-funded Internet start-up
IYB's biz model: create site for online aucts of new/used heavy indus equip
Id’d "AuctionBid.com" ("AB") as ASP of auct sw/bid process services on I’net
Gen, ASPs charge a fixed, per tranx fee to cust.
Parties agreed to diff biz model:
 Here, not paid flat fee/tranx, but get 3% Total Amt IYB to receive/C/tranx


AB gets 3% whether or not C ever pays IYB
Also diff, how IYB paid by its Cs:







Seller reqd to est auction sale price (sp) & pay IYB 10% of est up-front.
If SP of successful bidder =< est, IYB gets no more.
If SP >est, IYB w/get 50% of DIFF fm Seller. So Sellers w/not low-ball est.; 3%  AB
Bc payment strategies not normal auction, AB to custom sw to IYB specifically
AB gets no up-front pymts to dev sw, but believes > $ opps here – so will invest
AB will also host auction site on its hw at no added cost
You, part of Deal Team (lawyer, exec, SE, PMK) w/get mo client info fm memos.
© 2006-2008 Warren S. Reid All Rights Reserved
This model will change and be updated over time
11
What is an Applications Service Provider? (ASP)

ASP Model





Common ASP features:



ASP fully owns & operates sw apps and servers
ASP generally bills on "per-use" basis or monthly/annual fee
The advantages to this approach include:








ASP provides computer serv to custs over network
Custom client sys can also I’face to sys.
ASPs grown w  costs of special sw > $$ range of S/M-size cos. (’03-’08 $4bb 10bb)
W. ASPs, sw complex/$$ less; upgrade/dist sw to end users <; maint current, 24x7 suppt
SW integ issues elim fm client site
SW app $$ spread > clients
ASP expert w particular sw app knowhow > than in-house staff
Key sw sys kept current, avail, managed for perform by experts
> relia-bility, avail-, scal-, security of computer systems
SLAs guarantee certain service of service
Reduction of internal IT costs
Some inherent disadvantages include:





Client accepts app as is; ASPs only make cust solutions for largest Cs
C may rely on ASP for crit biz funct – limits control of funct relying on ASP
Changes in ASP mkt may result in type/level of service avail
Integration w C's non-ASP sys c/be problem
Eval ASP security, stabil, resources ELSE: Loss/compromise of control of data, image, security
© 2006-2008 Warren S. Reid All Rights Reserved
This model will change and be updated over time
12
ItsYourBid.com
From:
To:
Re:
Date:
MEMORANDUM [1]
Ted Gearhead, Head of MIS
Warren S. Reid, CEO
Deal with AuctionBid.com
March 13, 2008
_________________________________________________________________________
Warren: I evaluated all proposals, think AuctionBid.com (“AB”) is right fit for our needs/unique biz model. As “virtual” company, we want to invest
as little $ as poss up front to get started & AB looks like ideal solution. We want to avoid buy computer equip, rent
space for comp center, hire lots of employee - generally doing what normal startup would do. AB c/both host site &
provide us w sw for online aucts. They can run aucts & maintain hw & sw for us. It seems like an ideal fit.
Our one web designer, Tom Thumbs, w/be designing &
programming our website. He do all graphics, set up how home & auction pages look, design sw
that allows sellers to sign up for service, & post info on heavy equip they plan to sell, incl
descrips/pics. Tommy also designed & writing sw for buyer sign up, nav site & place bids. Only
piece missing, & it’s critical, is sw to actually run aucts, keep track of bids, etc. That’s for AB.
The basic structure of the relationship looks pretty straightforward.
AB has a sw package that permits website like ours to run aucts. For normal auct site, like eBay, AB software just “plugs into” website’s sw & works
like charm. However,
because we run our auctions diff, it necess for AB mod its sw.
Contract (K) we negotiate needs to provide for AB to make agreed-upon mods at own expense, & provide us w
modif sw package to plug into website sw Tommy designed & in process of writing.
AB had access to T’s design. AB says mod sw works w/o TT modifying what already done. Even tho
AB is expert in auct sw, from exp, know cust sw never works as designed; reqs tweaking. So must
provide short per (30 days) aft AB done w mods so we c/test sw, make sure works properly.
Bc we won’t have computers ourselves to do testing, AB will need to provide us w/access to their computers to do testing.
Concern: AB extreme busy. Their auction sw very popular; dozens of cos sign up w AB to run aucts.
I w/be working closely w our outside counsel, so if there are any things you want me to pass on to them, let me know.
© 2006-2008 Warren S. Reid All Rights Reserved
This model will change and be updated over time
13
ItsYourBid.com
MEMORANDUM [2]
From: Ted Gearhead, Head of MIS
To:
Warren S. Reid, CEO
Re:
Deal with AuctionBid.com
Date: March 13, 2008
___________________________________________________________________________
Ted. Thanks for useful memo. I agree w everything you say but have contract concerns.
1. Getting the site operational.



Auct website IS our business. If not up on sched, we out of business.
AB invests in IYB BUT if AB get big C pays for sw dev/mod, we on back burner; not GoLive.
Need sched to ensure, NMW, AB gets us fully up in 6 mos -- incl 1mo test; Not 1 day more! We clear?
2. Payments to AB





Make sure contract clear we pay them 3% of what we are due fm seller for each auct – not fixed price.
So: 3% of minimum that seller pays us up front. Minimum w/be 10% of seller ests equip will sell for.
AB gets 3% of S owes us at END if actual SP > est. ; We get 50% of diff S est & act SP; AB get 3% of the 50%
Bc it c/take time S pay, we want up to 90 days to pay AB fm auct end. If paid < 90, we pay AB 10d aft get check.
If no paid in 90/or at all, still owe AB 3%, t/be paid on 90th day. These are big corps & govt) so no-pay risk small.
3. Tommy Thumb

Tommy genius; W/o him we screwed. If he goes, b/sure AB can’t hire him w/i longer of 6 mos of gone or K end
4. Service Level



Website avail =lifeblood; NEED 99% uptime SLA/any 24 hrs. If unmet any 3 days/mo, AB pays $1K/hr for unavail
If prob for AB, AB arrange hot-swap auct back-up website if prime goes down/unavail on I’net for any reason.
Only except monthly maint w/site unavail for up to 1 hr/mo for sched maint of comp sys. Sun 2am – 3am PST
5. Term & Termination



K s/b 5 yrs long w option for us to renew addl 5 yrs w/exact same terms (will change % due AB auct 3%4%)
Website=our biz, AB can’t term K - NMW. AB only remedy -- sue for damage; xcept if owe >$10K, w/hv 30 days
If don’t pay, AB phase out website by sw mod to preclude new aucts; aucts in progress on day 30 go to end
© 2006-2008 Warren S. Reid All Rights Reserved
This model will change and be updated over time
14
AuctionBid.com
MEMORANDUM [3]
To:
Michael King, CEO
From: Connie Coder, VP, Business Development
Re:
Contract with ItsYourBid.com
Date: March 13, 2008
__________________________________________________________________
Michael:

After long time, ItsYourBid.com (IYB) responds + to our Prop to provide web hosting & auction sw services. A
start-up, but seem well-fund’d. Auct site their whole biz; worry if w/cn provide needed service. Assuaged concern

IYB diff biz model; s/wk well for large $$ S vs our clients who charge S a flat fee (or % of SP), and pay us fixed, per
auction fee. They need signif mods to our core sw.

#s look good: 3% of est min (IYB gets 10%); plus 3% of SP over est (IYB get 50%) is signif more money than usual
fixed $5.00 fee/auction charge. If S est is $10K but sells for $14K, IYB gets 10% of $10K = $1K PLUS 50% of $4k
= $2k for $3k total. We get 3% of $3k = $90.

Some equip may sell for tens of thousands of dollars, so our cut will be several thousand dollars

We give IYB 90 days to pay bc they bill S (too large $$ for credit cards). We get paid whether IYB gets paid or not!

We do mods at our expense. S/not be large $$ amt. We I’face w sw being devel by IYB for basic website nav

IYB web designer, Tom Thumb’s designs look relativ straightforward. Concern if sw TT develop’g changes signif
fm what saw, cause us redesign/rewrite sw mods. K s/limit IYB’s abil to change once K signed/pay us for changes

Agreed to get site up in 6 mos of K sign. No problem as long as Tommy still there ( or “as good” replacement.
Also depends on their not changing sw design after K sign. If they do so, may take longer to get website up.

If Tommy leaves/IYB expands prog dept, IYB may try to steal some AB progs. Incl a non-solicitation clause in K.
I know you meet w our attys this Saturday. Let me know of any other issues that they think are important.
© 2006-2008 Warren S. Reid All Rights Reserved
This model will change and be updated over time
15
AuctionBid.com
MEMORANDUM [4]
To:
Connie Coder, VP, Business Development
From: Michael King, CEO
Re:
Contract with ItsYourBid.com
Date: March 13, 2008
_______________________________________________________
Connie: Thanks for the memo. I am quite excited about this
relationship.

Competit >ever; all start auct site. Impacted Rev. New Ks < rev. Bad econ. We REALLY need this deal.

I like IYB’s biz mod; we hv chance to make lot more $ w less tranx; IYB startup – concern re long haul fin
stab. Must terminate if IYB gets in serious financ probs. IYB Pres says they flush, but worry nonetheless.

Cost lot $ mod sw for IYB; MUST recoup $ + make profit. Thus, we do absol min work nec get site up/run

If potent’l deal w $ upfront, we delay IYB wk; Push 6 mo 9 w lang for mo if IYB changes incr work >plan

They want 100% guarantee uptime; unrealistic; sell large equip – some downtime no big deal.
Get 97% w less penalties and w limited remedies (we try diligently to fix…)

Bc we incurr host $, but IYB pay us % of act revenues fm S, we depend on their sales effort. If can’t
attract S, make no money. So incl min paymts clause: $5K/mo or we can terminate K. Give them impetus
to mkt website

We own ALL rights to sw we develop. At K end, we keep sw… so they don’t move to another auction
hosting service. K s/be min 5 yrs to insure we recoup sw invest, w option 5 more years either party can
exercise. If renewed, want % incr fm 3 6%

If IYB files Bankruptcy or doesn’t pay by payment due date, want K termination rights on 30 days notice.
Complete pending auct, NO new ones last 30day per.
I know you meet w our attys this Saturday. Let me know of any other issues that they think are important.
© 2006-2008 Warren S. Reid All Rights Reserved
This model will change and be updated over time
16
AFTER YEARS OF EXPERIENCE:
THE GOLDEN ANSWER!
h
p
d(y) : f(y) +
2
(c) = P R
(l)+
© 2006-2008 Warren S. Reid All Rights Reserved
This model will change and be updated over time
17
AFTER YEARS OF EXPERIENCE:
THE GOLDEN ANSWER!
h
d(y)
p
f(y) +
:
(l)+
2
(c) = P R
© 2006-2008 Warren S. Reid All Rights Reserved
This model will change and be updated over time
18
QUESTIONS/COMMENTS
WSR CONSULTING GROUP, LLC
Warren S. Reid, Managing Director
PH: 818/986-8832
Fax: 818/986-7955
E-mail: wsreid@wsrcg.com
Website: www.wsrcg.com
Blog: blog.wsrcg.com
© 2006-2008 Warren S. Reid All Rights Reserved
This model will change and be updated over time
19