Why Phases are the Key to Project Performance Evaluation Douglas C. Bower,

Transcription

Why Phases are the Key to Project Performance Evaluation Douglas C. Bower,
Why Phases are the Key to
Project Performance Evaluation
Douglas C. Bower, MBA, MSc, PMP
Greater Toronto ISLIG – May 17, 2007
Agenda
ƒ Objectives
ƒ Review of Earned Value Management
ƒ Issues with Conventional EVM
ƒ Phase Earned Value Analysis concept
ƒ Using PEVA in sample project
ƒ Applying PEVA to portfolio analysis
ƒ Conclusions
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
2
Objectives
ƒ Introduce and describe a new PM concept
Phase Earned Value Analysis (PEVA)
 My proposed extension to Earned Value
Management (EVM) theory and methodology
 Uses project phases to facilitate EVM concepts
ƒ Demonstrate how PEVA can provide
 Simplified calculation of earned value measures
 Meaningful identification of schedule variance
 Improved visual presentation of status and trends
 Evaluation of projects and programs in portfolios
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
3
EVM Defined
ƒ Earned Value Management (EVM) is a
method for integrating scope, schedule,
and resources… and for measuring
project performance.
It compares the amount of work that was
planned with what was actually earned with
what was actually spent to determine if cost
and schedule performance are as planned.
– PMBOK 3rd Edition
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
4
Planned Value (PV)
What did we plan to achieve by now?
ƒ Planned Value (PV) is the authorized budget
assigned to the scheduled work to be
accomplished…
– PMBOK 3rd Edition
 Includes both direct and indirect costs
 Includes contingency amounts in the budget
 Includes part of budget for activities in progress
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
5
Earned Value (EV)
What have we achieved so far?
ƒ Earned Value (EV) is the value of completed
work expressed in terms of the approved budget
assigned to that work…
– PMBOK 3rd Edition
 Includes estimated EV for partly completed activities
 Cumulative Earned Value is the total of all EV
amounts for all project activities completed to date
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
6
Actual Cost (AC)
What have we spent so far?
ƒ Actual Cost (AC) is the total costs actually
incurred and recorded in accomplishing work
performed during a given time period…
– PMBOK 3rd Edition
 Can include both direct and indirect costs
 Cumulative Actual Cost is the total of all AC
amounts for all project activities completed to date.
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
7
EVM Cost Variance and
Cost Performance Index
ƒ Cost Variance (CV): What is the difference
between what we have achieved and spent?
Cost Variance = Earned value – Actual cost
CV = EV – AC
 Negative CV is the $ value that performance lags behind costs
ƒ Cost Performance Index (CPI): What is the
ratio of our performance to our costs?
CPI = EV / AC
 CPI gives performance as a ratio of actual costs to date
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
8
EVM Schedule Variance and Schedule
Performance Index
ƒ Schedule Variance (SV): What is the difference
between what we have achieved and what we
should have achieved by now?
Schedule Variance = Earned Value – Planned Value
SV = EV – PV
 Negative SV is the $ value that performance is behind plan
ƒ Schedule Performance Index (SPI): What is
the ratio of our performance to our plan?
SPI = EV / PV
 SPI gives performance as a ratio of the budget to date
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
9
Forecasting final results
ƒ Management wants to know:
 How will it all end?
ƒ Final results determined by
 quality of the project plan
 actual performance results
 management’s desire to affect results
ƒ Forecasting variables
 value of the work remaining
 performance efficiency factor
 total actual costs to date
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
10
Forecasting final cost results:
Estimate at Completion
1. Actuals to date plus an new estimate
•
•
Assumes all of the original estimating was seriously flawed
Take your costs to date, then add a new estimate for the
remaining work
• This is known as a “Management EAC”
EAC = Actual Costs + Estimate to Complete
2. Actuals to date plus remaining budget
• Assumes current cost variances are atypical
• Take costs to date, add the budget for the remaining work
EAC = Actual Costs + (Total Budget - Earned Value)
EAC = AC + BAC - EV
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
11
Forecasting final cost results:
Estimate at Completion
3. Cumulative CPI Estimate at Completion
•
•
Most commonly used approach for EAC
Take your remaining work, divide it by your cost efficiency
to date, then add your costs to date
EAC = Actual Costs + (Total Budget - Earned Value)
Cumulative CPI
 Cumulative CPI EAC Simplified
• Above formula can be simplified (through algebra) to get:
EAC = Total Budget / Cumulative CPI
EAC = BAC / CPI
•
Divide your total budget (BAC) by cost efficiency to date
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
12
Predicting a Project’s Time Duration
ƒ Critical path on current schedule is best
indicator of completion date
Schedule Variance (SV) indicates the
progress of the work compared to plan
SPI gives the ratio of achievement compared
to plan, but
Conventional SV and SPI are invalid in the
last third of the project (more on that later)
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
13
Issues with Standard EVM
1.Cost/time integration challenge
ƒ Requires a single WBS to organise both the
schedule and budget
2.Progress evaluation challenges
ƒ Schedule variance expressed in dollars
ƒ Variance indicators become useless in 2nd half
ƒ Doesn’t deal with milestones
3.Forecasting challenge
ƒ EVM can’t forecast future trend lines for costs
and achievements
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
14
EVM Cost/time Integration Challenge
External
Constraints
Schedule
Target
Milestones
WBS
Available
Resources
Planned
Stages
Activity
Sequences
Phased
Rollout
Some
SomeSchedule
Schedule
Items
ItemsNot
Notin
inWBS?
WBS?
Budget
Budget
Planned
Procurement
Internal Division
of Work
Greater Toronto ISLIG
May 17, 2007
Some
SomeWBS
WBSItems
Items
Not
Notin
inBudget?
Budget?
Standard
Industry
Breakdowns
Cost
Estimate
© Douglas Bower 2007
Corporate Cost
Control Formats
15
Project Value and Cost Æ
EVM Progress Evaluation Challenge:
Schedule Variance in Dollars
B
PM
Date of
Measurement
Missing:
Schedule
Variance
in Days
A
al
u
t
c
ed
n
an
l
P
st
Co
rne
Ea
e
lu
a
V
e
alu
V
d
CV
SV
Cost
Variance in
Dollars
Schedule
Variance in
Dollars
Time Schedule Æ
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
16
EVM Time Performance Challenge:
Schedule Progress Anomaly
ƒ EVM progress indicators (SV and SPI) may
become meaningless during last half of project
ƒ Why? Because both compare EV with PV
 As every project (or phase) nears completion, the
Earned Value must approach the Planned Value
 So, even if the project is months or years late…
• SV must approach zero (no time variance?)
• SPI must approach 1.0 (on schedule?)
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
17
Issues When EVM is Applied to
Phase Milestones
B
M
P
Project Value and Cost Æ
Budget
Baseline
What
Whatwill
willActual
Actual
Cost
be
when
Cost be when
Phase
Phase33finishes?
finishes?
Planned Value for
End of Phase 3
e
lu
a
V
ed
st
n
o
e
n
lC
la alu
a
P
u
V
t
ed
Ac
n
r
Ea
Phase 3
Planned
Completion
Date
Earned Value is
Lagging - Phase 3
is incomplete
Time Schedule Æ
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
18
Challenge: Using EVM to Plot
Future EV and AC Curves
Project Value and Cost Æ
What
Whatcurve
curverepresents
represents
future
cumulative
future cumulative
Actual
ActualCosts?
Costs?
?
?
B
PM
Budget
Baseline
What
Whatcurve
curverepresents
represents
future
cumulative
future cumulative
Earned
EarnedValue?
Value?
e
lu
a
V
ed
st
n
o
e
n
lC
la alu
a
P
u
V
t
ed
Ac
n
r
Ea
Current
Date
Time Schedule Æ
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
19
The PEVA Concept
1. Recognizes structured project phases
2. Allows separate time and cost baselines
3. Simplifies planned and earned value
4. Simplifies actual cost calculations
5. Compares planned and actual milestones
6. Forecasts future milestone dates and
cumulative costs at those points
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
20
1. PEVA recognizes
structured project phases
ƒ Structured phases are ƒ EVM allows
a key mechanism for
the control of the
scope, time and cost
dimensions
 Logical project
divisions
 Phase end is a
vantage point
 Time for stage gates,
phase review, etc.
Greater Toronto ISLIG
May 17, 2007
performance
evaluation at phase
end, but… fails to
isolate a phase from
the balance of the
project
© Douglas Bower 2007
21
2. PEVA allows separate
time and cost baselines
ƒ Cost and time
ƒ EVM requires:
baselines are
prepared separately
ƒ Requirements for
both budget and
schedule:
 Address all of the work
of the project
 Adopt phases as the
primary divisions
Greater Toronto ISLIG
May 17, 2007
 Common single WBS,
for both schedule and
budget
 Control accounts,
each with identified
costs, time frame and
responsible groups
© Douglas Bower 2007
22
3. PEVA simplifies planned value and
earned value calculations
ƒ PEVA establishes the ƒ EVM requires
Phase Planned Value
by summing the
budgets for all work in
that phase
mangers to calculate
or estimate the PV
and EV of all activities
in progress
 Phase EV is equal to
Phase PV when that
phase is completed
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
23
4. PEVA simplifies cost calculations
ƒ PEVA calculates the
Phase Actual Cost by
adding expenditures
and/or staff time for
any work completed
for that phase
 Just need identify the
right budget category
within a phase
Greater Toronto ISLIG
May 17, 2007
ƒ EVM requires
complex calculations
for cost of work in
progress
 Managers need timesheet codes and staff
hours for each work
package
 Need to attribute each
cost to a specific
package
© Douglas Bower 2007
24
5. PEVA compares planned
with actual milestones
ƒ PEVA compares the
planned completion
date for each phase
with the actual
completion date
ƒ EVM cannot
recognise phase
completion or other
milestones
 PV is baselined with
each planned phase
completion date, and
 EV and AC are
tracked with each
actual phase
completion date.
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
25
6. Forecasts future milestone dates and
cumulative costs at those points
ƒ PEVA Forecasting
 Cost: PEVA uses the
efficiency to date (CPI)
to forecast the
expected cost of all
future phases
 Time: PEVA uses the
rate of progress, called
SPI(t), to forecast the
end date of each
future phase
Greater Toronto ISLIG
May 17, 2007
ƒ EVM Forecasting
 Cost: EVM uses the
efficiency to date
(cumulative CPI) to
forecast the estimate
at completion (EAC)
 Time: EVM cannot
reliably forecast the
project end date
© Douglas Bower 2007
26
Introducing the PEVA Symbols
ƒ PEVA tracks performance only at phase end
 Or at the end of a sub-phase
ƒ Distinct symbols are used for charting PEVA at
the end of each phase:
Phase
Planned
Value
Greater Toronto ISLIG
May 17, 2007
Phase
Earned
Value
© Douglas Bower 2007
Phase
Actual
Cost
27
Phase Earned Value Analysis Concept
Phase
5
Phase Planned Value
Phase
4
Budget
Baseline
Phase Actual Cost
Actual Time and Cost Status
at Phase 3 Completion
Phase
3
Planned Time and Cost
Status at Phase 3 Completion
Actual Cost of Phases 1-3
Over budget
Total Budget for Phases 1-3
Phase
2
Phase
1
Budget at
Completion
Late
Project Value and Cost Æ
Phase Earned Value
Phase
6
Time Schedule Æ
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
28
PEVA Symbol Relationships
ƒ PEVA symbols identify the accumulated
ƒ
Phase Planned Value, Phase Earned
Value and Phase Actual Cost
At the end of every phase:
 Earned Value will equal the Planned Value,
and
 Actual Cost will be calculated on the same
date that the Earned Value was achieved
ƒ One of nine basic PEVA relationships
can occur at the end of each phase…
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
Phase
Actual
Cost
c
t
Phase
Planned
Value
Phase
Earned
Value
29
Nine Possible PEVA Conditions
Under Budget
On Budget
Over Budget
Early Completion
1
1
On Time Completion
Over
Budget
Earned
Value
Actual
Cost
2
Actual
Cost
Planned
Value
On
Time
Over
Budget
Planned
Value
Earned
Value
Late Completion
3
Over
budget
Planned
Value
Early
5
On
Budget
Actual
7
Actual
Cost
On
Time
Earned
Value
6
8
Early
Cost
Planned
Value
Earned
Value
Under
Budget
Under
Budget
© Douglas
Earned
Value
Late
On Time
Planned
Value
On
Budget Actual
Planned
Value
Actual
Cost
Early
Greater Toronto ISLIG
May 17, 2007
On
Budget
Planned
Value
Planned
Value
Earned
Value
Earned
Value
Late
4
Cost
Earned
Value
Actual
Cost
Actual
BowerCost
2007
9
Planned
Value
Late
Earned
Value
Under
Budget
Actual
Cost
30
Typical Project Activity Grouped by Phases
Assessment
Budget
Concept
Develop
Milestone 1
1
Engineering
Finalisation
Gather info
Hire staff
2
Milestone 2
Investigation
Justification
Knowledge
Long-term
3
Milestone 3
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
31
EVM: Assessing Project Activity - End of August
Assessment
Budget
Concept
Develop
1
Milestone 1
Engineering
Finalisation
Gather info
Hire staff
Milestone 2
Actual Time and Cost
Status at August 31
2
Investigation
Justification
Knowledge
Long-term
3
Milestone 3
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
32
PEVA: Assessing Project Activity - End of Phase 2
Assessment
Budget
Concept
Develop
1
Milestone 1
Engineering
Finalisation
Gather info
Hire staff
Milestone 2
Investigation
Actual Time and Cost
Status at Phase 2
Completion
2
Justification
Knowledge
Long-term
Milestone 3
Greater Toronto ISLIG
May 17, 2007
Progress on Phase 3
work is not included
© Douglas Bower 2007
3
33
PEVA Components
1.
Project Schedule

2.
PEVA Cost Table

3.
Project budget in spreadsheet
PEVA Cumulative Performance Forecast

4.
Gantt chart in PM software
Phase time/cost status and forecast in spreadsheet
PEVA Chart

Earned value tracking and forecast diagram
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
34
PEVA Cost Measures and Indicators
ƒ Phase Planned Value is the total budget for each phase
ƒ Phase Earned Value is equal to the Planned Value for
ƒ
each phase – when completed.
Phase Actual Cost is the total of all internal and
external costs attributed to each phase.
ƒ Phase Cost Variance: CVP = EVP – ACP
ƒ Phase Cost Performance Index: CPIP = EVP/ACP
ƒ Cumulative Cost Variance is total EVP less total ACP,
ƒ
at each successive phase end.
Cumulative CPI is the total EVP divided by total ACP, at
each successive phase end.
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
35
PEVA Time Measures and Indicators
ƒ Phase Schedule Variance is the difference between the
ƒ
planned and actual completion dates for a phase.
SVP = Planned phase end date – Actual phase end date
Schedule Performance Index is planned duration divided
by actual duration to a phase end.
SPIP = Planned duration / Actual duration
 Duration is elapsed time from project start to any phase end
Phase Completion
Planned Duration
Actual Duration
Project
Start
Greater Toronto ISLIG
May 17, 2007
<t>
Planned Actual
© Douglas Bower 2007
36
PEVA Sample Project
ƒ Following project is purposely simple
• Less detail to allow concept presentation within
timeframe and on this screen
ƒ Demonstration spreadsheet model
contains a PEVA table and a PEVA chart
• This Excel spreadsheet is available on request
ƒ Not necessary to show project schedule
• Let’s assume there is one…
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
37
PEVA Sample Project
Data
DataEntered
Enteredby
by
Project
Manager
Project Manager
Results
ResultsCalculated
Calculated
Automatically
Automatically
Earned Value Variances and
Indices by Phase
Forecast
Phase
End
Greater Toronto ISLIG
May 17, 2007
Cumulative
PV and EV
© Douglas Bower 2007
Forecast
Cum.
AC
Forecast Earned Value
Variances and Indices by
Phase
38
Estimate At
Completion
Last
Completed
Phase
To
ToDate
Date
Forecast
Forecast
Cumulative
Actual Cost
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
Forecast
End Date
39
Implementing PEVA
1.
2.
3.
4.
5.
6.
7.
8.
Prepare time schedule by phases
Prepare budget by cost elements
Group budget elements by phase
Confirm activities and identify planned
phase completion date
Deal with approved changes
Calculate actual costs
Track phase progress and completion
Review variances and take action
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
40
PEVA and Project Portfolio
Management
Project Portfolio Management
ƒ Corporate governance
 Strategy to address corporate mission
 Tactics to implement goals and objectives
 Knowledge and control of corporate initiatives
ƒ Governance of programs, projects and portfolios
 Assessing projects and programs before, during and
after delivery
 Authorizing and launching new projects
 Revising or canceling unsatisfactory projects
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
42
Portfolio Management Considerations
ƒ Resources: required vs. availability
ƒ Relevance: deliverables vs. objectives
ƒ Dependency: project in relation to others
ƒ Progress: meeting project schedule
Project planned vs. actual time
ƒ Performance: meeting project budget
Project planned vs. actual costs
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
43
PEVA and Project Portfolio
Management
ƒ Evaluating project performance and
progress by phases aids in portfolio
management
ƒ Phase and Earned Value:
EVM does not isolate phase milestones, cost
performance and schedule progress
PEVA permits and encourages project
assessment at each phase gate
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
44
PEVA-Portfolio Assesses
Performance and Progress
Performance
Progress
How are we doing?
How are we doing?
Earned value vs. actual
cost to the end of the last
completed phase
Where are we going?
Budget at Completion
vs.
Estimate at Completion
Greater Toronto ISLIG
May 17, 2007
Planned vs. actual
duration to the end of the
last completed phase
Where are we going?
Planned Total Duration
vs.
Forecast Total Duration
© Douglas Bower 2007
45
PEVA and Portfolio Management
Cost Performance
Budget
Budget &
Planned
Results
Schedule Progress
Value (EV) to
Last Completed
Phase
Planned
Duration (PD) to
Last Completed
Phase
6
Planned
Total
Duration
6
Alpha
Project
$
Actual
Costs
and New
Cost
Forecast
New Cost
Forecast
(EAC)
Greater Toronto ISLIG
May 17, 2007
Actual Cost
(AC) to Last
Completed
Phase
Schedule &
Planned
Duration
t
Actual
Duration (AD)
to Last
Completed
Phase
© Douglas Bower 2007
Forecast
Total
Duration
Actual
Duration
and New
Time
Forecast
46
PEVA and Portfolio Management
Cost Performance ($)
Schedule Progress (t)
Alpha
Project
Budget &
Forecast
Cost
Beta
Project
Planned &
Forecast
Completion
Gamma
Project
Delta
Project
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
47
PEVA and Portfolio Management
ƒ Graphical presentation provides visual
indication of status of individual projects
Indicates relative size and duration
Shows degree of progress and performance
ƒ Permits side-by-side comparison of all
current projects
ƒ Depicts related projects within a program
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
48
Conclusions
ƒ EVM has been effective where fully applied, but
 Standard EVM methodology has numerous issues
ƒ Phase Earned Value Analysis can simplify the
adoption of performance management
 PEVA also provides features not found in EVM
ƒ PEVA requires application in a range of projects
 Demonstrate its use and identify improvements
ƒ PEVA facilitates review of a project portfolio
 Provides graphical image of project status & forecast
Greater Toronto ISLIG
May 17, 2007
© Douglas Bower 2007
49
Thank You!
Further questions?
Douglas.Bower@Ontario.ca
Office: (416) 326-9604