Solution
Evaluation
BSA/BSAIS 3
Introduction
• Solution Evaluation describes the tasks to assess the performance of and
value delivered by a solution in use by the enterprise, and to recommend
removal of barriers or constraints that prevent the full realization of the
value.
• This is done when there is the existence of an actual solution, unlike
the evaluation of the value being done during the knowledge areas
Strategy Analysis and Requirements Analysis and Design Definition
Introduction
• Solution Evaluation is done to analyze the actual value being delivered,
identifies limitations which may be preventing value from being realized
and makes recommendations to increase the value of the solution.
• Can be performed during:
o Prototypes or Proofs of Concept
o Pilot or Beta releases
o Operational releases
Introduction
• Tasks includes:
o
o
o
o
o
Measure Solution Performance
Analyze Performance Measures
Assess Solution Limitations
Assess Enterprise Limitations
Recommend Actions to Increase Solution Value
Measure Solution
Performance
• This determines the most appropriate way to assess the performance of a
solution, including how it aligns with enterprise goals and objectives, and
performs the assessment
• Elements:
o Define Solution Performance Measures
o Validate Performance Measures
o Collect Performance Measures
Analyze Performance
Measures
• This examines information regarding the performance of a solution in order to understand
the value it delivers to the enterprise and to stakeholders, and determines whether it is
meeting current business needs
• Elements:
o Solution Performance versus Desired Value
o Risks
o Trends
o Accuracy
o Performance Variances
Assess Solution Limitations
• This investigates issues outside the scope of a solution that may be preventing
the enterprise from realizing the full value that a solution is capable of providing
• This identifies the root causes for under-performing and ineffective solutions and
solution components
• Elements:
o Identify Internal Solution Component Dependencies
o Investigate Solution Problems
o Impact Assessment
Assess Enterprise
Limitations
• This investigates issues outside the scope of a solution that may be preventing
the enterprise from realizing the full value that a solution is capable of providing
• Enterprise limitations include factors such as culture, operations, technical
components, stakeholder interests or reporting structures
• Assessing enterprise limitations identifies root causes and describes how
enterprise factors limit value realization.
Assess Enterprise
Limitations
• Elements:
o Enterprise Culture Assessment
o Stakeholder Impact Analysis
o Organizational Structure Changes
o Operational Assessment
Recommend Actions to
Increase Solution Value
• This identifies and defines actions the enterprise can take to increase the value
that can be delivered by a solution
• Recommendations generally identify how a solution should be replaced, retired, or
enhanced. They may also consider long-term effects and contributions of the
solution to stakeholders.
• These may include recommendations to adjust the organization to allow for
maximum solution performance and value realization.
Recommend Actions to
Increase Solution Value
• Elements:
o Adjust Solution Performance Measures
o Recommendations
Define Solution
Performance Measures
• Business analysts should determine if current performance measures exist or if
methods for capturing them are in place
• Performance measures may be influenced or imposed by third parties such as
solution vendors, government bodies or other regulatory organizations
• Types of measures:
o Quantitative Measures
o Qualitative Measures
Thanks be to God