Business Value and Customer Benefits of Test
Management with SAP Solution Manager 7.1
ALM Solution Management
Disclaimer
This presentation outlines our general product direction and should not be relied on in making a
purchase decision. This presentation is not subject to your license agreement or any other agreement
with SAP. SAP has no obligation to pursue any course of business outlined in this presentation or to
develop or release any functionality mentioned in this presentation. This presentation and SAP's
strategy and possible future developments are subject to change and may be changed by SAP at any
time for any reason without notice. This document is provided without a warranty of any kind, either
express or implied, including but not limited to, the implied warranties of merchantability, fitness for a
particular purpose, or non-infringement. SAP assumes no responsibility for errors or omissions in this
document, except if such damages were caused by SAP intentionally or grossly negligent.
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
2
Optimized Testing with SAP Solution Manager
Testing is necessary. It usually is expensive and time-consuming.
SAP Solution Manager supports you in optimizing your testing
activities.
no
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
3
Test Management
End-to-End Testing of SAP-centric Solutions
Type of Change
Test Scope Identification
New SAP
Solution
SAP Solution
Update
Business Blueprint
Test Planning
Test System Setup
Test Execution
Change
Deployment
Change Impact Analysis
Customer Pain Points
SAP Strategy for Test Management
1 Tests in heterogeneous system landscapes
1.
 SAP Solution Manager acts as central hub to manage
2.
2 Software updates affecting mission-critical
business processes
SAP change events and E2E Integration Testing
 Superior functionality from risk-based test planning,
3.
3 Test system setup and test data management
manual /automated functional and performance testing
4.
4 Effort for creation and maintenance of automated
tests
to status reporting and sign-offs
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
 Integration of Partner Test Suites
Public
4
Typical Customer Questions
Change Manager
What can we do to accelerate our development and
maintenance projects? How can I get more transparency
for planned SAP SP and EHP deployments!
Test Manager
Which mission critical business processes do we need to
test after software changes?
What are modern approaches to accelerate test execution?
Test Center Lead
How can we best automate regression testing?
How can we increase the efficiency of our testers for
manual testing?
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
5
SAP Solution Manager Integrated Model
IT Service Management
IT Portfolio and Project Management
Incident
Business
Requirement
Problem
Portfolio
Enhancement
Service
Request
Minor Release
Urgent Change
Request for
Change
Single
SAP
Source
Solution
of
Truth
Manager
Project
Major Release
Design Mgmt
Business Process Monitoring
and Analytics
Build Mgmt
Build
Execution
Test Mgmt
Test
Execution
Release &
Deployment
Mgmt
Deployment
execution
Change
Monitoring of Systems, Technical
Scenarios and End User Experience
Run SAP like a Factory
Build SAP like a Factory
SAP Solution Manager supports your entire solution (including SAP HANA)
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
6
SAP Test Management
Products and capabilities integrated with SAP Solution Manager 7.1
New SAP
Solution
SAP Solution
Update
Business Blueprint
Test Planning
Test System Setup
Change
Deployment
Test Execution
Change Impact Analysis
Test Option 1
Business Blueprint
Test Management
Test Automation
Test Workbench
Test Automation Framework
CBTA
HP QTP
3rd Party
Test Option 2
BPCA
Test Management
Test Automation
Quality Center
Business Process Testing
SAP TAO
HP QTP
Test Option 3
SAP Connector, Quality Manager, Requirements Composer, Team Concert, ...
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
7
Business Blueprint as foundation for Test
Management
Solution Documentation is the Prerequisite for High Value
Scenarios in SAP Solution Manager
SAP ERP
SAP CRM
DEV
TST
DEV
TST
PRD
PRD
Non-SAP
business
apps
Infrastructure
Many customers struggle with
solution documentation
Take advantage of fast business
process re-documentation
Get the most out of SAP
Solution Manager by adopting
high value scenarios
Business process re-documentation enables you to jump-start solution documentation
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
9
Solution Documentation as an enabler for…
Risk-Based Testing Strategy
Upgrade Preparation / System Consolidation
Standardization / Template Management
Accelerated Innovation
Centralized Documentation Repository
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
10
How to Begin?
Manual creation
Manual (redocumentation)
Upload from external tool
via Interface
Implementation project
using BPR as a source
Documentation as
part of the project
Implementation project
using RDS as a source
RBPD
Business Blueprint
Reverse Business Process Documentation
Automatic redocumentation
Automatic creation based
on ACH components
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
SAP Best Practice
Public
11
Business Blueprint Structure
Structure Levels – Example
Business Blueprint
Structure
Process Example
Demand Planning
Sales Order Processing:
Make/ Assembly To Order
Create Inquiry
Transaction
A business scenario is a set of processes that
define a business task in a comprehensive and
self-contained manner on a macro level
A process is a set of logically related activities
performed to achieve a defined business
outcome
A process step is an elementary activity
performed to accomplish a process
VA11- Create inquiry
VA12- Change inquiry
VA13- Display inquiry
VA15- List Inquiries
V.03- List of incomplete inquiries
Process flow visualized by
component view
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
12
Business Blueprint
Leverage generated Process Step Library to compose End-to-End Business Processes
From Process Step Library ….
Automatic generation of Process Steps for
•
FI
•
SD
•
MM
•
…
•
HR
… to E2E Business Processes
Manual composition of E2E Business Process
Quotation
Sales
Order
Delivery
…
Note: see SAP Solution Manager Wiki for details at http://scn.sap.com/docs/DOC-47361
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
13
Business Blueprint — Generation of Process Step Library
Available via Application “Scope and Effort Analyzer” (SP11) and
ABAP Program SAP Note 2061626 (SP10)
Customer benefits
 Fast start to create Business Blueprint
as starting point for Test Management
 SAP customers can automatically
generate a Process Step Library
including process steps with transaction
codes and reports
 Generation based on usage statistics of
customer PRD systems
 Process Steps includes SAP as well as
custom-developed transactions and
reports
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
14
Best Practices and White Papers
This whitepaper describes best practice cases
for solution documentation in the SAP Solution
Manager Application Lifecycle Management
(ALM). This includes references to test
capabilities, Business Process Monitoring, and
Change Request Management (ChaRM).
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
This document describes the procedures on
how, when and who could perform Compare &
Adjust to control changes done to business
processes and their assignments in different
use cases.
This whitepaper describes ALM possibilities in
SAP Solution Manager for an example of a
major release project (which performs changes
to productively used business processes which
are stored in a solution). This includes
references to test capabilities, Business
Process Monitoring, and Change Request
Management (ChaRM).
Public
15
How to Manage Testing in Hybrid Landscapes?
Document
Business
Processes
Collect &
Assign
Test
Cases
Generate
Test Plan
Assign
TestPackages
to Testers
Execute
Testing
Document
Test
Results
SAP ERP
FI/CO
Central Management of End-to-End Testing
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
16
SAP Solution Manager 7.1
Manual Testing of End to End processes
Manual Testing of E2E Business Processes
with SAP Solution Manager 7.1
Customer benefits
 Efficient setup of test cases for
manual testing
 Easy communication of test
information between test
coordinator and manual testers
 Integration of test data for fast
test execution
 Integration of incident
management for convinient
problem handling and retesting
Best Practice Manual Testing of E2E Business Processes with SAP Solution manager 7.1 – Link: http://scn.sap.com/docs/DOC-51553
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
18
SAP Solution Manager 7.1
Test Automation Framework
Test Automation Framework in SAP Solution Manager
Test Automation Framework
Non-SAP
Test Design
Test Execution
Test Result Analysis
Accelerated Repair
 Seamless integration
between SAP Solution
Manager and test tools
from SAP and Partners
 Start of automated tests
 View test results from
 Workflow between Tester
manual and automated
and Test Engineer to
tests in one environment
trigger test case repair
 Status and progress
reports
 Analyze problems and
perform repair activities
 Integrated partner reports
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
20
Building Automated Tests Using the Test Automation Framework
SAP Solution Manager 7.1
Test Configuration
Business Process
Test Script
CBTA, eCATT
HP QTP
Test Data
System under Test
Order Type
Customer
Product
OR
C1000
P-100
OR
C2000
P-200
Certify
Other ISV test
automation tools
Test Data Container
SAP customers have a choice of test automation tools integrated with SAP Solution
Manager 7.1 through the Test Automation Framework
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
21
Test Automation Framework
with SAP Solution Manager 7.1
Customer benefits
 SAP customers can choose the tool they
want to use for test automation from SAP
as well as certified partners
Test Design
 Business Analysts or Test Engineers can
build automated functional tests without
technical detail know-how
Test Execution
 One integrated environment provided by
SAP Solution Manager to manage all tasks
to build, run and analyze test automation
Non-SAP
Test Result Analysis
Accelerated Repair
How-To Guide Test Automation Framework: https://service.sap.com/~sapidb/011000358700000069232014E.PDF
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
22
SAP Solution Manager 7.1
Component Based Test Automation (CBTA)
End-to-End Regression Tests across SAP and non-SAP
Challenge: How IT can perform regression testing with zero business involvement and automate execution
for major and minor releases?
Change Impact Analysis
Release Blueprint
Test Planning
Test System Setup
Change
Deployment
Test Execution
UAT, IntT
Test Workbench
BPCA
Test Automation Framework
CBTA
Regression
Test
HP QTP
Automated Repair for Widespread SAP UIs
Record & Playback for non SAP UIs
String together E2E Tests crossing SAP and non SAP
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
24
Test Management
Component-Based Test Automation (CBTA) overview
Functionality:
– CBTA test scripts are composed by re-using SAP delivered
default components and customer specific screen components
– Fast repair of damaged test scripts possible
– CBTA Test Creation Wizard for test script creation by Business
Analysts
– Supported UI technologies: SAP GUI, SAP CRM Web Client,
ABAP Web Dynpro (SP10), Java Web Dynpro (SP10), SAP
Portal (SP10), SAP GUI for HTML (SP10), BSP (SP10),
HTMLB (SP10) and SAP UI 5 (SP Stack 12)
Business Analyst
CBTA – Test Creation Wizard
Business
Process
Quotation
Sales Order
Delivery
CBTA – process flow analysis
Availability:
– CBTA delivered with SAP Solution Manager 7.1 SP07
– License: included in SAP Enterprise Support contract
CBTA – Test Components and Test Script
CBTA enables your Business Analysts to build component-based test scripts which are highly flexible
and easy to maintain
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
25
Test Management in SP Stack 12
CBTA now supports SAP UI5 technologies
Record automated test scripts against SAP UI5 applications.
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
View results in the test log.
Public
26
CBTA supported UIs
UI Technologies
SAP GUI
SolMan 7.1 SP07
Release: Nov 2012

SolMan 7.1 SP10
Release: Nov 2013

SolMan 7.1 SP12
Release: July 2014

CRM WebClient



WD-ABAP


WD-JAVA


SAP GUI for HTML


Business Server Pages


SAP UI5

CBTA supports automation of 7 UI technologies in SAP Solution Manager 7.1 SP12
using default and screen components
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
27
Component-based Test Automation (CBTA)
Test Automation of E2E Business Processes using SAP Solution Manager - CBTA
Business Process “Order to Cash”
Quotation
Component-based Test Automation (CBTA)
Business Analyst executes business
transaction via CBTA
Sales Order
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Goods Issue
Billing
Test Composition Environment (TCE)
Attributes
•
•
Business Transaction
Systems under Test
Parameters
•
•
Parameters for test data inputs
Dynamic handover between scripts
Script
Components
•
•
SAP delivered test components
On the fly generated components
Test Data
•
•
Data defined in Test Data Container
Test Data Assignment Wizard
CBTA creates test script based on test
components during execution
Delivery
Public
28
Creation and Maintenance of automated tests with SAP Solution
Manager 7.1
Test Composition Environment (TCE)
 TCE provides all functions to create and maintain
CBTA test scripts and Test Configurations
 Features
 Attributes for Test Configuration and Test Scripts
 Maintenance and composition of CBTA test scripts
 Parameter handling
 Composition of E2E process tests including parameter handover
 Test data assignment
 Availability: with SAP Solution Manager 7.1 SP07
 License: included in SAP Enterprise Support contract
TCE enables your Business Analysts and Test Engineers to create and maintain your
automated regression tests in a convenient way
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
29
New
SP10
Composition of E2E Business Process Tests
Automated E2E business process tests
 Ability to compose E2E tests using Test
Composition Environment (TCE) of SAP Solution
Manager
 … in combination with test automation tools
integrated via Test Automation Framework
 TCE: html-based maintenance application for
automated tests
 Test automation tools: CBTA, eCATT, HP QTP,
WS Certify, …
Sales
Order
Delivery
Goods
Issue
Billing
Parameter handover is managed by TCE
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Example 1
CBTA 1
CBTA 2
CBTA 3
CBTA 4
Example 2
HP QTP 1
HP QTP 2
HP QTP 3
HP QTP 4
Example 3
HP QTP 1
CBTA 2
CBTA 3
eCATT 4
Public
30
Test Automation Framework in SAP Solution Manager 7.1
Test execution
Tester Worklist
in Workcenter Test Management
Test Script
SAP CBTA / HP QTP
5
1
Test results and logs
User starts test execution
Test Configuration
Test Script
Test Data
System Data
3
Test execution: handover of
Test Script + Test Data + SUT info
4
Logon and automated
business process execuction
System under Test
2
Test data selection
TDC
Non SAP
Test Data Container (TDC)
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
31
CBTA – test execution log
Header
Execution steps
Screenshot
Execution steps with
pass / failure
information
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
32
Component Based Test Automation (CBTA)
with SAP Solution Manager 7.1
Customer benefits
 User-friendly and robust test automation
application from SAP for SAP
Business Analyst
 Supports all important SAP user-interface
technologies
 Very easy to use and thus suitable to
create automated test cases by Business
Analysts with further refinement by test
engineers
 No additional license fees for SAP
customers with SAP Enterprise Support
Execution of business transaction
Business
Process
Quotation
Sales Order
Delivery
CBTA Test Script and components
CBTA Content: http://wiki.scn.sap.com/wiki/display/SM/SAP+Solution+Manager+WIKI+-+Test+Management
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
33
SAP Solution Manager 7.1
Test Data Management and Provisioning
Test Data Management and Test Data Provisioning
Customer Challenges
•1 Data refresh of Q- and Pre-PRD systems with
data from PRD system
•2 Provisioning of test data for manual testers and
automated test scripts
data refresh
SAP Approach
1. Alt 1: Automated full system copy of configuration data, master data and transactional data from
PRD system into systems with test activities w/o data scrambling (SAP LVM).
Alt 2: Full copy of configuration and master data and partial copy of transactional data with data
scrambling (SAP TDMS)
2. Definition of test data structure based on input parameters of test scripts, planning of test data
iterations and assignment to test scripts (SAP Solution Manager - Test Data Container)
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
35
Test Data Management
with SAP TDMS or SAP LVM
Customer benefits
 Fast and convenient refresh of nonproductive systems with data from production
systems
 SAP TDMS: full copy of configuration and
master data and partial copy of transactional
data with data scrambling
 SAP LVM: Automated full system copy of
configuration data, master data and
transactional data from PRD system into
systems with test activities w/o data
scrambling
Test activities
Quality
Assurance 1
Quality
Assurance 2
Productive use
Pre-Production
Production
data refresh
SAP Solution Manager Wiki: http://scn.sap.com/docs/DOC-47361  Test Management
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
36
Test Data Container (TDC) for entire Order to Cash process
Test Data included in TDC
•
grouped by Process Steps: Quotation, Sales Order, Outbound Delivery, Transfer Order, Goods Issue, Billing
•
Additional result column for each business transaction to enter posted document number
Quotation
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Sales Order Delivery
Public
37
Test Data Provisioning
with SAP Solution Manager 7.1
Customer benefits
 Test Data – required for manual tests and
automated tests – can be stored and provided
via Test Data Container (TDC) of SAP Solution
Manager
Test Data Provisioning
test data entry
test data upload
SAP Partner Solution*
test data planning
 TDC can provide test data for single tests and
E2E process tests
 Business Process Experts and Test Engineers
can enter suitable test data manually in TDC
TDC
Test Data Container (TDC)
 MS Excel file uploads allow fast data entry
 SAP Partner applications allow comprehensive
test data planning and test data provisioning
SAP Solution Manager Wiki: http://scn.sap.com/docs/DOC-47361  Test Management
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Please contact Sebastian Geissler at sebastian.geissler@ sap.com
Public
38
SAP Solution Manager 7.1
Business Process Change Analyzer (BPCA)
Only Test what has Changed
SAP Solution Manager’s Business Process Change Analyzer
Planned Change Event
Affected Business Processes?
Scope for Regression Test?
ABAP Code Change
Customizing Change
Test
Effort
Business Scenario 1.. n
Business Process 1
Business Process Step 1
Application of SAP Note
Business Process Step 2
Business Process Step 3
Application of SAP Support
Package
Business Process 2.. n
Business Process Step 1
Business Process Step 2
Application of SAP
Enhancement Package
Test Coverage
Business Process Step 3..
Activation of SAP Business
Function
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
40
Business Process Change Analyzer – how it works
Preparation
Business Blueprint
Trace to identify objects by process
BPCA Trace Result (TBOM)
Manual execution of process step
Automated
Change Impact Analysis
CBTA, SAP TAO, QTP, Certify..
BPCA use cases
1) Customizing changes
“Which critical Business Processes
will be affected by planned changes?”
2) Custom code development
3) Business Function activation
4) SAP SP and EHP deployment
Risk-based Test Scope Identification
“Can I get a recommendation
for regression tests?”
© 2015 SAP SE or an SAP affiliate company. All rights reserved.

Transactions

ABAP Code: Function modules, …

UI: Dynpro 1000, …

Tables: Customizing, Master Data
BPCA Change Impact Analysis
Order to Cash
Sales Order  code change
Delivery
Goods Issue  UI change
Billing
Procure to Pay
Create PO  customizing change
BPCA Test Scope Optimization and Test Plan Generation

Identification risk-based test scope based on affected process steps

Test Scope Optimization

Semi-automatic test plan generation (automateded for Test Option 1)
Public
41
Test Scope Optimization in SAP Solution Manager 7.1 Stack 10
New functionality
 New graphical summary screen showing
the result summary of test scope
optimization
 Test scope recommendations based on
the test scope optimization results in
further optimization possibility
 Improved performance of analysis run
and test scope optimization to handle
large change events
Reduce test efforts by focusing on relevant test cases
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
42
Only Test what has Changed
Risk based testing
Challenge: How to reduce regression test scope to an acceptable level, balancing risk to production
system against test effort?
Customer Case:
• Customer applies HCM Legal Change Packs quarterly
• Testing window is limited to 2 to 3 weeks
• Today 2500 scripts are used for regression testing
Strategy:
Use Business Process Change Analyzer to first focus testing
on the changed business processes and then to reduce efforts
by using risk-based test optimization approach.
Result of Test Scope Optimization
• 100% test scope - 1825 scripts “in scope”
• 99% test scope
- 76 scripts “in scope”
• 90% test scope
- 38 scripts “in scope”
Test Coverage
Test Effort
• Customer chose 99% test coverage with no impact to production
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
43
Optimized Testing
Through Scope and Effort Optimization and Test Automation
Business process change analyzer
 Test scope reduction of 30%-50% at 100% test
coverage
 Accelerated, risk-based test-scope identification for
regression tests
Test automation framework
Business Processes
Certified
interface
Third-party
Test automation
tools
 Smooth integration with best-of-breed test tools
 Scheduled execution of unattended automated tests – also
for remote locations
 Change impact analysis and work flow to trigger repair
activities for damaged test cases
Test capabilities provided by SAP Solution Manager allow you to reduce cost and number of
errors in a production system while improving the test coverage.
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
44
Business Process Change Analyzer
Automatic TBOM Generation




ABAP call hierarchy
In the past, dynamic TBOMs were created by
recording user actions or existing test scripts with
substantial effort
A new type of TBOM is introduced in SAP
Solution Manager 7.1 SP10 – “Semi-Dynamic
TBOMs”
Start
Transa
ction
Dynamic
TBOM
Semi-dynamic TBOMs can be created automatically
Level 1
Level 2
Level 3
Level 4
Semi-Dynamic
TBOM
Level
nn
Object
Object
Object
Object
Object
Object
Object
Object
Object
Object
Object
Object
Object
Object
Object
Object
Object
Object
Object
Object
Object
Object
Object
Object
Object
Object
Object
A background job can be triggered to perform a
source code scan on managed system and filter out
unused objects (based on Usage and Procedure
Logging – UPL data)
T-Code
Object
Object
…
Object
Object
Object
Object
Object
Object
Object
Object
Object
Object
Object
Object
Object
Ease automated regression testing by
reducing the effort for test script creation
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
45
Usage and Procedure Logging (UPL)
The New Way – Getting the Real System Usage to Create TBOMs
 UPL is a kernel-based logging technology providing runtime usage
information of ABAP procedure units like methods, function modules,
subroutines and much more …
Execute
business
transaction
1
Load ABAP
procedure
units
SAP Kernel
2
End User
 UPL complements the standard ST03N workload statistics of ABAP
executables
 UPL provides 100% reliable usage
analysis without measurable
performance impact
 UPL is available as of SAP NetWeaver
7.01 SP10 with Kernel 720 Patch 94
 BPCA uses UPL to identify used ABAP
procedure units and to create semidynamic TBOMs
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Evaluate usage
Development
Manager
4
Log usage
3
UPL
Public
46
Business Process Change Analyzer (BPCA)
Customer benefits
 Identification of critical business
processes affected by planned change
events
 Support for customer’s change
committee to decide on SPs, EhPs or
Custom triggered changes for SAP
production systems
 Test Scope Optimization: identification
of test scope with significant potential
for test scope reduction
Getting Started with BPCA - https://service.sap.com/~sapidb/012002523100009538962014E.PDF
SAP Note 1875064: BPCA - Known supported and unsupported Object Types
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
47
SAP Solution Manager 7.1
Scope and Effort Analyzer (SEA)
Customer requirements for improved planning of EHP projects
1. Transparency about change impact of EHP
deployments before physical installation
2. Reliable effort estimation for major development
adjustments and test activities
3. Tailored impact analysis for custom code and
modifications
4. Test scope optimization with significant reduced
test scope and test effort
5. Test plan for impacted business processes
including custom code and modifications
6. Simple guided tool based procedure without
significant preparation effort
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
49
Scope and Effort Analyzer (SEA)
New application with SAP Solution Manager 7.1 SP11
Customer benefits
 Early upgrade information before
deployment of SAP SP / EHP
 No additional usage or license costs for
customers with SAP Enterprise Support
contract
 Dashboards showing calculated efforts
for required ABAP code adjustments
and regression tests
 Detailed analysis to enable project
preparation for Development / Test
Managers
SEA Content – http://service.sap.com/sea
Getting Started
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
How-To Guide
Public
50
SAP Solution Manager - Scope and Effort Analyzer
Available with Stack 11
Customer
1 SAP Solution Manager
3
http://service.sap.com/sea
•
User enters system for
planned change deployment
•
User enters target SP / EHP
•
Information sent to SAP
SAP Solution Manager
•
Usage statistics
•
Tailored impact analysis for
custom code / modifications
•
Effort calculation
•
Business Blueprint generation
•
Test Scope and Effort Optimization
•
Recommendations
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
2 SAP Support Backbone
4
•
Calculation of SAP objects
(Bill of Material) for target
Enhancement Package
•
SAP sends BOM back to
SAP Solution Manager
Customer
Project Team
•
Result review
through Fact Sheet
•
Assessment of
analysis details
•
Parameter
variation for result
optimization
Public
51
Process Step Library and E2E Process Library
New in SAP Solution Manager 7.1 Stack 11: Automatic creation of ACH-based process step library.
Generate Process
Step Library
Create Processes in
E2E area manually
• Use the
generation report
to automatically
create an ACHbased process
step library
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
• Manually create
business
processes in your
solution
documentation
Copy Process steps
from PS library to
E2E
• Copy the
necessary steps
from the process
step library to
relevant
processes in the
E2E section
Refinement
• Disband shortcuts
Public
52
Benefits of Scope and Effort Analyzer
Early upgrade change impact analysis without physical EHP/SP installation
Reliable project effort estimation for required adjustment and test activities
Test Scope Optimization with significant reduced test scope and test effort
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
53
Test Management with Test Option 2
SAP Quality Center by HP
SAP TAO
Test Management
Products and capabilities of Test Option 2 with SAP Solution Manager 7.1
Business Blueprint
Test Planning
Test System Setup
Test Execution
Reporting
Change
Deployment
Change Impact Analysis
Quality Center
• Requirement
• Test Plan
• Business Process Tests
Solution Manager
Business Blueprint
• Process documentation
• Business requirements
Adapter
• Blueprint
Solution Manager
Change Analyzer
• Change Impact Analysis
• Test Scope Optimization
Quality Center
• Test Lab
• Sprinter
• QTP
• Defect
• Defects
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
/ test results
•
SAP Test Acceleration
and Optimization
Optimized SAP test scripts
•
Accelerated maintenance
•
SAP Test Data
MigrationServer
Setup of lean test systems
•
Test data provisioning
LoadRunner
•
Load and
performance testing
Public
55
SAP Quality Center by HP
Design Time: Activities to create Test Requirements and manual Test Scripts
3
1
Create Test Requirements
4
Create Test Scripts
Select Business Blueprint
2
Transfer
Assign to
SAP SolMan Adapter
SAP Solution Manager
SAP Quality Center by HP
SAP Quality Center by HP
Consists of
5 Define Test Set
5 Assign to Tester
SAP Quality Center by HP
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
56
SAP Quality Center by HP
Run Time: Test execution of manual tests
2 Open Test Set
6
3
1
Create Defect
Read Test Script
Email
notification
Test Coordinator
Tester
5
4
Execute test
Enter test results
7 Auto-create Incident
8 Solve Incident
Configurator
/ Developer
Test System
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
SAP Solution Manager– ITSM
Public
57
New Approach for manual Testing: HP Sprinter
 Floating windows with test step
guidance for Tester
 Smart Defects
 Recording of User Actions (list) and
Story Board (screenshots)
 Full integration with Quality Center
for Test Script selection and results
 Data injection –
partially working for SAPGUI
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
58
SAP TAO
Test Automation of Business Processes using SAP TAO
Business Scenario “Order to Cash”
Quotation
Sales Order
SAP TAO Process Flow Analyzer
Delivery
Goods Issue
Billing
SAP Quality Center by HP
Test Components for each
subscreen with parameters for
all fields
Business Analyst executes
business transaction from SAP TAO
upload
Test Case* composed out of Test
Components with parameters for
all input fields
File with Test Data for each input
parameter
(*) Note: Further test case refinement might be needed e.g. Test engineer may add more validation steps and
consolidate the test case for performance improvement.
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
59
SAP TAO
Test Automation of E2E Business Processes
SAP TAO test scripts

Test script variants can be built easily via additional Test Components, Flows and Test Data

Scenario tests can be built easily through composition of the appropriate single test
Quotation
Variant 1
Sales Order V1
C1
C2
Delivery
Goods Issue
Billing
C3
Test data
Sales Order V2
Quotation
Variant 2
C1
C2
C3
Delivery
Goods Issue
Billing
C4
Test data
SAP TAO
Test Components
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
60
SAP TAO
Test Execution with SAP TAO built test scripts
SAP Quality Center by HP
Test Script execution
Test data file
During test execution test data
is entered into input fields of
the SAP business process
SAP Test System
Test results
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Iteration
Result
#1
Passed
#2
Passed
#3
Failed
Public
61
New SAP TAO release 3.0
New functionality of SAP TAO 3.0
 Enables test automation of SAP CRM Web client for Sales, Service
and Marketing pillars
 Supports inspection of SAP CRM screens
 Supports consolidation of SAP CRM Web Client test scripts
Availability
 Now
 Note: SAP TAO 2.0 standard maintenance ends in Dec 2013
SAP TAO 3.0 enables Business Analysts and Test Engineers to create and maintain
automated tests for CRM Web Client and SAP GUI based business processes
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
62
SAP TAO 3.0: automated test case creation
for SAP CRM web client
1
CRM Web Client Executable
2 Process Flow Analysis
3 Test Script in SAP QC
4 Adjust and Validate the Test
Script
Test components
 Add CRM Web Client
application
 Search for Business Role
and Logical Link while
adding CRM application
 Record SAP CRM
application and create a
Process Flow Analysis
 Insert validation steps
while recording a process
flow
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Data file
 Generate Test Script in SAP
Quality Center
 Screen components are
automatically created
 Fine tune the script created
by SAP TAO
 Execute the script once to
validate it
 Data file is created and
linked with test script
Public
63
SAP TAO
Customer Benefits
Test Coverage
Accelerated Approach
 More business processes can be tested in a testing
cycle
 Fast, convenient and semi-automatic way to generate
automated test cases
 Defects are caught earlier in test system before
they move to production system
 Simple, easy and streamlined approach for
maintenance of test cases
Costs
Tangible Benefits
 Save cost by engaging less manual testers
 Up to 40% reduction in testing effort.
 Fast ROI with in 2-3 test cycles
 Up to 30% savings in maintenance of test cases
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
64
Summary
Test Management – Information Sources
Test Management
Presentation and Whitepapers
http://service.sap.com/testing
Best Practices
Application Lifecycle Management (ALM)
SCN – search in space
ALM and SAP Solution
Manager
http://service.sap.com/alm
Testing SAP Solutions
SAP Press
Wiki for SAP Solution Manager
http://scn.sap.com/docs/DOC-47361
Classroom
Training E2E220
Remote Service
Expert Guided Implementation (EGI)
http://service.sap.com/alm-services
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Professional Services
www.sap.com/services/testing
Public
66
Wiki for SAP Solution Manager 7.1
Access: http://scn.sap.com/docs/DOC-47361
Valuable information
•
Overview and detail presentations
•
How-To Guides, training materials
•
Target audience:
customers and consultants
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
67
Test Management – Best Practices
Best Practice Title
SCN Link
Best Practice: Regression Testing SAP-centric
Business Processes
http://scn.sap.com/docs/DOC-14714
Best Practice: Manual Testing of E2E Business
Processes with SAP Solution Manager 7.1
http://scn.sap.com/docs/DOC-51553
Test Automation with SAP Solution Manager 7.1 and
HP QTP
http://scn.sap.com/docs/DOC-33752
Best Practice: Test Management for SAP Business
Suite on SAP HANA Migration Projects
http://scn.sap.com/docs/DOC-46740
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
68
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP SE or an
SAP affiliate company.
SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP SE
(or an SAP affiliate company) in Germany and other countries. Please see http://global12.sap.com/corporate-en/legal/copyright/index.epx for additional trademark
information and notices.
Some software products marketed by SAP SE and its distributors contain proprietary software components of other software vendors.
National product specifications may vary.
These materials are provided by SAP SE or an SAP affiliate company for informational purposes only, without representation or warranty of any kind, and SAP SE or its
affiliated companies shall not be liable for errors or omissions with respect to the materials. The only warranties for SAP SE or
SAP affiliate company products and services are those that are set forth in the express warranty statements accompanying such products and services, if any. Nothing
herein should be construed as constituting an additional warranty.
In particular, SAP SE or its affiliated companies have no obligation to pursue any course of business outlined in this document or any related presentation, or to develop or
release any functionality mentioned therein. This document, or any related presentation, and SAP SE’s or its affiliated companies’ strategy and possible future
developments, products, and/or platform directions and functionality are all subject to change and may be changed by SAP SE or its affiliated companies at any time for
any reason without notice. The information in this document is not a commitment, promise, or legal obligation to deliver any material, code, or functionality. All forwardlooking statements are subject to various risks and uncertainties that could cause actual results to differ materially from expectations. Readers are cautioned not to place
undue reliance on these forward-looking statements, which speak only as of their dates, and they should not be relied upon in making purchasing decisions.
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
Public
69