SAP Test Management
Business Process Change Analyzer Overview
ALM Solution Management, Active Global Support (AGS) , SAP AG
Agenda
1.
Customer Pain Points and SAP Approach
2.
Business Process Change Analyzer – Overview
3.
Business Process Change Analyzer – Preparation
4.
Business Process Change Analyzer – Analysis
© 2011 SAP AG. All rights reserved.
RKT
2
Changing SAP Solutions
Customer pain points*
1
Tests in heterogeneous
system landscapes
2
Change Impact Analysis
 E2E Integration Tests of business processes in system
environments interfacing SAP with non-SAP solutions
 Indentification of critical business processes affected by
software changes
 No risk-based test recommendations
3
Test Data Management
 Test Systems with outdated test data
 Productive System copy is too expensive and rework intensive
 Creation of appropriate test data for manual / auto test cases
 Creation of automated test cases is time consuming and
4
Test
Automation
expensive to maintain via skilled QA specialists
 Automated test cases get damaged by change events and
need time consuming repair by QA Specialist
© 2011 SAP AG. All (*)
rights
reserved.
Pain
point
have been collected via customer survey conducted in the US and Europe
RKT
3
E2E Integration Testing of SAP Solutions
Test Process Embedded in the SAP Application Lifecycle
Type of Change
Test Scope Identification
New SAP
Solution

Implementation of
new SAP Solution
Business Blueprint

Business Blueprint
Design

Solution Configuration
Test Planning
System Setup
Change Impact
Analysis
SAP Solution
Update
SAP Support
Packages

Business Blueprint
Update


SAP Legal Change
Packages




SAP Enhancement
Packages
Identification of
Business Processes
affected by SAP
Solution Updates

Customizing changes


Custom Code
Recommendation of
business processes
for regression tests

Interface changes

Deploy Changes
to Production
Test Execution

Development of
Test Cases

Manual tests

Automated tests
Test Plan setup

Compilation of Test
Packages
Integration
Validation

Assigment of
Testers
Incident
Management

Performance tests

Setup of Test
System

Test status and
progress reporting

Creation of Test
Data

Test sign-off

Deployment of
changes through
transports from
Test to
Production
system

SAP Support
packages, Legal
Change
Packages,
Enhancement
Packages
Note: Test Project Preparation as first step including: test strategy review, definition of test objectives, test tools, test budget, timeline, roles & responsibilities
© 2011 SAP AG. All rights reserved.
RKT
4
SAP Test Management
Options for SAP Customers Based on SAP Solution Manager 7.1
SW Change
Test Scope Identification
Test Planning
Test System Setup
Test Option 1
Test Execution
Test Reporting
Change
Deployment
Manual tests
SAP Solution Manager
Test Workbench
SAP Solution Manager
Business Blueprint
SAP Solution Manager
Test Workbench
SAP Solution Manager
BP Change Analyzer
Automated tests
SAP Solution Manager
Test Workbench, Work Center
BW Reporting
SAP Solution Manager
Test Automation Framework
SAP TDMS
Partner Reports & Dashboards
Certified Interface
eCATT
Micro Focus
Worksoft
HP QTP
Test Option 2
IBM Rational
…
SAP TAO
SAP Solution Manager
Manual and automated tests
Business Blueprint
SAP Quality Center
SAP Quality Center + QTP
SAP Solution Manager
BP Change Analyzer
Test Option 3
SAP Quality Center
SAP TDMS
IBM Rational
SAP Solution Manager
Requirements Mgmt.
IBM Rational
Quality Manager
BP Change Analyzer
SAP TDMS
© 2011 SAP AG. All rights reserved.
Manual tests
IBM Rational
SAP Solution Manager
Project Status Reporting
Quality Manager
Business Blueprint
SAP Solution Manager
SAP Solution Manager
Project Status Reporting
IBM Rational
Automated tests
Quality Manager
IBM Rational
Functional Tester
RKT
5
Agenda
1.
Customer Pain Points and SAP Approach
2.
Business Process Change Analyzer – Overview
3.
Business Process Change Analyzer – Preparation
4.
Business Process Change Analyzer – Analysis
© 2011 SAP AG. All rights reserved.
RKT
6
SAP Solution Manager
Business Process Change Analyzer
SAP Solution updates occur frequently


SAP triggered: Support Packages, Enhancement Packages
Customer triggered: Customizing changes, Custom code development
Customer Pain Point
Which business processes are affected by planned change?
Approach
SAP
Solution
Update
Change Impact Analysis


Test Planning
Identification of business
processes affected by
change

Risk-based Test
Recommendation

© 2011 SAP AG. All rights reserved.
Test Case review
and creation of
missing test cases
Test Execution

Regression Tests

Manual Tests
 Automated
Tests
Test Plan
generation
RKT
7
SAP Solution Manager
Business Process Change Analyzer
Preparation
Order to Cash
Sales Order
Delivery
Goods Issue
Billing
Execution of mission-critical
business processes by Business User
Change Impact
Analysis
Planned Change
“Which critical Business Processes
will be affected by planned changes?”

SAP Support Packs

SAP EhPs

Custom Code

Customizing changes
Risk-based Test Scope
“Can I get a recommendation
for regression tests?”
© 2011 SAP AG. All rights reserved.
Trace Result:
Technical Bill of Material (TBOM)

Code: Function modules, …

UI: Dynpro 1000, …

Tables: Customizing, Master Data
Business Process Change Analyzer
Order to Cash
Sales Order  code change
Delivery
Goods Issue  UI change
Billing
Procure to Pay
Create PO  customizing change
Business Process Change Analyzer

Identification of business processes impacted by
software changes

Support decision making whether planned change shall
be executed

Automatic test plan generation for SAP Test Workbench
RKT
8
Agenda
1.
Customer Pain Points and SAP Approach
2.
Business Process Change Analyzer – Overview
3.
Business Process Change Analyzer – Preparation
4.
Business Process Change Analyzer – Analysis
© 2011 SAP AG. All rights reserved.
RKT
9
Preparation: Business Process Documentation
Alternatives to Create Business Process Documentation
Business Blueprint
Alternatives to setup a Business Blueprint in SAP Solution Manager
1) Activation of SAP Business Content: Business Process Repository (BPR)
2) Manual setup of core business processes
3) Provide a Business Process structure and use Solution Documentation
Assistant (SoDocA) to evaluate which business processes are actually in use
- based on existing SAP Solution Manager usage statistics (Early Watch
Alerts)
4) Business Process content by partner solutions (e.g. ARIS)
© 2011 SAP AG. All rights reserved.
RKT
10
Technical Bill of Material(TBOM) - Concept
SAP ERP
Execute business
Process from
Solution Manager
Order
Header
Order
Details
Save Sales
Order
Background
Trace
TBOM Created
Business Blueprint
© 2011 SAP AG. All rights reserved.
Technical Bill of Materials
RKT
11
Technical Bill of Material (TBOM) - Content
© 2011 SAP AG. All rights reserved.
RKT
12
Preparation: Technical Bill of Material(TBOM)
Alternatives for Manual and Automatic TBOM Creation
Business Blueprint
ERP, CRM etc
Alternatives to create TBOMs in SAP Solution Manager
1) Use eCATT scripts for automatic TBOM creation
2) Use external test automation tools for automatic TBOM creaiton using Test
Automation Framework
3) Manual creation by business users using TBOM work items
4) Manual creation from business blueprint
© 2011 SAP AG. All rights reserved.
RKT
13
Preparation: Automated Scripts for TBOM Creation
Test Automation Framework
Reuse automated test scripts

Customers have invested in creation of automated test scripts

Test scripts executing business processes steps can be reused.
Approach

Use the new Test Automation framework to reuse automated test scripts for TBOM
creaiton
2. Create Test Plan and Test Package
1. Assign Test Configurations
© 2011 SAP AG. All rights reserved.
3. Execute Test Package and create TBOMs automatically
RKT
14
Preparation: TBOMs Created by Business Experts
Work Items
Approach


Quality Expert to assign TBOM
creation work items to Business
Experts
Workflow notifications to easily
react and track work items
Quality Expert
Business Process Expert
Create and Manager Work list
Process work Items
Review work list
Identify missing TBOMs
Notification
Process Work item
Create work list & assign
BPX
Run Business Transaction
Review completed
work items
TBOM is created in
background
Notification
TBOMs created
© 2011 SAP AG. All rights reserved.
Close work item
RKT
15
Agenda
1.
Customer Pain Points and SAP Approach
2.
Business Process Change Analyzer – Overview
3.
Business Process Change Analyzer – Preparation
4.
Business Process Change Analyzer – Analysis
© 2011 SAP AG. All rights reserved.
RKT
16
Change Impact Analysis
Overview
“Which critical Business Processes will be affected by the planned
changes?”
Planned software changes

SAP Support Packages

SAP Enhancement Packages

SAP Legal Change Packages

Custom Code

Customizing changes
?
Business Process Change Analyzer
Business Processes with Trace
Order to Cash
Sales Order  code change
Delivery
Goods Issue  UI change
Billing
Procure to Pay
Create PO  customizing change
Identification of business
processes affected by
software changes
Customer Benefit: Increased insight into effects of software change events
© 2011 SAP AG. All rights reserved.
RKT
17
Change Impact Analysis – BPCA
Use Case 1 : Customizing Changes and Custom Code Developments
Customizing change
Workbench change
Trigger
BPCA
Execution
Work Center “Test Management”: SAP System + Transports + Business Processes
BPCA Analysis
Test Plan
Generation
© 2011 SAP AG. All rights reserved.
BPCA Analysis
Test Plan generated based on
impacted process steps
and assigned test cases
(manual, automated)
RKT
18
Change Impact Analysis – BPCA
Use Case 2 : Analysis of Planned Business Function Activation
EHP
SAP
System
Support
Package
Support
Package
EHP
Support
Package
Support
Package
Time
Business Functions deployed via EHPs
Business Function 01 - inactive
…
Business Function 02 - activated
Business Function nn – inactive – planned activation
SAP Solution Manager
Business Process Change Analyzer (BPCA)
BPCA identifies Business Processes affected
by planned Business Functions usage
before activation
© 2011 SAP AG. All rights reserved.
Business Blueprint
Order to Cash
Sales Order
Create
Sales Order
Delivery
Goods Issue
Goods
Issue
Billing
Procure to Pay
Create Purchase Order
RKT
19
Business Processes Affected by Planned Business
Function Activation
1) BPCA Selection Screen
2) BPCA Business Function Selection: select available, but inactive Business Functions
display BF docu
3) BPCA analysis results: Process Steps impacted by planned Business Function activation
display affected SAP objects
© 2011 SAP AG. All rights reserved.
RKT
20
Change Impact Analysis – BPCA
Use Case 3 : Test Scope Optimization of SAP Support Packages and EHP
Customer Situation

High number of impacted process
steps lead to high number of derived
regression tests

Changed SAP objects will be tested
multiple times
Approach
 Changed
SAP objects shall be tested
only once
 Combination
with customer defined
test strategy, e.g. focus on critical
processes
Customer Benefit: Optimized test scope recommendation based on test effort , test coverage and
business process priority
© 2011 SAP AG. All rights reserved.
RKT
21
Analysis: Test Recommendation
Semi Automatic Test Plan Generation
“Can I get a recommendation for regression
tests?”
Risk-based Test Scope Recommendation
BPCA Analysis: affected Business Processes
Test Workbench
Semi-automatic Test Plan generation via BPCA
Business Blueprint with assigned test cases
Customer Benefit: Semi-automatic Regression Test Plan generation for affected processes
© 2011 SAP AG. All rights reserved.
RKT
22
SAP Solution Manager
Business Process Change Analyzer
BPCA supporting SAP Upgrades
Approach
Customer benefits
 Technical
 Precise
upgrade, e.g. from SAP
R/3 to SAP ERP
 Additional
transports from the
source system to the upgraded
target system
information about affected
business processes after changes
subsequent to technical upgrade
 Accelerated
test scope identification for
regression tests
 BPCA can
identify business
processes affected by these
additional transports and provide
guidance for required regression
testing
© 2011 SAP AG. All rights reserved.
RKT
23
SAP Solution Manager
Business Process Change Analyzer
SAP Solution Manager 7.1
Business Process Change Analyzer
Precise insight

Identification of critical business processes
affected by planned change events
Improved handling of change events

Support for customer’s change committee to
decide on SPs, EhPs or Custom triggered
changes for SAP production system
Risk-based Test Planning

© 2011 SAP AG. All rights reserved.
Recommendation for subsequent regression
tests
RKT
24
BPCA Evaluation Project @ SAP Customer
Project Steps and Required Effort
SAP SolMan
Upgrade

Upgrade to SAP Solution Manager 7.0 EhP1

3 days

SAP Solman agent update in managed system

1 hour
SAP Solution
Documentation

Business process definition on paper

Already available

Analysis of 23 core business processes

30 minutes

Mapping to 3 level business process hierarchy

30 minutes

Lean documentation of 23 core business
processes in SAP Solution Manager Blueprint
with process texts, T-Codes, SAP system

2 hours

BPCA preparation: trace (TBOM) or each
business process via manual process execution

5h for 20 processes*

BPCA analysis for 3 software changes including
customizing and program changes

15 min for each
analysis
SAP Business
Process Change
Analyzer
© 2011 SAP AG. All rights reserved.
*TBOMs were created based on the test case description in a QTP record and play script.
TBOM creation could have been faster if we had the detailed test cases fromRKT
a business user 25
Appendix
SAP Standards for E2E Solution Operations
SAP Standardizes End-to-End Solution Operations
SAP Standard for Test Management
SAP Standards for Solution Operations:
Definition of support processes for
mission-critical operations
Provide Best Practices and Implementation
Roadmaps
Based on a general organizational model
Trainings / Certifications are available
Available for download at
http://service.sap.com/supportstandards
The standards allow to set up best-in-class operations
© 2011 SAP AG. All rights reserved.
RKT
27
© 2011 SAP AG. All rights reserved
No part of this publication may be reproduced or transmitted in any form or for any purpose
without the express permission of SAP AG. The information contained herein may be
changed without prior notice.
Some software products marketed by SAP AG and its distributors contain proprietary
software components of other software vendors.
Microsoft, Windows, Excel, Outlook, and PowerPoint are registered trademarks of Microsoft
Corporation.
IBM, DB2, DB2 Universal Database, System i, System i5, System p, System p5, System x,
System z, System z10, System z9, z10, z9, iSeries, pSeries, xSeries, zSeries, eServer,
z/VM, z/OS, i5/OS, S/390, OS/390, OS/400, AS/400, S/390 Parallel Enterprise Server,
PowerVM, Power Architecture, POWER6+, POWER6, POWER5+, POWER5, POWER,
OpenPower, PowerPC, BatchPipes, BladeCenter, System Storage, GPFS, HACMP,
RETAIN, DB2 Connect, RACF, Redbooks, OS/2, Parallel Sysplex, MVS/ESA, AIX,
Intelligent Miner, WebSphere, Netfinity, Tivoli and Informix are trademarks or registered
trademarks of IBM Corporation.
Linux is the registered trademark of Linus Torvalds in the U.S. and other countries.
Adobe, the Adobe logo, Acrobat, PostScript, and Reader are either trademarks or
registered trademarks of Adobe Systems Incorporated in the United States and/or other
countries.
Oracle is a registered trademark of Oracle Corporation.
UNIX, X/Open, OSF/1, and Motif are registered trademarks of the Open Group.
Citrix, ICA, Program Neighborhood, MetaFrame, WinFrame, VideoFrame, and MultiWin are
trademarks or registered trademarks of Citrix Systems, Inc.
HTML, XML, XHTML and W3C are trademarks or registered trademarks of W3C®, World
Wide Web Consortium, Massachusetts Institute of Technology.
Java is a registered trademark of Sun Microsystems, Inc.
JavaScript is a registered trademark of Sun Microsystems, Inc., used under license for
technology invented and implemented by Netscape.
Business Objects and the Business Objects logo, BusinessObjects, Crystal Reports, Crystal
Decisions, Web Intelligence, Xcelsius, and other Business Objects products and services
mentioned herein as well as their respective logos are trademarks or registered trademarks
of Business Objects Software Ltd. Business Objects is an SAP company.
Sybase and Adaptive Server, iAnywhere, Sybase 365, SQL Anywhere, and other Sybase
products and services mentioned herein as well as their respective logos are trademarks or
registered trademarks of Sybase, Inc. Sybase is an SAP company.
All other product and service names mentioned are the trademarks of their respective
companies. Data contained in this document serves informational purposes only. National
product specifications may vary.
The information in this document is proprietary to SAP. No part of this document may be
reproduced, copied, or transmitted in any form or for any purpose without the express prior
written permission of SAP AG.
This document is a preliminary version and not subject to your license agreement or any
other agreement with SAP. This document contains only intended strategies, developments,
and functionalities of the SAP® product and is not intended to be binding upon SAP to any
particular course of business, product strategy, and/or development. Please note that this
document is subject to change and may be changed by SAP at any time without notice.
SAP assumes no responsibility for errors or omissions in this document. SAP does not
warrant the accuracy or completeness of the information, text, graphics, links, or other items
contained within this material. This document is provided without a warranty of any kind,
either express or implied, including but not limited to the implied warranties of
merchantability, fitness for a particular purpose, or non-infringement.
SAP shall have no liability for damages of any kind including without limitation direct,
special, indirect, or consequential damages that may result from the use of these materials.
This limitation shall not apply in cases of intent or gross negligence.
The statutory liability for personal injury and defective products is not affected. SAP has no
control over the information that you may access through the use of hot links contained in
these materials and does not endorse your use of third-party Web pages nor provide any
warranty whatsoever relating to third-party Web pages.
SAP, R/3, SAP NetWeaver, Duet, PartnerEdge, ByDesign, SAP BusinessObjects Explorer,
StreamWork, and other SAP products and services mentioned herein as well as their
respective logos are trademarks or registered trademarks of SAP AG in Germany and other
countries.
© 2011 SAP AG. All rights reserved.
RKT
28