Oracle® E-Business Suite Testing:
How to Get Your Business Users On-Board
Amir Farhi
Director, Product Marketing
Copyright © Panaya
Agenda
• The challenges IT faces when testing Oracle EBS changes
• Improving cooperation by business users in the testing process
• SaaS accelerated manual testing technology
2
Copyright © Panaya
Panaya at a Glance
Leader in Oracle EBS & SAP SaaS-based Testing and Impact
Analysis Automation software
Serving customers in 60+ countries
1,000+ enterprise customers, 2,000+ successful ERP projects
3,000+ ERP systems analyzed
500,000+ test cases in past year
3
Copyright © Panaya
System
Consolidation
Constant Need for Change
Patches
Chart of Account
Changes
Functional
Enhancements
Upgrades
Mergers &
Acquisitions
Business-Driven
IT-Driven
Infrastructure
Changes
Migrations
New
Business
Processes
Regulations
4
Copyright © Panaya
Panaya Quality Management Cloud
Scope & Accelerate changes in Enterprise Applications, Cutting Cost & Risk
Change Impact Simulation
Oracle R12 upgrades, point-release upgrades
Oracle patches
Chart-of-Account (CoA) changes
Custom-code releases
Code Remediation
Collaborative Test Management & Test Acceleration
Automated test script creation
Automated documentation and test evidence
Accelerated manual testing
ALM integration (HPQC, Oracle ATS)
“Cloud Wisdom” – transforming common practices to best practices
5
Copyright © Panaya
Panaya on Oracle.com
http://www.oracle.com/us/products/applications/ebusiness/ebs-upgrade/index.html#cost
6
Copyright © Panaya
The Change Process, Today
IT Group
Initiate:
Business Users
IT Requirement
Plan:
Prepare Spec
& Scope
Build:
Develop
Business Requirement
Please
test
Please test
Test:
Please test
IT Manual
Testing
Automatic
Testing
Off-Shore
Testing
Limited knowledge of real-life
business processes…
Which constantly change!
7
Copyright © Panaya
Please
test
Please
test
Please
test
Please test
Please test
Please
test
Please
test
Please test
Please
test
Please
test test
Please
Please test
The Constraints of Change, Today
Compliance
Methodologies
Sponsor
8
Copyright © Panaya
9
Copyright © Panaya
Manual & Automated Testing
•
•
10
Unit testing, functional testing,
user acceptance testing,
regression testing
Performed by
functional experts
& business key users
Manual
Testing
Automated
Testing
Copyright © Panaya
•
Regression testing
of static, critical
business processes
•
Unattended execution
(“lights-out”)
•
Developed by test
engineers
Performed by HP
QTP, OATS, …
Panaya Manages & Accelerates Manual Testing
•
•
Unit testing, functional testing,
user acceptance testing,
regression testing
Performed by
functional experts
& business key users
Managed &
Accelerated
by Panaya
11
Accelerated
Manual
Testing
Automated
Testing
Copyright © Panaya
•
Regression testing
of static, critical
business processes
•
Unattended execution
(“lights-out”)
•
Developed by test
engineers
Performed by HP
QTP, OATS, …
Competing Forces of Testing
Cost
• Redundant testing
• Creating & maintaining test scenarios
• Executing & documenting manual tests
Quality
& Risk
•
•
•
•
Scoping what to test based on risk
Capturing test evidence for auditing
Eliminating critical production issues
Test process governance
12
Time to
Market
• Testing cycles take too long
• Capturing business process knowhow
• Lack of collaboration with the business
for test execution
Copyright © Panaya
ERP Manual Testing Challenges
52%
Capturing business process knowledge
43%
Maintaining Test Documentation
Creating Test Documentation
41%
Test Execution
38%
Scoping & prioritizing the test plan
38%
20%
Test project management
Passing Audits
6%
Source: Panaya ERP survey
13
Copyright © Panaya
Customers’ Testing Methodologies
20%
Ad-Hoc
30%
Scripted
50%
Organized
14
Copyright © Panaya
Testing Methodologies Characteristics
Ad-hoc
•
•
•
•
•
15
Oracle EBS system is stable, minimal changes
Use email to communicate testing tasks
No test catalog (no test scenarios)
Test runs need not be documented
No test automation
Copyright © Panaya
How Panaya Addresses Your Testing Needs
Ad-hoc
•
•
•
•
•
16
Visibility into testing progress
Visibility into business process testing coverage
Improved test run documentation
Improved defect management
Specific implementation methodology: onboarding &
ongoing
Copyright © Panaya
Testing Methodologies Characteristics
Organized
• Excel to manage & track testing process
• Rely on Business Process owners knowledge (SME) to
execute the test
• Test scenarios documented up to the transaction level in
Word/Excel
• Low use of test automation
17
Copyright © Panaya
How Panaya Addresses Your Testing Needs
Organized
•
•
•
•
•
18
Easily manage, assign, and track testing activities
Automate test evidence documentation
Manage defects
Building block for regression test suite
Specific implementation methodology: onboarding &
ongoing
Copyright © Panaya
Testing Methodologies Characteristics
Scripted
• Excel to manage & track testing process
• Tests executed by non-SME (QA Team, Offshore or System
Integrator)
• Test scenarios documented to the screen/field level in
Word/Excel
• Likely to use test automation
19
Copyright © Panaya
How Panaya Addresses Your Testing Needs
Scripted
• Easily manage, assign, and track testing activities
• Accelerate test scenario creation, test execution, defect
reporting, and test evidence documentation
• Manage defects
• Building block for regression test suite
• Specific implementation methodology: onboarding & ongoing
20
Copyright © Panaya
Panaya Collaborate Testing - Demo
21
Copyright © Panaya
Recording Test Scenarios
Click to start recording
your test scenario
23
Copyright © Panaya
Follow Your Business Process
24
Copyright © Panaya
Panaya Automatically Generates a Test Script
25
Copyright © Panaya
Tailor Test Script Details
Add manual steps or
external systems
Attach documents
(e.g. test variations,
test data)
Add comments and
special instructions
Append more
business functions
26
Copyright © Panaya
Easily Export to Microsoft® Word or Excel
27
Copyright © Panaya
Manage Test Catalog
28
Copyright © Panaya
Manage Test Catalog Details
29
Copyright © Panaya
Integrated Test Coverage Assessment
(via automated impact analysis simulation)
1. Panaya impact analysis
identifies required unit
tests for project
3. Adjust testing scope
- risk of failure (for
upgrade or patching)
- business usage
2. Panaya code analysis automatically
identifies which functional tests are
covering those unit tests
30
Copyright © Panaya
Integrated Test Coverage Assessment
(via automated impact analysis simulation)
1. Panaya impact analysis
identifies project code
corrections impacting each
functional scenario
31
2. Panaya marks functional scenario as “not
ready to test” due to pending project code
corrections. When code corrections
completed, status changes to “ready to
test”, and tester is notified.
Copyright © Panaya
Accelerated Functional Test Execution
Select scenario
Open test task
Assign test run
to user
32
Copyright © Panaya
Automated Test Evidence Recording
Tester’s task list
Initiate test evidence recorder
Record Oracle session
33
Copyright © Panaya
Functional Test Execution
Manage defects & re-test
Report test failure
&
Create defect
Assign and manage
defect
Re-test and record evidence
34
Copyright © Panaya
View test evidence
Functional Test Execution
Adhoc/Instant Testing
Assign Adhoc Test
Tester’s task list
Initiate test evidence
recorder
Record Oracle
session
35
Copyright © Panaya
Monitor Test Progress
36
Copyright © Panaya
Panaya myTest
Browserless Desktop Web Application
Tasks are fed to Business User desktops
Testers don’t need to go to ALM or Panaya portal
37
Copyright © Panaya
Running a Scripted Test
IT or Business User is assigned
a task from ALM
User selects Manual Run &
Document
Original Script is presented
User completes testing
(Panaya will sync with ALM)
38
Copyright © Panaya
Panaya also works with other ALMs
(HP Quality Center or Oracle ATS)
Use Panaya Test Builder to build your functional test scripts
automatically creates HP/OATS test designs, with step-by-step details
HPQC/OATS manages test results and defect management
39
Copyright © Panaya
Key Takeaways
Even with Test Automation, Manual Testing still dominates 
Accelerate the process!
You rely on your users to help with the testing 
Make it easy for them!
SaaS is easy to start; easy to deploy and easy to manage 
Test drive Panaya’s Collaborative Manual Testing!
40
Copyright © Panaya
Tha
k you!
info@panaya.com
41
Copyright © Panaya