Oracle ERP HRMS Testing 108 countries Roll-out - Challenges & Best Practices -Sathish Rajamani - P R Shankar Oracle Testing Dec 2011 ©2011, Cognizant 0 Contents 1 1 1 Background & Objectives 2 Application Landscape 3 Scope of Engagement 4 Challenges faced 55 Solution Approach 66 Value adds to client 7 Engagement summary | ©2011, Cognizant Background & Objectives Business Objectives Leading Biopharmaceutical company. Ensure smooth rollout of HCM application World-wide operations Quick time to market Over 50,000 people with presence Standardization of HR processes while catering to local/regional requirements. across all continents Deliver in a complex, environment with business requirements & priorities Company is rolling out Oracle ERP HCM application covering 108 countries to Drive lower cost for rollout | ©2011, Cognizant Objectives Background streamline the HR function 2 2 dynamic demands, QA Objectives Comprehensive overall test strategy for this global roll-out Consistency within quality organization client’s software Maximized value from testing and minimize time spent by business-users Scope of the engagement Engagement Objectives System & System Integration Testing Multi-lingual Testing Interface Testing UAT support Pre-Release Testing Global Release & Defect Management Security Testing Out of scope Performance Testing 3 3 | ©2011, Cognizant Modules in Scope Modules in focus Core HR Recruitment 2010 Assignment Mgmt Benefits & RP 2011 Time mgmt 2012 Payroll 2013 Learning Management 2014 Stock options module 2015 Core HR (Cluster – 0) (For non-Payroll countries) OM , PA, Time Management (Cluster – 1 & 2) OM , PA, Time Management (Cluster – 3 & 4) Rect. Learning Mgmt (Cluster 1 & 2) Payroll (Cluster 1 & 2) Rewarding performance (Cluster 3 & 4) 4 4 | ©2011, Cognizant Rect. Learning Mgmt (Cluster 3 & 4) Payroll (Cluster 4 & 5) Rewarding performance (Cluster 3 & 4) Seasonal events to synchronize 5 5 | ©2011, Cognizant Engagement Summary Dec - Mar’12 WAVE 4 • 50 countries • Recruitment Sep - Nov’11 Aug’11 • Philippines Jul’11 Mid release Apr ‘11 WAVE 2 Mar’11 Jan’11 Oct ‘10 Project Kick off First Release • International Assignment • Test Lab to Employee Testing exhibit capabilities • Interface Testing • Project Started 6 6 WAVE 2 Nov ‘10 | ©2011, Cognizant WAVE 1 Regression Testing • Switzerland • Belgium • Belgium • Italy • Spain • Spain • Turkey • Portugal • Portugal • France WAVE 3 • Malaysia • Indonesia • South Korea • Test Script Preparation • Vietnam • Regression • Hong Kong Testing • New Zealand • Norway • Thailand • Denmark • India • Finland • Singapore • Australia • Talent Suite ( PM, RP Learning) for Wave 1 to 3 Countries • Talent Suite ( PM, Rewards Learning) for all Wave Countries Testing HRMS systems - Challenges Faced Incomplete requirements (specifically local/regional/statutory requirements) Execution in a multi-vendor scenario Complex Implementations - involving multiple business processes, integration with external applications and geographies. Test data preparation: Challenges faced Identification of meaningful data sets for repeat test execution 7 7 Maximum scenario coverage Test Automation: Tool limitations and application dependencies Data Privacy – HR, Payroll , Benefits & other modules End-to-End Test Management Test Planning Metrics – Comprehensive set of Metrics for informed decision making Multi-lingual testing | ©2011, Cognizant Solution – Recommended approach Challenges 8 8 Approach Complex implementations– involving multiple countries and multi-lingual users across an organization. Two pronged approach – Globalization & Localization Engaged translators & localites Business requirements are sometimes missed; business scenarios are not detailed enough Model Driven Approach to Testing Seeding of functional experts and business users within the delivery teams Test data preparation Using our in-house tool to identify optimum number of datasets for data generation Data Privacy issues Data scrambler tool/ tool to mask sensitive fields Automation Challenges Tool-agnostic Framework driven automation Functional competency for testers Augment team with skilled testers along with business-users End to end Test Management Integrate various tools with each other and also with Project planning tool | ©2011, Cognizant Solutions and Processes Challenges & Complexities Solutions approach Internationalization & Localization Testing country specific modules Globalized Test Cases Localization to suit local countries Multi-lingual testing Decisions Involving foreign language testing Commonly used languages across Cultural Multi-lingual testing using Interpreters Localities French (France/Canada/Belgium/ African countries) German (Germany/Switzerland/Austria) Spanish (Different in Spain & different Spanish in Latin American countries) One-off languages (many) Testing with the help of interpreters Creation of Test cases, Test Data, Reports Execution by QA team with oversight by interpreters Test results validation Multi-lingual testing Technical methods Comparing test scripts using English & Application Validation for foreign language characters Operating systems Check and compare with English scripts and results 9 9 | ©2011, Cognizant Check results using error messages obtained from commonly used languages and corresponding error numbers to fix issues. Solution & Processes Challenges & Complexities • Continuous functionality enhancements causing changes to systems landscape. • Managing multiple upstream, downstream applications & interfaces Technical • End-users, Testers and Testers with additional language • Risk based testing • Leveraged Cognizant test accelerators • Data privacy • Data scrambler tool • Resistance to change • Testing Center of Excellence • Ensure compliance to corporate QA standards and philosophy. • Managing multiple sets of global & regional business units. • Managing multiple business partners and acquired entities. • Operating in 16X6 mode and in 9 different time zones. 10 10 • Blend of skilled people • Shorter testing window due to schedule over-run • A number of countries that are new to ERP implementation & has no process or tools to testing. Organizational Solutions approach | ©2011, Cognizant • Automation • Quality measures through business leaders support • Region specific initiatives Value-adds to Client Relationship with Oracle Oracle Platinum partner Expertise on processes, Methodologies and Artefacts Visual modeling and Risk Based Testing enabling tool LN EBPS Cognizant Partnership Solution Accelerators Our Commitment | ©2011, Cognizant Tool agnostic proprietary automation Framework Data sensitivity - Data scrambler tool Testing Capability 11 11 Test repository for delivered functionalities Heterogeneous talent pool of career testers Innovative tools and techniques to provide accelerated testing solutions Committed ‘Release-on-Release’ productivity gains Dedicated Innovation charters & teams Seeding of Business Users in delivery teams to act as product experts at offshore Client Appreciation ''Microsoft Word does not have a font big enough to show the gratitude I have for all of you. In the midst of insurmountable challenges you collectively triumph and continue to deliver quality work on the Oracle ERP HRMS project. Your dedication to this project including sacrificing your nights and weekends is commendable. Thanks to you, this important effort met our objectives as a company as we move forward. Your accomplishment is another great example of how innovative thinking and teamwork by QA can help move our company forward. Thank you for continuing to do an exceptional job! QA Manager 12 12 | ©2011, Cognizant Thank you ©2011, Cognizant 13