Business Assurance – Oracle Testing Capabilities September 18, 2014 Copyright © 2014 HCL Technologies Limited | www.hcltech.com Agenda 2 1 Business Assurance & Testing Services Overview 2 Our Oracle Testing Proposition & Methodology 3 Success Stories Copyright © 2014 HCL Technologies Limited | www.hcltech.com HCL BATS – Snapshot What Makes Us Different Proactive Quality over Reactive Testing Outcome-based Managed Quality Services Relationship Beyond the Contract Partner Synergies 200+ Clients served worldwide 10000+ Professional testers worldwide Partner World For Software Global System Integrator Strategic Service Providers CA-LISA partnership Global Framework Agreement Tool partner Analyst Speak 2014 Leader in Magic Quadrant for testing services globally and a Tier – 1 testing service provider $400+ Mn revenues earned 40+ Million dollar clients 20 Testing Global Delivery centers 3 Microsoft Gold Certified Partner Global Strategic Service Provider ‘HCL's strong focus and experience in testing services exhibited by its Testing Center of Excellence (TCoE) and Enterprise application testing services (EATS) which bring together industry's best practices and frameworks.’ 2013 Leader in Global Discrete and Embedded Product Engineering Testing & Enterprise Application Testing Services 2014 Major Contender as per Everest Group’s PEAK (Performance | Experience | Ability | Knowledge) Matrix for Independent Testing Services - 2014 Copyright © 2014 HCL Technologies Limited | www.hcltech.com Business Assurance – The Impetus for Change The Market The Competition - Testing is viewed as a non-value adding necessity - Necessity based on the need to identify errors created earlier The Strategy - Currently ranked 8th in market share among our key competitors - HCL viewed internally and externally - Re-Brand IV & VS as Business Assurance and Testing Services under as weak in testing the tagline ‘Assuring Business Runs ‘Independent Verification and - Cost pressure depressing what the As Intended’ market is willing to pay. Price is a key. Validation’ is firmly aimed at the - Create a Business Assurance legacy approach to testing - The key value proposition behind an Framework as flagship philosophy and MQS model is outcome-based pricing - Competitors moving toward a solution set offering the Total Quality ‘Business Outcomes’ model as with guaranteed annual cost Umbrella spanning the SDLC. opposed to a ‘Testing Process’ model reductions - Align full arsenal of our capabilities - None has created a coherent market behind this framework. Although we - A true MQS model provides the message, value proposition or breadth of quality services on a will continue to sell ‘point solutions’, solution predictable, declining cost basis our primary wedge will be the Framework. - HLC has very powerful raw assets that would become the building - Redefine ‘TCoE’ as ‘Managed blocks of a real Total Quality solution Quality Service’ (MQS) built on the Business Assurance Framework - Vendors are seen as equal with commoditized offerings A bold transformation of HCL Testing will allow us to leapfrog the competition, first in terms of market perception and later in terms of market share. 4 Copyright © 2014 HCL Technologies Limited | www.hcltech.com Financial Challenge for FY15 Global Revenue Target Revenue ($mn) Target YoY Growth 128.64 16.50% 147.85 16.60% FY 14 ACHIEVED FY 15 TARGET Global Revenue Target by Vertical ROW, $29.7 Global Revenue Target by Geo APAC, $30.00 CS, $38.1 NA, $70.00 PS, $5.0 EMEA, $50.00 FS, $59.1 MFG, $10.5 LSH, $7.6 5 Copyright © 2014 HCL Technologies Limited | www.hcltech.com Agenda 6 1 Business Assurance & Testing Services Overview 2 Our Oracle Testing Proposition & Methodology 3 Success Stories Copyright © 2014 HCL Technologies Limited | www.hcltech.com Oracle Testing - Snapshot Key Facts Oracle Capabilities 120+ Oracle Testing Professionals Global Oracle Services Partner In-house test lab on automation and performance testing Integrated pool of testing, domain and functional consultants Support of HCL Oracle EBS consultants , supporting Oracle users around the globe Key Oracle Testing Customers Global Platinum Partner (the highest level of partnership) One of world’s largest Oracle partners including Product Dev Test Script Repository for Oracle, Within Function and Across Functions Testing, Functional and Integration Test Scripts Across the Process areas – Financials, HRMS, CRM, SCM, Projects etc. Test Tools Expertise Automation Testing HP Quick Test Professional | HP Service Test | Use Mango Framework | Selenium open source Performance Testing HP Load Runner | HP Performance Centre| Rational Performance Tester |Borland Silk Performer | OpenSTA | Compuware QA Load Defect/ Test Management Tools Quality Center | ALM | Rational Quality Manager | Testlink | Bugzilla | 7 Copyright © 2014 HCL Technologies Limited | www.hcltech.com Enterprise Application Testing Service Offerings E-To-E Implementation Test Solutions Oracle Global Rollouts Test Solutions Project Streams Upgrades Test Solutions SAP EATS Service Offerings Product Lines CRM Product Re-Engineering Test Solutions ( Siebel CRM, Salesforce.com, MS CRM Dynamics) Maintenance & Support Test Solutions DW/BI Core Services Consulting •Due Diligence •Assessments •Test Processes definition & implementation •Metric definition & Implementation Test Automation •Automation Frame work •Regression Pack Preparation •Pre-Packed Reusable Automation Components Non-Functional Testing •Performance Testing •Security Testing •Conversions Testing •Cutover Testing •Backup and DR Testing •Compatibility Testing •Operational Readiness Testing Functional Testing • Requirement Management •Baseline Configuration Testing •Customization Testing •Interface Testing •Integration Testing •Batch Testing •Regression Testing • Support UAT Master data management, Release management & Test environment management Setup 8 Copyright © 2014 HCL Technologies Limited | www.hcltech.com Oracle Testing Expertise Key Differentiators Testing / Validation Partnership with Oracle Global Platinum Partner (the highest level of partnership) Oracle Certified Advantage Partner Integrated Practice and Solution Lab Reusable Test Script Repository for Oracle Applications Testing Investment in Oracle Solution Labs Ready to Use Test Lab with Product to accelerate product development Licenses & solution capabilities Development of Automation framework Ready to Use Solution Lab for all for Oracle Application Wrapper functions, Go-to-Market Partner for Edge Oracle Enterprise Applications reduce script maintenance and Applications Improved collaboration across the development effort up to 20%. Partnering Oracle in Fusion Applications and PeopleSoft 9.1 Testing Competencies under Oracle Flexible Costing Model for Test Universe umbrella. Automation Oracle Applications Test Scripts By Processes and Across the processes (Integration Test Scripts) 3 1 2 9 Copyright © 2014 HCL Technologies Limited | www.hcltech.com HEAT (HCL EBS Accelerated Testing) Framework for EBS Implementation / Upgrade AIM Implementation Phases EBS Test Scope Component Business Definition Testing Activities Phases Definition 1 2 Test Planning • • • • Define Test Efforts, Schedules & Metrics parameters Identify & Define Oracle Test environment Evaluate Interfaces and Customizations for testing Freeze Data Migration Test Requirements Test Design • • • • • Detailed Test Scenario preparation Freeze Test data format & combinations System Test script design Data Migration Test Case Design Test Design review (by client) and Sign Test Plan Environment 2 Test cases • Critical Process • Scenarios • Transactions Solution Design • Test cases • Transactions Reviewed Cases Scenarios Test Environment Build • Client Review • Cases Sign off • Test Data 3 4 3 Security Integr ation Gather High level Business requirement for Testing Identify Oracle Implementation /Upgrade Methodology Define Scope of Testing and identify scenarios Define Test Methodology & Test Types & Test Strategy Identify & Define Oracle Test environment 1 Business Processes Operations Analysis • • • • • Test Requirement Analysis 4 Functional Performance Test Execution & Reporting • Execute end to end Functional, Integration transactions (cases) test cases • Execute Performance , security tests, System tests • Identify & report defects • Support UAT Execution & Signoff • Perform go-live checks Transition 5 Open Issue s Production Environment Production / Go Live 10 6 5 UAT Defects closer 6 Support & Knowledge Transfer WIP issue s On Hold • DRE • ArrivalRate • Turnaround Time • Effort variance •Creation Productivity •Execution Productivity Defe ct Prod uctivi ty Effort Sche dule • Schedule Variance • Execute & close /reopen fixed defects • Escalate High priority /severity issues • Conduct perform stress and volume test • Prepare Metrics for defined parameters • • • • Production support Perform KT to customers core team Hand over Test reports Highlight open/pending issues Copyright © 2014 HCL Technologies Limited | www.hcltech.com Closure Execution/Control Planning Initiation Oracle EBS Testing Approach – Integration with the Implementation team 11 Oracle EBS Implementation Activities Project definition Requirement Specification Gap Analysis Document Configuration Customization System & SI Testing Performance & Regression Testing User Acceptance Testing Go-Live Testing Activities EBS Implementation/ Roll Out Upgrade, Enhancements • • • • Test Planning & Efforts Estimation Test Specification Walkthrough Test Scenario Analysis Test Concept Finalization & Signoff • Release Planning & Efforts Estimation • Test Requirements Analysis • Test Impact Analysis • • • • • Test Test Test Test Test • • • • Case Creation Case Review Case Update Data Preparation Environment Setup • • • • Test Execution Publishing Test Results Discuss Defects Load & Performance test requirements • Test Script Creation & Execution • Publishing Performance Reports • Regression Testing for new releases • Test Cycle Sing Off • Phase Hand Over to UAT • Post Rel Implementation reviews • Metrics Measurement & base lining Test Case Update Test Case Execution Publishing Test Results Defect Triage Meetings • NA • NA • NA • Automation Analysis / Test Data Preparation • Creation of Automation Pack • Executing automation Test Script to Check Regression Upgrade / Enhancement Activities Project Planning Project Management (Work Load Assignment) • Support Process (eg. New Users) • Run Books Preparation (eg. Changes in Batch, Schedule, Scripts, Dependencies) • SLAs • Scripts (eg. Installation Backup, Database Maintenance Related) Pre Production Validation Deployment in Association with IES • Post Rel Implementation reviews • Metrics Measurement & base lining Release Copyright © 2014 HCL Technologies Limited | www.hcltech.com Comparison Chart- Testing Cycles Procure to Pay (P2P Cycle) Create Requisitio n Submit for Approval Create Purchase Order Pay the Invoice Transfer, Import and Post to General Ledger Order to Cash (O2C Cycle) Submit for Approval Create Receipt upon receiving Goods Create an Invoice in Accounts Payable Execution time - Manual VS Automation Execution time - Manual VS Automation 12 12 Manual Testing (in Minutes Approx) 8 6 Automation Testing (in Minutes Approx) 4 2 0 1 3 5 7 9 11 13 15 17 No. of Scenarios 12 10 Execution Time Execution Time 10 Manual Testing (in Minutes -Approx) 8 6 Automation Testing (in Minutes Approx) 4 2 0 1 3 5 7 9 1113151719212325272931 No. of Scenarios Copyright © 2014 HCL Technologies Limited | www.hcltech.com Agenda 13 1 Business Assurance & Testing Services Overview 2 Our Oracle Testing Proposition & Methodology 3 Success Stories Copyright © 2014 HCL Technologies Limited | www.hcltech.com Testing Services Provided to some of our Customers End to End testing for Siebel 8.1 Call Center Application for a large retail chain company in the US Oracle Financials Automation Regression Testing for a financial security company that specializes in life and long term care insurance wealth management and senior supplement insurance. Oracle eBusiness Suite testing for a network solution company that provides innovative network solutions and also help the world’s leading organizations transition smoothly to a virtualized world where applications and information can reside anywhere Siebel–CRM On Demand/Web/BI Analytics/Oracle/Interwoven/ Analytics/eService for World largest antivirus/security system company 14 Application Testing in Siebel CRM and OBI reports for a Product Development Company which helps financial institutions manages funds and assets Functional, Regression, Automation, Performance and Integration Testing on Oracle Utilities products CC&B, WAM, SoA Suite, OUBI and non Oracle Utilities products GIS, Sun IDM, Web logic Portal Server, Secure MDAS & Energy Audit for reduction of AT&C losses in power sector. Automation Regression Performance and Volume Integration Systems Application Support Automated Functional and Regression Testing of Oracle Applications for Largest Automotive supplier in the world Testing Services Functional Application development Customer Application Upgrade Implementation Services Characteristics Solution Scope Consulting Description Copyright © 2014 HCL Technologies Limited | www.hcltech.com Enterprise Application Testing – Oracle Apps for world’s premier measurement company The Client: Client is one of the world market leader in the test and measurement (T&M) business. It designs, manufactures electronic and bioanalytical measurement instruments and equipment for test and measurement for a variety of research, medical, and industrial applications Area of Engagement Large Global Test and Measurement company - Global ERP & custom Applications Testing Engagement. Solution Customer Benefits • • Improvement in quality of client applications – excellent feedback from client business and end users. • Cycle time reduction through existing test case reusability and automation testing. (Cycle time reduced up to 30%) • Standardized Test Processes & Framework. • Test Repository of 326 test cases covering various modules like Order Management, Istore, Manufacturing, MML, Procurement, Isupplier, Finance, Iproc, Pricing, Planning, Demantra, Configurator, Oracle Mobile, Oracle-Siebel and Oracle-SAP E2E scenarios. • 90% of the existing regression test cases are automated using HP QTP tool. • Multiple Regression Cycles for Oracle Refresh Validation, Security Patch testing, JRE and Browser upgrades completed. Business Objectives • • Reduction in Functional Defect Leakage in production by improvement in quality of deliverables Reduction in cycle time • • Improvement in Business and End Users satisfaction SCOPE OF SERVICES • Manual, Automated Functional & Regression • End to End Testing between Oracle and other interfacing ERP/Custom Applications • Test Process standardization and Improvmt. Technology Spread • Oracle Application R12.1.3 • Middleware: Dazel, Fusion • HP: ALM v11 and QTP v10 • Other ERP and web legacy applications Engagement Model/ Size • Offshore, Core & Flexi – 5 Resources • Duration – March 2013 [Ongoing] 15 • • Testing services are carried out from HCL’s offshore ODC which includes manual and automated functional, system integration, regression and End to End testing across various multiple OUs. It covers the business processes like P2P, O2C, ISO, Manufacturing, Oracle to Siebel/SAP E2E Flows. Testing services covers various Oracle Apps modules like Order Management, Istore, Manufacturing, MML, Procurement, Isupplier, Finance, Iproc, Pricing, Planning, Demantra, Configurator, Oracle Mobile, Oracle-Siebel and Oracle-SAP E2E scenarios. Interaction and coordination with Business Users and Project Team to execute Functional scenarios in case of any changes or modification in the existing solution in the system. Automated and manual Regression Testing during Application, Browser, & JRE upgrades, Refresh and security patch testing. • Creation and modification of manual and automated scripts using ALM and QTP. • Creating and updating process documents. . existing business Copyright © 2014 HCL Technologies Limited | www.hcltech.com HCL’s APO methodology enables the world’s largest antivirus enterprise test center optimize its application landscape The Client: is one of the largest security software product companies providing security solutions. With headquarters in Santa Clara, California , our customer is a leading supplier of network security and availability solutions creating best-of-breed computer security solutions that prevent intrusions on networks and protect computer systems from the next generation of blended attacks and threats. Area of Engagement Solution Customer Benefits Service Areas: Enterprise Applications Testing, Performance and Automation Testing, Content Management , Oracle Fusion and Integration testing. HCL’s Test Factory in a Box [TFiB] along with our BATS Asset Methodology process framework for transition, execution and process management was extensively utilized to help our client address process gaps and streamline the application area of SDLC [Software Development Life Cycle]. We quickly ramped up from a 2 to a 32 member team within 6 months, fully implementing TFiB and PM Smart and were able to show a USD 336K value add to our client within the first quarter of the engagement through the development of a data comparison tool 360 K $ Value added to the engagement within first 6 months, this is 50% return on billing [not investment] as a value to customer. Business Objectives Our client had just undergone a takeover and faced the challenge of streamlining its Applications Portfolio, while retiring and enhancing certain critical enterprise applications HCL was to provide APO, QA consulting and QA managed services with gap analysis and focus on CTB [Change the Business] We followed a 3 phased approach: 1. As –Is: We conducted a test consulting exercise and Application Portfolio analysis to develop critical reports for analysis 2. Recommendations: We recommended process changes and solutions for gaps in technical expertise, together with TFiB implementation as agreed upon by our client Technology Spread Technologies: Siebel, Oracle BI, DB2, Oracle Fusion, Interwoven IPs / Frameworks: TFiB [Test Factory in a Box], BATS Asset Methodology Engagement Model/ Size Onsite-Offshore 32 PM 16 3. Implementation: We focused on CTB initially and on process change in the existing landscape. We are now engaged in continuous process improvements in the overall landscape Phoenix Program Go-Live, 3 year Program on client ‘s Web Portal. This Phoenix Project was over run by 1 year when HCL team engaged. HCL team made it go-live within first 6 months and our key resource names have figured in McAfee Web site as a customer recognition. Siebel CRM On Premise to On-Demand, one of the biggest Application area Programs is being supported around 80% by HCL. No other previous vendor engaged in more than 30% of the functional spread vis-avis our Managed services program which coupled Siebel functional, Oracle BI and Oracle Fusion together is supporting 80% of the functionalities. Customer saw great value is technology collaboration within three HCL teams, all under one Managed services project. BATS – Test Factory In a Box has been fully implemented. Daily, weekly and monthly review and metrics have helped customer in not only seeing report fast but able to see the trend and act on the missing risks in terms of coverage, resourcing and new projects identification. Copyright © 2014 HCL Technologies Limited | www.hcltech.com Oracle –Testing for Largest State Electricity Utility in India Client: Is one of the largest state owned electric utility in India covering a base of almost 11,000,000 customers. Area of Engagement Solution Customer Benefits Application Testing in Oracle Utility products- Customer Care & Billing , Work and asset management, oracle portal, GIS, Energy Audit. Faster and better test coverage with the involvement of testing team during definition phase. Business Objectives Use cases and high level business scenarios were created by the BA team during the definition phase. Customer was able to Avoid Failures / Outages due to Inadequate or Improper Testing and Reduce Implementation Cycle Time. Low level test cases were created using use case documents after getting validated from domain team. Reduced the time to fix bugs by effective root cause analysis by testing BA team. The test scripts were customized and parameterized Reduce Testing Cost and Reduce Overall Patching Cycle time: from Test to Prod. Automation scripts were run using QTP. Error Handling Mechanism was developed Risk Mitigation during Customizations, Patches, Process Changes, and Setup Changes etc. Functional testing was followed by integration and system integration testing of the complex oracle system with huge customer data. Documentation and delivery happened from Offshore Functional Testing for implementation of oracle utility products. Integration testing of complete utility application with tightly coupled applications integrated using SOA architecture. Creating and implementing automated scripts for functional testing of oracle customer care & billing , work and asset management. Implemented HCL automation framework. Technology Spread Quality center for test management. QTP for automation. Engagement Model/ Size 17 Onsite-Offshore Testing team consisted of utility domain experts ,oracle functional consultants, automation, and manual test engineers. Copyright © 2014 HCL Technologies Limited | www.hcltech.com ORACLE E-Business Suite [Configurator] Performance Testing The Client: Leading in manufacturing and distribution of Automatic Teller Machines (ATM), Point-Of-Sale Terminals, Business consumables and Highpowered Data Warehousing systems. Largest providers of IT maintenance support and services. Area of Engagement Solution Customer Benefits Performance report builds the confidence among all the stakeholders, that this application will provide uninterrupted service even in 500 user peak business hours. Webserver, JVM Heap memory, Server load balancing, Unix server resource CPU utilizations has monitored and tuned with best configuration parameters during load & stress test. ATM Retail Business Objectives Oracle E- business suite capacity & scalability measure under load Oracle Configurator model design stability Find optimal configuration values in web server for JVM heap memory usage. Conduct performance testing on the application as a proof of concept. Common business processes were identified Test environment accessed through VPN setup. Applied the Test Strategy and Execution plan HCL developed the Oracle NCA + Web scripts to automate the business process using LoadRunner software Identified the bottleneck on the application and reported to the clients. with detailed Performance Test Report HCL’s Test Environment Setup Technology Spread Load Runner 8.1 Sample Identified Performance Bottleneck Before Tuning Manufacturing After Application Tuning After Tuning Protocol: Oracle NCA+Web Monitors: Server Resource Monitor; Network Latency Monitor User Load : 500 Users Engagement Model/ Size Onsite(25%)-Offshore(75%) 18 18 Copyright © 2014 HCL Technologies Limited | www.hcltech.com 19 Copyright © 2014 HCL Technologies Limited | www.hcltech.com THANK YOU 20 Copyright © 2014 HCL Technologies Limited | www.hcltech.com EATS Product Streams PRODUCT SERVICES CORE APPLICATIONS TOOLS, TECHNOLOGIES & PLATFORMS BUSINESS ANALYTICS SAP Enterprise Resource Planning, Supply Chain Management, Supply Relationship Management, Product Lifecycle Management, Customer Relationship Management Net Weaver SOA SaaS Mobility Platform Solution Manager SAP TAO Business Intelligence Business Objects APO Oracle Financials, Human Capital Management, Supply Chain Management, Customer Relationship Management SOA/ Fusion On Demand BEPL J Developer OBIEE Data Warehousing CRM Sales Management, Service Management, Marketing Management, Banking/Financial Solutions, xRM MS Sharepoint Mobility Platforms CRM Online Cloud Services Web Services DW/BI Data Modeling, Source & Target Schema mapping, Extraction Transformation & Loading, Exceptional Data Analysis, Data Warehouse enhancement & Maintenance Informatica Data Stage Business Objects Cognos Hyperion Data Warehousing Reports DOMAIN SERVICES Finance 21 Manufacturing Retail Utilities Healthcare/Pharma Copyright © 2014 HCL Technologies Limited | www.hcltech.com Cost of Quality – Our Philosophy Key parameters of CoQ Introduce CoQ led approach • Identify CoQ levels against individual business domains • Define initiatives to reduce CoQ • Capture and analyze CoQ metrics periodically • Base line and measure the phase specific CoQ goals • Analyze and conduct Root Cause Analysis for all deviations • Tie CoQ to Value drivers for the QA CoQ Analysis – large Insurance company in USA Benefits • • Lower Operational Cost without compromising Quality Previously hidden costs related to poor quality become visible and demystified In-depth analysis of Cost of Quality can lead to actions to improve the situation YoY improvements in COQ (Do more for Less) Shorter time to market • • • 22 Copyright © 2014 HCL Technologies Limited | www.hcltech.com Business Process Testing Three layered Approach to Business Aligned Testing (implemented for a leading pharmaceutical company in UK) Business process Modeling of Business process Bottom up Approach (Where test cases are available) Top down Approach (Where test cases have to be designed) Components and Test cases Transformation from Application centric view to Business centric view Reusable test/business components Plug and play components to create business scenarios/process Components and Test cases Test cases automated Business diagram showing the various processes and sub-processes involved in creating a web order. Consists of Business Process, Application Components and Business Components 23 Copyright © 2014 HCL Technologies Limited | www.hcltech.com EATS Centralized Library with Re-Usable Business Components What is EATS (SAP/Oracle) Component Library? • • • • SAP /Oracle modules are based on standard ‘T ‘ Codes or Transaction codes for each Business Transaction Using the BPT Approach the test steps for each of the ‘T’ Codes can be componentized Components per module & for each ‘T’ Code are stored in a central repository Test Cases based on Client Business Processes can then be created using readily available components SAP Module No. of Reusable components Oracle Module No. of Reusable components Oracle Module No. of Reusable components OTC 249 AP 86 PO 33 FI/CO 123 AR 95 INV 24 MM 301 FA 44 OM 15 WM 116 GL 63 OIE 35 PP 19 CE 22 IPO 32 BI 43 CRM 45 Total SAP re-usable Components =760 Total Oracle re-usable Components= 449 Value Delivery From a Test Objective Reusability of Components leading to reduced test scripting effort, change control, and test cycle time reduction 24 Value proposition: 5-10% reduction in overall testing cycle time Copyright © 2014 HCL Technologies Limited | www.hcltech.com