Validata Advanced Testing Suite (ATS) The leader in Automated testing for T24 Agenda 1 Business Challenges 2 Validata Advanced Testing Suite 3 Validata Testing Approach 4 Validata Testing Methodology 5 Product Overview 6 Benefits Business Challenges Traditional test automation systems originated in a world that moved at a much slower pace, where waterfall development was the only game in town and no-one attempted to tackle automation of fast moving, mission-critical applications – they knew that the technology simply couldn’t keep up. These products all get their capabilities from powerful scripting languages, something that sounds good but has become a horror in the real world, requiring a cult of highly skilled and highly paid test automation engineers to communicate with the complex and mysterious deity, the test automation tool. Business Challenges: Need to test complex interaction between processes and systems Generic model for the organisation – encompassing all applications Multiple location support Multiple team support (over multiple locations) e.g. TAM, Test Centres Multiple environment support (for multiple applications) Referential integrity across environments End-to-end regression testing Validata Advanced Testing Suite (ATS) Validata Advanced Testing Suite (ATS) provides a full end-to-end automated testing capability that adapts easily to changes in the application under test, ensuring higher quality and reduced costs and effort. Validata ATS is a truly integrated and business process management solution. Validata ATS is the first model – driven test automation tool for Functional, Technical and Continuous Regression Testing. 30% increase in productivity Validata focuses on the analytics (the context and the content) thus providing root cause 38% increase in assets analysis linking requirements and testing. Full re-use reporting is on-demand from the Executive Dashboard Module. 20% increase in project success Project Success 80% reduction in current time to test 80% reduction in current spend on testing 50% faster time to Market Validata Unique Testing Approach Throughout many projects involving many applications and integrated systems, the differences between the intended methodology and the practical delivery of a solution are greatly underestimated. Our unique approach offers a Truly Integrated Testing Framework to ensure our clients can implement Validata ATS seamlessly and with immediate effect. Validata Group believes in delivering true business value. Our approach, whilst technology driven, is focused on the businesses needs by: Enabling business change without business disruption Aligning the business with IT This way, usual stated benefits can be aligned to quantifyable business outcomes Benefits Faster Cost Efficient Smarter Simpler Agile Consistent Business Outcomes Faster-to-Value Enhanced ROI Fast to Market Optimized Resources Staff Capex Opex Validata Testing Methodology Testing Techniques: Model Driven Data Driven Key Word Driven Validata Risk-Based Methodology Risk is the possibility that future events may cause adverse effects. Risk management is a discipline for understanding and mitigating these possibilities. Risk mitigation and compliance reduces costs and protects reputation. In the current business climate both “cost containment” and “reputation management” are high on Boardroom agendas. VALIDATA stores and links Risk related information to calculate risk assessment metrics. Risk Management in VALIDATA is utilized in impact production reports and on demand regression testing. VALIDATA’s risk-based approach to testing ensures that operational risks are identified and prioritized to ensure the issues are fully addressed. Business Process Driven Testing Many financial institutions are now regulated to demonstrate that not only are their business applications tested but that their operational processes are also aligned to the systems they use. Validata ATS is providing Business Process Testing, through its Business Flow Modeller (BFM) module. Business Flow Modeller provides the ability to import business workflows from external systems such as ARIS Workflows, store, edit and visualize them in Validata’s repository. Once the Business Process have been captured we are able automatically to generate test cases and link them with the related business processes. Business Process Test Cases So, Validata BFM enables end-to-end testing aligned with the business processes. Test Cases Validata CRM Loan Origination Banking Application This way, Validata user can ensure the qualitative and quantitative coverage of testing. G/L Model Driven Testing Businesses that need to test complex interactions between processes and systems often find that their testing capabilities are not as robust as they would want them to be. Significant benefits are to be found using a rigorous approach to clearly define the boundaries of both processes and systems that need to be tested effectively. Validata T24 Application Data Model Test Data (created or imported) Test Cases designed for use with any T24 Release Execution T24 Rx Under Test Validata Database Unlike other testing tools available, in Validata ATS, in order to create the Test Cases, the Application Model as well as the Test Data remain separate from the Test Case structure. All information is brought together during the execution time and run against any test environment. Faster, easier and more efficient maintenance is achieved when changes occur on the application or the test data level without effecting the total test case structure and providing to the user maximum flexibility and re-usability. Data Driven Testing Most IT departments make direct copies of their production systems for non-production. This inefficient (and expensive) process lacks focus and increases test cycles immeasurably. As production databases slowly grow, the longer it will take to make a complete system copy. As a result, your test team struggles, you come across compliance challenges, your hardware costs rise and the overall quality of your testing (and test data) remains poor. Validata ATS offers an end-to-end test data management solution which is flexible, fast and easy to use. Test Data Manager not only creates or generates synthetic data from scratch, it can also create subset databases, de-identify (mask or obfuscate) your existing data and bulk up data for performance testing. Data Profiling Data Masking Centralized Test Data Repository Data Quality Full audit trail & Version Control Data Creation Data Archiving Product Overview: Test Types Functional Testing • User Acceptance Testing (UAT) • System Integration Testing (SIT) • Interfaces Testing • Message Testing (MSG) Technical Testing • Unit Testing • Performance Testing Continuous Regression Testing Validata ATS has the ability to perform Parallel Testing on multiple environments using the unique test engine adapter Product Overview : Capabilities Validata ATS consists of several modules which manage and monitor an End-to-End project from Planning, Preparation, Execution, Analysis till Project Readiness. Meta Data Model Driven testing from clients application End-to-end Testing driven from Business Processes, Requirements and Change Requests Manual and Automated testing Integration Testing with associated systems, such as: SWIFT & ATM Full incident management capability, audit trail and history reports Comprehensive tool-based approach for SOA testing. Risk Management Data Privacy Built Reusable Test Assets Instant Traceability Reports Integrated Defect Management System Storage of all Projects Assets in one repository Product Overview : T24 Test Builder Business users can now be directly involved in creating Test Cases with the minimum effort. No need for technical knowledge is required. Team productivity is now boosted up its limits! Capabilities Simple and Fast test steps creation Composite screens support Automatically generate required steps against actual results comparisons Easily select the correct T24 Versions for testing New drop down selection of T24 modes Visualization of the T24 screen version Automatic validation of the Test data during the test case creation Automatic import test data from T24 environments Enhanced automatic calculations engine Automatic verifications of T24 status records Custom verification rules supporting data transformations and override messages Improved interface to support T24 enquiry testing User friendly GUI Benefits Test case productivity improved by 80% compared with the previous interface Test case quality improved by 60% Test cases creation deskilled by 76% Reduces the learning effort by 82% ( assuming that the user has minimum T24 knowledge) Test Data management improvement by 50% Automation level reaches 85 % in a common project Higher user productivity and support of automated testing through the Script Librarian feature Product Overview : Performance Tester Perform Continuous, Flexible and Scalable On demand Fully Performance Testing integrated with Reduced Temenos execution T24 time, risk, Easy & cost and Accurate effort Script less Result Analysis and User Cross Platform Testing Friendly Product Overview : Message Testing (MSG) Validata MSG provides an innovative automated testing framework with best practices and proven methodologies for testing of SWIFT, ATM, SOA and generic interfaces. TELEX DE.PRODUCT SWIFT Carrier Control DE.CARRIER Mapping DE.MAPPING DE.MESSAGE Formatting DE.FORMAT.**** DE.O.HEADER Banking Application Validata MSG verifies that the transaction in the Banking application has been generated according to the incoming swift message type and the proper mapping SWIFT rules Product Overview: Workflow Automation Test Suite Process Flow Business Requirement Gathering Test Case estimation / Effort Estimation One Time Setup for any Project Validata Setup (Typical creation as per Version of T24 to be Tested) Define Project Map Resources Set Up Environment Select Adapters Requirement Definition Test case Creation Generate test cases Input Statistic Data Execution of Test Cases T24 Defect Management Link test cases via calculation Reusable for any Geographic release with minor modification Product Overview: T24 Model Bank Accelerators Significant investment has been made in both the development of product functionality and relevant content, re-usable test cases to be packaged and delivered to clients as part of the overall product solution , to ensure full test coverage when it counts! Our testing accelerators allow Validata ATS to jump start our clients implementation by having up to 80% of the core Test Cases and Test Steps available immediately testing begins. The structure provides a ‘ready-to-use’ set of test scenarios, grouped into logical functions and based on the major banking business functions (i.e. Loans, deposits, FX...), providing re-usability. Reusability is the key driver in reducing costs. As a limited amount of customization will be required, the cost of implementing Validata is significantly reduced. Extend your test coverage with Validata ATS! Product Overview: Validata Adapters An Adapter is a component which connects Validata ATS to external systems and data sources to enable quality automated testing: Validata ATS acquires appropriate information from the software application under test using our unique adaptor technology SOA Adapter MS Project Adapter Our adapters enable the mapping between Validata objects and system under test objects No development / scripting is required T24 Web Adapter SQL Adapter Generic Adapters SWIFT Adapter Globus Desktop Adapter T24 OFS Adapter ISO-8583 Adapter Performance Adapter SOAP Adapter Product Overview: Defect Management Validata ATS provides an integrated Defects Management system that stores defects identified from every execution. It also manages the changes to requirements and processes and as soon as the fixes are available, redirects a new cycle of testing based on the impact analysis reports provided. Catch defects early during targeted integration / regression testing Change analysis impact report Ability to integrate with external system Audit, trail and history reporting Alert mechanism based on user customized workflows Monitor defects found through the Executive Dashboard and usercustomizable reports, offering full visibility Product Overview: On Demand Reporting Achieve end-to end traceability across multiple projects Get real time on demand reporting Develop these reports for internal use Build in your own KPI measurements Understand where your project is heading The Critical Differencies Efficient Testing • Reduced Testing time - Less time to develop, Shortened application life cycle and Faster time to market • Reduced QA Cost - Upfront cost of automated testing is easily recovered over the lifetime of the product. The cost of performing automated testing is much lower, many times faster and with fewer errors Improve Process •Consistent test procedures - Ensuring process repeatability, resource independence, eliminates manual errors •Replicating Testing - Across different platforms is easier using automation •Results Reporting - Automated testing produces convenient reporting and analysis with standardized measures allowing more accurate interpretations Effective Testing • Greater Coverage -The productivity gains delivered by automated testing enable more and complete testing. Greater coverage reduces the risk of malfunctioning or non-compliant software • Improved testing productivity - Test suites can be run earlier and more often Better Use of resources •Using Testing Effectively -Testing is a repetitive activity. Automation of testing processes allows machines to complete the tedious, repetitive work while resources are diverted to perform other tasks Test team members can focus on quality Cost Effectiveness: Automated Testing 900 Manual Testing 800 Traditional Automation Aggregated Effort (hours) 700 Typically Three Test Cycles within Upgrade 600 500 400 Validata Automation Testing Suite (ATS) # of Test Cycles 300 200 1 2 3 Validata ATS ROI within 2 test cycles 4 5 6 7 Traditional Automation ROI within 6 test cycles 8 9 10 Total Effort Per Approach (Hours) (Assumption: 35 Business Processes) Effort Overview: Test Creation Phase Manual Systems Integration Testing Functional Testing Continuous Regression Testing Performance Testing -70% less effort by reusing the test artifacts from SIT -60% less effort by reusing the test artifacts from SIT -30% Faster on test case creation Limitations -60% Faster than manual No Low level testing. With Accelerators Lack of Knowledge and Complex test transactions and enquiries. Highest Automation Required: Enquires Advanced Enquiries Test Data Automatic Business Rules Comparison Rules No qualitative test cases. No reusability -40% Due to Test data and scenarios reusability Highest Automation Required: Enquires Advanced Enquiries Comparison Rules Automatic Business Rules Highest Automation Required: Automatic Business Rules Effort Overview: Test Execution Phase Manual Functional Testing Systems Integration Testing Continuous Regression Testing Performance Testing -60% Faster on every cycle -70% Faster in any cycle Cycle 1 Same Effort for all Cycles Cycle 2 Cycle 1 Cycle 2 Cycle 3 Cycle 3 Cycle 4 -80% Faster on every cycle Cycle 1 Cycle 2 Cycle 4 Cycle 3 No comparison to manual as it is only automatic ROI based on re-usability 60% Reusability 40% Reusability 0% Reusability % Reusability Run MTC Automation Design C O S T % Reusability Automation Design C O S T On boarding Test Case Creation $$ Infrastructure Infrastructure Test Case Creation Automation – RUN 1 $$ Run MTC Automation - RUN 2 % Reusability Run MTC Automation Design Test Case Creation Infrastructure Automation – RUN 3 C O S T $$ Do You Have Any Questions? We would be happy to help.