Testing as a Service -
New
Realities and Perspectives to address Quality
and Agility challenges in BFSI Testing
Amiruddin Syed Mohammed
CSC Proprietary and Confidential
1
The Sectoral Challenge
BFSI Test Offerings
BFSI Corporate strategies…
Mergers &
Acquisitions
Innovative
Products
New
Technologies
Market
Concentration
and
Globalization
…Sectoral challenges…..
Regulatory & Compliance
Integration with Channel Partners / 3rd Party Systems
Security – Application / Network / Data
Migrations, Conversions, Consolidations & Legacy
Modernization
Global Adaptations
Data Warehousing / BI
CSC Proprietary and Confidential
2
The Need : Do More with Less
Market Agility and
Responsiveness
ROI and Cost Control
Business and
Operational Risk
CSC Proprietary and Confidential
Faster time to market for New products and services
Realize benefits from Distruptive and Emerging
technologies ( Cloud, Mobile , etc)
Empower business with modernized applications
New ways to collaborate with customers & partners
New business models
Lower TCO
Move from CAPEX to OPEX
Predictability of Testing and software costs
Scalable resources and Economies of scale
Eliminate Overhead cost on under-used capacity
Standardization through industrialized service delivery
Security, audit and reporting requirements
Functionality, Non-functionality, Predictability and
Reliability
Assurance of External & Internal Quality
3
So What is Testing as a Service (TaaS)?
Testing of IT applications ( Custom, Enterprise, Business apps) leveraging
Cloud for virtualized , scalable ,on-demand test labs that provide selfprovisioning and management of multi-platform environments. These are similar
to traditional 3rd-party testing services such as dedicated testing centers of
excellence but executed and managed in Cloud based.*
• Testing tools
• Test scripts
What is
Same….
• Test standards
• The work flow
• The standard applications that are being tested (like SAP or Oracle or point solution)
• Test metrics
• The test environment (Platform, architecture and the applications them selves)
• Complete utility model for platform, test experts and tools
• Predictable End-to-end cost
• Access to variety of tools.. In some cases more test coverage because of multiple
tools testing
• One stop solution possible for all testing .. Option to change the tools selection, when
not satisfied (Try and use)
What is
New….
• Verify architectural / design level – using new generation performance tools – before
going live.
CSC Proprietary and Confidential
* Adapted from IDC definition of TaaS4
Overview of ‘ As a Service ‘ from a Testing point of view
Capability-as-a-Service
(CaaS)
CaaS
• Functional Testing as a Service
• Performance Testing as a
Service
Testing
• Mobile Testing as a Service
• Test Automation as a Service
• Security Testing as a Service
PaaS
Platform-as-a-Service (PaaS)
• Test Environment (Servers / Desktops/
Configurations)on demand to support
SaaS
• .......
Software as a Service (SaaS)
• ASQ Tools in alternate licensing models
• Test Management Tools
• New Develpment / Enhancement
• Automation tools
• Patches / Hot Foixes
• Performance Testing tools
• Migrations / Upgrades
• LCQM tools
• Open Source Tools
CSC Proprietary and Confidential
5
How is TaaS different from Traditional Testing Models ?
Traditional Testing
TaaS
Labour Arbitrage as key lever
Business Value + Cost Reduction
as key lever
Craftsman Approach
Industrialized
Input based pricing
Output / Outcome based pricing
Rigid
Flexible and Scalable on Demand
Testing seen as a tactical activity
Testing seen as a strategic enabler
Resource ( People ) focus
Services ( Assets) focus
Limited collaboration with ASQ
partners
High on collaboration with ASQ
partners
A paradigm market shift underway — from labour arbitrage and process
efficiency to service arbitrage and business assurance
CSC Proprietary and Confidential
6
TaaS in Cloud for BFSI – SHAPE , TRANSFORM and MANAGE your portfolio
Business Drivers
IT Drivers
Key drivers for
testing in cloud
•Pressure to reduce operational spending
•Faster time to market
•Emergence of global workforce
•Meet dynamic resource requirements
•Move towards variable cost structure for
testing services and even ASQ tools
•Need to support strategic initiatives
•Multi-site delivery and 24X7 operations
•Focus on first-time-right
•High incidence of production issues and
higher cost of rework
•Keep pace with technology
Banking and Financial Services
CLOUD LAB
On-Demand
Resourcing
Service
Performance
Metrics
Insurance
Testing Offerings
SHAPE
- Test Process Management
-Cloud Enablement
Mobility
TRANSFORM
- Hybrid TCoE
- Web Apps. Perf. Testing
- Cloud Certification
Reusable Asset
Repository
Global Process
Framework
MANAGE
Industrialized Testing Services
Functional Testing
Non Functional Testing
ERP Testing
Specialized Validation
Choice of Engagement & Global Delivery Models with alternative Pricing Options
Virtual Teams using Collaboration tools & platforms
Output Based
Pricing
Pay as you go
Service arbitrage
Alliances - VMWare , Citrix , IBM Rational, HP Mercury, Segue, Compuware, Work soft, and ITKO
Ubiquitous Access
Geography independent
CSC Proprietary and Confidential
Sourced on Demand
Improved utilization
Elastic Use
scale-up / scale-down
Enhanced Quality
Faster time to market
7
TaaS Ecosystem – A snapshot
Non Functional Testing
Functional Testing
Mobile Testing
Cloud Certification
SAAS (Software as a Service)
Apps
& Services
Web
Applications
Client / Server
Enterprise Applications
– SAP, Oracle,
Cadence, PTC, Sugar
CRM
Tools
Sandbox
Windows (Multilingual,
Multi CPUs)
Platforms
MS-SQL. Oracle, DB2,
Informix, MySQL,
Teradata
CSC Proprietary and Confidential
Linux (Red hat,
Linux, Debian)
Sun Solaris
Elastic servers
(Tomcat, My
SQL
combinations)
Mobile Platform
simulators
Borland ES, Cold
fusion, Tomcat,
Web logic, Web
Sphere, Web
Application server
(SAP), ATG
Dynamo, JBOSS
Service
Virtualization
8
TaaS – Delivery Model
Customer requests
Testing from
Provider
Provisioning /
Scheduling of Tests
Provider publishes
Test Results &
Reports
Provider conducts
Testing
TaaS in Cloud
Provider
Customer
Cloud
Orchestration
FTP / URL / VPN
Test Requirements &
Application
Components
Test Strategy &
Planning
Customer
Sign-off
Service virtualization
Mobile Simulators
Cloud lab
Automated Software Quality Tools
Application Under Test
Certify
Application
Collaboration
Web Server
Application Servers
Database servers
Provider
Customer
Test Summary
Reports
CSC Proprietary and Confidential
Test Execution
Infrastructure
Stabilization
Provider &
Customer
9
Traditional Testing Vs TaaS Comparisons
Dramatic reduction in test cycle time
Significant reduction in total cost of operation
Traditional
Lab Config. 1
Test
Planning
Test Case/Data
Development
Configure
Environment
Test
Execution
Resolve
Defects
Test
Planning
Test Case/Data
Development
Configure
Environment
Test
Execution
Resolve
Defects
Config. 2
Test Pass 1
TaaS – Cloud Lab
Test Pass 2
Config. 1
Config. 2
CSC Proprietary and Confidential
10
The Challenge
– Concerns on Security in Cloud
– Lack of Test Environment management expertise
– In efficient test automation
– Beyond Testing – complimentary services ( ADM etc)
– Evaluating the right tools
– Lifecycle quality management
– Integration with non-virtualizable components
– Additional Skills for Testers
CSC Proprietary and Confidential
11
Critical factors an enterprise should consider while evaluating
test vendors for TaaS
• TaaS is evolving – hence Providers should offer customers flexible
buying options – discrete vs bundled
• High Value Test assets owned by the provider – reusable assets,
accelerators and frameworks
• Technical resource expertise in test automation
• Lifecycle quality management tools and capabilities
• Experience managing Security of data and TaaS environment
• SLA based delivery
• Automatic backup and recovery
• Dashboards and tracking tools
• Larger portfolio of offerings – benefit from ADM , SOA, Security offerings
CSC Proprietary and Confidential
12
Building Roadmap Towards TaaS
Phase 3
Cloud Testing Services
Manage
•
•
•
•
Replicate for other applications
Optimize tools and licenses
Extend to other testing types
Measurement & Ongoing Improvements
Phase 2
Pilot first application on Cloud
Shape
Transform
• Set up Cloud environment
• Carry out Proof of Concept
• Enhance Cloud Testing framework based on Pilot
results
Cloud Testing Strategy
Phase 1
• Cloud Testing assessment
• Detailed transition Plan identifying priority applications
• Identify test types – functional, automation ,
performance, security ….
CSC Proprietary and Confidential
13
CSC Proprietary and Confidential
14