Application Lifecycle
Optimization with
Agile Collaboration
and Cloud DevTest
Labs
Name
Date
Changing nature of applications – where is the application?
Users and and the applications have moved to the cloud.
— Applications are no longer in the hands of call
centers. Losing simplified consumption and
training of application use.
— Applications are no longer on our enterprise
computers and green screens. Losing control
over delivery of business applications.
— Applications are in the hands of the end
users. Losing knowledge of how the
application is being used. Who is SME?
2
Increasing complexity and heterogeneity of environments
— Internal cloud initiatives are pervasive, data visualization is in
the cloud
— Production is the only true end to end implementation people
have for combined business workflows
— These environments are getting more complex – monitoring
of a application is spanning data centers and cloud providers
— Production visibility is the only accurate record of how
composite and SOA applications actually run in cloud providers
3
Cloud based lab Constraints
“Wires hanging out” of the cloud for DevTest Labs
System Dependencies Remain
Unanswered
Mainframe
SaaS
System of
Record
DB
Cloud Environment
Dev
CRM
Provision Requests
Test
Order Mgr
Virtual Lab VM
Manager Catalog
Websphere
Virtual Machines
Dev & Test Cloud – Addressing Bottlenecks preproduction
Throughput is always set by the lowest capacity system
Post-Cloud throughput
20
20
2
10
8
=2
Actual throughput
Portal
Service/XML
Gateway
=2
ERP System
Order Mgmt
(CAN’T REPLICATE)
Fulfillment
Any off-Cloud system nullifies the promise of on-demand capacity
Introducing CA LISA suite
Optimizing Agile Composite Application Development
Portfolio
Management
Requirements
Design
Dev
System
Test
Integration
Test
UAT
Performance
Test
Deploy
Monitor
Application Lifecycle
Planning &
Governance
LISA
DevTest Cloud Manager
Service
Virtualization
Test
Automation
Defect
Collaboration
Platforms for agile composite app dev
ALM
(Requirements, Code, Test Mgmt)
Continuous
Validation
Production
& Support
Dysfunctional Development Cycles
Meeting business demand has consequences in IT
 Most new applications are composite and highly integrated
 Agile has replaced waterfall development methodologies
 Much of the new application development is self-service and customerfacing making complexity exponential
WWW.ITKO.COM
Dysfunctional Development Cycles
Meeting business demand has consequences in IT
 Much of the information developers need is outside of their control when they need it
 Limited predictability on performance and where it’s going to break
 Traditional products and methodologies fail in this new cloud architecture
Result: Inability to release new functionality on time – over budget and poor quality
WWW.ITKO.COM
4 Huge Opportunities for Improvement
WWW.ITKO.COM
Problem: Constraints
“I can’t do anything unless I have everything”
Flexible options to create and maintain Virtual Services
Live Traffic
HTTP
SOAP
Transaction logs,
WSDL definitions, flat
files, other
Agents
JMS
JDBC
Create
Virtual Services are typically 95100% “complete” upon creation
LISA Workstation
Virtual Services
Source
Application
Maintain
“Self-Heal” from
Live Systems
Constraint: Limited capacity for production level load tests
Large North American consumer bank web presence
Public facing applications
Load Generators
ESB
ESB
Eliminate Capacity Constraints
Back-end
Services
~20 tps
Before After
VSE
~5000 tps
Business Problem
Business Impact

Limited capacity on test instances of Back-end
Services

Unable to sufficiently test ESB for performance
 More complete SLA testing in less time
 Test lab costs reduced 30% in Year 1, 65% in
year 2
 Avoided over $30M in test lab hardware
upgrades
Constraint: Could not deliver on parallel development
Regional telco and global internet backbone
Billing
VSE
Savvion
DELAY
VSE
Siebel
DELAY
Time
Time
Before After
Business Problem


Business Impact
Integrate enterprise systems for 7 acquired
telecom companies


Increase speed and agility to deliver new
product offerings

70% testing time reduction for end-to-end
New release functional points increased by 60%
with better quality
38% reduction in testing time due to virtualizing
unavailable systems11
Problem: Manual Labor
“My team of 50 is now a team of 250 in just 5 years due to
more components and releases.”
Solution: Automation
Achieve and maintain 85%-95% coverage after 1st test cycle.
Baseline generation
Replay previous application transactions to verify behavior
Problem: Complexity
“We spend far more time figuring out where the bug is than
we do fixing the bug”
Solution: Collaboration
“Alt-Click!”
DEVELOPER
TESTER
Reduced “non-reproducible” defect closure by > 66%
Complexity: highly integrated systems inside enterprise
Leading Electronic Retailer – Mobile Sales app
System access
denied
Data setup 4+
hours/test
CMS
Apps
Errors lost at
integration
Customer
Info
App upgrade
incomplete
CMS
Database
OMS
CSR
APP
Integration
Broker
Functional &
Regression
Testers
Pricing
& Offers
Vendors
Inventory
Management
POS
Systems
Changes
invalidate
regressions
Result: Inability to release customer functionality to stores on time!
VMI
Solution: Visibility to DevTest Labs exposing application
behavior
Automate end-to-end regression and performance test
scenarios for better productivity
Baseline and
Directly invoke &
verify
ESB responses
CA LISA Users
Middle-tier
test suites
CMS
Apps
Virtualize
Customer app
ready 24/7
Customer
Info
Model virtual app
from definition
CA LISA agents
capture data, test
cases,
environment
CMS
Database
OMS
CSR
APP
Integration
Broker
Pricing
& Offers
Vendors
Inventory
Management
Functional &
Regression
Testers
POS
Systems
Deliver end-toend testing using
CA LISA Baseline
Reduce infrastructure cost, setup time and execute 60x faster
VMI
Complexity: Cloud based consumer applications
How is the user actually using the system?
I just use the back
Button…
End Users
I book marked this
page and start here…
22
How do the
users do
that?
Quality
Teams
Production Data Mining to Close the Loop
understanding Production enables a new best practice…
Load
Pattern
OMS v2.0
v2.1
Mainframe
System of
Record
ERP
Cost
Performance
Profile
Remove the problem of “wires hanging out”
For Cloud DevTest Labs
Virtual
Service
Catalog
CA LISA Virtualize
(Virtual Services)
Dev
Provision Requests
LISA Dev Cloud
Manager
MFvs
DBvs
SaaSvs
Test
VM
Catalog
Order Mgr
CRM
Websphere
Virtual Machines
Model dependent systems in dev test cloud to create
production like environments
Better modeling in Cloud DevTest Labs optimizes the
application lifecycle
Requirements
Design
Development
System Test
Integration
Test
UAT
Maintenance
WWW.ITKO.COM