What is new in
HP LoadRunner
HP Performance Center
Version 12
Shane Evans
March 11, 2014
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
HP Apps 12
Application Delivery Management in the new style of IT
We enable you to deliver high performance
applications with unprecedented velocity and
uncompromising quality.
2
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Market trends
Delivering applications faster and with quality
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
A radically different kind of user
Mainframe
Client/Server
Web
Devices
System-centric
User-centric
Users born after 1980
4
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
All trends bend to the user
Wanted: constant access to feature-fresh apps running on the device of choice.
Mobility
Volume
Velocity
Volume
Mobile apps
Volume
Rate of release per app
per month
Native PC apps
Hybrid environments
On premise
Time
5
Cloud
Time
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Time
Change is accelerating
Mobile
Cloud
Cloud
Composite
Apps
Composite
Apps
Composite
Apps
Web
Web
Web
Web
WAN
WAN
WAN
WAN
Pace of Change
LAN
6
WAN
Application Development Trends
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Application complexity drives user experience
3rd Party
Cloud Services
Customers
Major ISP
Load
Web
App
DB
Balancers
Servers
Servers
Servers
Mainframe
Employees
Storage
Browsers&
Devices
Mobile Carriers
Content
&
ISPs
Delivery
Web
Mobile
Networks
Services
Components
Performance testing and virtualization reduces risk and total cost of ownership
7
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Performance Testing
Version 12
Cloud, mobile and continuous testing
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Introducing Performance testing v12
Build, test and deliver with breakthrough speed and quality
Cloud Testing
Maximum performance
and scale
Enhanced Mobile
Testing
Continuous
Testing
User Experience &
Community
Realistic performance
mobile testing
Continuous
integration with
DevOps
Ease of use from any
platform. Share and
connect with users and
partners
Support a wide range of technologies, methodologies and
environments that represent the new style of IT
9
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Flexible Delivery
Get started quickly and
economically, with
community edition
Quality and Performance is imperative for BSkyB
"At British Sky Broadcasting, customer
experience is fundamental to delivering the
expansive entertainment and technology
services we offer, making quality and
performance imperative for speeding
innovation and business growth,”
“With HP Performance Center, using new
enhancements including REST API support, we
can now continuously integrate performance
testing across development and Agile teams to
deliver superior content and services that
continue to excite our customers and scale
based on demand.”
-- British Sky Broadcasting
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
HP Performance testing components
End User
Client(s)
4
1
Application Server(s)
Internet/WAN
Virtualize the Network
Author Scripts
3
Generate Load
5
7
Centralized
Assets
HP Live Network
Trend
Reporting
2
Measure Impact
6
Performance Center
11
Database
Performance
Global
Lifecycle
Collaboration
Plan and Execute Tests
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Analysis, Diagnostics and Reporting
HP Performance testing version 11.50 recap
Continuously enabling performance engineering
HP LoadRunner
HP Performance Center
New VuGen
•Community Integration
•Solution Explorer
•Correlation Studio
•Step Navigator
•Customizable Layouts
•Correlation Engine
TruClient updates
•
•
•
•
Async
Function Reuse
New APIs
TruClient for IE9
Web/HTTP
enhancements
• Async (Push/Poll/Long
Poll)
• JavaScript Engine
• Data Format
Extensions
Performance Application
Lifecycle (PAL)
Aligns Production
understanding with preProduction assumptions for
higher quality Application
Performance Engineering.
Miscellaneous
DevOps
12
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Lab Management
Automated Dev/Test lab
scheduling and
provisioning on private
or public cloud and
Application Deployment
for Build Verification
Testing.
Spotlight
Cloud Testing
Maximum Performance and Scale
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Cloud Testing / Maximum Performance and Scale
Customer-centric enhancements to performance testing -- in the cloud
Scale without the overhead
using automated, worldwide
provisioning of load generators
in the cloud
HP LoadRunner
HP Performance Center
The world’s most widely adopted
performance testing solutions
Save time/effort
by leveraging and sharing
cloud testing configurations
and resources across teams
Simplify administration
by defining cloud accounts,
manage cloud host usage using
My Performance Center
14
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Cloud Testing / Maximum Performance and Scale
Scale without the overhead
HP Performance Center and HP LoadRunner
seamlessly leverage public Cloud infrastructure
to deploy LoadGenerators (LGs)
•
•
•
LoadRunner or
Performance Center
Scale up and down based on test
requirements
Geographical distribution
Share cloud environments in between tests
AUT
Connect securely
on standard ports
LG
LG
LG
Value:
Elastically scale up to meet demands reducing cost
and overhead of managing dedicated infrastructure
15
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
AUT
LG
Cloud Testing / Maximum Performance and Scale
Share cloud testing configurations and resources across teams
Add multiple Cloud accounts and manage Network
Profiles for connecting to your various LGs
• Manage cloud accounts
• Provision multiple LoadGenerators (LGs)
• Run test with Cloud LGs
• Review provisioning reports
Value:
Significantly reduces provisioning time of performance
testing, while maintaining security and control
16
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Cloud Testing / Maximum Performance and Scale
Simplify cloud administration with My Performance Center
Easy administration of a shared cloud
performance test environment using
My Performance Center
• Allow PC testers to create test sets within
MY PC
• Easier Test Creation via “Test Express”
• Provide visibility into LAB Management
• Ease of access of ALM feature set
Value:
Reduce time of administration of performance testing
shared environment
17
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Cloud Testing / User flow
Create Cloud accounts
Manage Cloud accounts
Provision multiple LGs
Provisioning LGs starts
Run load test with cloud LGs
Usage Cloud report
18
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Cloud Testing / User flow
Create Cloud accounts
Manage Cloud accounts
Provision multiple LGs
Provisioning LGs starts
Run load test with cloud LGs
Usage Cloud report
19
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Cloud Testing / User flow
Create Cloud accounts
Manage Cloud accounts
Provision multiple LGs
Provisioning LGs starts
Run load test with cloud LGs
Usage Cloud report
20
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Cloud Testing / User flow
Create Cloud accounts
Manage Cloud accounts
Provision multiple LGs
Provisioning LGs starts
Run load test with cloud LGs
Usage Cloud report
21
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Cloud Testing / User flow
Create Cloud accounts
Manage Cloud accounts
Provision multiple LGs
Provisioning LGs starts
Run load test with cloud LGs
Usage Cloud report
22
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Cloud Testing / User flow
Create Cloud accounts
Manage Cloud accounts
Provision multiple LGs
Provisioning LGs starts
Run load test with cloud LGs
Usage Cloud report
23
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Spotlight
Enhanced
Mobile Testing Experience
For offline and on- premise tests
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Complete Mobile Testing / Performance Testing
Test mobile performance the way you need
Test performance the way you need
for all Mobile app delivery models
with new recording
Realistic end-to-end mobile test
HP Mobile TruClient or HP LR Mobile
App Protocol integrated with
Shunra Network characteristics
Value: Complete mobile performance test
25
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Complete Mobile Testing/ Performance Testing
New Recording Options
Mobile Applications Protocol
• Supports Native and Hybrid apps
• Real and emulated devices (Proxy)
On Device Recording
• Android available
Mobile TruClient Protocol
• Emulates true User Experience
• Supports Web based Mobile apps
• Ideal for Agile development
SMP - SAP Mobile Platform
26
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Complete Mobile Testing / Performance Testing
The complete solution for performance testing…with network characteristics
The complete solution for performance
testing mobile apps:
Analyze Mobile Performance on Network
• Identify bottlenecks before end users
• Test in both good and BAD network connections
• Understand impact of mobile on entire system
• HP Mobile TruClient or HP Mobile Application
Protocol
• Advanced Shunra emulates true network
conditions
HP has announced the intention to
acquire Shunra Technology!
27
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Mobile Performance testing / Benefits
Increases customer satisfaction
Reduces risk of application performance
issues due to the network
Realistic mobile performance testing
Complete mobile performance testing
Provides the most comprehensive options
for mobile performance testing.
28
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Complete Mobile Testing/ Redefine performance
In all testing scenarios
Include network characteristics in
automated performance tests
• Today’s composite apps are distributed–
the network and it’s erratic behavior is a
constant!
• Full integration of HP Shunra Network
Virtualization with HP Service
Virtualization
• Define and control network parameters
• With the industry’s most comprehensive
library of Network Model definitions
Value:
Avoid “it was the network” to ensure
uncompromised quality
29
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Spotlight
Continuous Testing
Continuous integration with Dev/Ops
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Continuous Testing
Performance management across the application lifecycle
3 Keys to better
performance:
• Test early
• Test often
• Leverage data from
monitoring as
baseline for test
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Performance Testing for Continuous Delivery
Test Early, Test Often
Build Load Test scripts during Dev
•
Integration with MS Visual Studio and Eclipse
Run Unit Tests in Load Test Scenarios
•
•
Support for nUnit and Selenium tests as part of
LoadRunner scenarios
Load Scenarios as part of Unit Testing
Add Performance Tests as build steps in Jenkins
•
•
•
32
For automated test scheduling and execution
Report pass/failure by defined SLA
Other Frameworks in plan
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Test
Continuous Testing
Integration with Dev tools
Helping Dev/Test load test in Continuous
Integration (CI): HP LoadRunner provides
developers with tools and APIs to infuse
performance testing earlier
• Leverage developer assets, adding APIs to Unit
tests in Visual Studio or Eclipse
• Execute Unit tests using the LoadRunner engine
and view test analysis from Jenkins
• REST API to support Continuous Delivery
processes
Value:
Accelerate application delivery by integrating performance
testing in Agile and hybrid environments
33
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Continuous Testing / Redefine Performance
Integration with Dev tools – Unit test
Add LoadRunner APIs to Unit Tests in
Visual Studio or Eclipse
Execute Unit Tests using the
LoadRunner Engine
Verify Output within the IDE
Create LoadRunner scenario from
the IDE
Integration with Jenkins: Automate
test scheduling, execute tests and
view results as part of the build plan
34
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Continuous Testing / Redefine Performance
Integration with Dev tools – Unit test
Add LoadRunner APIs to Unit Tests in
Visual Studio or Eclipse
Execute Unit Tests using the
LoadRunner Engine
Verify Output within the IDE
Create LoadRunner scenario from
the IDE
Value:
Accelerate application delivery by integrating performance
testing in Agile and hybrid environments
35
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Integration with Jenkins: Automate
test scheduling, execute tests and
view results as part of the build plan
Continuous Testing / Redefine Performance
Integration with Dev tools – Unit test
Add LoadRunner APIs to Unit Tests in
Visual Studio or Eclipse
Execute Unit Tests using the
LoadRunner Engine
Verify Output within the IDE
Create LoadRunner scenario from
the IDE
Value:
Accelerate application delivery by integrating performance
testing in Agile and hybrid environments
36
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Integration with Jenkins: Automate
test scheduling, execute tests and
view results as part of the build plan
Continuous Testing / Redefine Performance
Integration with Dev tools – Unit test
Add LoadRunner APIs to Unit Tests in
Visual Studio or Eclipse
Execute Unit Tests using the
LoadRunner Engine
Verify Output within the IDE
Create LoadRunner scenario from
the IDE
Value:
Accelerate application delivery by integrating performance
testing in Agile and hybrid environments
Available only on LoadRunner
37
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Integration with Jenkins: Automate
test scheduling, execute tests and
view results as part of the build plan
Continuous Testing / Redefine Performance
Integration with Dev tools – Jenkins
Add LoadRunner APIs to Unit Tests in
Visual Studio or Eclipse
Execute Unit Tests using the
LoadRunner Engine
Verify Output within the IDE
Create LoadRunner scenario from
the IDE
Value:
Accelerate application delivery by integrating performance
testing in Agile and hybrid environments
38
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Available with LoadRunner and Performance Center
Integration with Jenkins: Automate
test scheduling, execute tests and
view results as part of the build plan
Continuous delivery
REST API to support Continuous Delivery
processes:
Schedule, Run, Stop, Collate, Analyze tests
via REST API
Create Monitors, Topologies
Connect to Continuous Integration
solutions
39
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
NOTE: all product views are illustrations and might not represent actual product screen shots
Continuous Testing / Performance Application Lifecycle
Accurate, Realistic, Reliable Testing
Collect & analyze
production data
Analyze and tune
load test data
Load test
Compare production
and load test data
Refine load test details
Google Analytics and IIS data
For performance testing baseline
40
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Continuous Testing / Benefits
Developers and performance engineers:
Integrated and fast apps delivery
Accelerate application delivery by
integrating performance testing in Agile and
hybrid environments
Accelerate performance testing
Performance testing closer to reality with
accurate, realistic, reliable test: reduce risk
and improve test results
41
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Spotlight
Remarkable
End User Experience
Ease of use from any platform
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
My Performance Center UI
Ease of use and access
Allow PC testers to create test sets within MY PC
Easier Test Creation via “Test Express”
Provide visibility into LAB Management
Ease of access of ALM feature set
43
Easy
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
NOTE: all product views are illustrations and might not represent actual product screen shots
Test express
44
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
NOTE: all product views are illustrations and might not represent actual product screen shots
Remarkable End User Experience / Ease of Use
UI and automation features
Performance testing with relentless efficiency
• Analysis templates
• Support additional languages
• Support for SPDY and WebSockets
• TruClient Web/HTTP converter utility
• Reuse of test data via new VTS
Value: Slash time to test applications for
continuous high performance
45
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Building on our Community
Strength in Mindshare
HP Live Network (HPLN)
Integration with VuGen
• Automated content delivery
• HP, Partner and Community
developed Function Libraries,
Correlation Rules and Data
Format Extensions
• Connected to HP Passport
Partner-developed Protocols
• Planned sale/delivery via HPLN
46
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Updated HP Integrations
Open to all, better together
Requirements
Develop
Test
Deploy
Agile Delivery
Application Lifecycle Management
Dev integrations
Anywhere
HP Service Visualization 3.0, 3.1
HP Diagnostics 9.2, 9.3
HPQuality
SiteScope
Center 11.02 Service Management
HP Unified Functional Testing (UFT) 12
Business Service
Performance Center
HP Application LifecycleManagement
Management (ALM) 12
Fortify
Continuous Delivery
Automation
Service Virtualization
47
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
NOTE: all product views are illustrations and might not represent actual product screen shots
Spotlight
Flexible Delivery
Get Started Quickly and Economically
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Flexible Delivery / New Price Structure & Free trials
Free offers and trials
New Price Points
Offerings to get you
started:
• LoadRunner Community
• Performance Center
“smoke testing”
Pricing and licensing
simplicity
Controller cost has been
removed
Delivery your way
Multiple delivery options:
• Perpetual or Term licenses
• PC on SaaS
• LoadRunner in the Cloud
GREAT Opportunity to upgrade from LR to PC
49
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
To learn more…
Learn more at HP LoadRunner and HP Performance Center Blog.
Join HP Software on Facebook and Twitter.
www.hp.com/go/performancecenter
www.hp.com/go/loadrunner
50
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Closing & Questions
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Thank you