Knowit
Kristjan Kristjansson
Partner / Managing Consultant, Knowit Quality Management Oslo AS
Started at Knowit Quality Management Oslo AS Sept. 2013.
I have 12 years experience in the area of ​testing and quality assurance
from both the customer and vendor side, and i have a general broad
experience with test tools.
I have worked for many years in the Norwegian Armed Forces and this is
where i got really intressted i testing 
Utvalgte kunder: Nordea, Statsbygg, Oracle, Santander Consumer Bank, DNB, Telenor,
Simens Business Services – Det Norske Forsvaret.
Kristjan Kristjansson
Partner
+47 920 81 741
krk@knowit.no
http://no.linkedin.com/in/k
ristjan74
Nordic
1900 specialists
400 in Norway
Norway
Bergen, Oslo, Stavanger and
Kristiansand
Business
Areas
A large number of specialists in 3 main areas
1200
IT
400
200
Management
Design&
Digital
IT
The new
solutions
A unique combination of specialists creates a unique delivery
to our customers
BI
UI
User
Management
Brand
Design&
Digital
” We are allways looking for more
consultants, so please keep us in mind ”
IT
The new
solutions
A unique combination of specialists creates a unique delivery
to our customers
BI
UI
User
Management
Brand
Design&
Digital
Todays agenda
Introduction
Why test automation for mobile
Challenges in test automation for mobile
HP's tool set for test automation for mobile
Demo
Q&A
HP Software
- Arne Christian Sandsmark
A tipping point for application delivery
Surging application numbers
“Social, mobile, analytics,
cloud have reached the
tipping point in 2013.”
“New application
projects surge in 2013
and beyond.”
What we expect:
• Apps everywhere
• Accessed through multiple devices
• 30x increase in application
releases
• Closed feedback loop with
customers
2010
4 per app
2013
2015
36 per app
2020 • Focus on time-to-value and ROI
120 per app
Number of releases
per app per year
Composite applications
Business processes are actually an integration of existing components and
services
Each of these steps are
interconnected software
components, also called services
EXAMPLE:
The Online Shopping
Process
Search
Product
Buy
Customer Profiles
Composite
Pay
Payment
Managed Cloud Traditional
Ship
Track
Shipping
Track package
Public Cloud
Delivering change continuously and fast is risky
The Risks:
Interdependence
increases business
risk
• Apps are interdependent
• Each change adds to risk
Composite Application
Change
is constant
• New implementations
• Support packs
• Customizations
Speed
impacts bottom line
• Time to revenue
• Cost of
implementation
Q
Quality assurance
by validation throughout the
Application Lifecycle will
address these risks
HP Apps 12 addresses the spectrum of ALM
stakeholders
Stakeholders use their tool of
choice, while sharing resources
with complete traceability for a
unified ALM experience
Manual tester
Scrum
master
HP Agile Manager
VP of Apps
HP ALM Dashboard
App Security
tester
HP Fortify
HP Sprinter
HP ALM
Functional test
engineer
HP Unified Functional Testing
Unified, Automated, Collaborative
Performance engineer
Business
analyst
HP ALM Requirements
HP Performance
Testing
Management
Quality Assurance
HP Quality
Center
Developer
(SAP/ORCL)
Developer
(Java/.Net)
70+ Developer Tool integrations
HP Sprinter for Mobile
Session sharing
Snapshot support
Device vitals
Powerful testing suite
Interoperability
Test application
management
Predefined Widgets
Manual
Automation
HP Sprinter
Video streaming
Effective and efficient manual
testing of mobile apps and web
Sprinter
UFT
Private
Cloud
Public
Cloud
In-house
Full device
control
Wide
spectrum
HP MobileCloud Express
Powerful testing suite
Unlimited real-time shared
viewing of test execution,
device booking
management system
Pre-packaged and
pre-configured
Powerful replay
Full device control
Manual
Automation
Synced data to ALM and QC
Unlimited automation
Entry-level on-premise solution
Sprinter
UFT
Private
Cloud
Public
Cloud
In-house
Full device
control
Wide
spectrum
Knowit Quality Management AS
- Raj Rajangam
About me
•
•
•
•
•
Responsible for Test Automation in Knowit Quality Managment
12 years experience in test automation
International experience (eg: Coca-Cola, Barnes & Noble, and others)
I have led a number of automation projects
Broad experience from a variety of tools / frameworks
Why mobile is vital
Brand awareness
Increased
revenue
Monetization
Boost experience
Increased
profitability
Mobile success and failure is very visible
Very poor app
ranking in app store
Competitors have
4 star apps
Where is your app?
April 2012
What makes Mobile
complex
DEVICE
Development platform
vs
vs
Browsers
NETWORK
• Interoperability between 2/3/4G/wifi
• More content offered by 3rd parties
• Real-time services (voice,
streaming)
• Location-based services
BACKEND
• Complex value chain
• Mutiple integration points
How different Mobile testing is
Click
Double click
Right click
Drag
Snapshot
Type
Rotate / Tilt
Locate
Authenticate
Type
Speak
Tap & Multi tap
Double / long tap
Drag
Swipe
Pinch & zoom
Communicate
Test Automation
What can get in the way?
store
Silos
web
App Style
Cross-Platform
Differences
Use cases
Cross-platform differences
Name position
Menu panel
Labels
Text colours
Images
Button images
Layout issue
Build a
mobile testing strategy
Is this your mobile test lab?
Real devices, but how will it scale?
Select the right solution
Integrated testing suite
Help you accelerate the delivery of
your mobile applications
Manual
Automate
Deployment options
Help you scale, comply with
regulations, perform complex testing
scenarios
Private
Cloud
Public
Cloud
In-house
Real devices
help you understand the real
end user’s experience
Full device
control
Wide
spectrum
Choose the right level of tests
Build the optimal device testing matrix
Development
Unit testing
Sanity
Devices
New devices
Practices
Quality Assurance
Production
Regression
Compatibility
Interoperability
« Must » devices
« Major » devices
« Market » devices
4-8
8-20
20-40
~1 per quarter
~2 per quarter
~10 per quarter
Emulators + dedicated devices
Dedicated Devices
Shared Devices
HP UFT Mobile
HP UFT Mobile
Comprehensive market leading solution for functional test automation
Enables a consistent, repeatable process to:
•
•
•
•
•
Automate manual test scripts
Test a broad range of technologies
Accelerate testing cycles
Validate quality of frequent builds
Reduce per unit cost of testing
HP UFT mobile
•
Centralized, powerful automated testing solution for all mobile
application and web based services
•
Access to a LARGE mobile devices “sandbox” for validation and
manual testing
•
Browsing and validating automatically across a wide array of mobile
devices
HP UFT Mobile options
BOTH Private and Public Cloud
Automated
Functional
Testing
HP UFT
Private cloud of
dedicated real devices
HP UFT
Mobile
Mobile
functional test
Public cloud of
shared real devices
Web, DB, and
other servers
HP UFT Mobile
A mobile cloud of real devices
Test with real devices
A graphically driven
cloud service
Extends UFT…
one automated test,
on multiple platforms
(ScriptOnce)
HP UFT Mobile
Key strengths
Flexible and Scalable
Agile and Rapid
Multiple real devices
Cloud based service
Powerful automation
enables frequent test
coverage
Device agnostic scripts.
Write once and use on
multiple devices
Able to rapidly re-test
applications after each build
Integrated with HP
ALM
Requirements
Traceability
Test Planning
Defect Management
Mobile platform support
•
Supported Operating Systems:
•
•
•
•
•
•
•
•
Android – all versions
iOS - all versions
BlackBerry – up to version 10 (expected to be supported on release)
Symbian
Windows Mobile
WP 7.5 – LG platform
Meego, Limo
Supported manufacturers:
Nokia, Samsung, Motorola, Sony, LG, Apple, HTC, RIM,
Huawei, Acer, Asus, HP, Dell, Alcatel, Sharp, Toshiba, ZTE, Panasonic
Automated Testing with HP UFT Mobile
Real mobile devices
HP UFT
Extension
Powerful testing suite
(and emulators)
Perform almost any operations
Integrated with HP
ALM
Scalable
Device
agnostic
From single, small project
to hundreds of
simultaneous users
Develop, run and
schedule one test
across multiple
platform
Visual & Object
analysis
Secured
Full tractability of actions.
Device cleanups and
encryption abilities
Continuous testing
Global
Support fast, agile delivery
Accessible from any
location
(VPN mandatory with
MCE)
Manageable
Effective and efficient manual
testing of mobile apps and web
Manual
Automate
Full IT control on
authentication, access
permission and activities
Predictable availability
Complex scenario
advanced built-in functionalities
such voice injection and
recognition, NFC, location
based
Private
Cloud
Public
Cloud
In-house
Full device
control
Wide
spectrum
Demo
QA