STX project and software testing
Ossi Taipale
2012
Lappeenranta University of Tech.
STX among the other software
testing research projects
 Top down approach in the research projects :
ANTI-project:
Basic research
of SW testing,
2004 - 2007
ISO/IEC 29119:
SW testing
standard
MASTO-project:
Reference model
of SW testing,
2008 - 2011
SW testing in
the cloud
STX-project:
Intended
quality,
2011 - 2014
ISO/IEC 29119,
33063,
25000 series
Cloud
Testing
Laboratory
2014 -
Software testing research
 ANTI-project (2004 – 2007) : Factors af fecting sof tware
testing , for example:
• Product orientation, explicit knowledge, documented
information, SPL, product variants, outsourcing, repetitive
testing , reuse, testing automation.
• Service orientation, tacit knowledge, domain knowledge,
new delivery models, adaptive testing, explorative and
manual testing.

•
•
•
•
MASTO-project (2008 – 2011):
Reference model of software testing (ISO/IEC 29119)
Assessment model of software testing (ISO/IEC 33063)
Software testing in the cloud
Mapping between software product attributes and software
testing (ISO/IEC 25010)
Software testing and development
for intended quality, STX (20112014)
Research Problem
OU’s are evaluated through an assessment framework
Intended
Software Quality
Software
Development
•Software Products
ISO/IEC 12207
ISO/IEC 33000
series
•New Services,
Cloud computing
ISO/IEC 25000
series, Software
Quality
Software Testing
ISO/IEC 29119, 33063,
IEEE Std 1012, cloud
testing
Objective
 To show how software development, software testing and
intended quality depend on one another.
 Traditional software development and service models
 Emerging XaaS (Everything as a Service) architectures,
technologies and service models.
 The project results help the participating companies in
improving the ef ficiency of their quality management and
software testing and hence the ef ficiency of their software
development as a whole.
 Testing techniques
 Testing as a service
Testing of Quality Characteristics
Software testing
standard 29119
Part 4 contains
information on
how to map
Quality
Characteristics to
Test Design
Techniques and
how to map
Quality
Characteristics to
Types of Testing.
This is used as
reference in this
study.
Software Testing in the Cloud
 Cloud based testing offers a new delivery,
operation and maintenance model that is enabled
by the internet.
 It affects the actual testing work and the way
testing services are delivered. It also engages
the management in paying attention to aspects
such as pricing and security.
 Objective: This is an empirical study aimed at
understanding how organizations can
successfully use the cloud for testing and how
cloud based testing facilitates or hinders in
reaching for quality requirements or quality
attributes.
Software Testing in the Cloud
Testing in the cloud affects:
 Acquisition (cloud based testing emphasizes
services)
 Business (cloud based testing emphasizes pay
per use instead of license fees)
 Access (services are accessed over internet)
 Technical models of testing e.g. scalability
Publications from the STX project
(2011-2014)
Peer-reviewed articles
1. Riungu-Kalliosaari L., Taipale O., and Smolander K., "Testing in the
Cloud: Exploring the Practice", Preprint for Special Issue on Software
Engineering for Cloud Computing, IEEE Software (March/April 2012).
2. Pesonen, T., and Smolander, K., "Observations on eBusiness
Implementation Capabilities in Heterogeneous Business Networks", IFIP
International Federation for Information Processing, pp. 212-226, 2011.
3. Riungu L.M., Taipale O., and Smolander K., "Research Issues for
Software Testing in the Cloud" IEEE Second International Conference on
Cloud Computing Technology and Science (CloudCom), pp.557-564, Nov-Dec
2010.
4. Riungu L.M., Taipale O,, and Smolander K., "Software Testing as an
Online Service: Observations from Practice", 3rd International Conference
on Software Testing, Verification, and Validation Workshops (ICSTW), pp.418423, April 2010.
Publications from the STX project
(2011-2014)
Theses
M.Sc.
1. Aoke L., "Use of Standards in Software Development, Testing and
Quality Assurance: Special Focus on China", M.Sc Thesis, April 2012.
2. Timilsina U., "Security Issues on Testing of Public Cloud Applications",
M.Sc Thesis, February 2012.
Publications from the STX project
(2011-2014)
In Review
1. Riungu-Kalliosaari L., Taipale O., and Smolander K., "Software Testing as a
Service: Perceptions from Practice", Book chapter in review for Software Testing
in the Cloud: Perspectives on an Emerging Discipline, IGI Global (2012).
2. Timilsina U., Riungu-Kalliosaari L., Taipale O., Smolander K., "Security Issues
on Testing of Public Cloud Applications", Submitted to a Chinese journal, May
2012.
3. Seth F.P., Mustonen-Ollila E., Taipale O., and Smolander K., "Software Quality
Construction: Empirical Study on the Role of Requirements, Stakeholders
and Resources", Submitted to the 19th Asia-Pacific Software Engineering
Conference (APSEC 2012), June 2012.
4. Riungu-Kalliosaari L., Taipale O., Smolander K., and Richardson I., "A
Framework and Strategy for Cloud-based Testing in Practice", on-going 2012.
.
Cloud testing laboratory 2014…
Cloud-toimitusmalli edustaa uutta ohjelmistojen toimitusmallia
(delivery model). Tutkimusyhtiö Gartner arvioi cloud-toimitusmallin
mullistavan ohjelmistotuotannon rakenteen seuraavan kymmenen
vuoden aikana. Tämä muutos vaikuttaa sekä olemassa olevaan
ohjelmistotuotantoon että avaa uusia mahdollisuuksia suomalaisille
yrityksille pääsyyn maailman markkinoille. Muutoksen on arvioitu
sisältävän esimerkiksi ohjelmiston hankintamallin muuttumisen
ostomallista palvelumalliksi ja liiketoimintamalli muuttumisen
lisenssimaksupohjaisesta käytön perusteella veloitettavaksi. Lisäksi
ohjelmistoa käytetään ilman asennusta omalle työasemalle Internetin
yli ja cloud-toteutuksen tekninen malli tukee esimerkiksi
laajennettavuutta, uudelleen käyttöä, ylläpidettävyyttä, ja pääsyä
globaaleille markkinoille.