* A Systematic Literature
Review for Software
Sustainability Measures
Coral Calero
University of Castilla-La Mancha
Ciudad Real, Spain
Coral.Calero@uclm.es
Manuel F. Bertoa
Mª Ángeles Moraga
University of Malaga
Malaga, Spain
University of Castilla-La Mancha
Ciudad Real, Spain
bertoa@lcc.uma.es
MariaAngeles.Moraga@uclm.es
Coral Calero
*
We are quite sure sustainability is related to
quality
*
We need to define, formally, sustainability
(similarly to quality definition)
*
lt is necessary to use measures and
indicators in order to evaluate or to improve
the sustainability of a software product
* OUR MESSAGE
2
* The Sustainability formal definition (using ISO/IEC 25010)
User interface
aesthetics
Functional
Appropriateness
Functional
Sustainability
Appropriateness
Coral Calero
Confidentiality
Usability
Recoverability
Security
Integrity
Functional
Suitability
Functional
Completeness
Maturity
Fault tolerance
Adaptability
Portability
Performance
efficiency
Interoperability
Maintainability
Sustainability
Usability
Resource
utilization
Accesibility
Modularity
Testability
Time
behaviour
Availability
Reliability
Product Quality
Compatibility
Co-existence
Operability
Authenticity
Functional
Sustainability
Suitability
Functional
Correcteness
User error
protection
Learnability
Non repudiation
Accountability
Appropriateness
recognizability
Capacity
Reusability
Modifiability
Sustainability
Capacity
Installability
Replaceability
Appropiateness
Sustainability
recognizability
Analysability
* ISSUES WE ARE FACING
3
* The search of measures (doing a SLR)
Research
questions
RQ1) How much activity was
there in the last 20 years?
RQ2) Are there software sustainability measures
and indicators proposed in the literature?
RQ3) What sustainability aspects
have been paid more attention?
Coral Calero
Source
selection
Exclusion criteria
• Publication between 1/1/1992 - 31/12/2012
• All the phases of the software development
process
• References to software engineering
• Scientific soundness
• Relevance with respect to research questions
• Definition of measures or indicators related to
software sustainability
• “Environment” meant in the sense of
system environment, not nature.
• “Ecosystem” meant as population of
interacting systems, for example, agents.
• Measures related to software process, to
enterprise, to quality of service or to
hardware
• The paper does not propose measures, or
are not relevant
• Studies only available in the form of
abstracts or Powerpoint presentations and
Duplicate studies
RQ4) What are the limitations
of current research?
RQ5) Are there measures proposals
that fit on the 25010+S model?
Search
string
Inclusionexclusion
criteria
Final set of
papers and
results
4
Inclusion criteria.
(sustainab* OR environment* OR ecolog* OR green)
AND (software measure* OR software metric* OR
software indicators)
However, due to the great amount of results obtained,
we have debugged the results using the tools given by
the different digital libraries search engines.
Specific
forums:
GREENS 2012
and
re4susy2012
IEEE Digital
Library
ACM Digital
Library
* ISSUES WE ARE FACING
ACM
Returned by the
search engine
Selected by
abstract
400
41
36
100
4
41
100
31
11
7
5
3
6
3
18
4
740
70
Query 1
Query 2
Query 3
General Query
Query 1
Query 2
Query 3
IEEE
Specific Forums
Coral Calero
Total
2003
1
2004
1
2005
0
2006
0
2007
0
2008
2
2009
2
2011
1
44%
Number of measures
70
60
50
40
30
20
10
0
Quality in use Product quality
5
2010
2
QoS
Company level Process quality
Selected by
abstract
(without
repeated)
ACM
47
IEEE
17
Specific forums
4
Total (without repeated)
Digital Library
2012
7
Selected by Full
text
9
5
3
16
* Is
Coral Calero
correct our approach to software
sustainability?
*
*
*
Considering it as part of the quality
Using the ISO/IEC 25010
Considering it as a measurable concept
* PROPOSED QUESTION
6
*
THANKS!!
Coral Calero
Coral.Calero@uclm.es
Manuel F. Bertoa
Mª Ángeles Moraga
http://greenalarcos.blogspot.com.es/