* A Systematic Literature Review for Software Sustainability Measures Coral Calero University of Castilla-La Mancha Ciudad Real, Spain Coral.Calero@uclm.es Manuel F. Bertoa Mª Ángeles Moraga University of Malaga Malaga, Spain University of Castilla-La Mancha Ciudad Real, Spain bertoa@lcc.uma.es MariaAngeles.Moraga@uclm.es Coral Calero * We are quite sure sustainability is related to quality * We need to define, formally, sustainability (similarly to quality definition) * lt is necessary to use measures and indicators in order to evaluate or to improve the sustainability of a software product * OUR MESSAGE 2 * The Sustainability formal definition (using ISO/IEC 25010) User interface aesthetics Functional Appropriateness Functional Sustainability Appropriateness Coral Calero Confidentiality Usability Recoverability Security Integrity Functional Suitability Functional Completeness Maturity Fault tolerance Adaptability Portability Performance efficiency Interoperability Maintainability Sustainability Usability Resource utilization Accesibility Modularity Testability Time behaviour Availability Reliability Product Quality Compatibility Co-existence Operability Authenticity Functional Sustainability Suitability Functional Correcteness User error protection Learnability Non repudiation Accountability Appropriateness recognizability Capacity Reusability Modifiability Sustainability Capacity Installability Replaceability Appropiateness Sustainability recognizability Analysability * ISSUES WE ARE FACING 3 * The search of measures (doing a SLR) Research questions RQ1) How much activity was there in the last 20 years? RQ2) Are there software sustainability measures and indicators proposed in the literature? RQ3) What sustainability aspects have been paid more attention? Coral Calero Source selection Exclusion criteria • Publication between 1/1/1992 - 31/12/2012 • All the phases of the software development process • References to software engineering • Scientific soundness • Relevance with respect to research questions • Definition of measures or indicators related to software sustainability • “Environment” meant in the sense of system environment, not nature. • “Ecosystem” meant as population of interacting systems, for example, agents. • Measures related to software process, to enterprise, to quality of service or to hardware • The paper does not propose measures, or are not relevant • Studies only available in the form of abstracts or Powerpoint presentations and Duplicate studies RQ4) What are the limitations of current research? RQ5) Are there measures proposals that fit on the 25010+S model? Search string Inclusionexclusion criteria Final set of papers and results 4 Inclusion criteria. (sustainab* OR environment* OR ecolog* OR green) AND (software measure* OR software metric* OR software indicators) However, due to the great amount of results obtained, we have debugged the results using the tools given by the different digital libraries search engines. Specific forums: GREENS 2012 and re4susy2012 IEEE Digital Library ACM Digital Library * ISSUES WE ARE FACING ACM Returned by the search engine Selected by abstract 400 41 36 100 4 41 100 31 11 7 5 3 6 3 18 4 740 70 Query 1 Query 2 Query 3 General Query Query 1 Query 2 Query 3 IEEE Specific Forums Coral Calero Total 2003 1 2004 1 2005 0 2006 0 2007 0 2008 2 2009 2 2011 1 44% Number of measures 70 60 50 40 30 20 10 0 Quality in use Product quality 5 2010 2 QoS Company level Process quality Selected by abstract (without repeated) ACM 47 IEEE 17 Specific forums 4 Total (without repeated) Digital Library 2012 7 Selected by Full text 9 5 3 16 * Is Coral Calero correct our approach to software sustainability? * * * Considering it as part of the quality Using the ISO/IEC 25010 Considering it as a measurable concept * PROPOSED QUESTION 6 * THANKS!! Coral Calero Coral.Calero@uclm.es Manuel F. Bertoa Mª Ángeles Moraga http://greenalarcos.blogspot.com.es/