Reusability
Interoperability
Reliability
Efficiency
Supportability
Replaceability
Functionality
Flexibility
Testability
Security
http://www.tickit.org/
n
tio
ra
st
illu
ly
on
Kristian Sandahl, IDA
krisa@ida.liu.se
certification auditors,
a standardized training course for certification auditors,
a registration scheme for approved certification auditors,
a system for accrediting certification bodies for conducting TickIT
certifications,
a logotype to be used on certificates to show TickIT certification.
a standard set of requirements on the competence and behavior of
Kristian Sandahl, IDA
krisa@ida.liu.se
Kristian Sandahl, IDA
krisa@ida.liu.se
standard deviation from the mean = 3.4 faults per million
Define
Measure
Variant of the Shewhart cycle
Analyze
Improve
Control
Statistical process control
The variance of approved products should lie +/- 3
Manageability
Maintainability
An interpretation of ISO 9001 for software,
Safety
Integrity
Six sigma
Survivability
Usability
TickIT
Many
⇒Sandahl, IDA
Manyopinions
opinions
Kristian⇒
krisa@ida.liu.se
Statistical
Statisticaltechniques
techniques
requirements
Value-based – market sets the value
Manufacturing-based – conformance to
Usage-based – in the eyes of the beholder
Price?
Portability
Correctness
Transcendent – something we learn to recognize
Product-based – measurable variable
Quality factors
Perspectives of quality
is built on the principles:
1: Initial
2: Repeatable
Kristian Sandahl, IDA
krisa@ida.liu.se
Kristian Sandahl, IDA
krisa@ida.liu.se
5: Optimising
Each level has process areas.
3: Defined
4: Managed
Principle 1 Customer focus
Principle 2 Leadership
Principle 3 Involvement of people
Principle 4 Process approach
Principle 5 System approach to management
Principle 6 Continual improvement
Principle 7 Factual approach to decision making
Principle 8 Mutually beneficial supplier relationships
CMMI
A guideline to apply ISO 9001 to software industry, which
ISO 9000-3
Experience factory
Configuration Management
Process and Product Quality Assurance
Measurement and Analysis
Supplier Agreement Management
Project Monitoring and Control
Project Planning
Requirements Management
PA CMMI2
Kristian Sandahl, IDA
krisa@ida.liu.se
Kristian Sandahl, IDA
krisa@ida.liu.se
QFD
Requirements Development
Technical Solution
Product Integration
Verification
Validation
Organizational Process Focus
Organizational Process Definition
Organizational Training
Integrated Project Management
Risk Management
Decision Analysis and Resolution
Organizational Environment for Integration
PA CMMI3
Kristian Sandahl, IDA
krisa@ida.liu.se
Kristian Sandahl, IDA
krisa@ida.liu.se
Set quantifiable goals
Select processes
Run processes
Measure objectives
Analyse measurements
Package experience
Kristian Sandahl, IDA
krisa@ida.liu.se
Inspection
data
Analysis
Coding
Inspection
Sandahl, IDA
data Kristiankrisa@ida.liu.se
Test-cases
Inspection Inspection Inspection
data
data
data
Design
Improvement: reduce variation, increase precision
Control – adjust the process
Assurance – prediction of defects
Appraisal – defect detection
Inspections in quality assurance
6.
5.
4.
3.
2.
1.
QIP
n = number of nodes
complexity
Size can be measured in:
Kristian Sandahl, IDA
krisa@ida.liu.se
Kristian Sandahl, IDA
krisa@ida.liu.se
maintained for the user. Weight: 10
Number of external interfaces – any computer-readable
I/O. Weight: 7.
Sometimes a file might be counted twice.
Number of logical files – any group of information
system. Weight: 4
Number of user online queries requiring action by the
reports, lists. Weight: 5
Number of user outputs – distinct output applications:
online queries. Weight: 4
Number of user inputs - distinct input applications , not
Language-neutral combination of size and
complexity
Mostly used for administrative information
systems
Growing interest, but still a closed community
Factors in function point analysis
Kristian Sandahl, IDA
krisa@ida.liu.se
Function points
Kristian Sandahl, IDA
krisa@ida.liu.se
e = number of edges (arcs)
Often a linear combination between size and
Due to McCabe(76)
Cyclomatic number V(G) = e – n + 2
Regression analysis from empirical material
lines of code (KLOC)
function points
Halstead software science
Measuring complexity
Research – predicting troubles
3
XI
IV
5
V 6 VI
7
8
VII 9 VIII
10
11
IX 12 X
13
14
4
1
II
Kristian Sandahl, IDA
krisa@ida.liu.se
=TQM
Kristian Sandahl, IDA
krisa@ida.liu.se
V(G) = 14 – 11 + 2 = 5
What’s get measured gets done
Importance of feed-back
Non-personal software
Creating a passion for quality
Live as you learn
Incentive system
Involve customers
Set prioritized goals
Quality is everybody’s responsibility
Document how you will work with quality
Improve continuously
Management
III
2
I
Example
Kristian Sandahl, IDA
krisa@ida.liu.se
performance
infrastructure
Think about 2-3 important quality factors of
communication
the metrics in a PUM-like project
Kristian Sandahl, IDA
krisa@ida.liu.se
Describe in detail how data can be collected for
the factors.
Define some metrics that can be used to indicate
software.
Home assignment
Wisdom