MIMOS - Grid software
Production process.
QA Practices and Tools
Ng, Kwang Ming
2nd June 2008
Pointers
• MIMOS background
• CMMI @ MIMOS
• Testing @ MIMOS
2
MIMOS Background
MIMOS Berhad is an agency under
the Malaysian Government’s Ministry
of Science, Technology & Innovation
and its focus is on National R&D for
ICT
3
MIMOS Background
MIMOS: Vision & Mission
Vision
To be a Premier Applied Research
Center in Frontier Technologies
Mission
To pioneer innovative information &
communication technologies towards
growing globally competitive
indigenous industries
4
MIMOS Background
Path to Manageable Quality in Software
• A defined development process that is
manageable yet flexible.
– Driven by guidelines.
• A testing rigueur that covers user experience
features.
– Focus on the primary user impact.
5
MIMOS Background
Path to Manageable Quality
• CMMI @ MIMOS
– MIMOS Process Groups & Production Process
– Asset library & review bank
• Testing @ MIMOS
– Usability Testing
– Functional, Performance & Load Testing
– Compatibility & GRIDs
6
CMMI@ MIMOS
• Why?
– Its a proven standard for process management and
improvement
– Provides a flexible guideline for software development
framework.
• MIMOS CMMI Implementation
–
–
–
–
Software Process Focus Groups
Software Production Process Overview
Process Infrastructure (Process Asset Library)
Project Artifacts
CMMI@MIMOS
MIMOS Software Process Group
Sponsors
MIMOS CMMI
Process Focus
Competency Development
Group (CDG1)
CMMI Process
Improvement Team (PIT2)
Process, Tool and Six Sigma
Engineering
Software Development
Process
Testing
Project Management
Human Resource
Support
Functional Area Reps
Process Action Team
1
CDG – representatives from SDCE Departments, Projects Groups and Corporate HR
– comprise of Process Area (PA) Champions for each CMMI PA within SDCE
2 PIT
CMMI@MIMOS
MIMOS Software Production Process
Project Management
Quality Management
Requirement
Gathering
Review
Review
Review
Inspection
Customers
Planning
Requirement
Analysis
Design
Code &
Unit Test
Build &
Integration Test
RRR
IRR
Configuration and Change Management
TRR
Test
Planning
Test
Development
Functional /
System Test
Customers
Review
Review
Integral & Support
Process Improvement
IRR – Integration Readiness Review
TRR - Test Readiness Review
RRR - Release Readiness Review
CMMI@MIMOS
MIMOS Software Production Process
PM
SQE
Quality Management
SSE, SDE
Requirement
Gathering
PM
Project Management
Review
Planning
SCM
Review
Review
Requirement
Analysis
Design
Inspection
Code &
Unit Test
SCM
Customers
Build &
Integration Test
RRR
IRR
Configuration and Change Management
TRR
SSTE, STE
Test
Planning
Test
Development
Functional /
System Test
Customers
Review
Review
Integral & Support
Process Improvement
IRR – Integration Readiness Review
TRR - Test Readiness Review
RRR - Release Readiness Review
CMMI@MIMOS
MIMOS Process Infrastructure
Policy Statements
Policies
Framework
Standards &
Tailoring Guidelines
“What's”
Process Documents
Job Aids
Enablers
Supporting Process Assets
Checklists, Forms, Templates, Guidelines, etc.
Tools, Training Material & Plans
CMMI@MIMOS
MIMOS Process Asset Library
MIMOS Best Practice Website
BEST PRACTICE
WEBSITE
Testing@MIMOS
Q1 2007
Q2 2007
Q3 2007
1. Identify Areas
For Improvement
AREAS
• test environment
• test processes
• tester competencies
METHODS
• questionnaires
• footprint charts
• other best practices
2. Execute
Improvement Effort
AREAS
• test environment
• test processes
• testers competencies
METHODS
• individual KPIs
• group KPIs
• CMMi
• footprint chart reviews
3. Collaboration
Effort
PARTNERS
• IBM (RUP)
• QAI
• Other Certification Bodies
Test COE
Testing@MIMOS
Usability Testing
Screen Video
Any activity that is
taking place on the
user's screen
Window Events
Window events such as the
window/dialog getting focus,
opening, closing and resizing
Mouse Clicks
Mouse events that
include left, right and
middle clicks
Audio
Original user audio
through a microphone
Camera Video
All of the user’s
video through a
camera
Keyboard Activity
Every keystroke that
the user makes
Web Page Changes
Browser events such as
when and where a web page
is changed
Screen Text
All text on the user’s screen
during the period of the
recording
Testing@MIMOS
Functionality Testing
PASSED
FAILED
PASSED
Functional test cases are
derived from the functional
requirements of the
software and are the basis
for system testing.
These help you in testing if
the required functionality is
working as per the
specifications and if the
expected result is correct.
Testing@MIMOS
Performance Testing
The
Because
process
a break
of exercising
at any point
an application
in your system
by emulating
means your
actual
customers
users are
with
not getting
a load generation
the service tool
you for
think
thethey
purpose
are of finding system bottlenecks
Controller
System Under Test
Testing@MIMOS
Load & Stress Testing
Controller
System Under Test
LOAD TESTING - exercising the system under
test by feeding it the largest tasks it can
operate with. Load testing is sometimes
called volume testing, or endurance testing.
STRESS TEST - overwhelming its resources with data.
The main purpose behind this madness is to make sure
that the system fails and recovers gracefully - this
quality is known as recoverability.
Testing@MIMOS
Compatibiliy Testing
Testing application on different
platform to ensure the
scalability and robustness of
the application.
APPLICATION
VISTA
Testing@MIMOS
GRID Testing
TESTING AREAS:
• Security
Test on Grid Security Infrastructure
for loopholes and vulnerabilities
• Resource Management
Test on the reliability of the
resources on the grid
• Information Service
Validate and verify the information
flows for grid resources
• Data Management
Test on connectivity between data
resources and client
Thank You