Analytical Thinking
Assessments and Assertions
Jeff Offutt
http://www.cs.gmu.edu/~offutt/
SWE 205
Software Usability and Design
Assessments
Judging or determining some quality about
a person or situation
•
•
•
•
•
•
1-Jul-16
He is a good teacher
She is a good student
He is a good husband
She is a good researcher
He is an effective manager
He is quite tall
© Jeff Offutt
2
Assertions
Statements that can be either True or False
The validity is observable
• His exams cover all the material
• She always reads the material
before class
• She has all As
• He always considers her feelings
• She has published more than 40 papers
• Her papers are referenced hundreds of times
• The results of her research are being put into practice
• His employees always achieve their goals
• His employees give him above-average reviews
• He is 180 cm tall
1-Jul-16
© Jeff Offutt
3
Preparation for Action
An assessment is often made as a
preparation for action
•
•
•
•
•
•
•
1-Jul-16
Accepting a job
Giving a promotion
Making a recommendation
Working on a project
Taking a class
Voting for a candidate
Buying a car
© Jeff Offutt
4
Grounding
An assessment is well grounded
if the assertions adequately
support the assessment
1-Jul-16
© Jeff Offutt
5
Standards
• The standards for whether a set of assertions
adequately support the assessment varies and are
determined by the community
• Reasons that a set of assertions do not meet the
standards for supporting an assessment :
1. Not enough assertions
2. Incorrect assertions
3. Different standards
1-Jul-16
© Jeff Offutt
6
Levels of Competence—Sports
1. Beginner
No knowledge or skills
2. Novice
Understands rules or process
3. Competent
Usually does what is expected
4. Proficient
Others admire performance and sets a new standard for others
5. Virtuoso
Widely admired and inspirational, helps others rise to new
heights of excellence
6. Master
Superior performance at a level that most could never reach
1-Jul-16
© Jeff Offutt
7
Levels of Competence—Grades
1. A
Superior demonstration of knowledge
2. AExcellent demonstration of knowledge
3. B+
Understands most material
4. B
Performs as expected, understands most material,
some problems
5. C
Significant lapses in knowledge, mostly adequate
6. F
Inadequate, most material not learned
1-Jul-16
© Jeff Offutt
8
Levels of Competence—Job Performance
1. Poor
Missed many deadlines, unreliable, many work products had to
be substantially revised
2. Fair
Sometimes late, some work products had significant problems
3. Good
Reliable, met most deadlines, most work products were of high
quality
4. Very Good
Exceeded deadlines, work products were above average, helped
co-workers with their work
5. Excellent
Work products were of very high quality, solved problems in
imaginative and creative ways, helped train co-workers
1-Jul-16
© Jeff Offutt
9
Choosing a Job
Criteria
Company A
Company B
Company C
Salary
+1
+2
0
Location
+2
-1
0
Work Environment
-3
0
+1
Education Support
+1
+1
+3
Opportunity for Learning
+3
0
+2
Opportunity for Advancement
+1
0
+1
Work Stress
-3
+1
-2
SUM
2
3
5
1-Jul-16
© Jeff Offutt
10
Summary—Usability
Evaluations
• Every statement in the usability evaluations should
be an assertion
• These should lead to assessments :
Is the UI User Appropriate ?
Is the UI good enough ?
1-Jul-16
© Jeff Offutt
11