Real World
Summative
Performance
Domain
COS Tasks
COS
Objective
Exam
LRs
“The graduate demonstrates
application of each of the standard
arithmetic algorithms: addition,
subtraction, multiplication, division,
exponentiation, on the set whole
numbers.”
“Find the sum of the first 100
counting numbers.”
What issues does this example raise?
SubjectMatter
Experts
Psych
Editors
P.C.s
Psych.
Measurement
Content
Course
Mentors
Project
Coord.


Foundational knowledge and skill assessment
Higher-order thinking skills with determinate
outcomes
Identify
Recognize
Understand
Recall
List
Define
Explain
Analyze
Evaluate
Recommend
Create
Discuss
Contrast
Apply
Item Pool
PreAssessment
Form
A
Form
B




Objective: Recognize the causes of World War II
Item #1- Pre-assessment: Which of the following
was instrumental in causing World War II?
Item #2- Form A: What effect did the Versailles
Treaty have on the German economy?
Item #3- Form B: How did Japan’s invasion of IndoChina affect European international policy?
 Modified
Angoff:
“What percentage of students, based on
the definition of minimal competence,
will correctly answer this question?”
 Content Difficulty
 Item Difficulty
 Random Variance






Objective, lower cognitive demand
assessments must be passed before referral
can be made
Published in TaskStream
Two forms (two possible resubmissions)
Five level rubric multiple aspects
Turnitin.com and Caveon
Summative, integrative with
focus on beginner performance
 Simulations and
case studies (high fidelity)
 Internships (Demonstration Teaching,
nursing rotations, service projects, etc.)
Institutional
Data
Mentor
Evaluation
Program
Evaluation
Assessment
QA
Quality
Assurance
Of Unit
Candidate
Assessment
Protocol
Performance
Outcomes
Employer
Survey
Other
Outcome
Measures
Candidate
Survey


Pre-assessments
Assessments







Performance Assessments
Objective Assessments
Essay Assessments
Pre-clinical Experiences
Demonstration Teaching
Laboratories
Collaborative Projects
A program is approved that will require assessment support:
1. Development Planning: Requirements, resources,
schedules
2. SME Participation: Initiate recruitment and training of
subject matter experts
3. Content Definition: Define and organize assessment
domains
4. Alignment: Align domains to independent learning
resources
5. Specification: Build an assessment specification
6. Item & Task Creation: Create (or revise)
specified items and performance tasks
No
7. Item & Task Review: Perform 5-step content and
editorial review of each item and task
8. Committee Review: Convene SME review
committee for additional content review
9. Data Entry: Place approved items in an online
item bank/delivery system
Item/Task
Approved
Yes
No
Item/Task
Approved
Yes
10. Standard Setting: Determine item difficulty level
to enable setting of test form passing scores
11. Form Development: Build individual exam forms
12. Field Testing: Use bootstrap method to gather
initial performance statistics; revise items/exams
as necessary
13. Administration; and 14. Scoring: Announce,
schedule, administer assessments; score, record,
report
15. Maintenance: Continuously review and update
assessment materials