Uploaded by Liz Howland

Handouts - Item Analysis

advertisement
Item Analysis Graph
Course:
Test #:
_
Analyzed Date/Time: ___________________________ KR Score:
Administered Date/Time:
Point Biserial
> 0.25
________________
Point Biserial
0.25 - 0
Median/Possible:
Point Biserial
Negative
P Value
0-30%
P Value: Very Difficult:
31-50%
P Value: Difficult:
51-62%
P Value: Average:
63-80%
P Value: Easy:
81-95%
P-Value: Very Easy if not
predesignated as Mastery:
96-100%
Total
__
N: ________
KR Score: Reliability –
Trustworthiness/consistency of
results. Range 0.0 to +1.0 – higher
is better
p-Value: % correct, Level of item
Difficulty. Range should be in 30%
- 80%.
Point Biserial: Discrimination
ability of each question with
consideration of the upper and
lower performers > 0.25 –
Acceptable – higher is better
Black: Invalid question, adjust
scores per department guidelines
and rewrite.
Dark Gray: Item needs revision:
furthest from Ideal.
Light Gray: Consider revision –
approaching ideal.
White: Ideal for discrimination &
level of difficulty
Total Number of Items
Alternative Overall % of exam:
Hot Spot: _______
____ Faculty Members:_________& ________
________
Number of Select All That Apply Questions: _____ Fill in the Blank (Math): _______
Graph: _______
Drag and Drop: _____
Audio/Video: ______ Total Number:_______
Questions Adjusted:
Example: #3 – accept C or D, #10 - nullify
Questions to be Revised:
(list by number)
Chart Exhibit: _____
Summary of scores after adjustments:
A
B
C
D
F
92-100
84-91
76-83
68-75
< 68
#
Item Analysis Algorhythm
Exam Analysis
Examine the Mean, Median,
Standard Deviation and
KR20
Item Analysis
Item Analysis
Item Analysis
Item Difficulty
Item Difficulty
Item Difficulty
< 30%
30-80%
> 80%
Item too difficult. Consider
giving credit to more than
one answer, nullify or
delete. Exam should then be
rescored.
Evaluate the IDR and Point
Biserial
Point Biserial > 0.25
Evaluate IDR and each
individual response.
Consider adjusting the item
to improve PBCC
Point Biserial < 0.25
Revise item
Is item pre-identified as
Mastery?
Is item pre-identified as
Mastery?
No - Item is too easy, revise.
Yes - Keep it.
Point Biserial < 0 (a negative
number). Item must be
looked at closely and
revised.
Download