Item Analysis Graph Course: Test #: _ Analyzed Date/Time: ___________________________ KR Score: Administered Date/Time: Point Biserial > 0.25 ________________ Point Biserial 0.25 - 0 Median/Possible: Point Biserial Negative P Value 0-30% P Value: Very Difficult: 31-50% P Value: Difficult: 51-62% P Value: Average: 63-80% P Value: Easy: 81-95% P-Value: Very Easy if not predesignated as Mastery: 96-100% Total __ N: ________ KR Score: Reliability – Trustworthiness/consistency of results. Range 0.0 to +1.0 – higher is better p-Value: % correct, Level of item Difficulty. Range should be in 30% - 80%. Point Biserial: Discrimination ability of each question with consideration of the upper and lower performers > 0.25 – Acceptable – higher is better Black: Invalid question, adjust scores per department guidelines and rewrite. Dark Gray: Item needs revision: furthest from Ideal. Light Gray: Consider revision – approaching ideal. White: Ideal for discrimination & level of difficulty Total Number of Items Alternative Overall % of exam: Hot Spot: _______ ____ Faculty Members:_________& ________ ________ Number of Select All That Apply Questions: _____ Fill in the Blank (Math): _______ Graph: _______ Drag and Drop: _____ Audio/Video: ______ Total Number:_______ Questions Adjusted: Example: #3 – accept C or D, #10 - nullify Questions to be Revised: (list by number) Chart Exhibit: _____ Summary of scores after adjustments: A B C D F 92-100 84-91 76-83 68-75 < 68 # Item Analysis Algorhythm Exam Analysis Examine the Mean, Median, Standard Deviation and KR20 Item Analysis Item Analysis Item Analysis Item Difficulty Item Difficulty Item Difficulty < 30% 30-80% > 80% Item too difficult. Consider giving credit to more than one answer, nullify or delete. Exam should then be rescored. Evaluate the IDR and Point Biserial Point Biserial > 0.25 Evaluate IDR and each individual response. Consider adjusting the item to improve PBCC Point Biserial < 0.25 Revise item Is item pre-identified as Mastery? Is item pre-identified as Mastery? No - Item is too easy, revise. Yes - Keep it. Point Biserial < 0 (a negative number). Item must be looked at closely and revised.