Item Banking
Neil Wilkinson
Item Banking
2
•
Test development
•
Item banking
•
What data is stored
•
Why use item banking
•
Item bank features
•
Keys to successful item banks
Presentation Title runs here l 00/00/00
Test Development
Test Development
Analyse
Job
Analyse
Stats
Write
Administer
Set
Standard
Review
Build
Exam
Item Banking
Statistics
History
Content
Scoring
Learning
Outcome
References
+ Management + Searching
+Reporting +Auditing
Test
Review
Process
Item
=
Item Bank
Author
Status
Other Data
Item banking
Item banking
Item banking is the process of storing all of your items and
related data
Item bank
An item bank could be a database, a word document, an excel
document, anything that ties together content with related
data.
What data
Content
•
The question you are asking
•
Distractors
•
Graphics
•
Other Material (audio/video/pdf/graphics)
Scoring
•
The correct answer or key
•
Sample responses
•
Rationale
•
Alternative scoring
Learning
Outcome
•
The learning outcome/syllabus/objectives are generally
stored in a tree structure
•
Every item might have one or more classification
•
Each author might write to a particular section
•
Used for gap analysis
Reference
•
It is often useful to store a reference to something that
proves the item correct
•
It could be a book, journal webpage or other
•
This gives you the ability to check the quality and validity
of the item
Other Data
•
Items often have meta-data
•
This should be configurable and searchable
•
Often a mix of response types (free-text, drop down lists,
combo boxes)
•
Eg Blooms Taxonomy, item status
Review
Process
•
Items may have a review process
•
Each step might have outcomes
•
Items might need to be tracked through the process
•
Example: ‘how many items are currently at 1st Editorial
Review?’
Statistics
•
Items may have statistics generated by a measurement
expert
•
Statistics could have come from many exam sittings
•
Often used in test construction
•
Used to review author and item performance
Test Build
•
Items will be added to a test
•
The test will be exported for delivery in some environment
•
The test could be in many formats, including
Word/QTI/XML
History
•
Who reviewed an item?
•
What was changed?
•
What tests has it been delivered in?
•
How did it perform?
Why?
Why Item Bank
Increased reliability. Good items can be reused, bad items
can be retired.
Why Item Bank
Increased consistency. Review steps allow all items to go
through the same review process.
Why Item Bank
To allow reporting on program status
Why Item Bank
Increased speed of creating tests
Why Item Bank
Customised workflow for your items.
Why Item Bank
Ability to build an audit trail for your items.
Why Item Bank
Increased security of items.
Item bank features
Item Bank Features
•
Item authoring
•
Remote item authoring
•
Support of multiple item types
•
Item banking
•
Search capabilities
•
Import/export capabilities
•
Batch editing capabilities
Item Bank Features
•
Test construction
•
Test assembly
•
Export features
•
Ancillary features
•
Security and access
•
Workflow management
•
Project tracking
Key features
Key features of successful Item Banks
•
Thoughtful creation of meta-data
•
Item bank manager
•
Solid processes
•
Consistency
•
Training
•
Migration
•
Stakeholder buy in
Thank you!