Item Banking Neil Wilkinson Item Banking 2 • Test development • Item banking • What data is stored • Why use item banking • Item bank features • Keys to successful item banks Presentation Title runs here l 00/00/00 Test Development Test Development Analyse Job Analyse Stats Write Administer Set Standard Review Build Exam Item Banking Statistics History Content Scoring Learning Outcome References + Management + Searching +Reporting +Auditing Test Review Process Item = Item Bank Author Status Other Data Item banking Item banking Item banking is the process of storing all of your items and related data Item bank An item bank could be a database, a word document, an excel document, anything that ties together content with related data. What data Content • The question you are asking • Distractors • Graphics • Other Material (audio/video/pdf/graphics) Scoring • The correct answer or key • Sample responses • Rationale • Alternative scoring Learning Outcome • The learning outcome/syllabus/objectives are generally stored in a tree structure • Every item might have one or more classification • Each author might write to a particular section • Used for gap analysis Reference • It is often useful to store a reference to something that proves the item correct • It could be a book, journal webpage or other • This gives you the ability to check the quality and validity of the item Other Data • Items often have meta-data • This should be configurable and searchable • Often a mix of response types (free-text, drop down lists, combo boxes) • Eg Blooms Taxonomy, item status Review Process • Items may have a review process • Each step might have outcomes • Items might need to be tracked through the process • Example: ‘how many items are currently at 1st Editorial Review?’ Statistics • Items may have statistics generated by a measurement expert • Statistics could have come from many exam sittings • Often used in test construction • Used to review author and item performance Test Build • Items will be added to a test • The test will be exported for delivery in some environment • The test could be in many formats, including Word/QTI/XML History • Who reviewed an item? • What was changed? • What tests has it been delivered in? • How did it perform? Why? Why Item Bank Increased reliability. Good items can be reused, bad items can be retired. Why Item Bank Increased consistency. Review steps allow all items to go through the same review process. Why Item Bank To allow reporting on program status Why Item Bank Increased speed of creating tests Why Item Bank Customised workflow for your items. Why Item Bank Ability to build an audit trail for your items. Why Item Bank Increased security of items. Item bank features Item Bank Features • Item authoring • Remote item authoring • Support of multiple item types • Item banking • Search capabilities • Import/export capabilities • Batch editing capabilities Item Bank Features • Test construction • Test assembly • Export features • Ancillary features • Security and access • Workflow management • Project tracking Key features Key features of successful Item Banks • Thoughtful creation of meta-data • Item bank manager • Solid processes • Consistency • Training • Migration • Stakeholder buy in Thank you!