Guide to the Smarter Balanced IT Architecture
Connecticut Assessment Forum
August 14, 2012
Measured Progress ©2011
Agenda
•
•
•
•
•
•
•
Smarter Balanced Update
IT Architecture Project Overview
Defining the Architecture – Period A
Governance and Implementation – Period B
Architecture Summary Report
Technical Standards for Interoperability
Q&A
2012
Smarter Balanced Update
Measured Progress ©2011
IT Architecture Project Overview
Measured Progress ©2011
Overview of Smarter Balanced Architecture Initiative
•
The Approach: This is larger than any single company
agenda; it requires an open and collaborative approach
• The Team: We have assembled a Collaborative with:
o The thought leadership (industry, academia, industry
associations & individual contributors) to ensure the vision
is grounded in assessment and education best practices
o The technical capability to deliver
• The Process: Experienced and Agile; sustainability via a
community approach
• The Goals: Open, Flexible, Standards Based, and
Componentized
2012
• Planning & blueprinting
• Item types
• Content development &
universal design
• Learning standard
alignment
•
•
•
•
•
Content and data reviews
Test form construction
Field testing
Item banking & statistics
Content exchange /
interoperability
Assessment
Lifecycle
Content
Development
•
•
•
•
Psychometric analysis
Equating
Score tables - scaling, norming
Performance levels / cut
scores
• Field test analysis
Post-Test
• Aligning results with
Administration
curriculum / instruction
• Program and teacher
effectiveness
• Individual reporting
• Diagnostic reporting
• Informing & personalizing
instruction
• Performance on
standards
• Dashboard / summary
reporting
• Aggregation / disaggregation
• Exchanging results / data
Pre-Test
Administration
Assessment
Life Cycle
Test
Administration
Reporting
Scoring
•
•
•
•
•
Computer scoring
Professional scoring
Algorithmic (AI) scoring
Portfolio scoring
Sub test / strand scoring
•
•
•
•
•
Attemptedness
Performance levels
Scaling / norming
Growth scores
Range finding
• Administration planning
& scheduling
• Registration, assignment,
• Form sampling
• Online infrastructure
readiness assessment
• Pre-session planning
(paper / online) & setup
• Alternate form
assignment
• Test form delivery
• Platform (paper, online,
mobile) presentation
• Item content & tools
• Adaptive testing
• Response collection
• Proctoring controls
• Form content security
• Desktop security
• Accessibility
• Testing anomalies
2012
Project Approach
Analysis
Envisioning and
Decomposition
Validation and
Documentation
Governance and
OSS Strategy
Execution
Drivers and
Tradeoffs
Scenario
Mapping
Execute Architecture
Governance Model
Goals and
Capabilities
Conceptual
Models
Consolidate
Library
Define Arch
Review Process
Assist Vendor Selection
and Oversight
User Personas
Logical Models
Validate
Architecture
Define OSS Mgmt
Process
Monitor OSS
Development Activities
Scenarios
Detailed
Architecture
Reqs
Coordinate QA
Activities
Technology
Models
0-3 Weeks
3-7 Weeks
7-10 Weeks
10-12 Weeks
Jan 2012 -> Ongoing
2012
Team
2012
Defining the Architecture – Period A
Measured Progress ©2011
Process
• Workshops
• Showcases
• Reviews
• Final Deliverables
2012
Governance and Implementation– Period B
Measured Progress ©2011
Governance Structure
• Executive Committee
• Architecture Review Board
• Architecture Core Team
• Extended Architecture Team
2012
Governance Processes
2012
Architecture Summary Report
Measured Progress ©2011
Architecture Overview
Architecture Summary Report available at:
http://www.smarterbalanced.org/smarter-balancedassessments/technology/
Title: Assessment System Architecture and Technology
Phase 1 Report
2012
Technical Standards for Interoperability
Measured Progress ©2011
Standards Groups
• CEDS
• IMS Global
• SIFA
• AIF
2012
Assessment Interoperability Framework
2012
Question and Answer
Measured Progress ©2011