Next Generation Learning Content Management Robby Robson RR 5-10-2004 President, Eduworks Chair, IEEE Learning Technology Standards Committee Principle Investigator, NSDL Reusable Learning & Personal Collections projects = Made from Reused or Repurposed Content Next Generation Learning Content Management As We May Think . . . Vannevar Bush, The Atlantic Monthly, 1945 5-10-2004 Next Generation Learning Content Management The Information Mountain Selection by association, rather than by indexing, may yet be mechanized. One cannot hope thus to equal the speed and flexibility with which the mind follows an associative trail, but it should be possible to beat the mind decisively in regard to the permanence and clarity of the items resurrected from storage. There is a growing mountain of research. But there is increased evidence that we are being bogged down today as specialization extends. The investigator is staggered by the findings and conclusions of thousands of other workers - conclusions which he cannot find time to grasp, much less to remember, as they appear. Eduworks Corporation Next Generation Learning Content Management 5-10-2004 Quoted from As We May Think Wholly new forms of encyclopedias will appear, ready-made with a mesh of associative trails running through them ... The Internet – by the Millions Internet Hosts 300 250 Internet Users (Worldwide) 200 16 36 70 147 248 451 513 587 719 800 150 1996 1997 1998 1999 2000 2001 2002 2003 02 03 2004 100 94 50 95 96 97 98 99 00 01 04 Sources: Internet Software Consortium (www.isc.org), Internet World Stats (www.internetworldstats.com/emarketing) Eduworks Corporation Next Generation Learning Content Management 5-10-2004 RR Have the the mountain? Havewe weclimbed climbed mountain? RR Eduworks Corporation Next Generation Learning Content Management Courtesy RCA Wilson 5-10-2004 COURSE MANAGEMENT SYSTEMS As they have been 5-10-2004 Next Generation Learning Content Management Course Management Systems Poll: What are the benefits of Course Management Systems* ? 1. 2. Anywhere / Anytime Access to Courses Automation of Administrative functions (Grading, Class Rosters, etc.) 3. Organization of content (Syllabi, drop boxes, course materials) 4. 5. More effective learning Collaboration (Chat, Bulletin Boards, Email, Webinars) * Also called Virtual Learning Environments and Learning Management Systems Eduworks Corporation Next Generation Learning Content Management 5-10-2004 CourseWork (Stanford) http://aboutcoursework.stanford.edu/advantages.html Advantages: Why Use CourseWork? Reasons to use Stanford's Web-based Web Site Development and Distribution System. 1. Web site management is simple and quick, including: • Self registration for students. (No one has to create student lists.) • Section sign-ups. • Links to Registrar's class lists. 2. CourseWork manages the distribution and collection of assignments. • Students can submit any type of document for a problem set, essay assignment, or project. • Instructions for any type of assignment can be posted. • Web-based quizzes with multiple choice and short answer questions can be easily created, distributed, scored, and returned. 3. The system provides privacy and security. • Student, TA, Faculty,Guest roles have different levels of access to the Course Web site. • SUNet IDs and passwords are used for access to all sites. • Faculty control student registration. They can create class lists or allow students to register online. Self-registration can be closed at any time. 4. CourseWork's information management tools are quick and easy-to-use. CourseWork: • Includes an Email/Web announcement system. • Provides simple file uploads for class handouts, syllabi, images, articles, and other course materials. • Is integrated with the Leland Systems class Web server, so Web-based materials from previous courses can be linked to the system. • Has a link to library systems for e-reserves. 5. A permanent record of course materials is always accessible. CourseWork: • Automatically archives all class material. • Allows easy search and retrieval of all class material. 6. CourseWork has professionally maintained servers that are: • Maintained 24 hours a day, 7 days a week. • Backed up automatically. Eduworks Corporation Next Generation Learning Content Management 5-10-2004 RR Stellar™ Course Management System Stellar (MIT) https://stellar.mit.edu/features/benefits.html Benefits Stellar course management system supports teaching and learning on the web. Instructors get an easy way to share class materials and take care of time-consuming administrative tasks. Students get round-the-clock access to materials, discussion boards, and online homework submission. A Stellar class website provides a simple and reliable online environment for instructors to do the following: • Add and manage a wide variety of multimedia class materials without having to learn HTML • Manage class website membership automatically with official data from the Registrar, and become acquainted with students through photos from the Card Office • Save time on administrative tasks by managing homework submissions and letting students choose sections on the class website • Communicate easily with students through announcements, email, and threaded discussions Eduworks Corporation Next Generation Learning Content Management 5-10-2004 RR CTools (Michigan) CTools is used in a wide variety of courses and projects. Even the same features are often used in different ways to meet a course teaching goal or group collaboration style. Follow the links below for a tour of some of CTools main tools and examples of their uses in course and collaboration sites. My Workspace Worksite Setup Announcements for viewing a list of all your CTools sites, and creating or modifying their setup for posting and viewing deadlines, events, etc for posting current, time-critical information Resources for posting documents and URLs Discussion for structured conversations in written form Chat for real-time conversation in written form News for viewing content from online sources Assignments for posting, submitting, and grading online DropBox for private file-sharing between instructors and students Email Archive for viewing email sent to the site's group email address Web Content for accessing an external website within the site Eduworks Corporation https://ctools.umich.edu/portal Schedule for a personalized view of information from your CTools sites and your CTools preferences Next Generation Learning Content Management 5-10-2004 RR OnCourse (Indiana) Oncourse is an online course management system (CMS) developed at Indiana University. It permits faculty and students to create, integrate, use, and maintain Web-based teaching and learning resources. For students, Oncourse offers content and learning tools through a single, consistent Web interface. For faculty, Oncourse provides a framework for building teaching materials without requiring knowledge of programming or HTML. A unique feature is that course and individual user Web sites are automatically generated as information is updated in university databases. http://oncourse.iu.edu/news/story.html Eduworks Corporation Next Generation Learning Content Management 5-10-2004 RR As We May Learn . . . From MEMEX to LENEX … 5-10-2004 Next Generation Learning Content Management Making a Significant Difference POLL: What has the most potential to significantly improve learning? 1. More access to more courses? (MIT Open Course Ware Initiative) 2. More effective access to information? (“The Right Stuff at the Right Time in the Right Way”) 3. More effective ways to share knowledge? (“What you know is what you can generate*”) 4. Cyberspace Immersion? (Gaming, Simulations, Twitch speed, 24/7 mobile access, …) 5. Better Learning Environments? (Constructivism, Learning Outcomes, Assessment, ...) *Brian Gaines, at WebNet 1996 Eduworks Corporation Next Generation Learning Content Management 5-10-2004 A History of Knowledge Sharing Goals for sharing Information Available, accessible and accurate When and where and by whom it is needed Goals for sharing Knowledge Dynamic, interactive and genuine Global and mobile Eduworks Corporation Next Generation Learning Content Management 5-10-2004 The Evolution of Internet Technology JavaScript in HTML Java Frameworks File-based Database-Based Repository-Based Content Players Content Interoperability Content Reusability 1996 Services Model ASP / Cold Fusion 1997 1998 1999 2000 2001 2002 2003 2004 Games! Distributed Network Client / Server Mobility! Global Net! RR Eduworks Corporation Next Generation Learning Content Management 5-10-2004 Transformation of Learning Technologies Before Bundled Functionality Captured Proprietary Eduworks Corporation Bundled Services Familiar Organized for credit Content After Good Internal Course as the container Learning Object Paradigm Best Interchangeable Focused Organized for learning Content Harvested Interoperable Next Generation Learning Content Management 5-10-2004 Emerging Themes 5-10-2004 A Global Federation of Learning Resources Architectures for Federations Service Oriented Frameworks Managing Information in a Distributed Network Managing for Reuse New Product Categories – or None at All Standardization Next Generation Learning Content Management A Global Federation of Learning Resources An emerging federation of educational digital libraries and repositories 5-10-2004 Next Generation Learning Content Management Hallmarks of the Federation Resources contextualized for learning All resources validated for accuracy and quality, by review or by provenance Rights management framework Using metadata Explicit usage licenses appropriate for the educational community Committed to Open standards Extensible tools Eduworks Corporation Next Generation Learning Content Management 5-10-2004 The Future is Now What does JORUM mean? The word is of Biblical origin and means a collecting (or drinking!) bowl. We also view it as meaning the JISC Online Repository for [learning and teaching] Materials. Eduworks Corporation Next Generation Learning Content Management 5-10-2004 RR Architectures for the Federation All Different, Yet All the Same 5-10-2004 Next Generation Learning Content Management COLIS System Model (Collaborative Online Learning and Information Services) http://www.jisc.ac.uk/uploaded_documents/ACF68A.ppt#259,3,COLIS System Model Content Package Creator Course Creatorr Digital Rights Management DRM Enabled LO Content Package Learning Object/ Content Package Repository Digital Rights Metadata WebContent Metadata Repository Z39.50 Search Gateway & Request/Deliver E resource Repositories eg Documents E Journals Author Learning Units Web Resources Multimedia Objects Learning Management and Delivery Environment Infoseeker Unified Portal inc. Single User Signon , Access Management Course Unit Creator Audit Usage Digital Rights Learner Resource Metadata Repository XML Z39.50 Learning Object Metadata Repository Z39.50 Learning Object Metadata Repository SRW Anyone People Directories / Authentication Services Eduworks Corporation Next Generation Learning Content Management 5-10-2004 RR From National Science, Math, Engineering and Technology Digital Library Web Site -- Overview of the Core Library Architecture RR 5-10-2004 Next Generation Learning Content Management Eduworks Corporation CELEBRATE (European Schoolnet) LCMS/LMS LO Repository Client LCMS/LMS messages messages Client Celebrate Brokerage messages LO Repository Library Client messages LO Repository Client Client Figure 1: Brokerage Federation showing Clients To appear in James Simon & Jean-Noël Colin, Celebrate: A Federated Model for Exchange of Learning Objects Eduworks Corporation Next Generation Learning Content Management 5-10-2004 RR CORDRA (ADL Project) http://www.lsal.cmu.edu/lsal/expertise/projects/cordra/intro/intro-v1p00.html (Content Object Repository Discovery and Registration/Resolution Architecture) Eduworks Corporation Next Generation Learning Content Management 5-10-2004 RR Web Services for Education 5-10-2004 Next Generation Learning Content Management Source: Understanding XML and XML Schema—Part 1. By Ravi Trivedi Service Oriented Architectures RR Service Oriented Architectures Problem: Monolithic Systems are Easy to Conceive but hard to Make Work Large systems are hard to maintain Integrations are costly and clunky With proprietary methods information is often unavailable or inaccurate Result: Users are frustrated Eduworks Corporation Solution: Modularize Replace functionality with services Rely on open standards for exchanging data Create community standards for exchanging information Next Generation Learning Content Management 5-10-2004 RR The Open Knowledge Initiative & Sakai Sakai c. 2004 OKI c. 2002 Eduworks Corporation Next Generation Learning Content Management 5-10-2004 RR JISC Framework http://www.cetis.ac.uk:8080/frameworks Eduworks Corporation Next Generation Learning Content Management 5-10-2004 RR Formulating Frameworks POLL: Suppose you had to identify the services needed for supporting a learning environment at your institution: 1. 2. 3. 4. You would not know what to do. You would invent something completely new. Your answer would apply only to your institution. Your answer would apply to any similar institution. *Brian Gaines, at WebNet 1996 Eduworks Corporation Next Generation Learning Content Management 5-10-2004 Implications Service-oriented frameworks are affecting commercial and non-commercial product development Monolithic products are giving way to platforms for specialized solutions Content & Information management is at the core Eduworks Corporation Next Generation Learning Content Management 5-10-2004 Managing Distributed Information Ecosystems: Content, Rights and Supporting Technology 5-10-2004 Next Generation Learning Content Management Ecosystem Components Law & Policy Market Mechanisms Expectations concerning content, commerce and rights Content development and distribution workflows Content management Eduworks Corporation Agents & Actors who distribute, acquire or enforce content and rights Learning environments Standards Infrastructure Rights management Technology Content Models Metadata Management Next Generation Learning Content Management 5-10-2004 RR DISTRIBUTED INFORMATION ECOSYSTEM Law Market Mechanisms Information Environment Policy Expectations Environment in which “Information Happens” Eduworks Corporation Next Generation Learning Content Management 5-10-2004 RR DISTRIBUTED INFORMATION ECOSYSTEM Law Market Mechanisms Authors Publishers Information Environment Librarians / Repository Managers Policy Faculty Expectations Students Actors in the Ecosystem Eduworks Corporation Next Generation Learning Content Management 5-10-2004 RR DISTRIBUTED INFORMATION ECOSYSTEM Law Information Environment Market Mechanisms Authors Publishers Librarians / Repository Managers Internal Sites ------------- Author Libraries, Repositories, Content Mgt Systems Etc. Catalog Find Assemble External Sites -------------- Policy Faculty Learning Management Environments --------------Course Mgt Systems, Collaborative Environments, Portals Etc. Expectations Students Use Acquire Publish Digital Libraries E-stores Bookstores Etc. Distribute CONTENT MANAGEMENT Eduworks Corporation Next Generation Learning Content Management 5-10-2004 RR DISTRIBUTED INFORMATION ECOSYSTEM Law Information Environment Market Mechanisms Authors Publishers Librarians / Repository Managers Internal Sites ------------- Author Distribute Content Libraries, Repositories, Content Mgt Systems Etc. Distribute Content Catalog Find Assemble Publish Acquire Content External Sites -------------Digital Libraries E-stores Bookstores Etc. Acquire Content Policy Students Faculty Learning Management Environments --------------Course Mgt Systems, Collaborative Environments, Portals Etc. Expectations Distribute Content Acquire Content Use Acquire Distribute Content Distribute Acquire Content The Flow of Content Eduworks Corporation Next Generation Learning Content Management 5-10-2004 RR DISTRIBUTED INFORMATION ECOSYSTEM Law Information Environment Market Mechanisms Authors Publishers Librarians / Repository Managers Internal Sites ------------- Author Distribute Rights Libraries, Repositories, Content Mgt Systems Etc. Distribute Rights Catalog Find Assemble Publish Acquire Rights External Sites -------------Digital Libraries E-stores Bookstores Etc. Acquire Rights and Track Usage Policy Expectations Students Faculty Learning Enforce and Management Distribute Environments Rights --------------Course Mgt Systems, Collaborative Acquire Environments, Rights and Portals Track Usage Etc. Use Acquire Enforce and Distribute Rights Distribute Acquire Rights and Track Usage The Flow of Rights Eduworks Corporation Next Generation Learning Content Management 5-10-2004 RR DISTRIBUTED INFORMATION ECOSYSTEM Law Authors Information Environment Market Mechanisms Librarians / Repository Managers Publishers Internal Sites ------------Author Distribute Rights Libraries, Repositories, Content Mgt Systems Etc. Distribute Rights Catalog Find Assemble Publish Acquire Rights External Sites -------------Digital Libraries E-stores Bookstores Etc. Rights Expression Content Protection Eduworks Corporation Expression / Enforcement Standards Acquire Rights and Track Usage Policy Expectations Students Faculty Learning Enforce and Management Distribute Environments Rights --------------Course Mgt Systems, Collaborative Acquire Environments, Rights and Portals Track Usage Etc. Use Acquire Enforce and Distribute Rights Distribute Authentication Acquire Rights and Track Usage Financial Services Usage Tracking & Reporting Services Content Next Generation Learning Infrastructure Content Management Services Registry (Some Standardized) Authorization 5-10-2004 RR Rights Registry Managing Content For Reuse Lessons from the NSDL Reusable Learning Project 5-10-2004 Next Generation Learning Content Management Reusability Factors* GRANULARITY Determines meaning of “reuse” Defined by “content model” INTEROPERABILITY Technical Involves Standards RIGHTS Copyrights Terms of Use Ability to Modify Attribution Eduworks Corporation METADATA Descriptive Context (Educational) Technical Usage Instructions DESIGN Content Presentation Structure Pedagogy Context * www.reusablelearning.org Next Generation Learning Content Management 5-10-2004 RR Content Management Framework POLL: Which of the following applies to your institution 1. Multiple separate content collections; no integration 2. Multiple separate content collections; some integration 3. Integrated content collections 4. Integrated content collections with common metadata 5. Integrated content collections with common metadata and rights management *Brian Gaines, at WebNet 1996 Eduworks Corporation Next Generation Learning Content Management 5-10-2004 Learnativity Content Model Learning Environment LMS / CMS LOM Level 3 Learning Component “Total Experience” Chapter Lesson Unit Course SCORM, the Next Generation SCORM Content Aggregation LOM Level 2 Learning Object Addresses Single Learning Objective Sharable Content Object (SCO) LOM Level 1 Information Object* Fact Concept Principle Process Procedure Asset or SCO LOM Level 1 Content Asset .doc .wav .swf .fla .jpeg .mpeg *From work of Robert Horn LOM Level 4 Asset Applets / Flash Movies / Interactive Content Eduworks Corporation Next Generation Learning Content Management 5-10-2004 RR Transformation of Content Management Before Shaky Eduworks Corporation Metadata standards Common taxonomies Common models Rights Institutional Repository Federation among sources Access through Services Intentional Management Spotty Diverse approaches Access Idiosyncratic Organization Divergent taxonomies Divergent models Rights Integrated Library Course Management System Department Web Sites Personal Web Sites Ad Hoc Management After Silos Harvested Persistent Rights Management Access Robust Next Generation Learning Content Management 5-10-2004 E-Learning Product Categories Functionality 5-10-2004 Next Generation Learning Content Management Product Categories, e.g. “Course Management System” Defined by functionality Determined by marketing Make it easier for customers to make purchasing decisions Linked with pricing models May not be stable K.C. Green: “Mature Market without Mature Products.” Eduworks Corporation Next Generation Learning Content Management 5-10-2004 RR Learning Technology Functionality Correlate learning needs with content assets CREATE CONTENT MANAGE CONTENT Match content to goals Import / Store / Find / Serve content Design / Author / Assemble content Package / Describe content Offer Learning Catalog Manage rights / versions DETERMINE GOALS MANAGE GOALS Set Instructional Goals Manage skills & competencies Establish Competencies / Certifications Set Business Goals / Determine Metrics Evaluate training effectiveness / apply to training decisions ENGAGE IN LEARNING MANAGE LEARNING View and navigate through content Maintain learning profiles and histories Communicate and collaborate via email, chat, whiteboards etc. Manage enrollment and enforce business rules Take Tests Engage in simulations and scenario-based learning Share applications / participate in Webinars Manage physical resources Provide authentication and security Assign credit or certification Report results Determine learning and performance support requirements Eduworks Corporation Next Generation Learning Content Management 5-10-2004 RR Course Management System Functionality Correlate learning needs with content assets CREATE CONTENT MANAGE CONTENT Match content to goals Import / Store / Find / Serve content Design / Author / Assemble content Package / Describe content Offer Learning Catalog Manage rights / versions DETERMINE GOALS MANAGE GOALS Set Instructional Goals Manage skills & competencies Establish Competencies / Certifications Set Business Goals / Determine Metrics Evaluate training effectiveness / apply to training decisions ENGAGE IN LEARNING MANAGE LEARNING View and navigate through content Maintain learning profiles and histories Communicate and collaborate via email, chat, whiteboards etc. Manage enrollment and enforce business rules Take Tests Engage in simulations and scenario-based learning Share applications / participate in Webinars Manage physical resources Provide authentication and security Assign credit or certification Report results Determine learning and performance support requirements Eduworks Corporation Next Generation Learning Content Management 5-10-2004 RR (Corporate) LMS Functionality Correlate learning needs with content assets CREATE CONTENT MANAGE CONTENT Match content to goals Import / Store / Find / Serve content Design / Author / Assemble content Package / Describe content Offer Learning Catalog Manage rights / versions DETERMINE GOALS MANAGE GOALS Set Instructional Goals Manage skills & competencies Establish Competencies / Certifications Set Business Goals / Determine Metrics Evaluate training effectiveness / apply to training decisions ENGAGE IN LEARNING MANAGE LEARNING View and navigate through content Maintain learning profiles and histories Communicate and collaborate via email, chat, whiteboards etc. Manage enrollment and enforce business rules Take Tests Engage in simulations and scenario-based learning Share applications / participate in Webinars Manage physical resources Provide authentication and security Assign credit or certification Report results Determine learning and performance support requirements Eduworks Corporation Next Generation Learning Content Management 5-10-2004 RR Authoring Tool Functionality Correlate learning needs with content assets CREATE CONTENT MANAGE CONTENT Match content to goals Import / Store / Find / Serve content Design / Author / Assemble content Package / Describe content Offer Learning Catalog Manage rights / versions DETERMINE GOALS MANAGE GOALS Set Instructional Goals Manage skills & competencies Establish Competencies / Certifications Set Business Goals / Determine Metrics Evaluate training effectiveness / apply to training decisions ENGAGE IN LEARNING MANAGE LEARNING View and navigate through content Maintain learning profiles and histories Communicate and collaborate via email, chat, whiteboards etc. Manage enrollment and enforce business rules Take Tests Engage in simulations and scenario-based learning Share applications / participate in Webinars Manage physical resources Provide authentication and security Assign credit or certification Report results Determine learning and performance support requirements Eduworks Corporation Next Generation Learning Content Management 5-10-2004 RR Learning Content Management System Functionality Correlate learning needs with content assets CREATE CONTENT MANAGE CONTENT Match content to goals Import / Store / Find / Serve content Design / Author / Assemble content Package / Describe content Offer Learning Catalog Manage rights / versions DETERMINE GOALS MANAGE GOALS Set Instructional Goals Manage skills & competencies Establish Competencies / Certifications Set Business Goals / Determine Metrics Evaluate training effectiveness / apply to training decisions ENGAGE IN LEARNING MANAGE LEARNING View and navigate through content Maintain learning profiles and histories Communicate and collaborate via email, chat, whiteboards etc. Manage enrollment and enforce business rules Take Tests Engage in simulations and scenario-based learning Share applications / participate in Webinars Manage physical resources Provide authentication and security Assign credit or certification Report results Determine learning and performance support requirements Eduworks Corporation Next Generation Learning Content Management 5-10-2004 RR Virtual Classroom Functionality Correlate learning needs with content assets CREATE CONTENT MANAGE CONTENT Match content to goals Import / Store / Find / Serve content Design / Author / Assemble content Package / Describe content Offer Learning Catalog Manage rights / versions DETERMINE GOALS MANAGE GOALS Set Instructional Goals Manage skills & competencies Establish Competencies / Certifications Set Business Goals / Determine Metrics Evaluate training effectiveness / apply to training decisions ENGAGE IN LEARNING MANAGE LEARNING View and navigate through content Maintain learning profiles and histories Communicate and collaborate via email, chat, whiteboards etc. Manage enrollment and enforce business rules Take Tests Engage in simulations and scenario-based learning Share applications / participate in Webinars Manage physical resources Provide authentication and security Assign credit or certification Report results Determine learning and performance support requirements Eduworks Corporation Next Generation Learning Content Management 5-10-2004 RR Human Capital Management System Functionality Correlate learning needs with content assets CREATE CONTENT MANAGE CONTENT Match content to goals Import / Store / Find / Serve content Design / Author / Assemble content Package / Describe content Offer Learning Catalog Manage rights / versions DETERMINE GOALS MANAGE GOALS Set Instructional Goals Manage skills & competencies Establish Competencies / Certifications Set Business Goals / Determine Metrics Evaluate training effectiveness / apply to training decisions ENGAGE IN LEARNING MANAGE LEARNING View and navigate through content Maintain learning profiles and histories Communicate and collaborate via email, chat, whiteboards etc. Manage enrollment and enforce business rules Take Tests Engage in simulations and scenario-based learning Share applications / participate in Webinars Manage physical resources Provide authentication and security Assign credit or certification Report results Determine learning and performance support requirements Eduworks Corporation Next Generation Learning Content Management 5-10-2004 RR Man turns to stone listening to standards presentation* Eduworks Corporation Next Generation Learning Content Management 5-10-2004 RR * Permission has been requested to use this image from http://www.williams.edu/dean/oxford/oxford.htm Standardization The Standardization Process Principles discussed Champions Implement Serious Prototypes Products Produced Products Stabilized Conformance & Compliance Possible Prototypes Standards announced Maybe products Early Adoption More Adoption Market Adoption Markets wait Early test suites Precision added Global adoption Early Specs Aviation Industry CBT Committee Advanced Distributed Learning initiative IMS Global Learning Consortium IEEE Learning Technology Standards Committee ISO/IEC JTC1 SC36: Standards Learning, Education and Training MANY INTERNATIONAL ORGANIZATIONS Eduworks Corporation Next Generation Learning Content Management 5-10-2004 RR Progression of Learning Technology Standards Learning is part of bigger picture Cornucopia of standards that define all of elearning 1996 Eduworks Corporation 1997 1998 Content interoperability within the learning community 1999 2000 2001 Next Generation Learning Content Management 2002 2003 2004 5-10-2004 RR Interoperability Standards Specifically for Learning, Education & Training SCORM Metadata* Aggregation & Packaging Communication API* and Data Model* Sequencing & Navigation AICC First three as above File-based and HTTP-based communication Different Sequencing Smart Graphics Package Exchange Notification Services Eduworks Corporation IMS Question & Test Interoperability Learning Design Learner Models Architectures & Frameworks OTHER Open Knowledge Initiative API’s Rights Expression Languages** Competencies * IEEE Standards (or close) ** ISO/IEC Standards Next Generation Learning Content Management 5-10-2004 RR