ATI Annual Report 10/11 System-wide Success Indicator Details for Instructional Materials Introduction This report provides: The reported median* status level** for each top level Instructional Materials Goal for AY 10-11 across all 23 campuses compared to last year. The reported median* status level** for each Success Indicator under each top level Instructional Materials Goal for AY 10-11 across all 23 campuses compared to last year. Areas where improvement has been made over last year (indicated by a plus (+) sign). Areas where the Success Indicator has been downgraded from last year (indicated by a minus ( – ) sign). * The median of a data set is the “value” that separates the top half of the data from the bottom half after the data has been sorted. From a positional standpoint, in a list of responses ordered from 1 to 23 (one per campus), the response in position 12 represents the median. ** See Appendix A for a description of the Status Level Criteria. Accessibility information: This document has been designed to be accessible for persons with disabilities. Specifically, headings and lists are used to convey document structure, table rows that contain header cells are denoted, and visual information conveyed via graphs is also presented in text form via tables immediately following the graphs. If you encounter any accessibility difficulties with this document, please contact the ATI at ati@calstate.edu. Top Level Instructional Materials Goals with Reported Median Status Levels for AY 10-11 and Compared to AY 09-10 Top Level Goal Median Median This Year Last Year (10-11) (09-10) 1.0 Timely Adoption: The campus has implemented a comprehensive plan to ensure the timely adoption of textbooks and other instructional materials. Established Established 2.0 Identification of IM for Late-Hire Faculty: The campus has implemented a comprehensive plan to ensure that textbooks have been identified for courses with late-hire faculty. Defined+ Initiated 3.0 Early Identification of Students with Disabilities: The campus has implemented a comprehensive plan to ensure that students with disabilities are identified and able to request alternate media materials in a timely manner. Managed Managed 4.0 Faculty Use of LMS (or non-LMS) Course Websites: The campus has implemented policies and procedures to promote the posting of all required curricular and instructional resources (including print-based and multimedia materials) in a central, accessible electronic location. Defined Defined IM SI Details AY 10/11 1 Median Median This Year Last Year (10-11) (09-10) 5.0 Accessibility Requirements for Multimedia: The campus has implemented policies and procedures to ensure that accessibility requirements have been incorporated into the adoption process for all multimedia-based instructional resources. Defined+ Initiated 6.0 Accessibility Requirements for Curricular Review and Approval: The campus has implemented policies and procedures to ensure that accessibility requirements have been incorporated into the curricular review process. Initiated Initiated 7.0 Supporting Faculty Creation of Accessible IM: The campus has implemented policies and procedures to support faculty in selecting, authoring, and delivering accessible instructional materials. Defined Defined 8.0 Communication Process and Training Plan: The campus has implemented a broad-based ATI awareness campaign, supported by a comprehensive training infrastructure to increase technological accessibility across the campus. Established+ Defined 9.0 Process Indicators: The campus IMAP committee has sufficient breadth, resources, and authority to effectively implement a comprehensive IMAP initiative. Defined Top Level Goal IM SI Details AY 10/11 Defined 2 Instructional Materials Top Level Goals Status – Reported AY 10-11 Number of Campuses at each Instructional Materials Goal Status Level AY 10-11 Goal 1.0 2.0 3.0 4.0 5.0 Optimizing 0 0 5 0 0 Managed 7 2 9 3 Established 11 5 6 Defined 5 7 Initiated 0 Not Started Totals Status 6.0 7.0 8.0 9.0 0 1 2 0 4 4 2 3 4 4 6 3 6 7 5 2 8 6 4 7 6 4 8 1 6 6 9 6 4 7 0 1 0 2 1 3 1 1 3 23 23 23 23 23 23 23 23 23 Goal 1.0 – Timely Adoption The campus has implemented a comprehensive plan to ensure the timely adoption of textbooks and other instructional materials. Top level goal median = Established. IM SI Details AY 10/11 3 Goal 1.0 – Success Indicators with Medians – This Year Compared to Last Number 1.1 1.2 1.3 Median Median This Year Last Year (10-11) (09-10) Campus has formally documented (e.g. Policy, Resolution or Procedure) a process to ensure the timely adoption of textbooks and other instructional materials. [Commitment] Established Established Campus has developed capacity (e.g. established practices, specified staff time, educational/training resources, and/or technology) to achieve compliance with timely adoption. [Ability] Established Established Campus has developed milestones or specific measures of success for timely adoption compliance (e.g. percentage of timely adoptions) and implemented a system to track these measures. [Measurement] Established Success Indicator Description + Defined Goal 1.0 – Results Chart Success Indicators AY 10-11 Campus Counts for each Success Indicator AY 10-11 Status Level Optimizing IM SI Details AY 10/11 1.1 1.2 1.3 2 0 1 4 Managed 6 7 6 Established 9 8 8 Defined 6 5 3 Initiated 0 3 1 Not Started 0 0 4 Goal 2.0 – Identification of IM for Late-Hire Faculty The campus has implemented a comprehensive plan to ensure that textbooks have been identified for courses with late-hire faculty. Top level goal median = Defined+. IM SI Details AY 10/11 5 Goal 2.0 – Success Indicators with Medians – This Year Compared to Last Number 2.1 2.2 Success Indicator Description Median Median This Year Last Year (10-11) (09-10) All academic units have implemented specific procedures for late hire or adjunct faculty members for the timely adoption of curricular materials. [Ability] Initiated Campus has developed specific measures of success for late-hire faculty (e.g. percentage of late-hire adoptions completed by campus deadline) and implemented a system to track these measures. [Measurement] Initiated + Initiated Not Started Goal 2.0 – Results Chart Success Indicators AY 10-11 Campus Counts for each Success Indicator AY 10-11 Status Level 2.1 2.2 Optimizing 0 0 Managed 0 0 Established 5 5 Defined 6 5 Initiated 8 2 Not Started 4 11 IM SI Details AY 10/11 6 Goal 3.0 – Early Identification of Students with Disabilities The campus has implemented a comprehensive plan to ensure that students with disabilities are identified and able to request alternate media materials in a timely manner. Top level goal median = Managed. Goal 3.0 – Success Indicators with Medians – This Year Compared to Last Number Success Indicator Description Median Median This Year Last Year (10-11) (09-10) Managed 3.1 Campus has implemented a system to provide early registration for alternate media-eligible students. [Ability] Managed 3.2 Campus has implemented a system to track early registration usage by alternate media-eligible students (intended to provide alternate media programs with sufficient time to produce alternate media as well as to document student conformance with alternate media submissions procedures). [Measurement] Managed Campus has implemented a system that allows alternate media requests to be submitted without appearing in-person during regular business hours (e.g. web-based forms, integration with student registration portal). [Ability] Established 3.4 Campus has implemented a system to track the timeliness of alternate media requests. [Measurement] Established– 3.5 Campus has developed specific measures of success for early identification of students with disabilities (e.g., percentage of eligible students who utilize early registration) and implemented a system to track these measures. [Measurement] 3.3 + Defined Established + Defined Managed Defined Goal 3.0 – Results Chart Success Indicators AY 10-11 IM SI Details AY 10/11 7 Campus Counts for each Success Indicator AY 10-11 Status Level 3.1 3.2 3.3 3.4 3.5 Optimizing 10 6 2 5 4 Managed 9 7 5 5 2 Established 3 6 7 6 4 Defined 1 1 3 2 6 Initiated 0 0 5 3 2 Not Started 0 3 1 2 5 Goal 4.0 – Faculty Use of LMS (or non-LMS) Course Websites The campus has implemented policies and procedures to promote the posting of all required curricular and instructional resources (including print-based and multimedia materials) in a central, accessible electronic location. Top level goal median = Defined. Goal 4.0 – Success Indicators with Medians – This Year Compared to Last Number 4.1 4.2 4.3 4.4 4.5 4.6 Success Indicator Description Median Median This Year Last Year (10-11) (09-10) Campus has formally documented (e.g., Policy, Resolution or Procedure) a process to promote or require the posting of IM to the campus LMS. [Commitment] Initiated Initiated Campus has screened its LMS to determine whether it conforms to Section 508 accessibility standards and established a plan to address (or work-around) identified gaps. [Ability] Established Established Campus has established specific guidelines and procedures for submitting course and curricular materials hosted in campus LMS. [Commitment] Defined Defined Campus has implemented procedures to accelerate the delivery of alternate media materials to improve timeliness (e.g. electronic delivery via campus LMS or FTP). [Ability] Defined Initiated Campus has implemented mechanisms to provide alternate media production staff with access to instructional materials on LMS course sites for purposes of evaluating and converting materials. [Ability] Defined Defined Campus has established specific measures of success (e.g., number of course sites with posted syllabi) for faculty posting of curricular materials in the campus LMS. [Measurement] Initiated Initiated IM SI Details AY 10/11 + 8 Goal 4.0 – Results Chart Success Indicators AY 10-11 Campus Counts for each Success Indicator AY 10-11 Status Level 4.1 4.2 4.3 4.4 4.5 4.6 Optimizing 0 3 1 3 4 0 Managed 1 5 2 4 4 0 Established 7 7 5 1 3 2 Defined 2 4 6 6 4 4 Initiated 9 3 6 9 5 10 Not Started 4 1 3 0 3 7 Goal 5.0 – Accessibility Requirements for Multimedia The campus has implemented policies and procedures to ensure that accessibility requirements have been incorporated into the adoption process for all multimedia-based instructional resources. Top level goal median = Defined+. IM SI Details AY 10/11 9 Goal 5.0 – Success Indicators with Medians – This Year Compared to Last Number 5.1 5.2 5.3 5.4 5.5 Success Indicator Description Median Median This Year Last Year (10-11) (09-10) Campus has developed and implemented accessibility requirements for selecting and adopting multimedia curricular materials (e.g. requirements for captions, transcripts, audio description, accessible web players). [Commitment] Defined Campus has established a strategic process, based on available resources, for prioritizing the remediation of inaccessible multimedia materials. [Commitment] Defined Initiated Campus has gathered survey information from media libraries regarding multimedia usage and format types (e.g. most frequently utilized titles and formats) to aid in tool selection and prioritization decisions. [Measurement] Initiated Initiated Campus has built capacity (e.g. established practices, specified staff time, budget, tools, and/or work space) necessary to address the accessibility of existing and planned multimedia content and its delivery. [Ability] Defined Defined Campus has established measures of success related to multimedia accessibility (e.g. percent of new materials that are accessible, percent of existing materials that have been remediated). [Measurement] Not Started Not Started + Defined Goal 5.0 – Results Chart Success Indicators AY 10-11 IM SI Details AY 10/11 10 Campus Counts for each Success Indicator AY 10-11 Status Level 5.1 5.2 5.3 5.4 5.5 Optimizing 0 0 1 1 0 Managed 3 1 1 2 2 Established 7 5 4 8 2 Defined 4 6 3 4 2 Initiated 8 8 7 6 4 Not Started 1 3 7 2 13 Goal 6.0 – Accessibility Requirements for Curricular Review and Approval The campus has implemented policies and procedures to ensure that accessibility requirements have been incorporated into the curricular review process. Top level goal median = Initiated. Goal 6.0 – Success Indicators with Medians – This Year Compared to Last Number 6.1 6.2 6.3 Success Indicator Description Median Median This Year Last Year (10-11) (09-10) Accessibility requirements have been developed and integrated into the academic curriculum review process for new course adoptions and existing course reviews. [Commitment] Initiated Initiated Campus has established accessibility standards or guidelines for selecting and authoring curricular materials. [Commitment] Initiated Initiated Campus has established specific measures of success (e.g., number of courses that have undergone accessibility review) for incorporating accessibility into the curricular review and approval process. [Measurement] Initiated IM SI Details AY 10/11 + Not Started 11 Goal 6.0 – Results Chart Success Indicators AY 10-11 Campus Counts for each Success Indicator AY 10-11 Status Level 6.1 6.2 6.3 Optimizing 1 0 0 Managed 3 2 0 Established 4 4 1 Defined 2 3 1 Initiated 10 9 10 Not Started 3 5 11 Goal 7.0 – Supporting Faculty Creation of Accessible IM The campus has implemented policies and procedures to support faculty in selecting, authoring, and delivering accessible instructional materials. Top level goal median = Defined. IM SI Details AY 10/11 12 Goal 7.0 – Success Indicators with Medians – This Year Compared to Last Number 7.1 7.2 7.3 7.4 7.5 7.6 Success Indicator Description Median Median This Year Last Year (10-11) (09-10) Campus has formally documented (through Policy, Resolution or Procedure) the nature of faculty responsibility for selecting and authoring accessible curricular materials. [Commitment] Defined Campus has established specific mechanisms to encourage faculty authoring and adoption of accessible instructional materials (e.g. recognition in article or letter of appreciation). [Ability] + Initiated Defined + Initiated Campus has developed and disseminated examples of accessible curricular materials and practices (e.g. accessible syllabus template, faculty exemplars). [Ability] Defined Defined Campus has specified technology (e.g. workstations, software, scanners) and personnel resources (e.g. student assistants, lab technicians) necessary to support faculty creation of accessible instructional materials. [Ability] Established Established Campus has implemented mechanisms to provide content distributors with access to tools or practices that allow accessibility testing of curricular materials (e.g. text-tospeech, voice recognition, keyboard-only navigation, Document Map view). [Ability] Defined Campus has established specific measures of success for faculty creation of accessible instructional materials (e.g. improving quality of course reader and/or e-reserve material submissions). [Measurement] Initiated + Initiated + Not Started Goal 7.0 – Results Chart Success Indicators AY 10-11 IM SI Details AY 10/11 13 Campus Counts for each Success Indicator AY 10-11 Status Level 7.1 7.2 7.3 7.4 7.5 7.6 Optimizing 0 0 2 2 1 1 Managed 5 2 2 5 3 0 Established 2 5 4 7 5 2 Defined 6 6 9 4 3 1 Initiated 5 5 6 3 8 9 Not Started 5 5 0 2 3 10 Goal 8.0 – Communication Process and Training Plan The campus has implemented a broad-based ATI awareness campaign, supported by a comprehensive training infrastructure to increase technological accessibility across the campus. Top level goal median = Established+. Goal 8.0 – Success Indicators with Medians – This Year Compared to Last Number 8.1 8.2 8.3 8.4 8.5 8.6 Success Indicator Description Median Median This Year Last Year (10-11) (09-10) Campus has developed a formal awareness campaign to increase knowledge of accessibility issues and responsibilities. [Commitment] Established Campus has built capacity (e.g. specified staff time, technology, and/or materials) in support of this awareness campaign. [Ability] Defined Campus has developed and disseminated a variety of training materials, both in content and modality (e.g. quick use guides, workshops, FAQ), for selecting, authoring, and distributing accessible materials. [Ability] Established Campus has disseminated training materials for faculty regarding methods to post curricular materials to the campus LMS course site or equivalent (see Section 4). [Ability] Established Campus is tracking participation in training activities and usage of training materials for accessible authoring, conversion, and delivery of curricular materials (e.g. number of workshop attendees, number of users who download templates, or watch training videos) . [Measurement] Defined Initiated Campus is tracking the effectiveness of training activities and materials for accessible authoring, conversion, and delivery of curricular materials. (e.g., user satisfaction levels, decreased demand for alternate media conversion). [Measurement] Initiated Initiated IM SI Details AY 10/11 + + Defined Defined + Defined Established 14 Goal 8.0 – Results Chart Success Indicators AY 10-11 Campus Counts for each Success Indicator AY 10-11 Status Level 8.1 8.2 8.3 8.4 8.5 8.6 Optimizing 0 2 1 0 1 1 Managed 5 5 6 6 3 1 Established 7 3 7 7 4 1 Defined 5 7 6 8 6 4 Initiated 6 6 2 1 7 9 Not Started 0 0 1 1 2 7 Goal 9.0 – Process Indicators Campus IMAP committee has sufficient breadth, resources, and authority to effectively implement a comprehensive IMAP initiative. Top level goal median = Defined. IM SI Details AY 10/11 15 Goal 9.0 – Success Indicators with Medians – This Year Compared to Last Number 9.1 9.2 9.3 9.4 Success Indicator Description Median Median This Year Last Year (10-11) (09-10) Campus IMAP committee membership consists of stakeholders from all key units (Student Affairs, Academic Senate, Curriculum Committee, Academic Technology, Library) as well as faculty, staff and student. [Commitment] Established Campus IMAP committee has suitable authority to ensure effectiveness of IMAP effort as well as to resolve issues and challenges. [Ability] Initiated – Defined Campus IMAP committee has established a system to effectively track its task delegations and overall project management. [Measurement] Initiated Initiated Campus has established a formal administrative review process by campus executive leadership for all IMAP components. [Verification] Initiated Initiated + Defined Goal 9.0 – Results Chart Success Indicators AY 10-11 Campus Counts for each Success Indicator AY 10-11 Status Level 9.1 9.2 9.3 9.4 Optimizing 1 0 0 1 Managed 6 5 1 2 Established 7 4 1 0 Defined 1 2 5 3 Initiated 5 9 9 8 Not Started 3 3 7 9 IM SI Details AY 10/11 16 Appendix A – Description of Status Level Criteria Success Indicators were determined using the following criteria: Status Level Description for Resources Description for Procedures Description for Documentation Optimizing The campus has a mature practice. Additional procedures are in place to conduct regular administrative reviews of success indicators to gauge effectiveness and implement improvements. Documentation is continually revised to reflect the managed practice. Periodic administrative review of documentation is conducted. Resources have been both identified and allocated. Periodic administrative review of resource allocations is conducted. Managed Campus has a mature practice. Additional procedures are in place to track and capture success indicators (milestones and measures of success). Documentation is complete and fully reflects the standard practice. Resources have been both identified and allocated. Established Campus has a standard practice. Procedures are consistent and formal. Documentation is complete and fully reflects the standard practice. Resources have been both identified and allocated. Defined Campus has a common practice. Any procedures in place are consistent but informal. Documentation, if present, is in working draft form. Resources have been firmly identified but not yet allocated. Initiated Campus has an ad hoc or developing practice. Any procedures in place are generally ad hoc. Documentation is generally absent. Resources have been tentatively identified but not yet allocated. Not Started No action has yet been taken. No documentation has yet been generated. No resources have yet been allocated. IM SI Details AY 10/11 17