L.A. Harbor College, Special Programs and Services SLO and SAO Assessment Report: July 2011 LA HARBOR COLLEGE Student Learning Outcomes (SLOs)/Service Area Outcomes (SAOs) Student Services Assessment Report (Instructional SLOs: See LAHC Academic Affairs Division) Department Name: Special Programs and Services Department Head: Dr. Deborah Tull Phone: (310) 233-4621 Reviewed by: ____________________________ Date: 7/16/11 Institutional Learning Outcomes Intended SLO Outcomes Means of Assessment and Criteria for Success 5 As a result of participation in the service delivery process, students will become independent users of services and resources with timely and appropriate requests for services Means: SPS Student Services Resource Utilization Survey to be administered in the Spring 2011 semester. Summary of Data Collected Data to be reported in Spring 2011: Data summary attached. Use of Results June 2011 – August 2011 data driven reorganization and streamlining of service delivery process for optimal success of students with disabilities. Effective date of full reorganization: Fall Semester, September 2011 Analysis of student services delivery documentation: counseling notes, service referral documentation, approved tutoring form, approved testing accommodation form, etc. Criteria: At least 70% of the students surveyed and/or researched through the data sampling process will attain the outcome 1 L.A. Harbor College, Special Programs and Services SLO and SAO Assessment Report: July 2011 Institutional Learning Outcomes 4 Intended SLO Outcomes As a result of the specialized counseling, students will successfully link with support services on the campus and in the community. Means of Assessment and Criteria for Success Summary of Data Collected Means: SPS Student Services Resource Utilization Survey to be administered in the Spring 2011 semester. Data to be reported in Spring 11: Data summary attached. Use of Results June 2011 – August 2011 data driven reorganization and streamlining of service delivery process for optimal success of students with disabilities. Effective date of full reorganization: Fall Semester, September 2011 Analysis of student services delivery documentation: counseling notes, service referral documentation, approved tutoring form, approved testing accommodation form, etc. Criteria: At least 70% of the students surveyed and/or researched through the data sampling process will attain the outcome. 2 L.A. Harbor College, Special Programs and Services SLO and SAO Assessment Report: July 2011 Institutional Learning Outcomes Intended SLO Outcomes Means of Assessment and Criteria for Success Summary of Data Collected 5 As a result of the specialized counseling, students will establish feasible personal and career goals along with viable educational plans in support of their life goals Means: Student Education Contract (SEC) Which identifies academic goals. SPS Student Services Resource Utilization Survey to be administered in the Spring 2011 semester. Data to be reported in Spring 11: Data summary attached. Use of Results June 2011 – August 2011 data driven reorganization and streamlining of service delivery process for optimal success of students with disabilities. Effective date of full reorganization: Fall Semester, September 2011 Analysis of student services delivery documentation: counseling notes, transcripts, etc. Completion of a special personal development career planning class, workshops or SEC oriented counseling sessions. Criteria: At least 70% of the students surveyed and/or researched through the data sampling process will attain the outcome. 3 L.A. Harbor College, Special Programs and Services SLO and SAO Assessment Report: July 2011 Institutional Learning Outcomes 5 Intended SLO Outcomes Means of Assessment and Criteria for Success As a result of the specialized counseling, students will be able to successfully demonstrate selfadvocacy skills as they interface with faculty, staff and SPS paraprofessionals. Means: SPS Student Services Resource Utilization Survey to be administered in the Spring 2011 semester. Summary of Data Collected Data to be reported in Spring 11: Data summary attached. Use of Results June 2011 – August 2011 data driven reorganization and streamlining of service delivery process for optimal success of students with disabilities. Effective date of full reorganization: Fall Semester, September 2011 Analysis of Student services delivery documentation: counseling notes, service referral documentation, approved tutoring form, approved testing accommodation form, etc. Criteria: At least 70% of the students surveyed and/or researched through the data sampling process will attain the outcome. 4 L.A. Harbor College, Special Programs and Services SLO and SAO Assessment Report: July 2011 Institutional Learning Outcomes Intended SLO Outcomes Means of Assessment and Criteria for Success Summary of Data Collected 1 As a result of tutorial and other support services, students will be able to demonstrate effective use of written, oral, and non-verbal communication. Means: SPS Student Services Resource Utilization Survey to be administered in the Spring 2012 semester. Data to be reported in Spring 2012 Use of Results June 2012 – August 2012 data driven reorganization and streamlining of service delivery process for optimal success of students with disabilities. Effective date of full reorganization: Fall Semester, September 2012 Analysis of student services delivery documentation: counseling notes, service referral documentation, approved tutoring form, approved testing accommodation form, etc Criteria: At least 70% of the students surveyed and/or researched through the data sampling process will attain the outcome. 5 L.A. Harbor College, Special Programs and Services SLO and SAO Assessment Report: July 2011 Institutional Learning Outcomes Intended SLO Outcomes Means of Assessment and Criteria for Success Summary of Data Collected 5 As a result of specialized counseling and participation in the service delivery process, students will be able to demonstrate selfmanagement through practices that promote physical, cognitive and emotional well-being. Means: Resource Utilization Survey to be administered in the Spring 2012 semester. Data to be reported in Spring 2012 Use of Results June 2012 – August 2012 data driven reorganization and streamlining of service delivery process for optimal success of students with disabilities. Effective date of full reorganization: Fall Semester, September 2012 Analysis of student services delivery documentation: counseling notes, service referral documentation, approved tutoring form, approved testing accommodation form, etc Criteria: At least 70% of the students surveyed and/or researched through the data sampling process will attain the outcome. 6 L.A. Harbor College, Special Programs and Services SLO and SAO Assessment Report: July 2011 Institutional Learning Outcomes Intended SLO Outcomes Means of Assessment and Criteria for Success Summary of Data Collected 4 As a result of the provision of support services, students will develop the ability to work as a team with SPS professional and paraprofessional staff as they progress towards their educational goals. Means: Resource Utilization Survey to be administered in the Spring 2013 semester. Data to be reported in Spring 2013 Use of Results June 2013 – August 2013 data driven reorganization and streamlining of service delivery process for optimal success of students with disabilities. Effective date of full reorganization: Fall Semester, September 2013 Analysis of student services delivery documentation: counseling notes, service referral documentation, approved tutoring form, approved testing accommodation form, etc Criteria: At least 70% of the students surveyed and/or researched through the data sampling process will attain the outcome. 7 L.A. Harbor College, Special Programs and Services SLO and SAO Assessment Report: July 2011 Institutional Learning Outcomes Intended SLO Outcomes Means of Assessment and Criteria for Success Summary of Data Collected 5 As a result of the job development and placement activities, students will be able to secure part-time or fulltime employment in their interest areas if desired. Means: Resource Utilization Survey to be administered in the Spring 2014 semester. Data to be reported in Spring 2014 Use of Results June 2014 – August 2014 data driven reorganization and streamlining of service delivery process for optimal success of students with disabilities. Effective date of full reorganization: Fall Semester, September 2014 Analysis of student services delivery documentation: counseling notes, service referral documentation, approved tutoring form, approved testing accommodation form, etc Criteria: At least 70% of the students surveyed and/or researched through the data sampling process will attain the outcome. 8 L.A. Harbor College, Special Programs and Services SLO and SAO Assessment Report: July 2011 Institutional Learning Outcomes 4 Intended SLO Outcomes Means of Assessment and Criteria for Success Summary of Data Collected As a result of the college cultural and social activities, students will be able to increase their social support network and gain a respect or appreciation for diversity. Means: Resource Utilization Survey to be administered in the Spring 2014 semester. Data to be reported in Spring 2014 Use of Results June 2014 – August 2014 data driven reorganization and streamlining of service delivery process for optimal success of students with disabilities. Effective date of full reorganization: Fall Semester, September 2014 Analysis of student services delivery documentation: counseling notes, service referral documentation, approved tutoring form, approved testing accommodation form, etc Criteria: At least 70% of the students surveyed and/or researched through the data sampling process will attain the outcome. 9 L.A. Harbor College, Special Programs and Services SLO and SAO Assessment Report: July 2011 Institutional Learning Outcomes Intended SLO Outcomes Means of Assessment and Criteria for Success Summary of Data Collected 3 As a result of access to special materials and equipment, students will develop mastery in the utilization of the materials and equipment. Means: Resource Utilization Survey to be administered in the Spring 2015 semester. Data to be reported in Spring 2015 Use of Results June 2015 – August 2015 data driven reorganization and streamlining of service delivery process for optimal success of students with disabilities. Effective date of full reorganization: Fall Semester, September 2015 Analysis of student services delivery documentation: counseling notes, service referral documentation, approved tutoring form, approved testing accommodation form, etc. Criteria: At least 70% of the students surveyed and/or researched through the data sampling process will attain the outcome. 10 L.A. Harbor College, Special Programs and Services SLO and SAO Assessment Report: July 2011 Institutional Learning Outcomes Service Area Outcomes Means of Assessment and Criteria for Success Summary of Data Collected Use of Results 1,2,3,4 As a result of SPS communication, the college community will have an increased understanding of disability-related federal and state laws, specific legal issues related to service provision, accommodations and classroom instruction, and access standards for a barrier free campus. Means: LAHC Data Collection Effort: faculty,staff,administration satisfaction survey. Data to be reported on an annual basis by the close of the Spring semester. SPS advisory efforts will be adjusted based on survey results and specific requests for disability-related expertise from the various campus committees and constituency groups. Results will be used to influence policy and practice at the college and District levels. Other: SPS active participation in campuswide meetings, provision of informational workshops, inclusion in college ADA Committee (documented through committee minutes and professional development calendars) Criteria: At least 70% of the survey respondents will report increases in their understanding of disability related issues from SPS information dissemination. 11 L.A. Harbor College, Special Programs and Services SLO and SAO Assessment Report: July 2011 Institutional Learning Outcomes 1,2,3,4, Service Area Outcomes As a result of SPS development and maintenance of campus and community partnerships, the college will receive supplemental resources to support the educational and personal success of students with disabilities. Means of Assessment and Criteria for Success Means: Annual analysis of: (1) SPS college and community partnerships (2) Actual Resource Development Outcomes Summary of Data Collected Use of Results Data to be reported on an annual basis by the close of the Spring semester. Data will be used to refine/redefine the most useful SPS college and community partnerships, determine the most effective participation level, and develop a resource development plan for the upcoming year. Criteria: Maintenance of college and community partnership participation should be at or above the 75% level, development of new partnerships at or above the 5% level, and resource development at or above the 5% level from the preceding years budget. 12 L.A. Harbor College, Special Programs and Services SLO and SAO Assessment Report: July 2011 Institutional Learning Outcomes Service Area Outcomes Means of Assessment and Criteria for Success 1,2,3,4 As a result of efficient SPS program management the strategic program goals and objectives will be attained. Means: Ongoing Analysis: (1) Approval of State Chancellor’s Office DSPS Program Plan, (2) Approval of State Chancellor’s Office DSPS Year End Report, (3) Approval of federal TRIO Program Annual Performance Report, (4) Formal Advisory Committee approval of SPS targeted goals and objectives, (5) College SPS Program Review process, (6) College Research Division’s satisfaction surveys to faculty, staff and administration and disabled student population, (7) Internal SPS quantitative and qualitative surveys Summary of Data Collected Raw data to be reported on an annual basis by June 30 of each year; yearly state and federal reports to align with respective deadlines. Use of Results By September of each academic year, data driven reorganization and streamlining of service delivery process for optimal success of students with disabilities. State and/or federal corrective action plans to be developed in response to respective audit/program review processes. Criteria: 80% or above approval rating from state, federal or advisory entities, At least 75% satisfaction ranking from college surveys. SPECIAL PROGRAMS AND SERVICES DATA OVERVIEW: SLO AND SAO MEASUREMENT 2011 PAGES 8 - 25 13 L.A. Harbor College, Special Programs and Services SLO and SAO Assessment Report: July 2011 2011 SPS Student Learning Outcome Analysis Data Summary: Special Programs and Services Spring 2011 Student Survey Answer Options ADHD Brain injury Chem Depend Hearing Learning Mobility Psych Speech Visual Other Health Response Percent 16.3% 7.0% 14.0% 4.7% 46.5% 9.3% 20.9% 4.7% 14.0% 34.9% Response Count 7 3 6 2 20 4 9 2 6 15 14 L.A. Harbor College, Special Programs and Services SLO and SAO Assessment Report: July 2011 Answer Options African-American American Indian Asian Filipino Hispanic Pacific Islander White (non-Hispanic) Other Decline to State/Unknown Response Percent 15.9% 0.0% 0.0% 0.0% 38.6% 2.3% 22.7% 6.8% 13.6% Response Count 7 0 0 0 17 1 10 3 6 15 L.A. Harbor College, Special Programs and Services SLO and SAO Assessment Report: July 2011 Response Percent Response Count During the day 80.5% 33 During the evening 58.5% 24 On weekends 34.1% 14 Over the internet 26.8% 11 Answer Options 16 L.A. Harbor College, Special Programs and Services SLO and SAO Assessment Report: July 2011 Answer Options The office hours are convenient. I did not wait a long time for an appointment. I received the help I needed from SPS. I can independently access SPS services and resources. I understand the procedures to request services. I am able to comply with the required deadlines to receive services. Strongly Agree/ Agree 82% Strongly Disagree/ Disagree 16% 64% 14% 23% 83% 12% 5% 74% 7% 19% 86% 7% 7% 78% 7% 15% Neutral 2% 17 L.A. Harbor College, Special Programs and Services SLO and SAO Assessment Report: July 2011 Answer Options Strongly Agree/ Agree Neutral Strongly Disagree/ Disagree 81% 9% 9% 84% 7% 9% 75% 14% 11% I was greeted politely by the staff. The staff responded to my needs in a sensitive manner. The office provided sufficient staffing to meet my needs. 18 L.A. Harbor College, Special Programs and Services SLO and SAO Assessment Report: July 2011 Answer Options I have more information about other services on campus. I have received information on community resources. I have successfully worked with other campus service sites I have successfully worked with other community resource sites. I have the confidence to approach instructors to request a service or accommodation. I am able to express my needs when communicating with faculty and staff. I actively participate in my educational planning process. I am clear about what classes are needed for my major. I have more direction to pursue my career goals. I have completed a student educational plan. Strongly Agree/ Agree 83% 67% 62% 43% 81% 80% 80% 81% 86% 76% 5% 21% 18% 31% Strongly Disagree/ Disagree 12% 13% 21% 26% 12% 11% 16% 10% 7% 15% 7% 9% 5% 10% 7% 10% Neutral 19 L.A. Harbor College, Special Programs and Services SLO and SAO Assessment Report: July 2011 Answer Options Registration Assis Referral Serv Counseling Serv Tutoring Serv High Tech Center Inst Personal Dev Inst Testing Accomm Note Taking Equipment Loan Captioning Serv Interpreter Serv Special Materials Excellent/ Very good 83% 79% 88% 71% 65% 71% 87% 69% 72% 69% 69% 81% Good Fair/ Poor 7% 8% 2% 11% 14% 13% 8% 13% 9% 19% 15% 7% 10% 13% 10% 18% 22% 16% 5% 19% 19% 12% 15% 11% 20 L.A. Harbor College, Special Programs and Services SLO and SAO Assessment Report: July 2011 2011 SPS Service Area Outcome Analysis Data Summary: Spring 2011 Special Programs and Services Faculty, Staff Administration Satisfaction Survey Administration Date: June 2011 Respondents: Job Classification Administrator Classified Manager Classified Support Division Chair Full-Time Faculty Hourly Faculty Student Worker Response Percent 4.8% 6.0% 32.1% 6.0% 31.0% 16.7% 3.6% Awareness of DSPS: Extremely Aware/Moderately Aware 76% Somewhat Aware 14% Slightly Aware/Not Aware 10% 21 L.A. Harbor College, Special Programs and Services SLO and SAO Assessment Report: July 2011 Since the beginning of the Spring 2011 semester, how many times have you visited or contacted DSPS? None Response Percent 50% 1-5 Response Count 42 35.7% 30 6 to 10 4.8% 4 More than 10 9.5% 8 Answered Question: 84 Skipped Question: 9 Please answer the following based on your most recent experience with DSPS: I was treated with courtesy by the staff. Strongly agree/ Agree 95% N/A 0% Strongly Disagree/ Disagree_________ 5% The staff was attentive to my needs. 95% 0% 5% The staff was knowledgeable in answering my questions. 95% 0% 5% The Assistance I received from this department was useful. 95% 0% 5% The office hours were convenient to meet my need. 88% 7% 5% Overall, I am satisfied with the services I received. 93% 0% 7% 22 L.A. Harbor College, Special Programs and Services SLO and SAO Assessment Report: July 2011 Data Overview: Internal Special Programs and Services Analysis Research indicates that the retention, graduation, and transfer rates of students with disabilities have increased during the 2010-11 academic year (34 graduates and 20 transfers). The data is available for review in the SPS Office. The data indicates that the existing programs and services are meeting the basic needs of students so they can attain their educational goals. It would be desirable if supplemental funding could be made available so SPS could hire additional staffing and expand its service hours. During the 2010 -11 academic year there was a 22% increase in students accessing services in SPS. Work is currently underway by SPS certificated staff to fully assess student learning outcomes and integrate the findings into programmatic changes if necessary. Surveys have been developed, distributed, collected, and analyzed which address student satisfaction levels with the service delivery and instructional offerings. Employee evaluations have been conducted to ensure that employees either meet or exceed the standards necessary to successfully work with students with disabilities. The SPS Coordinator has secured federal Student Support Services grant funds (Project A.S.A.P.) for over 20 years to safeguard optimal service delivery and instructional opportunity for LAHC students with disabilities. The reapplication process for the federal funding occurred during 2009 with award notification of the refunding occurring in the Summer of 2010. The Grant Proposal received high scores from three readers and received all of the possible prior experience points. The primary purpose of the federal Student Support Services grant funding is to increase student retention, graduation and transfer rates of postsecondary education students. A Student Satisfaction Survey circulated by SPS (2009-10) indicated that approximately 95% of the students who applied for services received the help they needed from SPS. This need centered on the provision of federally and state mandated services. Strengths of SPS were found to be effective leadership, an excellent faculty/staff, outstanding counselors, great ability to secure additional funds through grants (1.5 million dollar federal grant secured by SPS Coordinator), campus-wide representation throughout the campus on disability related issues, strong campus commitment to services for students with disabilities and administrative support for SPS program. Reported areas of improvement include: the need for a larger facility, the need for an operational air conditioning system, the need for additional tutors (especially Math) and other support staff, the specific need for supplemental counselors and instructors, the need for learning disability assessment services, the need for greater student self-advocacy because of inadequate communication of students with instructors, the need for improved access to High Tech Center offerings and the need for additional supplies and equipment. The LAHC Spring 2011 student, faculty, staff and administration satisfaction surveys (two instruments) on SPS have been completed with results quantified. The Student Satisfaction Survey results indicate an acceptable degree of satisfaction with the service delivery component of SPS: over 90% of the rankings for services were within the good – excellent range. The Instructional component (including the High Tech Center for students with disabilities) had a 79% good – excellent ranking with 22% of the respondents giving the instructional area a fair – poor ranking. Ongoing SPS employee evaluations ensure that the Program has qualified, competent employees. The Spring 2011 Faculty, Staff, and Administrator SPS Satisfaction Survey indicated that 90% of the respondents were aware of the SPS Services, 50% had actually visited or contacted SPS, and over 90% were satisfied with the services they received. 23 L.A. Harbor College, Special Programs and Services SLO and SAO Assessment Report: July 2011 Compliance with college, district, state and federal regulations have been maintained with two exceptions: (1) there are architectural barrier removal issues that must be dealt with on the campus, and (2) there are campus computer lab and other instructional venue accessibility issues that must be dealt with. A full state Program Review was conducted in 2009-10 along with the development of the mandated DSPS State Program Plan (submission date: June 15, 2010). The Program Review found that the college was in compliance with state and federal mandates for the provision of instruction and service delivery for students with disabilities. The understaffing problem within SPS was mentioned. It was recommended that SPS increase its counseling staff and High Tech Center instructional staff. An annual report is submitted to the Chancellor’s Office every year. This report includes student data, activity data and budgetary data. Data from this report has never been questioned or disputed by the state. A California Community College Chancellor’s Office DSPS Technical Assistance Site Review was conducted at the Los Angeles Harbor College Special Programs and Services in May of 2009. The review process yielded some recommendations and noted some exemplary practices: Exemplary practices: Effective leadership from the Special Services Coordinator and full SPS faculty/staff participation in addressing campus-wide disability-related issues; Knowledgeable Assistive Technology Instructional Assistant; Coherently identified issues with awareness of needs; Well-prepared and engaged in the technical assistance visit; Strong campus commitment to services for students with disabilities; Administrative support for the Special Services program; Well-organized Special Services program, apparent teamwork, skill and experience; Impressive recent assessment of assistive technology on campus; Very comprehensive program and tremendous accomplishments with a limited staff; Excellent physical access throughout the campus; Recommendations: Development of policies that support campus-wide accessibility and strategies to promote access and consistency in website development and distance education courses; Provide direct link to SPS on college website; Refinement of the closed-captioning process and further development of the Alternate Media Production Center; 24 L.A. Harbor College, Special Programs and Services SLO and SAO Assessment Report: July 2011 Provision of appropriate assistive technology equipment and/or software throughout the campus; Refinement of distance education instructional policies and practices: need full compliance with ADA/Section 508; Acknowledgment of the needs of students with disabilities through adoption of a “priority response” status with the campus IT department; Recognition of legal mandates that place responsibility for accommodations with the College, not the Special Services program, and notwithstanding the cost of such accommodations. Development of a follow-up process with students regarding requested accommodations. The LAHC Spring 2011 student, faculty, staff and administration satisfaction surveys (two instruments) on SPS have been completed with results quantified. The Student Satisfaction Survey results indicate an acceptable degree of satisfaction with the service delivery component of SPS: over 90% of the rankings for services were within the good – excellent range. The Instructional component (including the High Tech Center for students with disabilities) had a 79% good – excellent ranking with 22% of the respondents giving the instructional area a fair – poor ranking. Ongoing SPS employee evaluations ensure that the Program has qualified, competent employees. The Spring 2011 Faculty, Staff, and Administrator SPS Satisfaction Survey indicated that 90% of the respondents were aware of the SPS Services, 50% had actually visited or contacted SPS, and over 90% were satisfied with the services they received. 2010-11 Resource Development Analysis: (1) 2010: 1.5 million dollar 5 year TRIO Grant Award, (2) Provision of district-wide FREE Violence Prevention Training by L.A. County Mental Health, (3) Increased levels of CTE and Health Center funding to support SPS activities. Other data documenting SLO/SAO attainment with appropriate data integration (on file in SPS Office): (1) State and Federal DSPS and TRIO year-end reports, (2) MIS Data Reports which tabulate the numbers served, disability types and services rendered, (3) Anecdotal records and qualitative review findings within SPS program files and research report correlating SPS service provision with SLO performance. 25