INSTITUTIONAL EFFECTIVENESS ASSESSMENT PLAN - DEPARTMENT / UNIT Department/Unit: The Office of Educational Opportunity and TRIO Programs College/Division: Student Services Date: May 17, 2004 Mission Statement: (purpose and functional responsibilities of the department) To provide outreach and access through a wide range of services designed to facilitate the continuance and expansion of educational opportunities to individuals from diverse backgrounds facing unique challenges. By collaborating with schools, community based organizations and government agencies; we serve as an advocate for this populace, upholding ideals of integrity, leadership, accountability, and excellence. Intended Outcome # 1: To publicize the wide range of outreach and access services provided by the Office of Educational Opportunity and TRIO Programs that are designed to facilitate educational opportunities. Effectiveness Indicators: (What factors/variables/elements will you be measuring to gauge your success at reaching your intended outcome?) During fall semester 2004/2005, we will measure: Attendance at the OEO and Trio Programs informational showcases Number of hits on the OEO and TRIO Web site Return rate of e-surveys Success Criteria: (For each indicator described above, what minimum score, value or result will signal success? What score, value or result will signal a need for improvement? What score, value or result will signal a need for immediate intervention?) Success will be demonstrated if: (1) at least 50 people (students, faculty, administrators, community personnel) attend the OEO and TRIO Programs informational annual showcase; (2) if there is an average of 25 hits per month on the OEO and TRIO Programs website; and (3) if there is a response return of 40% of the e-surveys. Evidence of a need for improvement will be demonstrated if: (1) fewer than 50 people attend the OEO and TRIO Programs informational showcase, (2) there are fewer than 25 hits per month on the Web site, and (3) there is a response rate for e-surveys of less than 40%. Immediate intervention will be warranted if (1) fewer than 15 people attend the informational showcase, (2) there are fewer than 10 hits per month on the Web site, or (3) the response rate for e-surveys drops below 20%. Data Collection and Analysis Procedures: (How, when, and by whom will data be collected? How will it be analyzed? What will be the product of the analysis?) Data will be collected by the departmental director using: Sign-in sheets for informational showcases Tabulation of the number of presentations made to core classes and community based organizations The number of responses to e-mail surveys as a percentage of the total number of eligible recipients of those surveys WebTrends data about Web site utilization The director will collate the results, tabulate the number of attendees and presentations, calculate the percentage response rate on e-surveys, and derive WebTrends reports about the number of hits on the Web site. Utilization of Results: (How will results of the analysis be used in planning, decision making, and continuous improvement? What type of actions will be taken based on the analysis results?) If a minimum of 50 people attend the informational showcase, we will analyze the attendance records and use the names to help our department to further publicize and make referrals to the appropriate programs within the department. If the attendance at the showcase is less than 50 people, we will reassess whether it will be necessary to schedule another showcase, or use another marketing strategy. We will respond to the achievement or failure to achieve other success factors in the same general pattern. Intended Outcome # 2: Collaborate with other campus service units to give students access to expanded educational opportunities. Effectiveness Indicators: (What factors/variables/elements will you be measuring to gauge your success at reaching your intended outcome?) During academic year 2004/2005 we will track: Documentation of OEO and TRIO Programs staff collaboration with the staff of other service units Attendance at collaborative programs by OEO and TRIO program students Documentation of shared resources and events sponsored. Number of new or expanded programs based on collaboration. Success Criteria: (For each indicator described above, what minimum score, value or result will signal success? What score, value or result will signal a need for improvement? What score, value or result will signal a need for immediate intervention?) To demonstrate success: The department must have a minimum of two collaborative programs annually At least 40 of the 225 OEO and TRIO program students (Student Support Services and McNair) will attend each collaborative program. If fewer collaborative programs are implemented or less than 40 OEO and TRIO Program students attend each program, there will be a need for improvement. Data Collection and Analysis Procedures: (How, when, and by whom will data be collected? How will it be analyzed? What will be the product of the analysis?) OEO and TRIO program staff will document collaborative programming with other campus service units, including the level of resources required, the number of events sponsored, the number of OEO and TRIO program students who attend, and the number of new or expanded programs based on collaboration that were developed. Utilization of Results: (How will results of the analysis be used in planning, decision making, and continuous improvement? What type of actions will be taken based on the analysis results?) If the desired results are not obtained, the OEO and TRIO Programs Director will review the structure, format, and content of collaborative programming with other campus service units to identify areas of resistance, lack of access, or lack of motivation. The Director will monitor the success of collaborative activities continuously and use the results to reinforce positive collaborative relationships and inspire such collaboration in areas in which it does not currently occur. Intended Outcome # 3: Identify at least two ways in which services have reinforced students’ own confidence in their ability to succeed academically. Effectiveness Indicators: (What factors/variables/elements will you be measuring to gauge your success at reaching your intended outcome?) During academic year 2004/2005, we will measure: Students’ self-assessments of their own confidence in their ability to succeed academically after exposure to OEO and TRIO academic support services. Success Criteria: (For each indicator described above, what minimum score, value or result will signal success? What score, value or result will signal a need for improvement? What score, value or result will signal a need for immediate intervention?) Success will be demonstrated if at least 70% of students who have participated in a OEO and TRIO academic support activity feel more confident in their own ability to succeed academically. If fewer than 70% of the students who participated feel this way, there will be a need for improvement. If more than 40% of the students who participated do not feel more confident in their ability to succeed academically, there will be a need for immediate intervention. Data Collection and Analysis Procedures: (How, when, and by whom will data be collected? How will it be analyzed? What will be the product of the analysis?) OEO and TRIO staff members will distribute a paper survey form to students after they have completed one of the OEO and TRIO academic support activities (tutorials and academic workshops). The survey form will contain five questions to which students will respond using a five point Likert scale, from 1 (strongly agree) to 5 (strongly disagree) Questions will inquire about the value of OEO and TRIO academic support programs to academic self-confidence Twice per semester OEO and TRIO Programs staff will collate, tabulate, and calculate results from these surveys. Utilization of Results: (How will results of the analysis be used in planning, decision making, and continuous improvement? What type of actions will be taken based on the analysis results?) The OEO and TRIO Program Office will use the results of this intervention to guide the planning and implementation of changes in the Programs. If a need for improvement is shown, we will consider ways to enhance the academic effectiveness of existing services. If there is a need for immediate intervention, we will carefully re-assess our academic support services, gather data about the experience at a reference group of peer schools, and consider major modifications in the programs we offer. Intended Outcome # 4: Effectiveness Indicators: (What factors/variables/elements will you be measuring to gauge your success at reaching your intended outcome?) Success Criteria: (For each indicator described above, what minimum score, value or result will signal success? What score, value or result will signal a need for improvement? What score, value or result will signal a need for immediate intervention?) Data Collection and Analysis Procedures: (How, when, and by whom will data be collected? How will it be analyzed? What will be the product of the analysis?) Utilization of Results: (How will results of the analysis be used in planning, decision making, and continuous improvement? What type of actions will be taken based on the analysis results?) Intended Outcome # 5: Effectiveness Indicators: (What factors/variables/elements will you be measuring to gauge your success at reaching your intended outcome?) Success Criteria: (For each indicator described above, what minimum score, value or result will signal success? What score, value or result will signal a need for improvement? What score, value or result will signal a need for immediate intervention?) Data Collection and Analysis Procedures: (How, when, and by whom will data be collected? How will it be analyzed? What will be the product of the analysis?) Utilization of Results: (How will results of the analysis be used in planning, decision making, and continuous improvement? What type of actions will be taken based on the analysis results?)