Counseling Department Program Plan SLO Addendum April 12, 2013 (Program Plan completed June 2012, reviewed by CIP on March 29, 2013.) Assessment Overview The Counseling Program Plan was completed and reviewed by the Student Services Council in spring 2012. In spring 2011 and 2012, Counseling assessed our program Student Learning Outcome: Create a Plan to Facilitate Educational and Career Goals. We discussed the results of our spring 2011 assessment at a Counseling retreat on March 29, 2012, and it is also discussed in our Program Plan. The following information regarding assessment of our Spring 2012 Program SLO and CG Course SLO and Core 4 Competencies assessment was not included in our June 2012 Counseling Program Plan. A department meeting was held on September 13, 2012 to discuss the spring 2012 Program SLO assessment results (see below.) In addition, during spring 2012, the Counseling Department completed our first formal assessment of both course SLOs and Core 4 Competencies, conducting assessments in a majority of our CG course offerings. We held a department meeting on September 27, 2012 to discuss the results of our assessment process. We continued to assess course SLOs in fall 2012, and have scheduled a meeting on May 9, 2013 to discuss our fall 2012 assessment results. The following forms are attached to this addendum: Student Services Department SLO Assessment Analysis Form, summarizing program SLO assessment results for spring 2011 and spring 2012 (also included in the spring 2012 Program Plan Transfer and Basic Skills Departmental Assessment Analysis Form for CG course SLOs-Spring 2012 Transfer and Basic Skills Departmental Assessment Analysis Form for Core 4 Competency assessment results- spring 2012 Pre and Post Test administered in spring 2011 and spring 2012 Program SLO results: Our assessment of the Counseling program SLO was conducted during a two week period in April 2011 and again in April 2012. Students were given a pre and post test, to be administered before and after the 30 minute counseling appointment, which asked them to rate their knowledge of the next steps necessary to reach their educational and career goals, on a selfreport Likert scale. A copy of the assessment instrument is attached for review. Results were consistent over the two assessment years. In 2011, 98.5% and in 2012 97% of students who initially did not know the next steps to reach their educational and career goals stated that after the appointment they now knew what to do. Through department discussions, it was observed that during the survey period, the students who completed the pre and post survey were more focused than those who did not. This increased the effectiveness of the sessions. We realized that having more directed communication with students prior to their appointments was an important tool for a productive and impactful counseling session. Following this discussion, the Counseling Department has implemented a series of focused steps, which are outlined in large posters placed at the entrances to the Counseling areas in both Aptos and Watsonville, as well as on our website. These steps are called “Before you Make an Appointment” (BYMA), and cause students to focus on the items or steps needed in order to make the counseling session more productive, as well as whether their issue is more appropriate for a 30 minute appointment or 10 minute Express (walk-in) advising session. The BYMA charts and concept were reviewed at a department meeting in fall 2012, and revised for greater clarity and effectiveness for students. These steps have increased the effectiveness of counseling appointments. However, in preparation for our spring 2013 program SLO assessment, we realized that our survey data, reflecting students’ opinions of their knowledge of the next steps necessary to reach their goals, did not provide us with sufficient information to guide us in making program improvements. While it was valid and informative to discover that increasing communication about the counseling session improved the sessions, we also needed information on the specific, measurable knowledge and information that students had gained during the counseling session. Our Counseling SLO committee met with the SLO Coordinator on April 11, 2013 to review and refine our assessment tool in preparation for the upcoming spring 2013 program SLO assessment. We decided to add the following measurable and verifiable elements to the pre and post test: 1) Do you have an Educational Plan? (Y/N/I don’t know) 2) What is your next English course (list of choices including N/A and “I don’t know” 3) What is your next math course (same as above) 4) What are your next steps after meeting with a counselor today? (List of 8-10 choices including “other”, with counselor to review at completion of session.) The spring 2013 assessment instrument will be reviewed and refined by the Counseling Department prior to implementation, and results will be discussed in the spring 2013 Student Services Program Planning Annual Update. CG Course SLO results: In spring 2012, Student Learning Outcomes were assessed for the following courses: CG1-College Success CG 51-Introduction to College CG 52-College Study Skills CG 54-Career Planning CG 107-Career and Transfer Research Activities A department meeting was held on September 27, 2012 to discuss the results. Assessment results were mixed with competency ranging from 50 to 90% depending on the assessment. It was clear throughout the assessments that many students have issues with procrastination and time management and both of these issues have been identified to address in the Probation and Dismissal Workshops that we will begin offering in summer 2013. It was interesting that 90% of students in CG 1 who did not plan to transfer are now planning continued education and transfer. It was also noted by our students throughout that more frequent and ongoing contact with counselors is needed to maximize success in reaching their goals. In line with our Program Plan goals and recommendations, Fall 2013 will bring additional sections of CG 51 and students will have the opportunity to meet with their CG instructor during both course and appointment formats. Being able to attend workshops, seminars and other training opportunities was the most frequently stated request. Also, counselors noted that increasing opportunities to share ideas about teaching activities and ideas was helpful. This has resulted in weekly meetings and a deeper and more regular collaboration between CG51 instructors. There are several CG courses that are offered by instructors outside of the Counseling Department: CG 205 and 205L: Academic Survival Skills and lab (taught through the Tutorials program) CG 65: Leadership Development: (taught by Dean of Student Services and required for Cabrillo Student Senators) CG 212: Raising Self-Esteem (taught through Disabled Students Programs and Services) CG 286: Transition to College (taught through Disabled Students Programs and Services) These courses were not included in our department analysis, as the instructors were not part of the Counseling Department. In the future, we plan to include these instructors and courses in our department discussions. Core Four Assessment Results In spring 2012, all Core Four Competencies were assessed in CG courses. At the department meeting of September 27, 2012, three of the Core Four were reviewed and discussed: Communication Critical Thinking and Information Competency Personal Responsibility and Professional Development It was discovered that Global Awareness was mapped only to one CG course, CG 212- Raising Self Esteem, which is taught through Disabled Students Programs and Services. While competency in Global Awareness was assessed in this class, the instructor retired in spring 2012 and we were unable to obtain the assessment results. In addition, we realized that many of our CG courses should be mapped to Global Awareness as well, and we plan to submit revised course outlines reflecting this to the Curriculum Committee prior to the October 2013 deadline. This information is also reflected on the attached Departmental Assessment Analysis Form for Core Four. Student assessment revealed good skills in Critical Thinking, for those who undertook the Critical Thinking assignment. Students were surprised by the amount of insight gained from a critical self-analysis of their skills and areas for improvement. Students varied in their presentation skills, and it was determined that additional instruction in the use of effective communication techniques was needed. In the area of Personal Responsibility, students realized they used “victim” language more often than they realized, and achieved a greater awareness of how to take responsibility for their own actions and outcomes. From the results of this discussion, CG instructors determined that stating goals and objectives more explicitly, providing more supporting activities, and providing more frequent feedback to students would lead to greater student achievement in Core Four Competencies. Counselors were interested in attending On Course and other workshops on teaching methods, and having increased opportunities to discuss teaching methods with other CG faculty. As a result, additional department meetings have been held, and smaller committees of instructors teaching the same CG course have been formed. Student Services Department SLO Assessment Analysis Form Use the form below to summarize the results of the department meeting in which you discussed the results of your SLO assessment. Department Counseling Meeting Date Counseling Retreat 3/29/12, Department meeting 9/13/12 Number of Staff participating 4 staff, 12 Counseling faculty % of department 89% of contract staff and faculty SLOs measured Create a plan to facilitate educational and career goals. Assessment Tool (Briefly describe assessment tool) Pre and post test administered before and after 30 minute counseling appointments during a two week window, in April 2011 and again in April 2012. Students were asked to rate their level of knowledge of the next steps necessary to reach their educational and career goals, on a self-report Likert scale. We measured the change in knowledge of next steps between the beginning and the end of each counseling session. Timeline for Development of Assessment Tool Assessment Analysis The assessment tool was developed in conjunction with the BRIC team in Spring 2011. (Summarize the assessment results; discuss what student needs and issues were revealed) The pre and post tests were administered to 141 students in Spring 2011 and 148 students in Spring 2012. 98.5% (2011) and 97% (2012) of the students who initially said that they did not know the next steps necessary to reach their educational and career goals claimed they did know them by the end of their counseling appointments. Overall, the surveys of both years showed that students are receiving guidance from counselors on the steps that they need to take to meet their goals. Through departmental discussions, it was determined that during the survey period, students were more focused in the kinds of questions they asked their counselors. This increased the effectiveness of the sessions. This realization led to a decision to refine our communication with students prior to their appointments in order to help them focus their questions and in order to enhance the sophistication and impact of the counseling sessions. We now have signs outlining a series of steps that guide students in their choice between express advising and counseling appointments. This list of considerations itself guides students in better articulating their needs. Next Steps (How will you address the needs and issues Development of a checklist/intake process as a way to help students focus and plan for their educational and career goals (see attached checklists): 1) BYMA: “Before You Make an Appointment” revealed by the assessment?) 2) List of topics appropriate for 10 minute Express visits and 30 minute appointments Timeline for Implementation We are discussing developing an online questionnaire for students to take prior to their appointments to facilitate their own clarity and to establish clear expectations for counseling sessions. We will administer the same survey next year in order to see whether our changes in communication, signage, and, possibly, the online questionnaire have an effect. (Make a timeline for how you will implement the next steps outlined above ) Review, refine BYMA in Fall 2012, again in Fall 2013 (based upon Fall 2012 changes) SLO assessment, Spring 2013 Pre-Test Spring 2011 and Spring 2012 1. What is your reason for seeing a Counselor today? Identify educational or career goals I know what my educational or career goals are, but need to identify next steps to achieving them Other _______________________________________________________________ 2. What is your educational or career goal? AA/AS without transfer Transfer to a 4-year university Career Certificate Program Acquire Job Skills Update Job Skills Basic English/Math Skills Other _______________________________________________________________ 3. Do you know what the next steps are toward reaching your educational or career goal? Yes No 4. Rate your knowledge of your next steps below by circling the appropriate number 1 2 3 4 5 poor fair good very good excellent Post-Test Spring 2011 and Spring 2012 1. What is your educational or career goal? AA/AS without transfer Transfer to a 4-year university Career Certificate Program Acquire Job Skills Update Job Skills Basic English/Math Skills Other _______________________________________________________________ 2. Do you know what the next steps are toward reaching your educational or career goal? Yes No 3. Rate your knowledge of your next steps below by circling the appropriate number 1 2 3 4 5 poor fair good very good excellent Pre-Test Spring 2013 1. Do you have an Educational Plan? Yes No I don’t know 2. What is your next English course? ESL Level:_______________ English 255 English 100 English 1A Other _______________________________________________________________ I don’t know Not Applicable/Not needed for my educational goal 3. What is your next Math course? Math 254CM Math 254A Math 254B Math 154 Math 154A Math 154B Math 152 Math 152A Math 152B Other _______________________________________________________________ I don’t know Not Applicable/Not needed for my educational goal 4. What are your next steps after meeting with a counselor today? Take the Math/English Assessment Research transfer universities Enroll in classes Research career options Choose a major Enroll in CG 54 Choose the appropriate General Schedule follow up appointment Education Pattern Other _____________________________________________________ Post-Test Spring 2013 1. What is your next English course? ESL Level:_______________ English 255 English 100 English 1A Other _______________________________________________________________ I don’t know Not Applicable/Not needed for my educational goal 2. What is your next Math course? Math 254CM Math 254A Math 254B Math 154 Math 154A Math 154B Math 152 Math 152A Math 152B Other _____________________ I don’t know Not Applicable/Not needed for my educational goal 3. What are your next steps after meeting with a counselor today? Take the Math/English Assessment Research transfer universities Enroll in classes Research career options Choose a major Enroll in CG 54 Choose the appropriate General Schedule follow up appointment Education Pattern Other _____________________________________________________ Transfer and Basic Skills Departmental Assessment Analysis Form Note: Individual Assessment Form precedes this form. Use the form below to summarize the results of the department meeting in which you discussed the core competency assessment process or the assessment of course SLOs. Append this form to your Instructional Plan and incorporate the results into the narrative of your plan. Department Counseling Meeting Date 9/27/12-Core Four Assessment-Spring 12 Number of Faculty/Staff participating in dialogue FULLTIME 9 FT, 2 adjunct Number of Faculty/Staff sharing Assessment Results 4 FT, 2 adjunct Total number of faculty/staff in department 14 FT, 5 adjunct Core Competency or Course SLOs measured ADJUNCT What student needs and issues were revealed? Communication Critical Thinking Personal Responsibility and Professional Development Communication: final presentation on a student service, selected, researched and visited by the student. Critical Thinking: an individual analysis of study skills, identifying strengths and weaknesses, and creating plans for improvement. Personal Responsibility and Professional Development: In a written paper, students perform personal analysis and assess themselves based on 9 different areas of subject matter learned in class and describe the skills and techniques they will utilize in the future. Students could benefit from additional explanation of effective communication techniques. Presenters varied in their ability to convey subject matter in a concise and articulate manner, and to hold the attention of their audience. Were there any areas where Students who participated in critical analysis of their Assessment Tools (Give examples of major assignments your faculty/staff used to measure the competency or course SLOs) Assessment Results (Summarize the overall results of your department Revised 7/20/07 student performance was outstanding? Any areas where it can be improved? study skills, strengths and weakness did excellent work, and were surprised at the insights gained by participation in this activity. Students revealed that they used “victim” language more often than they realized and needed to take more responsibility for their actions. Next Step in the Classroom to Improve Student Learning How might student performance be improved? Check all the items faculty/staff felt would help them address the needs and issues that were revealed by the assessment. When filling out this form on a computer, please indicate selections by deleting unselected items. Next Step in the Department to Improve Student Learning Check all that the department felt would help them improve student learning. When filling out this form on a computer, please indicate selections by deleting unselected items. Revised 7/20/07 Through analysis of our CG courses, we realized that many courses are not mapped to Global Awareness as they should be. This is incorrect, and revised course outlines will be submitted at the next opportunity to reflect this Core 4 Competency. One CG course, CG 212, Raising Self-Esteem, is mapped to Global Awareness. This course is taught through Disabled Student Programs and Services, and while the competency was assessed, the instructor retired in spring 2012 and we were unable to obtain the assessment result. The course has not been taught again since spring 2012. o State goals or objectives of assignment/activity more explicitly o Revise activities leading up to and/or supporting assignment/activities o Increase in-class discussions and activities o Increase student collaboration and/or peer review o Provide more frequent or more comprehensive feedback on student progress o Increase guidance for students as they work on assignments o State criteria for grading more explicitly o o Offer/encourage attendance at seminars, workshops or discussion groups about teaching methods o Consult teaching and learning experts about teaching methods o Encourage faculty to share activities that foster competency o Have binder available for rubrics and results Priorities to Improve Student Learning (List the top 3-6 things faculty/staff felt would most improve student learning) Stating the goals of the assignment and grading criteria more explicitly Revise activities leading up to and/or supporting assignment/activities Increase student collaboration and/or peer review Attend On-course training Implementation (List the departmental plans to implement these priorities) Revise CG course outlines to include Global Awareness as a Core 4 Competency that is being taught across the department. Provide increased opportunities for CG instructors and counselors to attend On Course training. Timeline for Implementation (Make a timeline for implementation of your top priorities) The Annual Update to our Program Plan will reflect additional assessment data on our CG courses. Beginning in spring 2013, CG instructors are meeting more frequently to discuss ideas and align assignments where appropriate. In addition to those already trained, one additional CG instructor has attended On Course training in spring 2013. Others are incorporating more of this curriculum into the classroom. Revised CG course outlines mapping Global Awareness to many of our courses will be submitted in fall 2013. Revised 7/20/07 Transfer and Basic Skills Departmental Assessment Analysis Form Note: Individual Assessment Form precedes this form. Use the form below to summarize the results of the department meeting in which you discussed the core competency assessment process or the assessment of course SLOs. Append this form to your Instructional Plan and incorporate the results into the narrative of your plan. Department Counseling Meeting Date 9/27/12- SLO Discussion of Spring 12 Number of Faculty/Staff participating in dialogue 9 FT, 2 adjunct FULLTIME Number of Faculty/Staff sharing Assessment Results 4 FT, 2 adjunct Total number of faculty/staff in department 14 FT, 5 adjunct Core Competency or Course SLOs measured Assessment Tools (Give examples of major assignments your faculty/staff used to measure the competency or course SLOs) Revised 7/20/07 ADJUNCT CG 1: Demonstrate an understanding of the transfer process. Utilize self-management and study skills techniques. CG 51: Apply strategies to be successful in college. CG 52: Demonstrate techniques for note taking, memorization, essay writing, reading test taking, and time management. CG 54: Assess and analyze one’s interests, values and skills and career options in order to make educational and career decisions. CG 107: Research, analyze and assess career and/or transfer requirements and options. Demonstrate career or transfer planning, job search, and/or transfer application skills. CG 1: Final project-students answered questions referencing the text, Your College Experience, stating how they planned to apply the skills learned in the future. Students evaluated themselves and developed ongoing plans for success. CG 51: Final group presentation using description and grading rubric. CG 52: Library research project used to assess students’ ability to investigate student support Assessment Results (Summarize the overall results of your department What student needs and issues were revealed? Were there any areas where student performance was outstanding? Any areas where it can be improved? Next Step in the Classroom to Improve Student Learning How might student performance be improved? Check all the items faculty/staff felt would help them address the needs and issues that were revealed by the assessment. resources and programs. Assessment results were mixed, with competency ranging from 50 to 90% depending on the assessment. Many students have issues with procrastination and time management Career decision making is based primarily on internal factors vs. external influences For CG1 College Success: Of students not planning to transfer at the beginning of class, 90% changed their minds and are now planning continued education and transfer. Students need more frequent and ongoing contact with counselor to maximize success in reaching their goals. o State goals or objectives of assignment/activity more explicitly o Revise content of assignment/activities o Revise activities leading up to and/or supporting assignment/activities o Increase student collaboration and/or peer review o Increase guidance for students as they work on assignments o Collect more data When filling out this form on a computer, please indicate selections by deleting unselected items. Next Step in the Department to Improve Student Learning Check all that the department felt would help them improve student learning. When filling out this form on a computer, please indicate selections by deleting unselected items. Priorities to Improve Student Learning (List the top 3-6 things faculty/staff felt would most improve student learning) Revised 7/20/07 o Offer/encourage attendance at seminars, workshops or discussion groups about teaching methods o Consult teaching and learning experts about teaching methods o Encourage faculty to share activities that foster competency o Create bibliography of resource material Attendance at seminars and workshops about teaching methods. Consulting teaching and learning experts about teaching methods Encouraging faculty to share activities that foster competency Collecting more data Implementing a required CG 51 Introduction to College course for all new students. Implementation (List the departmental plans to implement these priorities) Facilitate participation in On Course and other trainings for more CG instructors Increase the number of meetings and discussions about CG curriculum, thereby increasing the dialogue and sharing of teaching methods and activities. Obtain funding for 28 sections of a mandatory CG 51, Orientation to College course. Timeline for Implementation (Make a timeline for implementation of your top priorities) Revised 7/20/07 Increase opportunities for collaboration and training over the 2012/2013 academic year. Implement a required Introduction to College course by Fall 2013