Assessment of Student Learning Plan Counseling Services Kansas State University A. Student Life Unit and Date Academic Year: 2011 - 2012 Division: Student Affairs Unit: Counseling Services Date Submitted: August 4, 2010; updated 11/20/2010 B. Contact Person(s) for the Assessment Plans Dorinda J. Lambert, Ph.D., Director, Counseling Services C. The Program at Counseling Services: Mission & Service Areas Kansas State University Counseling Services, in support of the overall mission of the University, provides the highest standard of professional services to help all students approach their full potential - personally, academically, and socially. Within an accepting, sustaining and compassionate setting, we attend to the psychological needs of our students to alleviate concerns, facilitate problem solving, promote wellbeing, and enhance success. This attention to student needs is also seen in our consultation to other campus offices/departments as part of our role in maintaining a safe and equitable campus community. As an integral part of our multicultural campus community, the Counseling Services staff value diversity and strive to provide culturally sensitive and relevant services. In doing so, we work collaboratively with other entities, both on and off campus, while appropriately protecting confidentiality in order to foster and maintain a safe and healthy environment. In addition, during times when a critical event occurs, we are ready to offer timely response through consultation, outreach, and follow-up in order to lessen the effects of trauma and promote resolution. Counseling Services provides three areas of service: 1. Direct service as a) brief consultation and crisis consultation/management to faculty/staff and students and b) short-term services to currently registered students, which includes counseling (individual, couples, group) and biofeedback training; 2. Educational outreach and consultation on mental health information; and 3. Pre-doctoral psychologist internship training program accredited by American Psychological Association. D. Assessment of Student Learning Three-Year Plan [2010~2012] D1, 2 and 3. Table 1 covers each of these items for each of the service areas: 1. a description of student learning outcomes, 2. group assessed and assessment methods (measures or assessment tools, timeframe), and 3. the data presentation and discussion process. 1 Table 2 indicates relationship between student learning outcomes of the Counseling Services and K-State student learning outcomes. D4. Unit’s Process for Using Assessment Results to Improve Student Learning Timing of the assessments 1) Table 1 Item I: Direct-Service Counseling: The Clinical assessments done at intake and termination (1a) have been a part of the clinical process at CS since 1985 with the more formalized KPIRS assessments (1b) being developed and implemented over the last 20 years with the data presentation and discussion being a part of the agency culture throughout that time. These assessments are continuing to be used during this current Assessment of Student Learning Three-Year Plan [2010~2012]. 2) Table 1 Item II: Educational Outreach & Consultation: The survey of presentations (2) are currently being gathered after each presentation and will continue to be gathered throughout the three-year plan and beyond. The data gathered about the use of the online materials (e.g Susie’s Strategies and other programs developed online) has been instituted in 2010 and will continue to be gathered on a yearly basis throughout the three-year plan. 3) Table 1 Item III: Psychologist Internship Training: The student learning outcomes have been an essential part of the internship program since it was first accredited by APA in 1987 and effectively assisted in the continual re-accreditation of the program since then. The time frame for the intern evaluations outlined in Table I occurs each semester and will continue during this current Assessment of Student Learning Three-Year Plan [2010~2012]. Our internship program will be undergoing its next APA Accreditation Site Visit sometime in Spring/Summer 2012. Use of and Presentation of the results In addition to the on-going steps that are used to validate the accuracy of assessment, diagnosis and treatment (case review, supervision, validated instrument completion) cumulative agency data is reviewed at the end of each year to show the summative results of the year’s activity and make comparisons with previous years results as well as national comparisons. Specific needs maybe identified for improvement and are typically followed by providing staff with in-service development seminars. These seminars are regularly offered within the department for 3 hours each month. Additionally, all professional staff are expected to complete 50 hours of validated professional development activity each two year period for maintenance of professional licensure; this continuing education is required by the State of Kansas Behavioral Sciences Regulatory Board. An external review of the agency’s pre-doctoral psychology internship program and the agency’s overall functioning is made every 8 years by the national accrediting board of the American Psychological Association. Summative data is evidenced each year in the Annual Report that goes to key offices on campuses and is available to all through the KSU Counseling Services website. This will continue during this current Assessment of Student Learning Three-Year Plan [2010~2012]. In addition, the results of the agency’s activities and the feedback from the client surveys administered each semester are reviewed twice a year by the CS staff at meetings of the department. Then changes or revisions are made in the delivery of Counseling Services as needed at the staff planning meetings which are convened at the beginning of each academic year. Additionally, after receiving recommendations from the national APA internship accreditation review, suggested adaptations are made to comply and maintain accreditation. 2 All of the above evaluation results are used to improve the agency service delivery and the staff professional skills. The continuing use of our services by the campus community and the improvements seen in students who have received our services can be considered a positive result of these efforts. 3 Table 1 Assessment of Student Learning Three-Year Plan (2010-2012) Counseling Services, Kansas State University Measurement (Tools & Timeline) Service Area Group Assessed Student Learning Outcomes I. Direct Service Counseling Students attending at least 3 sessions of individual or group counseling 1. Identify personal concerns and develop strategies to alleviate symptoms that have created the interference with academic and social functioning. (Personal concern or symptom areas include mood, learning problems, interpersonal conflicts, career uncertainties, self-harm, and addiction issues). 1a. Ongoing intake interview and follow-up assessment at session 3 by counselors using DSM defined rubric of diagnosis, case descriptors, and action maker assessment [Direct measure] Students receiving educational presentations or workshops provided by Counseling Services 2. Make use of skills and information presented to enhance ability to be successful in life. 2. Ongoing survey of attendees utilizing Presentation/Workshop Evaluation Form completed by the students at the end of the presentation [Indirect measures] Students viewing the Suzy’s Study Strategies video posted on UniversityLifeCafe . 3. Develop personal goals for improved academic performance through the reflecting process of self-efficacy and outcome expectation of the 10-areas of study behaviors and skills. II. Educational Outreach & Consultation 1b. Ongoing student self-ratings on symptoms, academic & social interference, readiness, and progress at intake and at session 3 (pre & post tests), utilizing K-PIRS [Indirect measure] 3. Ongoing internet-based survey of the students who viewed the Suzy’s Study Strategies video that will be compared to the students who haven’t viewed the video [Indirect measure]. Data Presentation & Discussion On a weekly basis, selected cases are reviewed during group case conference attended by all clinical staff. Annually, summative results are published in the Annual Report by September, and discussed twice a year during the staff retreat in August and planning meeting in January. At the end of each semester, survey results are reviewed by the program Committee. Annually, summative results are published in the Annual Report by September, and discussed twice a year during the staff retreat in August and planning meeting in January. 4 Table 1 Continued. KSU Counseling Services SLO Assessment Service Area III. Psychologist Internship Training (Accreditation by American Psychological Association) Group Assessed Students completing the Pre-doctoral Psychology Internship Program Student Learning Outcomes Measurement (Tools & Timeline) 4. Demonstrate skills related to professional identity and professionalism (i.e., gaining self-knowledge, making sound, ethical, clinical and personal judgments, demonstrating sensitivity to cultural differences, and experiencing a sense of responsibility to oneself, the community, and the profession) 4a. Supervisors’ evaluation on professional decorum and professional objectives at the end of semester, utilizing the Intern Semester Evaluation Form on a 5point rating scale [Direct measure] 5. Conduct effective counseling and therapeutic interventions (i.e., individual and group psychotherapy, assessment, crisis intervention, diagnosis, and treatment planning) 5a. Supervisors’ evaluation of artifacts of the interns’ performance at the end of semester, utilizing the Intern Semester Evaluation Form on a 5point rating scale. The artifacts include videotapes, audiotapes, case write-ups, and presentations at a formal case conference) 4b. Intern follow-up evaluation of training program [Indirect measure] Data Presentation & Discussion At the end of each semester, progress is reviewed with the intern, and discussed in a group meeting including the interns, supervisors, and the training director. Annually, summative assessment results are reported and discussed among the training supervisors in July 5b. Intern follow-up evaluation of training program [Indirect measure] 6. Conduct effective developmental, remedial programmatic, and educational interventions (i.e., consultation, outreach, workshop development, and teaching) 6a. Ongoing evaluation by senior staff on interns’ activities discussed in supervisors’ meetings, then a formal evaluation by the Training Director at the end of semester, utilizing the Intern Semester Evaluation Form on a 5-point rating scale [Direct measure] 6b. Intern follow-up evaluation of training program [Indirect measure] 5 Table 2 Relationship to K-State Student Learning Outcomes Counseling Services, Kansas State University University-wide SLOs Service Area Program SLOs I. Direct Service Counseling 1. Identify personal concerns and develop strategies to alleviate symptoms that have created the interference with academic and social functioning II. Educational Outreach & Consultation 2. Make use of skills and information presented to enhance ability to be successful in life. 3. Develop personal goals for improved academic performance through the reflecting process of self-efficacy and outcome expectation of the 10-areas of study behaviors and skills. III. Psychologist Internship Training 4. Demonstrate skills related to professional identity and professionalism 5. Conduct effective counseling and therapeutic interventions 6. Conduct effective developmental and remedial programmatic and educational interventions Knowledge Critical Thinking Communication Diversity Academic / Professional Integrity x x x x x x x x x x x x x x x x x x x x x x x x x x x x x x 6