Curry Health Center (CHC) Optimal Bear Program Assessment Submitted by Brent Hildebrand, Curry Health Center - Student Wellness Health Promotion Specialist I. Summary From September 5, 2012 to May 22, 2013, CHC Student Wellness collected assessment data from clients participating in the Optimal Bear peer wellness coaching program during the Fall 2012 and Spring 2013 semesters. Interpretation of the data indicated high levels of client satisfaction as well as improvement in all measured client performance indicators. There was marked difficulty in collecting exit assessments from clients, resulting in a smaller data set for pre-post comparison than was anticipated. The information gleaned from this assessment supports the continuation and expansion of the Optimal Bear program and warrants continued support from Curry Health Center. Furthermore, anecdotal observations made during the assessment process have indicated a need for logistical modifications to improve the exit assessment collection rate. II. Background Information and Relationship to Strategic Issues The Optimal Bear peer wellness coaching program was developed by two Health and Human Performance students interning for CHC Student Wellness during the summer of 2011. This program is designed to empower University of Montana students to reach their full potential both academically and personally through one-on-one wellness coaching. The client-coach interaction is based in a motivational interviewing theory in which the coach facilitates client-directed goal setting and behavior change. Optimal Bear coaches provide encouragement and quality resources to student clients, as well as a level of external accountability that enables students to reach their goals. The Optimal Bear program demonstrates Curry Health Center’s commitment to partnering for student success through strengthening student support. The program is designed to help students with wellness factors including but not limited to sleep, stress, nutrition, and physical activity, which influence student success. Optimal Bear can also help students learn specific skills such as time management methods, study skills, and stress management techniques that may directly benefit academic performance. Because of this coaching, the program has the potential to facilitate desired student outcomes, such as increased upper division retention rates, increased freshman success, increased six-year graduation rates, increased retention and graduation rates for students in two-year programs, and increased participation in student success initiatives. pg. 1 III. Indicators and Assessment All incoming Optimal Bear clients were required to complete an intake survey prior to or during their first session with their wellness coach. Most clients completed the survey remotely via an emailed link to an online survey hosted by a third party online assessment tool. This survey included questions designed to provide coaches with pertinent information about client wellness factors, as well as various indicators that were used in pre-post comparisons. Thirty-nine intake surveys were collected. Clients who completed the six week program were subsequently asked to complete an exit survey. The exit survey used the same third party online assessment tool as the intake survey. There was marked difficulty in ensuring clients completed and submitted the exit assessment. Twenty-three out of 39 exit surveys were collected making the response rate of exit surveys at 58 percent. Six questions included in the exit survey were identical to intake survey questions and were used for pre-post analysis. These questions used a ten-point Likert-type scale. The indicators used for pre-post comparison were frequency of client lifestyle oriented goal setting, client energy level, client stress level, client sleep quality, client fatigue, and client motivation/enthusiasm. The other thirteen questions included in the exit survey addressed client satisfaction with the Optimal Bear program, client satisfaction with their wellness coach, and overall program success. The end of the survey offered clients an opportunity to provide open-ended feedback regarding what they learned from the program and what improvements could be made to it. IV. Findings Pre-post data comparison demonstrated improvements in all measured indicators. Data was analyzed twice: with all clients represented (see Table 1, Appendix) and with clients excluded from analysis if their pre-test score did not indicate significant need for improvement (see Table 2, Appendix). Criteria for client exclusion was a pre-test score of ≥7 for questions where 10 was a significant problem or ≤4 for questions where 1 was the significant problem. This differentiation was made in order to exclude from analysis wellness indicators not likely addressed by the Optimal Bear program per client, based on information provided by that client in the intake survey. Mean Likert-type scale scores demonstrated prepost improvement for all questions with all clients included in analysis and with clients criterion-excluded from analysis. TABLE 1 Mean pre- and post-program wellness indicator scores using a ten point Likert-type scale. All clients included in analysis. (Note scale directionality) Q1. How often do you set lifestyle oriented goals? (1=never, 10=daily) Q2. Rate your overall energy level: (1=lowest, 10=highest) Q3. Rate your overall level of stress: (1=lowest, 10=highest) Q4. During the past month, how would you rate your overall sleep quality? (1=poorest, 10=highest) Q5. In the past week, have you had trouble staying awake while driving or sitting in class or lacked energy when engaging in social activities? (1=no problem, 10=significant problem) Mean preprogram score Mean postprogram score Difference N= 6.13 7.91 1.78 23 4.87 7.22 2.35 23 6.70 5.17 -1.52 23 5.22 6.61 1.39 23 4.91 3.87 -1.04 23 pg. 2 Q6. During the past month, have you felt a lack of motivation or enthusiasm? (1=no problem, 10=significant problem) 5.78 4.87 -0.91 Mean absolute pre-post improvement across all wellness factors 23 1.50 TABLE 2 Mean pre- and post-program wellness indicator scores using a ten point Likert-typre scale. Both pre- and postprogram data were excluded from analysis if pre-test score was ≥7 or ≤4, depending on what direction was considered the more positive end of the Likert-type scale. (Note scale directionality) Q1. How often do you set lifestyle oriented goals? (1=never, 10=daily) Q2. Rate your overall energy level: (1=lowest, 10=highest) Q3. Rate your overall level of stress: (1=lowest, 10=highest) Q4. During the past month, how would you rate your overall sleep quality? (1=poorest, 10=highest) Q5. In the past week, have you had trouble staying awake while driving or sitting in class or lacked energy when engaging in social activities? (1=no problem, 10=significant problem) Q6. During the past month, have you felt a lack of motivation or enthusiasm? (1=no problem, 10=significant problem) Mean preprogram score Mean postprogram score Difference N= 4.50 5.47 2.97 15 4.67 7.24 2.57 21 7.20 5.30 -1.90 20 4.35 6.00 1.65 17 6.38 4.23 -2.15 13 7.57 5.14 -2.43 14 Mean absolute pre-post improvement across all wellness factors 2.28 Client satisfaction with the Optimal Bear program and client satisfaction with their wellness coach was good across all questions. Clients consistently responded with high Likert-type scale scores. Mean Likert-type scale scores per question ranged from 7.96 to 9.65. The mean Likert-type scale score across all client satisfaction questions was 8.80. The lowest mean score for the client satisfaction portion of the exit survey was 7.96 regarding how well clients were able to reach their wellness goals set during the program. The highest mean score on this portion of the exit survey was 9.65 regarding client overall experience with the Optimal Bear program. (see Table 3) TABLE 3 Exit assessment data. Mean score on a Likert-type scale of 1-10. Scale directionality for some questions has been reoriented so that the presented data is directionally similar with 1 representing the most negative end of the scale and 10 representing the most positive end. (N=23) Q7. Upon completion of this program do you feel you have a better grasp on your life and how you can live it to the fullest? Q8. How helpful were the educational handouts provided by your coach? Q9. The Health Coach was . . . - Able to answer my questions Q10. The Health Coach was . . . - Well prepared for each session Q11. The Health Coach was . . . - Enthusiastic and encouraging to help me reach my goals Q12. The Health Coach was . . . - Able to provide me with additional support when needed Mean scale score 9.22 8.52 8.70 8.78 8.83 8.78 pg. 3 Q13. The Health Coach was . . . - Well informed on the topics that were addressed 8.74 Q18. How well were you able to reach wellness goals set during the Optimal Bear program? Q19. How would you rate your overall experience with the Optimal Bear Wellness Program? 7.96 Mean score across all client satisfaction questions 8.80 9.65 Questions 16 and 17 on the exit survey targeted client-perceived program efficacy. These questions asked clients to respond yes or no to statements about the overall effectiveness of the program. 95.7% of clients reported that the program increased their awareness of factors that influence their health. 100% of clients reported they would continue their wellness progression using the tools/techniques/information gained during their participation in the Optimal Bear program (see Table 4). TABLE 4 Exit assessment data. Clients were asked yes or no questions regarding efficacy. (N=23) Q16. Did Optimal bear help you increase your awareness of factors that influence your health? Q17. Will you continue your wellness progression with the tools/techniques/information gained from Optimal Bear? % of clients who responded “yes” 95.7% 100% The exit survey also collected subjective data via open-ended questions and responses from clients. Providing feedback on these two questions was optional for clients yet a large number of thorough responses were still collected. These questions asked clients to comment on the most important tools they learned from the Optimal Bear Program and to provide feedback on how the program could improve (see Tables 5 & 6). TABLE 5 Q14. What were the most important tools you learned from the program? (all client responses listed) How to utilize my time more wisely to make sure my homework gets done and I still have time for other activities. Daily habits to make sure I'm thinking more positive. How to plan to eat healthy. Setting up goals. How to eat healthier and how to manage my stress by journaling . Planning and forgiveness of myself. How to manage time, eat healthy on a budget, and incorporate exercise into daily life. The calendar with different daily suggestions for distressing and eating healthier and better sleep. The grocery shopping lists, and the going to the gym! I never realized how stuck I was in my exercise routine, and underestimating the machines. Most importantly, my wellness coach confirmed my efforts in stress management were where they needed to be and encouraged me to just keep at it. The support alone was great, and telling me to stop being so hard on myself. The most important tools I learned was how to stay positive and avoid negative thoughts and pg. 4 feels [sic] as much as possible. Also I learned how to use my time better which helped influence my stress and free time that I could use to socialize. How to manage time--so that I have time for myself! Stress relief and goal setting. strategies for getting enough sleep, understanding where I am/ where I want to be with different goals (certain quizzes helped), planning tools for time management (urgent/important sheet, planning each day). I developed a better grasp for what works for me when setting goals--writing them down. I found the ideas my help coach helped me come up with very useful. Journaling different activities like my visits to the gym and having a calendar helped prevent my procrastination. I enjoyed coming to meet with my health coach every Friday even on a day I was depressed because I looked forward to keeping on my health goals rather than letting a problem offset my goals. About thought-stopping, prioritizing, and remembering to put my immediate needs first before I can help others. Also, that I do have time to exercise, and it makes me feel better. Simple but profound lifestyle change techniques and making conscientious use of blocks of unscheduled time in my school & work schedule. Everything. How important it is to manage my time, focusing on exercise, sleeping, study time, and stress relievers. Learning to properly schedule my time to focus on my priorities strongly helped and has taught me a lot by participating in this program. Goal setting, and to be okay with not meeting goals. Adding exercise as a goal before subtracting foods. I believe the most important thing I got from Optimal Bear, was the knowledge on how to make the changes I am making permanent. Study techniques. Positive thinking. Overall health tips. The knowledge of how to set goals for myself in whatever I do. I learned to respect myself and value who I was as a person and my opinions. TABLE 6 Q15. What can Optimal Bear coaches do to improve their wellness coaching? (all client responses) listed) Can't think of anything...! Nothing comes to mind. Maybe give more suggestions, and getting more experience by interacting with more students; not only one student per coach. They don't need improving. Hire me after graduation. I can't think of anything I would change. It was better than I could have hoped for. I thought the wellness coach did an amazing job. I can't think of anything to change. Everything was great, no improvement needed. Nothing I can particularly think of! Come up with quiz directed at assessing organizational strategies (i.e. what a healthy level of organization in different areas of life might look like and to what extent I fit that). That might be helpful at the beginning in figuring out areas I don't even realize I'm not helping myself in. Beth was great, and I can't think of anything she didn't do that could have been helpful. I’d love to have more weekly handouts. Or to look at an Optimal Bear blog. I realize that Optimal Bear is only a 6 week health coaching session, however, for those that finish the pg. 5 program, having a blog with new topics daily would help us keep on track. I felt I might have been treating my health coach like a therapist most of the time. I think she picked up on that and encouraged me to make an appointment at CAPS. I wonder if all other health coaches had similar situations, and if so, encouragement to seek out counseling from a professional is so helpful. Or will Optimal Bear be able to hire/support licensed counselors? I honestly had a fantastic experience--I just want Optimal Bear to continue as a program so that more students like myself can see such encouraging and profound success in achieving their long-term goals for better well-being and greater success in their lives. Beth was fantastic! I loved all the handouts that she had supplied me with. I really don't know! I thought it was pretty good. Not sure what needs to change. I honestly cannot think of one thing that can be done to make this program better. I have learned so much from Optimal Bear. I am not too sure. I loved this and I would love to do it every week for the rest of college, I think it has changed my life tremendously and I'm sad it’s only 5 weeks. V. Recommendations The data collected in this assessment has proved to be highly valuable in decision making and planning for the future of the Optimal Bear program. Historically, The Student Wellness office has applied an environmental, population-based approach to the vast majority of its health promotion strategy. Though including interpersonal level programming like Optimal Bear was a shift in practice for the Student Wellness office, the need for wellness programming specifically targeting higher risk students was apparent. Since its establishment, the budding program had been in somewhat of a trial phase, with its future depending partly on client feedback and wellness indicator improvement noted by this assessment. The foremost recommendation based on the data collected in this assessment is that the Optimal Bear program be continued into the future with support from Curry Health Center. Marked improvements in client performance indicators and highly positive subjective feedback clearly demonstrate partnering for student success and validate the program’s ability to strengthen student support at the University of Montana. Because of Optimal Bear’s close alignment to this important aspect of UM’s strategic plan, Curry Health Center will look to expand the time and resources put into the program so that it may reach a greater number of students during the 2013-2014 school year. Based on anecdotal evidence collected during the assessment process, the program will also make modifications to assessment procedure and information gathered on the intake survey. Clients will be asked on the intake survey to provide information for a preferred form of contact. This information should expedite scheduling Optimal Bear sessions and will improve communication between coaches and clients. This enhanced communication should also increase the return rate of the exit survey, thus allowing for further assessment that is representative of a higher percentage of Optimal Bear Clients in the future. pg. 6 Appendix pg. 7 Appendix (cont.) pg. 8 Appendix (cont.) pg. 9 pg. 10