Husson University Institutional Assessment Plan A comprehensive institutional system of assessment for all programs and departments November 14, 2014 Outline I. II. III. IV. V. VI. Introduction Culture of Assessment The Mission, Goals, and Values of the University Institutional Student Learning Outcomes Assessment at Husson Conclusion Appendices Appendix A: Timelines for Full Review by Assessment Committee I. Introduction Husson University is a private institution of post-secondary education offering undergraduate and graduate degrees in business, health, education, and science and humanities. Husson dedicates itself to excellence in teaching and a personalized collegiate experience. To reach our goals we must make sure our students are learning and achieving success in the classroom, in their programs, outside of class, and eventually in their professional careers. The traditional programs for Husson extend to its founding as a School of Business in 1898. Programs first diversified into Health with the merger of the Eastern Maine Medical Center School of Nursing. Occupational and Physical Therapy augmented the Health Offerings. Programs in Elementary Education began in the School of Science and Humanities, but are now part of the School of Education which is within the College of Health and Education. Offerings in Paralegal and Criminal Justice have been folded into the College of Business. Science and Humanities have developed strong offerings in Psychology, the natural and physical sciences, and English. The University also offers a variety of Master’s programs in Business, Counseling, Education, Human Relations, and Health Care professions. The University now offers two professional doctorates. The first is Physical Therapy. The School of Pharmacy adds a second professional doctorate. In the fall of 2014 the New England School of Communications became the newest addition to the University, adding Bachelor of Science programs in Communications Technology, Media Studies, and Entertainment Production. 1 Much of the energy for enhancing educational quality comes from programs subject to licensing and specialized accreditation. Hosting the DPT and PharmD requires the university community to respond to and learn from the expectations of those programs. Individual programs have also taken the lead in developing and administering assessment tools. The University strives toward a more coordinated effort to coalesce these programmatic assessments. With a new president, a new mission, and a new focus and energy we are ready to implement a university wide assessment plan. II. Culture of Assessment To have a successful assessment program all parties must be involved. The program must be university supported and have an ongoing mechanism for encouragement, evaluation and improvement of the assessment process itself. Thus, we are growing and will continue to grow a culture of assessment here at Husson. Though a few departments have successfully been assessing themselves for years for outside accreditation groups, there has not been an expectation of assessment in terms of student learning. The assumption was that faculty members knew how to teach well and knew what should be taught, so students must be learning. The start of our self- study report in the spring of 2011 provided us with the opportunity to put assessment on the forefront of everyone’s mind. Committees were formed for each NEASC standard and they included employees from all over the university. Each committee had to face the issue of assessment and where Husson was at in regards to their standard. In addition we held a vision retreat, open to all faculty members, administrators, board members, and invited alumni and students, which focused on critical thinking and assessment. This led to follow up sessions on teaching and assessment. In August of 2013 faculty attended an assessment workshop as part of Faculty Development Days. This was followed up by additional assessment workshops and official time periods set aside for assessment meetings in May of 2014 and August of 2014. To help implement the plan we created an Outcomes Assessment committee to assist the Director of Institutional Research and the Director of Assessment in guiding and supporting each program and department through the assessment process, to monitor their activities and provide feedback on their reports. The committees will provide help sessions to educate staff and faculty so that they can complete their assigned assessment tasks and understand the importance of these activities in reaching the goals of the university. Our assessment plan is guided by the following principles. 1. The purpose of the assessment plan is to assess, verify, support and enhance the ability of the university to carry out its mission. 2. Assessment will help us insure quality in our degrees and programs. 3. Assessment will help us make better informed decisions using data. 4. Meaningful assessment of student learning requires clearly articulated institutional, departmental and individual course outcomes. 5. The success of the plan depends upon the support and participation and collaboration of all faculty, staff and administrators. 6. The success of the plan depends upon logistical, technical and financial support as well as adequate resources. 7. Assessment activities will be ongoing and include a variety of methods and results will be shared and incorporated into future plans. 2 III. The Mission of the University The current mission of Husson University was approved in the summer of 2011. “Husson inspires and prepares students for professional careers in current and emerging fields in the context of an education informed by the sciences and humanities. We achieve this career preparation by supporting and emphasizing: · Outstanding teaching · Scholarly contributions to one's discipline or field of expertise. · An undergraduate and graduate curriculum that is challenging, relevant, and promotes critical thinking skills, self-confidence and strong communication skills. · Commitment to ethical behavior and social responsibility through involvement in the world by faculty and students, administrators and staff, board members, and involved citizenship as a university. · Lifelong learning to prepare students professionally and personally for the challenges of a constantly changing world. · A diverse cultural and global perspective achieved through student development and experiential learning opportunities that reinforces our commitment to a strong academic community. · Careful management and stewardship of University resources” To achieve this mission Husson’s strategic plan incorporates four separate initiatives each with a set of action items to be assessed over time. The four initiatives are delivering educational excellence, strengthening university resources, enriching community engagement, and integrating student life. Under each initiative is a list of action items to be completed over a span of years. An update on the status of these actions items is conducted each year and concludes with a yearly assessment report. IV. Institutional Student Learning Outcomes At Husson we have student level outcomes at the university wide level down to the course level. To assess how well our students reach these outcomes we assess them at the course-level, at the programlevel, and with surveys aimed at all students during their years at Husson and at the 1-year follow-up. Our general education program aims at creating students who are ethical, critical thinkers with a global awareness of the world around them, who can communicate their professional competence as they become aware of their part in this world. Our course level and general education outcomes support our program level outcomes which in turn support our school level outcomes which in turn support our mission to inspire and prepare students for professional careers in current and emerging fields in the context of an education informed by the sciences and humanities. Our collaborative spirit enriches our abilities to see our students as one whole as well as individuals with different goals and needs depending on their chosen major. Thus, our student learning outcomes build upon each other to help create an allaround student. V. Assessment at Husson An important step in assessment is documenting the process by which programs, courses and course 3 material evolve and how they are assessed, as well as how service and support departments are organized and assessed. By documenting this process we can improve our abilities to better meet students learning needs and we can demonstrate how these student outcomes are met. As a complete assessment of programs, schools and departments is a new concept to many at Husson the following lays out, in phases, the tasks that need to be completed in order to assess our classes, programs, schools, support departments and overall university in regards to how well we educate and prepare our students for their professional careers. The primary end products resulting from these tasks will include summarized data documenting how well we achieved our student learning and student support outcomes and reports summarizing the process, the findings and the plan of action for each program, school, student services and support department. The underpinning assessment principles The approach to assessment in this plan is driven by a number of beliefs about effective assessment. These beliefs are as follows: 1. Clear goals and outcomes Goals and outcomes must support the mission of the program or department, the University’s mission and be meaningful, manageable and measurable. 2. Authenticity and value Assessment tasks should reflect and develop the skills that students will need in their university studies and in their professional practice. If assessment is perceived by students to be authentic, it is more likely to be valued. If not, it is likely to be confusing to students and perceived as irrelevant. Service and support departments’ objectives should reflect what is necessary and realistic to help students succeed. 3. Fairness and objectivity Many theories of human motivation stress the importance of perceived equity and fairness. As student work is to be assessed against objective criteria, it is important that these requirements be clearly spelled out in the assessment details given to students. As a program’s or department’s work is assessed, it is important that feedback is received from all affected parties and reviewed in context. 4. Efficiency and practicality Assessment of student learning should occur regularly and continuously. Assessment is formative in nature and may be used to inform instruction as well as measure student learning. Conducting assessment of student learning when students are at these various points allows departments, and programs to measure progress toward the objectives more completely. However, keep it simple and focus on one goal at each time point and incorporate data, tools and ideas that are already in use if they are appropriate. Remember that goals and outcomes may change over time and all goals need to be part of the whole university so engage faculty and students in the assessment progress. Logistical Framework To put this assessment model into place and have it work we must design and implement procedures to carry it out at all levels. We need a logistical framework to guide implementation and management of the assessment process. This section describes our current framework. The assessment model used can be summarized in the schematic below. 4 Set strategic goals and measurable outcomes Use results to improve program and procedures; modify goals and outcomes as needed Construct performance reports on goals Design and implement a program with measurement tools to assess all course and program outcomes and goals Collect and analyze data to assess performance on each outcome and overall goal The implementation of this model will be conducted in phases. Some phases will overlap in time as work can be done concurrently. Steps to complete each phase are identified where applicable. Phase 1: Creation of Committees Done: Fall 2012 Create Academic Outcomes Assessment committee that will be in charge of assuring that every program has measurable outcomes and has mapped them; that mechanisms and infrastructure are in place for collecting assessment data and then analyzing it to assess learning outcomes; to provide feedback on such endeavors and help with communication of findings. Phase 2: Finalize University Assessment Plan and Resource Manuals Done: May 2014 Step 1: Finalize Draft of University Wide Assessment Plan and Resource Manuals with committees Step 2: Circulate the drafts among all faculty and management, collect feedback and then finalize the assessment plan. Plan will be revisited each year and adjusted as necessary. Step 3: Post the plan and the manual on the Institutional Research’s website October, 2014 Phase 3: List of goals and outcomes and Mapping of to show alignment across program/department and institution Dates: 9/13 - 8/14 Purpose: To show that all goals work towards meeting the mission of the university and that all courses, programs and departments are aligned to increase student learning and success and where that learning takes place. Steps – may vary depending on whether a course, program or department. Nonacademic departments follow Steps 1, 5 and 6. 1. Define course goals and program goals or department goals. Create measurable outcomes to support each goal. Learning outcomes should be meaningful, manageable and measurable. 5 2. Mapping: Align course goals with program goals 3. Demonstrate how students attain program goals through course completions (identify for course whether each goal is Introduced, Practiced, or Attained) 4. Mapping: Align program goals with school goals 5. Align goals with program or department mission statement and the University’s mission statement 6. All goals need to be on Husson’s website and for academics, listed in the University Catalog Phase 4: Creation of Guidelines and Tutorials on Different Parts of Assessment 1. Create IR website: http://www.husson.edu/office-of-institutional-research 2. Post Guidelines and Tutorials 3. Share with faculty and staff at department meetings and Faculty Forum Summer 2014 Summer 2014 2014 - 15 Phase 5: List of assessment tools for each outcome Dates: 9/2013- 8/2015 Purpose: Create assessment tools to assess each outcome in order to show whether goals attained. Task: complete assessment form(s) to identify how each outcome will be assessed, see Appendix C. Background Information: A goal is only as good as the measurement tool that is used. Evidence of student learning should be collected through both direct and indirect methods. The combination of the two allow for a more comprehensive view of what students have learned and how they have learned it. Each program and department will be assessed with at least two direct and two indirect measurements and at least one measurement must include a trustworthy external perspective. The following definitions come from the NEASC Commission on Institution of Higher Education’s SelfStudy Guide. Direct methods reveal student attainment of knowledge, abilities, skills, attitudes, and values. Indirect methods gather the perceptions of students and others about what students have learned, and opinions and reflections about the teaching and learning process as well as indications of what factors affect student learning. Examples of direct and indirect measurements of STUDENT LEARNING: Direct Indirect Course assignments Student surveys, focus groups Standardized tests Exit surveys and interviews Pre and post-tests Alumni and employer surveys 6 Essay tests across programs uniformly graded Internships: supervisor surveys internships/enrichment Passing rates on licensure exams Portfolios % go on to graduate school, job placement Participation rate in Performance in professional competitions Retention and transfer rates The Guiding Principles of Assessment of Student Learning ● Assessments measure students' attainment of learning outcomes. ● Assessments measure the level of student success. ● There should be a connection between the way students learn the material and the way they are tested on it. ● Assessments should be varied. ● Assessments include formal and informal evaluations. ● Students should know the evaluation plan at the beginning of a course. Examples of direct and indirect measurements of successful SERVICE AND SUPPORT DEPARTMENTS. Direct Indirect Usage reports in-house student satisfaction surveys % receiving financial aid National surveys (CIRP, NSSE) % students who pay back loans interviews from in-house colleagues Employment rates Self-evaluation reports Once a cycle of data has been collected on each assessment tool than outcomes and goals can be reassessed, as well as reassess the measurement tool. Phase 6: For every department and program: Identify which program goal(s)s will be assessed during the next academic year (fall –summer) and during that year collect and analyze data using the assessment tools described in Phase 5 to assess performance Purpose: Only by collecting data and documenting what we see can we actually prove whether our goals are met. Every year every program should be assessing at least one outcome from a given goal, but preferably at least 1-2 outcomes from 2 different goals or they will not be ready for a full review every 3 years. You cannot wait and just collect data once every 3 years. Assessment is continuous. Follow a plan that is doable and not a burden. Plan to target a few outcomes every year and then you will be able to assess all goals and thus the whole program after a few years. Phase 7: At end of data collection period, review results and assess what is working and what needs to be changed and document this in a written summary report 7 Purpose: Bringing members together across a department or program to discuss data analysis and experiences, gives everyone a chance to see the results of past changes, successes and failure, and the opportunity to help plan the future direction of their department or program. Each June a short summary of the assessment activities of each program is to be uploaded to the University Assessment Google site. For spring 2015 these reports will be voluntary. Faculty who do not belong to a specified department with a coordinator or director will be responsible for the General Education report. The Annual Program Reports will provide a summary of the assessment activities over the past year and what was learned from those activities. The report should include, but is not limited to, the following: 1. program mission statement 2. program goals for the previous year 3. program’s student learning outcomes and identify which ones assessed 4. summary of which learning outcomes assessed and results of student progression 5. summary of how each goal was met or not met and why 6. program goal’s for coming year 7. program learning outcomes that will be assessed during coming year Student Service or Support Department’s Annual Assessment Reports are due in July and should be comprised of, but not limited to, the following: (1) the department mission statement (2) the department’s goals and objectives - list out overall yearly goals and goals specific to current fiscal year (3) which goals were assessed and how for given year (4) compilation of the results of the assessment measures (this should include strengths and needs, plan for change in organization or methods to carry out goals, data collection, etc.) (5) evidence that these results are used to improve the department. By incorporating the assessment activities and results into the annual reporting process we have an ongoing mechanism for encouragement, evaluation and improvement of the assessment process itself. Every five years each program, together with their school, will summarize their assessment activities over the last five years. Assessment Report or complete matrix shall be comprised of, but not limited to, the following: (1) program mission statement (2) the desired program outcomes/learning outcomes (3) the assessment measures used to evaluate student mastery of the student competencies stated and to evaluate if program goals met (4) evidence that the program incorporates these outcomes/student competencies across the curriculum (i.e., mapping) (5) compilation of the results of the assessment measures and decisions made (this should include strengths and needs, plan for change in teaching methods, curricula, data collection, progress or results of previous changes, etc.) (6) evidence that these results are used to improve the program or department, including how assessment results would be used in future program planning. 8 Reports will be due the end of June and should be uploaded to the Assessment Google site. Phase 8: Communication of learning outcomes and goal attainment and implementation of changes to the university community Purpose: Changes and additions can only be fully implemented, with everyone experiencing their benefits, when everyone is knowledgeable about them. A written report summarizing all program and department reports will be compiled yearly and posted on the Institutional Research webpage and the Assessment Google site. The Office of Institutional Research will store all reports on the Assessment Google site for internal viewing. Things to consider at department, school and university levels: How are the outcomes used by faculty, administrators? How are the accumulated data best organized so that faculty and staff can access the data and use it to improve programs? How are outcomes communicated to others? Post reports for faculty and staff, post reports for general public, discuss at staff, department, school and college meetings, Faculty Forum The format and distribution of the reports will be revisited after each assessment cycle. Phase 9: Re assess ---- Start at Phase 3 if goals or outcomes have changed, at Phase 4 if any assessment tools have changed or start at Phase 5 if no changes to goals, outcomes or assessment tools. Assessment cycle is complete. Continually assess the process as programs and departments are being assessed and information is shared. VI. Conclusion -To be written once the assessment plan is in place and one cycle has been completed. 9 Appendix A Academic Program Full Assessment Reporting Cycle Group 1: The following departments/programs will report in the spring of 2015, 2020, and 2025 on the progress over the previous 5 years: School of Physical Therapy (including BS in Kinesiology), School of Pharmacy and all Counseling Programs Group 2: These following departments/programs will report in the spring of 2016, 2021, and 2026 on the progress over the previous 5 years: College of Business - all programs, School of Nursing Group 3: These following departments/programs will report in the spring of 2017, 2022, and 2027 on the progress over the previous 5 years: School of Science and Humanities - all programs, General Education Group 4: These following departments/programs will report in the spring of 2018, 2023, 2028 on the progress over the previous 5 years: New England School of Communication - all programs, School of Occupational Therapy Group 5: These following departments/programs will report in the spring of 2019, 2024, and 2029 on the progress over the previous 5 years: School of Education 10