Planning and Assessment Ramapo College Establishing Assessment Plans and Annual Reports 1 Why do we Assess? • Demonstrate fiscal and human resources are invested in ways that result in quality outcomes which enable the institution to achieve its mission, vision, and goals • Evaluate Institutional Effectiveness • Evaluate Student Outcomes 2 What is Assessment? • Process for gathering and analyzing information to gauge your unit’s performance • Using that information to improve your unit’s performance 3 Steps in Assessment? • • • • • • • Defining a program or unit’s mission Identifying unit goals Developing desired outcomes/objectives Establishing criteria for success Monitoring progress towards the outcomes Communicating results Using results to make improvements 4 Three Year Unit Plans • Simple • Workable • Provide meaningful information to guide decision making and improve unit effectiveness 5 Assessment Cycle • Outcome measures (for the prior years planning objectives) must be entered into the WEAVE system by end of August 6 Assessment Tools • WEAVE is an online system for annually tracking and reporting the institution’s outcomes. 7 Language of Assessment & Planning • • • • • • • Mission/Purpose Goals Outcomes/Objectives Measures and Findings Action Plan Tracking Achievement Summary Analysis Annual Reporting (DAR Report) 8 Mission/Purpose . • The mission statement should be clear and brief, consist of the purpose of the unit and a brief list of key responsibilities or services provided. 9 Entering Mission/Purpose in WEAVE Each unit will enter its mission statement in the system. Click on Mission/Purpose in the Assessment tab. Enter mission statement, click Save. After saving, the statement will appear and can be edited The mission statement should be clear and brief, consist of the purpose of the unit and a brief list of key responsibilities or services provided. Review the Mission statement at The beginning of each assessment cycle to be sure it adequately reflects the purpose of the unit 10 Entering Goals in WEAVE Click on Goals in the Assessment tab. Enter goal statement, click Save. After saving, the statement will appear and can be edited Text can be entered directly from the keyboard or cutand-pasted from another document REMEMBER Goals are warm and fuzzy. They are non-specific, non-measurable, and usually cannot be definitively attained. VERY IMPORTANT Be sure to save information before leaving a screen, otherwise it will be lost; edits can be made later. 11 Outcomes/Objectives Outcomes and Objectives are realistic targets for programs. High quality outcomes are: Specific,Measurable, Achievable, Relevant, and Time-Referenced (S.M.A.R.T.) Outcomes and objectives are written in an active tense and use strong verbs like “plan,” “write,” “conduct” and “produce.” Who is going to do what, when, why (what will be demonstrated or achieved), and to what standard? 12 Entering Outcomes/Objectives in WEAVE • Click on Outcomes in the Assessment tab. Enter outcomes statement, click Save. After saving, the statement will appear and can be edited • Text can be entered directly from the keyboard or cut-and-pasted from another document REMEMBER Objectives are specific, measurable, achievable, relevant and timereferenced. 3 to 5 is ideal. Not all Outcomes need to be assessed each year. VERY IMPORTANT Be sure to save information before leaving a screen, otherwise it will be lost; edits can be made later. 13 Measures • Tools used to determine whether your outcomes have been achieved. • Tools that will provide useful and useable information. 14 Entering Measures and Findings in WEAVE • Click on Measures and Findings in the Assessment tab. • • The reason outcomes are tracked is to discover where modifications can be made to improve performance. Click on the gray arrow beside each outcome/objective and add findings for each measure created, not by outcome • Actions refer to the tasks necessary to effect those modifications. • Indicate the extent to which the achievement target was “Met, Partially Met, Not Met”. • Actions to improve performance are desirable even when targets are met • Click Save. • • If targets are partially met or not met further actions are required. At this point, you can edit what you have written, add findings for another measure, or go to the data entry screen for Action Plans. All Measures need to have Findings for the current planning year entered into the system by September 1st. • If the Achievement Target was “Not Met” or only “Partially Met”, develop an “Action Plan” to improve future results VERY IMPORTANT 15 Be sure to save information before leaving a screen, otherwise it will be lost; edits can be made later. Achievement Targets • Each measure should specify, when possible, the desired level of performance (level of satisfaction, productivity, efficiency, performance). 16 Entering Achievement Targets in WEAVE • The option to establish Achievement Targets is presented in the Measures and Findings area • Click on the gray arrow beside each measure and click on add or edit for each outcome/objective • Click Save. You will be returned to the Summary Measures and Findings screen, and your newly entered measure should appear, with options to View, Edit, or Delete. • You will see the Add Measure button at the top center of the screen. At this point, you can edit what has been entered, enter a new measure, go to a different data entry screen, or logout. • Very important: Immediately under the description of each Measure, you will see a link to Add Findings. If you have completed the data collection for the year, and have results available, you can click on Add Findings to enter that data. See instructions under Findings.) VERY IMPORTANT Be sure to save information before leaving a screen, otherwise it will be lost; edits can be made later. 17 Findings=Results • The reason outcomes are tracked is to discover where modifications can be made to improve performance. • Actions refer to the tasks necessary to effect those modifications. • Actions to improve performance are desirable even when targets are met • If targets are partially met or not met further actions are required. 18 Findings The results of assessment measures 19 Analysis of Findings • • • • • How do the results meet expected outcomes Were the targets appropriate What worked well What were the most effective assessment tools What changes or strategies would make the results more effective (Note: specific plans for addressing outcomes/objectives that were not met should be listed in the Action Plan) 20 Achievement Summary/Analysis • Explain what your findings for this year mean and how you have used or are planning to use the information to improve your future outcomes 21 Action Plan List actions in the Action Plan which might include: • Modifying processes, operations, or practices of the unit • Modifying intended outcomes or measures 22 Action Plan • Action Plans and Analyses can not be entered into the system until data collection and analysis have been completed for the measurement period— typically the end of August • If a unit collects, analyzes, and reports results more frequently (monthly or by semester), those data can be entered into the system at that time, but what appears online by the end of September must be a summary of the entire year 23 Entering an Action Plan in WEAVE • Click on Action Plan Tracking in the Assessment tab • Click on Add Action Plan Enhancement Action tab • The screen shows the status of the Action Plan – – – – – • • Planned In Progress Finished On Hold Terminated Text can be entered directly from the keyboard or cut-and-pasted from another document An Action Plan must be completed for all Outcomes Objectives where SPIF funds are requested. SPIF funding requests will be collected when the Assessment Plan is developed and should not appear in the request for budget funds during the annual budget submission process. • Measure-Outcome/Objective Relationships – click on the boxes that correspond to the correct Outcomes which will automatically appear in the box. • The Condensed Description (50 characters or less) of the Action Plan. • Full Description of the actions your unit will be taking • Projected Completion Date • Implementation Description • Priority Level assigned (High, Medium, Low) • Person/Group Responsible for the action • Additional Resources Needed to carry out the action—human, technical, or other • Budget Amount Requested —Request SPIF funds • Click Save 24 Achievement Summary/Analysis • The Analysis section of the system enables the integration and interpretation of outcome data. It is the most important piece of the outcomes reporting function. • In the Analysis section, explain what all the findings for this year mean and how they have been used or will be used to improve future outcomes 25 Analysis Questions • What specifically did your assessments show regarding proven strengths or progress made on outcomes? In this section discuss: – how the results of this assessment demonstrate the progress made in improving actual outcomes, or in measuring them effectively, noting the improvements demonstrated were due to the modifications in operations or programs made based on either this year’s or last year’s results; and – strategies to further improve the unit’s performance based on assessment results (including descriptions of • Changes or modifications planned for the upcoming year's to implement those improvement strategies; and • (2) changes or modifications recently made based on this year’s assessment results. (Note: your specific plans for implementing modifications should be included in the “Action Plan” section above.) 26 Analysis Questions What specifically did your assessments show regarding proven strengths or progress made on outcomes? – how the results of this assessment demonstrate the progress made in improving actual outcomes, or in measuring them effectively, noting the improvements demonstrated were due to the modifications in operations or programs made based on either this year’s or last year’s results; and – strategies for further improving the unit’s performance based on these assessment results including: • Changes or modifications planned for the upcoming years to implement those improvement strategies; and • changes or modifications recently made based on this year’s assessment results. 27 What specifically did your assessments show regarding any outcomes that will require continued attention? This section should include discussion of: • any outcomes that were not met (i.e, targets “not met” or only “partially met”) • why that occurred, and • strategies to improve those outcomes. Needs identified to modify or add outcomes, measures, or targets should be included. (Note: specific plans for addressing these shortcomings should be listed in the “Action Plan” section) 28 WEAVE Document Repository Upload and store information about your plan Click on Document Repository in the Assessment tab. Click on the Upload Document tab Click on the Browse button to locate the file you want to upload Enter the name of the file in Document Name text box Description – Purpose and description of the file Expand All—contains the assessment elements with which you wish to associate the file (the file may be associated with more than one element. Click Save. 29 WEAVE Printing Reports Select cycle • • • • FY 2016 FY 2015 FY 2014 (Current) 2008-2009 (Previous) 30