OUTCOMES ASSESSMENT Developing and Implementing an Effective Plan Principle 1. Outcome Assessment Excellence in sport management education is evaluated through the assessment of student learning outcomes and operational outcomes. Institution is required to have developed and fully implemented an O/A process. Creating the Outcomes Assessment Plan 1. 2. 3. 4. 5. Mission and Broad-Based Goals Student Learning Outcomes Basic Skills Development Student Personal Development Methods for Measuring Effectiveness Mission and Broad-Based Goals Institution: Provide your institution’s approved mission & broad-based goals Sport Management Program: Provide the approved broad-based goals for your sport management program Measurement: State how you will provide evidence that the goals are being accomplished Student Learning Outcomes What is a learning outcome? Description of what your students are able to do Clear and measurable Related to the goals of the institution. Identify measurement tools you will use/Rubric design Institutional Goals Program Learning Outcome Communicate effectively both orally and written. Comprehension and application of professional written and oral communication business skills. Measure Attainment of Learning Outcomes Identify a minimum of: – two direct measures – two indirect measures Explain the process for how your measures will provide meaningful results Provide copies of your instruments/rubrics in the appendix Determine Measures and Assessment Tools Types of Measures: Student Learning Outcomes (Direct) Student Learning Outcomes (Indirect) Student Satisfaction (Indirect) Operational Effectiveness (Indirect) Note: Two direct and two indirect measures are required. Direct Measures Direct Measures: Demonstrates direct evidence of student learning Examples: Comprehensive exams Standardized national exams Pretest and posttest assessments Portfolios Capstone assessment Pre/Post Testing Develop test to address course content – relate to CPC areas Administration – Embed within select course Introduction to sport management Capstone seminar Set benchmarks for expected improvement Written & Oral Communication Assessment Written Format Mechanics Grammar Content Organization Style Oral Communication Use of technology Presentation design Speaks clearly Enthusiasm Stays on topic Content Professional Image College Goals Program Learning Outcome Benchmark Measurement Tool Communicate effectively both orally and written. Comprehension and application of professional written and oral communication skills. 80% of the students will meet defined proficiency standards in writing skills using the writing rubric Written assignments in BU450 evaluated with Rubric 80% of the students will meet defined proficiency standards in presentation skills using the presentation rubric Presentations in BUS 311 evaluated with Rubric Capstone Assessment Capstone course measurements – Foundation courses used as a basis for instrument development Internship Portfolio Case study Case Assessment - Selection & Question Development Direct Measure – link to specific outcome Define clear purpose – What are you trying to measure? – Broad range of outcomes vs. specific areas Issues to consider – Is the case comprehensive enough to address all areas being assessed – Case selection for graduate and undergraduate programs Case Selection & Question Development (cont.) Select Specific Learning Outcome – Demonstrate knowledge of the fundamental principles of the sport management field. Cases and questions developed to address this outcome Questions tested, reviewed and refined Development Of Evaluation Rubric Rubric development – Analysis of core sport management content areas and relevancy of measurement through selected case – Evaluation criteria and weightings agreed upon Grading consistency – Training Indirect Measures Indirect Measures: Indirect evidence of student learning outcomes (asking versus demonstrating) Examples: Internship evaluations National or program-specific student satisfaction surveys - NSSE Student SWOT analysis Alumni survey Basic Skills Development Prepare a statement on the “Basic Skills” development program at your institution Describe how this is administered within the sport management dept. – Programs to help students with writing deficiencies – Tutoring services Personal Development of Students Prepare a statement on the “Personal Development” of students at your institution Describe how this is administered within your academic unit – Special programs focused on personal development – student leadership – First year seminar Measuring Program Effectiveness Explain how you will measure the effectiveness of your sport management program – Accomplishment of goals and objectives in the strategic plan – Retention data – Graduation rates – Teaching evaluations – SWOT Final Step – Action Plans College Goals Student Learning Outcomes Benchmark Measurement Tool Results Action Plan Communicat e effectively both orally and written. Comprehension and application of professional written and oral communication business skills. 80% of the students meet proficiency standards in writing measured using writing rubric Written assignments in BU210 and BU404 85.6% of the student in BU210 & BU404 met the standard Continue to record scores for writing evaluation the these two courses. Discuss the possibility of a standardized test in the core courses to meet this competency Problem Areas Direct measures – linking measure to specific outcome Rubric development & data collection – Go beyond use course grades Role of teaching evaluations Useful Resources http://course1.winona.edu/shatfield/air/rubr ics.htm http://academic.scranton.edu/department/a ssessment/ksom/