Colorado School of Mines Annual Assessment of Student Learning Outcomes Report For Academic Year 2011-12 Undergraduate Programs Sample Plan The purpose of assessment is to promote excellence in student learning and educational practices by fostering a campus culture of self-evaluation and improvement. The annual assessment report enables CSM to document engagement in continuous improvement efforts. Provide responses to the following six questions/items and email this completed document to kmschnei@mines.edu by September 14. Feel free to expand the tables below as needed. The Assessment Committee will provide written feedback in response to the department annual report, using this rubric as the basis for their feedback. The annual report will also be useful for the reaccreditation efforts related to ABET and the Higher Learning Commission. Components of this annual report that are specific to ABET re-accreditation are noted below. This sample assessment plan is intended to be a guide only. It reflects many of the principles of strong assessment plans but is not intended to suggest that CSM assessment plans should be identical to this one. Department/Program Biology Person Submitting This Report Kay Schneider Phone 3087 Email Kmschnei@mines.edu 1. List your program objectives (broad statements that describe what students are expected to attain within a few years of graduation) and describe the assessment methods/measures for each program objective. (ABET Criterion 2B and 4A 1-3.) Program Objective 1: Program Objective 2: Program Objective 3: Program Objective 4: Graduates will demonstrate teamwork skills/behaviors. Graduates will apply scientific knowledge. Graduates will participate in lifelong learning opportunities. Graduates will engage in ethical behavior in professional activities. All objectives are currently assessed using the two assessment methods described below. Indirect assessment measure(s)/method(s) Employer Survey Alumni Survey Performance criteria 80% of employers agree that graduates demonstrate achievement of this objective. 80% of alumni agree that graduates demonstrate achievement of this objective. 1 Population/sample/ recruitment strategies Employers of graduates 2-4 years after graduation. Frequency/timing of assessment Fall 2011, 2015, 2019 Alumni 2-4 years after graduation. Fall 2010, 2014, 2018 2. List your student outcomes (specific, measureable, attainable, relevant, and timely statements which describe what students will know and be able to do by the time of graduation) and describe assessment methods/measures for each student outcome. (ABET Criterion 3A and 4B 1-3.) Student Outcome 1: Students will communicate effectively in oral and written formats, using terminology that is appropriate to the discipline. Direct assessment measure(s)/method(s) Oral presentation in Biol 202. The rubric is online at biol.edu/202rubric. Oral presentation in Biol 312. The rubric is online at biol.edu/312rubric. Peer evaluation of the Biol 312 oral presentation. The rubric is online at biol.edu/312peerrubric. Each Biol 416 capstone research project will be assessed by a team of two faculty members. The scoring rubric is online at biol.edu/416rubric. Results of the assessment are maintained in a spreadsheet so that results can be compared over time. Indirect assessment measure(s)/method(s) Survey Exit interviews Exit interviews Performance criteria 65% of students will achieve a rating of “meets expectations” on the five criteria measured by this assignment. 80% of students will achieve a rating of “meets expectations” on the five criteria measured by this assignment. 50% of students will rate their peers at the same level as the Professor. 75% of seniors will earn a “meets expectations” rating on all criteria. Performance criteria 70% of senior students will agree that they achieved this outcome as a result of their educational experiences at fictional university. 40% of students will indicate they have begun to make progress on achieving this outcome. 80% of students will indicate they have made substantial learning gains in achieving this outcome. 2 Population/sample/ recruitment strategies Since this is an inclass assignment, all students will participate. Frequency/timing of assessment Fall 2009, Fall 2011, Fall 2013, Spring 2010, Spring 2012, Spring 2014 Since this is an inclass assignment, all students will participate. Each semester Since this is an inclass assignment, all students will participate. All students in Biol 416 are required to complete the assignment. We will randomly select half of the assignments for assessment. Each semester, beginning spring 2012. Population/sample/ recruitment strategies Seniors will complete the survey in Biol 450, which is a required course for the major. A random sample of second year majors will be invited to participate in an exit interview. A random sample of graduating seniors will be invited to participate in an exit interview. Fall 2011 and 2013 Spring 2012 and 2014 Frequency/timing of assessment Spring 2010, 2013, 2016 End of spring term, beginning in 2012 and annually thereafter Middle of spring term, beginning in 2012 and annually thereafter Student Outcome 2: Students will design and conduct research activities using appropriate scientific methods and tools. Direct assessment measure(s)/method(s) Second-year students will complete a pre-test in Biol 204. Results will be compared with the ETS field exam (which is a graduation requirement for majors.) Each capstone research project will be assessed by a team of two faculty members. The scoring rubric is online at biol.edu/416rubric. Results of the assessment are maintained in a spreadsheet so that results can be compared over time. ETS Biology Field Exam Performance criteria 80% of senior students will achieve statistically significant gains in at least 70% of concepts measured by the exam. 65% of seniors will earn a “meets expectations” rating. Indirect assessment measure(s)/method(s) Survey Performance criteria 70% of students will agree that they achieved this outcome as a result of their educational experiences at fictional university. 40% of students will indicate they have begun to make progress on achieving this outcome. 80% of students will indicate they have made substantial learning gains in achieving this outcome. Exit interviews Exit interviews 70% of seniors will achieve or exceed the pass rates achieved by students enrolled at peer institutions. 3 Population/sample/ recruitment strategies All students in Biol 204 will complete the pre-test in class. The field exam is required of graduating majors. Frequency/timing of assessment Fall 2010 and 2012 Spring 2011 and 2013. All students in Biol 416 are required to complete the assignment. We will randomly select half of the assignments for assessment. Fall 2011 and 2013 Spring 2012 and 2014 All biology majors are required to complete the exam (graduation requirement.) Mid-April of each year Population/sample/ recruitment strategies Seniors will complete the survey in Biol 450, which is a required course for the major. A random sample of second year majors will be invited to participate in an exit interview. A random sample of graduating seniors will be invited to participate in an exit interview. Frequency/timing of assessment Spring 2010, 2013, 2016 End of spring term, beginning in 2012 and annually thereafter Middle of spring term, beginning in 2012 and annually thereafter Student Outcome 3: Students will describe the interaction of plants, animals, microorganisms and their environment. Direct assessment measure(s)/method(s) Each capstone research project will be assessed by a team of two faculty members. The scoring rubric is online at biol.edu/416rubric. Results of the assessment are maintained in a spreadsheet so that results can be compared over time. ETS Biology Field Exam Performance criteria 75% of seniors will earn a “meets expectations” rating. Indirect assessment measure(s)/method(s) Survey Performance criteria 70% of students will agree that they achieved this outcome as a result of their educational experiences at fictional university. 40% of students will indicate they have begun to make progress on achieving this outcome. 80% of students will indicate they have made substantial learning gains in achieving this outcome. Exit interviews Exit interviews 70% of seniors will achieve or exceed the pass rates achieved by students enrolled at peer institutions. 4 Population/sample/ recruitment strategies All students in Biol 416 are required to complete the assignment. We will randomly select half of the assignments for assessment. All biology majors are required to complete the exam (graduation requirement.) Population/sample/ recruitment strategies Seniors will complete the survey in Biol 450, which is a required course for the major. A random sample of second year majors will be invited to participate in an exit interview. A random sample of graduating seniors will be invited to participate in an exit interview. Frequency/timing of assessment Fall 2011 and 2013 Spring 2012 and 2014 Mid-April of each year Frequency/timing of assessment Spring 2010, 2013, 2016 End of spring term, beginning in 2012 and annually thereafter Middle of spring term, beginning in 2012 and annually thereafter Student Outcome 4: Students will analyze the impact of chemical and molecular processes on living organisms. Direct assessment measure(s)/method(s) Each capstone research project will be assessed by a team of two faculty members. The scoring rubric is online at biol.edu/416rubric. Results of the assessment are maintained in a spreadsheet so that results can be compared over time. Performance criteria 75% of seniors will earn a “meets expectations” rating. Indirect assessment measure(s)/method(s) Survey Performance criteria 70% of students will agree that they achieved this outcome as a result of their educational experiences at fictional university. 40% of students will indicate they have begun to make progress on achieving this outcome. 80% of students will indicate they have made substantial learning gains in achieving this outcome. Exit interviews Exit interviews Population/sample/ recruitment strategies All students in Biol 416 are required to complete the assignment. We will randomly select half of the assignments for assessment. Population/sample/ recruitment strategies Seniors will complete the survey in Biol 450, which is a required course for the major. A random sample of second year majors will be invited to participate in an exit interview. A random sample of graduating seniors will be invited to participate in an exit interview. Frequency/timing of assessment Fall 2011 and 2013 Spring 2012 and 2014 Frequency/timing of assessment Spring 2010, 2013, 2016 End of spring term, beginning in 2012 and annually thereafter Middle of spring term, beginning in 2012 and annually thereafter Student Outcome 5: Students will demonstrate mastery in using scientific instrumentation. Direct assessment measure(s)/method(s) Biol 302 lab project. The rubric is online at biol.edu/302rubric. Performance criteria 75% of students will earn a “meets expectations” rating. Biol 416 lab project. The rubric is online at biol.edu/416rubric. 75% of students will earn a “meets expectations” rating. 5 Population/sample/ recruitment strategies All students in Biol 302 are required to complete the assignment. All students in Biol 416 are required to complete the assignment. We will randomly select half of the assignments for assessment. Frequency/timing of assessment Fall 2010 and 2012, Spring 2011 and 2013 Fall 2011 and 2013 Spring 2012 and 2014 Indirect assessment measure(s)/method(s) Survey Population/sample/ recruitment strategies Seniors will complete the survey in Biol 450, which is a required course for the major. Performance criteria 70% of students will agree that they achieved this outcome as a result of their educational experiences at fictional university. 40% of students will indicate they have begun to make progress on achieving this outcome. 80% of students will indicate they have made substantial learning gains in achieving this outcome. Exit interviews Exit interviews Frequency/timing of assessment Spring 2010, 2013, 2016 A random sample of second year majors will be invited to participate in an exit interview. A random sample of graduating seniors will be invited to participate in an exit interview. End of spring term, beginning in 2012 and annually thereafter Middle of spring term, beginning in 2012 and annually thereafter 3. Map the student outcomes to courses and to the ABET outcomes. (View ABET outcomes.) Courses 1 0 1 Student outcome 1 Student outcome 2 Student outcome 3 Student outcome 4 Student outcome 5 Student outcome 1 Student outcome 2 Student outcome 3 Student outcome 4 Student outcome 5 1 0 2 1 2 1 X 2 0 0 2 0 2 2 0 4 3 0 0 3 0 2 X X X X X 3 0 1 X X X X B C X X X X X X 3 1 2 X X X I X 3 8 2 4 0 0 4 0 1 4 0 2 4 1 6 4 5 0 X X J X X X X X X X K X X X X 4. Identify the assessment activities that your program has implemented in the past year. Direct assessment methods: Pre-test of knowledge in 204 Lab project in 302 Oral presentation in 312 Capstone research/lab project in 416 ETS field exam Indirect assessment methods: Alumni survey 6 4 6 0 4 7 0 X X X X X X X ABET Outcomes D E F G H X X 3 0 5 X X A X 3 0 4 5. Describe how you have shared assessment results with faculty and explain how the faculty have used assessment results to improve student learning. Describe the specific actions you have taken or will take to facilitate students’ attainment of the program objectives and student outcomes. (ABET Criterion 4C.) Faculty discussed results in August and agreed to: Begin the process of obtaining approval for requiring Biol 204 as a prerequisite to Biol 304. Bob will take the lead on this project. Seek funding to purchase additional ergometers for the human performance lab, for use in Biol 402 and 416. This equipment will provide students with opportunities to obtain experience in conducting studies and analyzing data related to fitness and endurance testing. Janet will take the lead on this project. In Fall 2011, begin to review software options for Biol 312, to provide students with expertise in applying scientific and mathematical techniques to the study of genetics. Geore will take the lead on this project. 6. Describe any changes that you are planning to make in your assessment plan for next year. In 2011-12, we will examine academic records for students who completed the exam in Biol 204, but who are no longer enrolled at fictional university or are no longer biology majors. This may enable us to determine if we can identify common characteristics among students who do not persist in the major and if we can address this by improving advising, revising prerequisites, or taking some other action. Susan will take the lead on this project. We will begin conducting interviews of second-year students and seniors. Other aspects of the plan will remain unchanged for 2011-12. 7. Describe how you have used the feedback from the assessment committee in response to last year’s report to improve your assessment efforts. The assessment committee recommended that the faculty reconsider the performance criteria and possibly modify them so they are consistent, as the current criteria range from 40% to 80% proficiency. The faculty discussed this issue during the annual Fall retreat and have modified some of the performance criteria. 7