STUDENT LEARNING ASSESSMENT PROGRAM SUMMARY FORM AY 2012-2013 Degree and Program Name: B.S. Biological Sciences Submitted By: Dr. Gary A. Bulla, Associate Chair, Biological Sciences Please use size 10 font or larger. Please complete a separate worksheet for each academic program (major, minor) at each level (undergraduate, graduate) in your department. Worksheets are due to CASA this year by June 14, 2013. Worksheets should be sent electronically to kjsanders@eiu.edu and should also be submitted to your college dean. For information about assessment or help with your assessment plans, visit the Assessment webpage at http://www.eiu.edu/~assess/ or contact Karla Sanders in CASA at 581-6056. PART ONE What are the learning objectives? 1. Students will demonstrate the ability to perform basic laboratory techniques. 2. Students will demonstrate the ability to conduct a research project using scientific principles and methods, then interpret their results in terms of current theories and issues in the biological sciences. How, where, and when are What are the expectations? they assessed? a. Assessed during laboratory a. 80% will demonstrate exercises and examinations, appropriate lab skills in each by instructors in core courses which BIO core has acourse with lab component (BIO1200G, BIO1300G, BIO3800 and BIO3120) b. 75% of graduating seniors will agree or strongly agree b. Exit survey will be used that they have the laboratory to assess the number of skills to be employed; graduating seniors that agree or strongly agree that they have the laboratory skills to be employed (Tallied by Assoc Chair) a. Rubric (see appendix 2) used to determines students abilities to interpret graphs and analyze data. Assess sophomore (BIO3120) and Junior/Senior(BIO3800) scores using similar rubric. Course instructors will gather data. Grant Committee will collect and analyze data in What are the results? a. Scores from laboratory competency final exams in BIO core courses given in Fall 2012 and Spring 2013 indicate that 69.0% of students demonstrated acceptable lab skills. b. Exit surveys issued to graduating seniors in 2013 showed that 84% of students agreed that they had adequate preparation for research. a. Students will average 5.0/6.0 a.Students attained average in each rubric category of >5.0/6.0 in 5 of 8 rubric categories b. 50% of graduating seniors will conduct original research b. 41 of 68 (60%) seniors indicated that they had conducted independent c. 25% of graduating seniors research on the exit survey (excluding CLS and TC) will present results at a research c. 15% of graduating seniors Committee/ person responsible? How are results shared? Instructors will collect data and provide to Assoc Chair -Faculty will be informed that BIO did not meet expectations for laboratory competency nor student-rated preparedness. This aspect will be revisited by the Curriculum and Assessment committees and mechanisms sought for improvement. a. Report Rubric prepared by TUES Grant Committee ; Results shared with BIO Faculty and Assessment Committee b-d. Exit surveys tabulated by the Associate Chair- Communicated to BIO Faculty and Assessment Committee preparation for National Science Foundation teaching Grant (TUES grant). b. Number of graduating seniors (excluding CLS and TC) that have been engaged in undergraduate research projects (Tallied by Assoc Chair) conference. d. Total number of 80 student semesters engaged in undergrad research will be met presented results at a research conference. d. Total number of student semesters engaged in undergraduate research was 94 for FY13 c. Number of graduating seniors excluding CLS and TC) presenting at research conferences (Tallied by Assoc Chair) d. Number of total Bio students engaged in undergraduate research projects (Tallied by Assoc Chair) 3. Students will demonstrate an ability to write effectively. EWP data will be utilized EWP submissions will average 3.5 or above in critical writing samples in BIO courses 4. Students will be able to construct a professional research poster Bio3120 ( a core BIO course) Students will average 3.0/4.0 students will produce in each rubric category professional posters; A rubric (see Appendix 3) will be used to assess poster quality . Not yet instituted 5. Student will enhance global citizenship by participation in biology clubs with conservation and/or volunteer efforts. Assessed by Biology exit Surveys administered electronically at end of fall and Spring semesters by Assoc Chair 53% of graduating seniors Data will be shared with faculty; indicated that they participated Faculty requested to promote club in one or more of these clubs Activity 50% of graduating seniors will indicate that they have participated in biology clubs (Botany, Wildlife, Pre-med, Pre-vet, Eathwise) -EWP papers submitted for Bio Benchmark not met. Discuss in core courses received average faculty meeting how to improve ratings of 3.37/4.0 (3.36 COS lab report submissions. Ave) ; Data will be evaluated by TUES Committee and presented to faculty 6. Students will demonstrate the quantitative and analytical skills to analyze data sets generated by biological experiments and surveys. a. Bio3120 (Molec. Cell Biology) lab grades and rubric , exams and research projects; capstone course (BIO 4984), Assessed by instrictors. 7. Students will demonstrate the ability to critically read and evaluate research papers and review articles in the biological sciences. Research report written for inclusion in writing portfolio; term paper written for senior capstone course (BIO 4984) a. 80% will demonstrate proficiency by attaining grades of C or higher on laboratory finals. a. 69% of students earned grades of C or higher on laboratory finals in the BIO core courses. b. Watson-Glaser scores exceed the COS mean. b. Watson-Glaser were slightly above previous years, increasing from 26.6 to 27.9 substantially above the EIU mean of 25.2. -80% will demonstrate proficiency by attaining grades of C or higher on research report and term paper. . 38 of 47 (81%) of students earned grades of C or higher on BIO 4984 capstone term paper. b. Watson-Glaser Tests (EIU Testing Center) . Benchmaks for lab final in core courses not met. Data shared with faculty and Assessment Committee Results shared with Faculty and Assessment Committee. (Continue objectives as needed. Cells will expand to accommodate your text.) PART TWO Describe your program’s assessment accomplishments since your last report was submitted. Discuss ways in which you have responded to the CASA Director’s comments on last year’s report or simply describe what assessment work was initiated, continued, or completed. In response to the CASA Directors comments for FY12, we have removed the MFT as an assessment tool, included three of the Provosts learning goals into the assessment, moved the EWP results to a new category related to student writing, and the feedback loop more clearly explained, indicating that entire faculty discussion will take place at the faculty retreat and during regular faculty meetings to engage faculty in assessment . I. Content learning assessment The MFP test in Biology was critically analyzed by the BIO Assessment Committee and deemed an inadequate assessment tool due to lack of participation by the majority of sister institutions. Faculty discussions took place to identify another mechanisms assess student knowledge. An in-house exam is being developed to assess learning of content. Integrative learning- A group of BIO faculty was awarded a $7K Proposal Initiative Fund (PIF) grant from the Office of Grants and Sponsored Research to acquire preliminary data for submission of a large grant proposal to the National Science Foundation (NSF) designed to broadly improve the BIO curriculum. The PIF project , entitled Using Inquiry-based Learning Modules to Vertically Integrate Core Biological Concepts into the Biology Majors Curriculum, including $2500 to hire an outside consultant to develop assessment tools for this program. An on-site visit by tow assessment experts occurred in FA11. Curriculum has been incorporated into Bio3120 and Bio3800, two majors courses , and will be expanded into freshman biology (BIO1100) and biostatistics (BIO4750). The projected NSF grant will include $45K for assessment. This proposal is designed to implement inquiry-based learning techniques to bring integrative learning to our core biology curriculum. It includes a vertically integrated curriculum to reinforce the concept that modern biological research requires input and skills in different sub-fields within biology. The topic infused into the curriculum is global warming, with distinct aspects of fish ecology laboratory exercises infused into several core courses. The integration of these inquiry-based modules into multiple core requirement courses will serve to reinforce the use of important skills in critical analyses, thus making it more likely that the students can achieve the high transfer. II. Exit Surveys: Results and Trends (Appendix 3) Eighty six graduating seniors submitted exit surveys this year (>90 of the FY13 graduating class). Surveys were distributed to students by email using Survey Monkey. Obvious strengths regarding BIO faculty included knowledge of subject, organization, helpfulness, attitude, (>94% agree rate in each category) and laboratory exercise appropriateness (84% agree rate) . Concerns identified include (as in past years) helpfulness of academic advisors and helpfulness of BIO faculty in career choice (63% and 45% students gave positive ratings, respectively), although ratings improved substantially from 3 years ago in the latter category (from 29%). Students involved in research projects showed strong positive responses to academic preparation (84% positive), equipment availability (88% positive), research interest (92% positive), value of the research experience (69% positive). and increased desire to pursue a graduate degree (51%). Assessment of facilities by students were mixed. Participation in honor societies, Botany Club, and the Fish and Wildlife Ecology Club has dropped from 73% to 53%. Most respondents (87%) reported that they made the right choice in selecting the Biological Sciences. Internship experiences were generally strong, with a 73% positive rating of ratings of on-site supervision and preparation for graduate school or job placement success (dropping from 100% in both categories to 73% and 83%, respectively) compared to previous years. PART THREE Summarize changes and improvements in curriculum, instruction, and learning that have resulted from the implementation of your assessment program. How have you used the data? What have you learned? In light of what you have learned through your assessment efforts this year and in past years, what are your plans for the future? Exit Survey- Biological Sciences began administering the exit survey electronically via Survey Monkey in 2010, but response rate was initially low. This year, the survey was sent out during finals week to increase participation and an on-site exit interview was made mandatory. This resulted in an increase from 32 to 86 respondents. . In addition, survey questions were expanded to assess post-graduation plans and student comments about the program. Results from this survey are used to assess student satisfaction with faculty, program, equipment, internship and research experiences and club participation. Biology Forum (BIO 1150) course was added to the BIO core five years ago, and thus most graduating students would have taken this course. The course is designed to provide a broad overview of career paths and employment opportunities in the biological sciences, as well as undergraduate research opportunities. Attendanceat and summary of a departmental research seminar is required. Exit survey results do not indicate an obvious effect in response to the question of BIO assistance in deciding on a career (question #7 in Ext Survey). The assessment committee will address this issue in AY14. Integrative learning- The Department of Biological Sciences was awarded the Provost’s Integrative Learning Award in 2011 for high impact experiences (undergraduate research, internships, volunteerism). Students involved in research experiences was very high in BIOBIO (94 students during FY13) , although only 50% of graduating students completed at least one semester of research. This lower number likely more adequately reflects the student population since the number of respondents more than doubled this year. Bio faculty will be encouraged to increase student research opportunities. Curriculum change- The PIF project , entitled Using Inquiry-based Learning Modules to Vertically Integrate Core Biological Concepts into the Biology Majors Curriculum (describe in part I above). The first phase of this project has been piloted and will be expanded over the next year, including the assessment tools used. Appendix 2. Data interpretation Assessment A. ASSESSMENT QUESTION SET Assessment #1v3 Name: _______________________________________________________ Gender: M / F Ethnic Identity (optional): ___________________ Current Class Standing: Freshman / Sophomore / Junior / Senior Please check the Biology courses that you have completed and indicate your final grade for that course. If you have repeated a particular course, enter the best grade from the repeats. If you are currently taking a course, enter “on-going” under Final Grade. Are you a transfer student (circle one)? YES * NO *If you are a transfer student, indicate the result of the equivalent course you have taken if you receive credit from those courses. A. ASSESSMENT QUESTION SET (page 2 of 5) Course Semester/Year Final Grade BIO1100: General Biology BIO1150: Biology Forum BIO1200G: General Botany BIO1300G: Animal Diversity BIO3120/BIO3100: Molecular and Cell Biology BIO3200: Genetics BIO3510: Animal Physiology BIO3520: Plant Physiology BIO3800: Ecology BIO4750/MAT2250G: Biometrics/Statistics BIO4984: Evolution Suppose you are a scientist investigating the use of alternate sources of energy, and your focus is on the use of certain types of algae that can produce useable fuel from biological sources, also known as biofuel. One of your colleagues managed to isolate a type of alga (algae are aquatic unicellular photosynthetic organisms) from a lake where the annual average temperature is 8oC. You are in a team to study whether this new type of algae might make a suitable candidate as a source of biofuel, because the oil produced by alga to regulate their osmotic balance can be extracted and converted to fuel. The following graph depicts the reading of temperature at the lake over a 12-month period. Each month, 4 different recordings are made and the average for those 4 readings are used to represent the temperature of that month. A. ASSESSMENT QUESTION SET (page3 of 5) Lake Water Temperature Average Temperature (degree Celcius) 18 16 14 12 10 8 6 4 2 0 Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Month Figure 1. Average lake water temperature. Each bar represents the average of 4 readings from the indicated month. The vertical lines represent the standard deviation. Q1. How many months have a monthly average temperature that is at or above the annual average? Explain your answer. Q2. Compare and contrast the average temperature of May to the average temperature of June. How are they similar, and how are they different? What do the similarity and difference mean? Explain your answer. Q3. In order to study this new alga to assess whether it is a suitable candidate for biofuel production, your first task is to find a way to grow it in abundance under laboratory conditions. To achieve this, you will need to know the temperature at which this organism will grow the best. A. ASSESSMENT QUESTION SET (page 4 of 5) A. Given what you know about the annual average temperature as well as the monthly average temperature of the lake from which this alga was found, formulate a hypothesis of the effects of temperature on the rate of growth of this alga. Provide an explanation to justify your hypothesis. B. Design and describe an experiment that will allow you to test the hypothesis you proposed in part (A). Be sure to identify the relevant variables. C. Provide the predicted outcomes of your proposed experiment, as well as your interpretation of these potential outcomes. Be sure to include sufficient detail to justify your explanation. The next step in determining whether this new alga is a suitable candidate for biofuel production is to examine the amount of oil produced by this alga under different conditions. You decide to investigate the impact of salinity on the production of oil from this alga by quantifying the amount of oil produced by the alga when it is grown under different concentrations of sodium chloride (NaCl). This experiment was done with 2 liters of algal culture per condition. The summary of your data is presented below. NaCl concentration (mM) 1 10 25 40 Alga mass (g/L) 5.2 4.9 2.2 0.7 Oil (% of algal mass) 12.7 22.9 46.1 61.8 Q4. Based on the data from this table, which salt concentration gives the largest amount of oil per liter? Show your work and explain your answer. The colleague who identified this alga also managed to collect data on the abundance of this alga from the lake throughout the year. Along with counting the alga, she had also performed a count for total invertebrates of the same sample. The data that she had collected is presented in the table below. A. ASSESSMENT QUESTION SET (page 5of 5) Month Total Alga Mass (g/L) Total Invertebrate Mass (mg/L) January 4.57 21.71 February 4.19 22.34 March 10.22 44.91 April 8.87 34.39 May 7.72 36.66 June 2.91 13.14 July 2.65 12.28 August 2.11 9.84 September 5.55 12.78 October 10.87 26.45 November 8.87 35.44 December 6.12 28.17 Table 1. Total algal mass and total invertebrate mass at the lake. Q5. Produce a graphical representation of the data in the table above. You may either hand draw it in the space below, or you may use a software like Excel to produce the graph. Q6. Using the data from both Figure 1 and the graph that you have just created, propose a hypothesis concerning the population change of the invertebrates of this lake. Explain your hypothesis. B. TUES RUBRIC ANSWER SET Q1: According to the graph 7 months had an average temperature of 8oC or above, but only 4 months including standard deviation bars. Q2: The average temperature of June is more accurate than that of May both at 12oC because the error bar in May is highly greater than that of June. Q3A: Higher average temperatures should be efficient in algae growth by providing more sunlight for photosynthesis to be successful. In lower temperature months there may not be valuable sunlight to aid in growth of the algae. This will also lead to the production of biofuel due to higher osmotic pressure. Q3B: Growing algae in the presence of efficient sunlight water and also controlling in with algae in cooler water with less sunlight over a full month. Q3C: Since algae are photosynthetic unicellular organisms they cannot survive in the absence of sunlight so therefore since the algae in warmer water and more sunlight will survive and therefore producing more biofuel. Q4: The 1 mM NaCl gave the highest percentage of oil per liter: 52/127 = 0.409 Q6: The population change of the invertebrates of the lake seemed to be fairly standard. Invertebrates with higher (mg/L) mass seemed to have the same high total algae mass (g/L) while invertebrates of lower mass were vice versa. C. TUES RUBRIC FOR SCORING (page 1of 2) C. TUES RUBRIC FOR SCORING (page 2 of 2) D. TUES RUBRIC RESULTS –Spring 2012 Q1 Q2 Q3A Q3B Q4A Q4B Q5 Q6 Appendix 3. Scientific Poster Assessment