Central Washington University Assessment of Student Learning Department and Program Report Please enter the appropriate information concerning your student learning assessment activities for this year. Academic Year of Report: _2010-11_____________ College: __COTS_______ Department _Geological Sciences______ Program: __Master of Science in Geology 1. What student learning outcomes were assessed this year, and why? In answering this question, please identify the specific student learning outcomes you assessed this year, reasons for assessing these outcomes, with the outcomes written in clear, measurable terms, and note how the outcomes are linked to department, college and university mission and goals. Student Learning Outcome Assessed: 1) Critically synthesize and interpret published scientific literature; differentiate data from interpretation (GEOL 502) 2) CWU Writing rubric (GEOL 534; GEOL 523; GEOL 578) 3) Quantitative Analysis (GEOL 584) 4) Knowledge of core concepts in Geology (GEOL 523) 5) Manipulate and graph data (GEOL 523) Why assessed? These outcomes are important for graduate students to develop as they research and write their Masters theses. Link to Department Goals: These learning outcomes relate to Geological Sciences Department Goal (1):” Offer a multitude of dynamic learning opportunities: (a) for majors, students will demonstrate the knowledge, skills, and disposition to be successful in their chosen field of geological sciences or related field.” Graduate students must be able to understand and critically interpret the published scientific literature in their discipline in order to a) gain the knowledge to be successful in their specialization and b) learn the best way to effectively communicate the results of their own scientific research. They must also be able to effectively employ quantitative analysis of their scientific data. Link to College of the Science Mission: “As practitioners of scientific inquiry, students and faculty create and apply knowledge to solving human, social and environmental problems.” Understanding how to interpret scientific writing is a critical step toward achieving the COTS mission of creating and applying knowledge to solve problems. Student must then be able to communicate effectively in writing and quantitative analyses to apply that knowledge in a way that can be interpreted and utilized by others. Link to University Mission: … “The university community values teaching as the vehicle to inspire intellectual depth and breadth…of its students.” Critical synthesis and interpretation of the primary scientific literature, writing effectively, and employing quantitative analyses instill intellectual breadth in our Masters students. 2. How were they assessed? In answering these questions, please concisely describe the specific methods used in assessing student learning. Please also specify the population assessed, when the assessment took place, and the standard of mastery (criterion) against which you will compare your assessment results. If appropriate, please list survey or questionnaire response rate from total population. A) What methods were used? 1) Critically assess literature: The students wrote an essay on the regional geology of Washington State, which integrated their own observations from a week-long field course in the region along with results from previously published research on the geology of the region. 2) CWU Writing Rubric: Students wrote library research papers (GEOL 534, 523 and 578). 3) Quantitative Analysis: Students completed a course assignment that involved quantitative analysis in GEOL 584. The first QA table shows the results from a basic analysis problem; the second QA table is the same students’ results on a more complex quantitative analysis problem. 4) Understand Core Concepts of Geology: Final exam question in GEOL 523 5) ) Manipulate and interpret graphed data: Final exam question in GEOL 523 B) Who was assessed? 1) Critically assess literature: Incoming new graduate students in the GEOL 502 Regional Field Geology of the Pacific Northwest 2) CWU Writing Rubric: Graduate students in the GEOL 534 Petroleum Geology, 523 Cryosphere, and 578 Volcanology courses 3) Quantitative Analysis: Graduate students in the GEOL 584 Geochronology course 4) Understand Core Concepts: Graduate students in GEOL 523 Cryosphere course 5) ) Manipulate and interpret graphed data: Graduate students in GEOL 523 Cryosphere course C) When was it assessed? 1) Critically assess literature): Fall, 2011 2) CWU Writing Rubric: GEOL 534 in Spring, 2011; GEOL 423 in Spring, 2011; GEOL 578 in Spring, 2011 3) Quantitative Analysis: GEOL 584 Winter, 2011 (a. Basic analysis; b. More complex analysis) 4) Core Concepts: GEOL 523 Spring, 2011 4) Manipulate and interpret graphed data: GEOL 523 Spring, 2011 3. What was learned? In answering this question, please report results in specific qualitative or quantitative terms, with the results linked to the outcomes you assessed, and compared to the standard of mastery (criterion) you noted above. Please also include a concise interpretation or analysis of the results. GEOL 502, Fall 2011 Assessment of Learning Outcome: 1) Critically synthesize and interpret published scientific literature; differentiate data from interpretation Student 1 2 3 4 5 6 7 8 Average Outline Geol, Synthesize Lit 5 4 5 5 4 2 3 4 4.0 Organization, Format 4 5 5 5 5 5 5 4 4.75 Figures & Tables 5 4 5 5 4 2 5 5 4.4 Spelling & Grammar 3 5 5 5 5 5 5 5 4.8 Succinct & Clear Writing 4 5 5 5 5 5 4 5 4.8 Integrates Obs & Examples 5 5 5 5 5 2 5 5 4.6 Complete References 4 4 4 5 3 2 4 4 3.8 Average 4.3 4.6 4.9 5.0 4.4 3.3 4.4 4.6 4.4 GEOL 534 Petroleum Geology Spring 2011: CWU Writing Assessment Rubric Element Content Reasoning Organization Rhetoric of the Discipline (optional for Gen Ed) Conventions & Presentation Pass* Non-Pass* 5/100% 5/100% 5/100% 5/100% 0/0% 0/0% 0/0% 0/0% 5/100% 0/0% Pass* Non-Pass* 3/100% 3/100% 3/100% 3/100% 0/0% 0/0% 0/0% 0/0% 3/100% 0/0% Course: GEOL 523 Rubric Element Content Reasoning Organization Rhetoric of the Discipline (optional for Gen Ed) Conventions & Presentation GEOL 578 Volcanology: CWU Writing Assessment Pass Number Total Number of Students Evaluated 4 4 Pass Percent No Pass number No Pass Percent 100 0 0 Content 4 100 0 0 Reasoning 4 100 0 0 Organization 4 100 0 0 Rhetoric of Discipline 4 100 0 0 Conventions and Presentation 4 100 0 0 GEOL 584 Geochronology: Quantitative Analysis Skills— Basic Level Problem Student set-up Computation Answer Average 1 2 3 4 5 6 7 Average 4 4 4 4 4 4 4 4.0 4 4 4 4 4 4 4 4.0 4 4 4 4 4 3 3 3.7 4.0 4.0 4.0 4.0 4.0 3.7 3.7 3.9 GEOL 584 Geochronology: Quantitative Analysis Skills— More Complex, Advanced Level Calculations and Reasoning Problem Student set-up Computation Answer Average 1 2 3 4 5 6 7 Average 4 4 4 4 4 4 2 3.7 4 4 3 4 3 4 2 3.4 3 2 3 3 4 4 3 3.1 3.7 3.3 3.3 3.7 3.7 4.0 2.3 3.4 GEOL 523: Demonstrates core knowledge Student 1 2 3 Avg. Defines key term 3 3 1 2.3 Demonstrates knowledge of key concept 4 4 4 4.0 GEOL 523: Manipulate and interpret graphed data Interprets Plots graphed Student data data 1 4 3 2 4 3 3 4 3 Avg. 4.0 3.0 4. What will the department or program do as a result of that information? In answering this question, please note specific changes to your program as they affect student learning, and as they are related to results from the assessment process. If no changes are planned, please describe why no changes are needed. In addition, how will the department report the results and changes to internal and external constituents (e.g., advisory groups, newsletters, forums, etc.). These results indicate that the incoming Masters degree students are weakest in the areas of a) providing complete and properly-cited references and b) synthesizing the information from previously published literature into their writing. In particular, the students need to improve on properly acknowledging the sources of their information in their writing. We will use this information to target improvement in those particular writing skills in our other core courses in the Geology MS program that emphasize writing and critical synthesis of literature, e.g. GEOL 502 Current Topics and GEOL 503 Research Methods. Graduate students’ writing abilities have improved after they have completed some portion of their CWU graduate program in Geology, as shown by the higher scores on the CWU writing rubric, given in the spring. Graduate students are competent in setting up and computing basic quantitative problems, but could take more care to ensure that they have arrived at a correct answer/conclusion. They are not as skilled at solving more complex problems, but are still competent. Graduate students demonstrate the ability to graphically manipulate data, but are not as competent at interpreting graphical data. We will continue to assign and assess quantitative problems and emphasize this skill in our graduate courses. 5. What did the department or program do in response to last year’s assessment information? In answering this question, please describe any changes that have been made to improve student learning based on previous assessment results. Please also discuss any changes you have made to your assessment plan or assessment methods. We have not made any changes in our assessment plan or methods in the last year.