2014

advertisement
Geology B.S., B.A. Programs
Assessment Report 2014
Assessment Results, 2013-2014 Overview
We present four assessments from the B.A and B.S. Program in Geology that evaluate a full
range of Program Learning Outcomes. Not surprisingly, all of the assessments presented here are
derived from laboratory-based assignments. Capstone and other milestone experiences in geology
typically and necessarily integrate the traditional ‘lecture hall’ experiences of reading, critical
analysis, and subsequent written communication (our PLOs 2 & 3), but also the very applied
experience of working with geologic materials, maps and techniques in the laboratory and the
field. As such, the Laboratory Skills / Course Project rubric is applied in all cases.
These four assessments analyze 30 separate pieces of student work derived from four sequential
courses that progress in complexity.
In the two ‘lower-level’ classes (GEOL 3701 and 3801) overall class results are strong and there
are no students that fall below the minimum competence level. In fact results indicate that our
students are operating at or above the ‘accomplished’ level.
The two ‘upper-level’ classes (GEOL 3810 and 3910) are difficult courses, where students are
introduced to the complications of three-dimensional geometry and thinking. These difficult-tograsp concepts are applied in both the laboratory and in the field. Here we see the both the rigor of
the courses and difficulty that some students have with 3D thinking, spatial relationships, their
comfort working in the field, and applying mathematical analysis to natural systems. In these
courses there are four instances where students perform below the level of basic competence, and
two instances of work that is at, or just above, minimum competence level. The large standard
deviation for the Field Methods (GEOL3910) is evidence of this.
Course assessments are briefly summarized below. Assessments were performed using the
departmental rubrics, modified as needed to take into account the requirements of the
assignment.
GEOL 3710 – Igneous and Metamorphic Petrology: Term Project
Term-long comprehensive study of a suite of rocks. A course average of 10.7/15, where 5/15
indicates “competence” and 10/15 indicates “accomplishment”. The large standard deviation
(2.66) indicates that there is a wide range of abilities. The lowest average scores in the area of
‘Organization’ is consistent with difficulties students encounter when needing to track numerous
aspects of the project and integrate them into a coherent piece of work.
This project provides an excellent introduction to the methods used by and skills required of a
professional geologist. It incorporates all of the Geology BS/BA PLOs, and the students highly
value the experience.
GEOL 3801 – Sedimentology and Stratigraphy: Cull Canyon Stratigraphic Section
Field data collection, laboratory analysis and discipline-specific write-up. Course average is
9.8/12 , where 4/12 indicates competence and 9/12 indicates accomplishment. The lowest scores
indicate that execution is a weak area relative to others. Future efforts to demonstrate methods,
provide examples and make clear the expectations for the final product may help in this area, but
overall the class results are very strong.
We would be wise to continue and ideally increase the number of field experiences in order to
produce students with strong field skills. There is no substitute for field experience and no
question that the more time in the field that students accumulate, the more insight they will have
in other aspects of geology.
GEOL 3810 – Structural Geology: Term Project
A term-long, semi-cumulative analysis of a complexly deformed area in Montana. Course average
is 8.6/15, where 5/15 is ‘competent’ and 10/15 is ‘accomplished’. With the exception of one
student who barely met the competence threshold (5/12), the results are solid.
These types of term-long, highly integrative projects that simulate professional duties are an
important part of a modern education in geology. The difficult nature of this type of assignment
is visible in the low scores in the areas of "Quantitative Skills and Synthesis". This is not
surprising considering that many students have poor math and critical analysis skills. Both of
these are likely issues prior to attending CSUEB, and thus it is incumbent upon us to maintain
and even increase the number of assignments that require our students to apply mathematical
methods to geologic problems, and to read challenging scientific literature for content and
analysis.
GEOL 3910 – Geologic Field Methods: Geologic Map
Produce from direct field investigation a geologic map and report. Course average is 8/15, where
5/15 is ‘competent’ and 10/15 is ‘accomplished’. Two students failed to meet the competence
threshold (5/12), and one was just above it (6/12). There is a relatively large range of scores, as
indicated by the standard deviation of 4.65.
This serves as a capstone course and may be, in many ways, the most difficult course for many
students: it is a field class, where ideally all of the methods from previous courses are applied.
Issues range from discomfort from being in the field, difficulty recognizing rock types and
structures, and inability to visualize in 3D. This assessment area does not necessarily measure
how good a geologist a student may be, but rather reflects more on their ability to operate
comfortably in a field environment (hills, wildlife, 3D, etc.), which is not necessary for all
geologists, as some may prefer to work in laboratory or less rugged field environments.
CSUEB Geology B.S., B.A. Program ‐ CRITICAL THINKING VALUE RUBRIC
Creative thinking is both the capacity to combine or synthesize existing ideas, images, or expertise in original ways and the experience of
thinking, reacting, and working in an imaginative way characterized by a high degree of innovation, divergent thinking, and risk taking.
This rubric may be applied to student writing assignments and projects in order to assess how well the Geology B.S., B.A. Program Learning
Outcomes have been achieved.
Exemplary 3
Accomplished 2
Competent 1
Insufficient Evidence 0
Clearly understands purpose and
role of the exercise and its
importance and context within the
Earth Sciences and/or related
subfield.
Proposes/develops new means
methods to address the problem.
Strong understanding of
purpose and role of the
exercise and its importance
and context within the Earth
Sciences and/or related
subfield.
Uses discipline‐appropriate
means to address the
problem.
Understanding of the
purpose and role of the
exercise and some insight
into its importance and
context within the Earth
Sciences and/or related
subfield.
Follows instructions and
understands the steps.
Poor understanding of the
purpose and role of the
exercise with little/no
insight into its importance
and context within the Earth
Sciences and/or related
subfield.
Unable to follow
instructions.
2. Problem Solving
Developsalogical,consistentplan to
solveproblem,andrecognizes
consequencesof solutionandcan
articulate reasonforchoosing solution.
Develops a plan to solve the
problem. Has some insight into
consequences and some ability
to articulate reasonfor
choosingsolution.
Considers and rejects less
acceptable approaches to
solving problem.
Only a single approach is
considered and used to
solve the problem.
3. Embracing
Contradictions
Integrates alternate, divergent, or
contradictory perspectives or ideas
fully. Proposes/uses multiple
working hypotheses.
Incorporates alternate,
divergent, or contradictory
perspectives or ideas in a
exploratory way.
Applies multiple working
hypotheses
Includes (recognizes value)
alternate, divergent, or
contradictory perspectives or
ideas in a limited way.
Has difficulty creating multiple
working hypotheses
Fails to Acknowledge
alternate, divergent, or
contradictory
perspectives or ideas.
No use of multiple
workinghypotheses
4. Innovative
Thinking
Creates a novel/unique idea, method,
hypothesis, format, or product.
Imagines/conceives a
novel/unique idea, method,
hypothesis, format, or product.
Reformulates a collection of
available ideas.
No new ideas
5. Connections,
Synthesis,
Transformation
Synthesizes ideas or solutions into a
coherent whole.
Connects ideas or solutions in
novel ways.
Recognizes existing connections
among ideas or solutions.
No recognition of significance
of exercise to discipline or
global context.
1. Competencies
Strategies and skills that
apply to geological problem
solving (i.e. discipline‐specific
lab
& field exercises).
Modified from: Critical Thinking Value Rubric, AAC&U http://www.aacu.org/value/rubrics/WrittenCommunication.cfm
CSUEB Geology B.S., B.A. Program – LABORATORY SKILLS / COURSE PROJECT RUBRIC
Laboratory skills and course projects and assignments are where the discipline‐specific skills, methods, techniques
and processes that are fundamental to the Earth Sciences are acquired and utilized.
This rubric or portions of it may be applied to student laboratory and course assignments and projects in order to assess
how well the Geology B.S., B.A. Program Learning Outcomes have been achieved.
Exemplary 3
Accomplished 2
Competent 1
Insufficient Evidence 0
1. Organization
Organization is clear,
consistent, observable and
skillful and content is
cohesive.
Organization is clear,
consistent & observable.
Organization is
intermittently observable.
Organization is poor or not
observable.
2. Presentation
Work is attractive, clean,
clear, accurate, visually strong
Work is well produced,
clear, mostly‐accurate,
visually effective
Work is adequate with
minor errors, visually inert
Work is unclear, informal,
minimally conveys intent and
error prone
3. Quantitative
Skills
Applied innovative and
insightful
mathematical
methods and techniques.
Demonstrates
mathematical mastery.
Applied situation‐
appropriate mathematical
methods and techniques.
Demonstrates solid math
skills.
Applied basic
mathematical methods.
Demonstrates modest
math skills.
Unable to apply basic
mathematical methods and
techniques.
Insufficient math skills.
4. Execution
Work is complete to levels
above expectation and
turned in early or on time
Work is strong, complete
and turned in on time
Work is adequate, complete Work is incomplete or not
and turned in on time
turned in on time
5. Connection,
Synthesis,
Transformation
Synthesizes ideas or
solutions into a coherent
whole. Creates connections
to higher‐level discipline‐
specific concepts and
practices.
Connects ideas or solutions
in novel ways.
Recognizes connections to
higher‐level discipline‐
specific concepts and
practices.
Acknowledges existing
connections among ideas or
solutions.
Modified from: AAC&U
No recognition of significance of
exercise to discipline or global
context.
CSUEB Geology B.S., B.A. Program Assessment
Rubric:
Lab Project
Course:
GEOL-3801: Sedimentology and Stratigraphy
Quarter:
Spring 2014
Assignment: Cull Canyon Stratigraphic Column
Student
ID
1
2
3
4
5
Notes:
Organization
3
2
3
2
3
Presentation
3
2
3
2
3
Connection,
Synthesis,
Execution Transformation
2
3
2
2
2
3
2
2
2
3
Total
11
8
11
8
11
Quantitative skills are not assessed by this project; they are assessed using other lab assignments in the course
CSUEB Geology B.S. Program ‐ LAB SKILL COURSE PROJECT RUBRIC
APPLIED TO: GEOL3810 Winter 2014
GEOL3810 Quarter Lab Project: BS_PLO's 2 & 4 Class Average = 8.6
Student
pr3277
wg2728
yg6466
mw6564
qm4554
xv2896
in2972
tj2344
fn2395
fp3887
sw4285
sp2953
Organization
2
3
3
2
2
2
2
3
2
2
3
2
Presentation
2
2
3
3
2
1
1
3
1
2
2
2
Quantitative Skills
2
2
2
2
2
1
2
2
2
2
2
2
Execution
2
3
3
3
3
1
2
3
1
2
3
2
Connection/
Synthesis/
Transform
2
2
2
2
3
1
2
2
1
1
3
2
Total
8
10
11
10
9
5
7
11
6
8
10
8
CSUEB Geology B.S., B.A. Program Assessment
Rubric:
Lab Project
Course:
GEOL 3910
Quarter:
Spring 2014
Assignment: Geologic Map
Student
ID
Organization
Quantitative
Presentation Skills
Connection,
Synthesis,
Execution Transformation
Total
1
2
3
4
5
6
7
1
1
1
3
3
3
1
0
1
0
2
3
2
0
2
2
1
2
3
2
1
0
1
1
3
3
2
1
1
1
1
3
3
1
1
Download