Chemistry Assessment Update
Assessment Committee Mandate
C101-Lecture
C121-Laboratory
Chemistry department expanding into
C100-Lecture
C120 Laboratory
Outcomes
 Demonstrate the ability to identify and
explain how scientific theories are
formulated, tested, and validated.
 Demonstrate the ability to integrate and
apply scientific methods which include
defining parameters of problem, seeking
relevant information, subjecting proposed
solutions to rigorous testing, and drawing
conclusions based on the process.
Outcome 1
 Demonstrate the ability to identify and
explain how scientific theories are
formulated, tested, and validated.




Scientific theory formulation starts with an
observation
That leads to a hypothesis
It is tested by controlled experimentation using
the scientific method
It is validated by considerably more controlled
testing
Outcome 2
 Demonstrate the ability to integrate and
apply scientific methods which include
defining parameters of problem, seeking
relevant information, subjecting proposed
solutions to rigorous testing, and drawing
conclusions based on the process.
 This question seeks to determine that
students understand all phases of the
experimental method
2010-2011
 Pilot year
 Tried assessment questions in lecture
and laboratory
 Tried different questions in Fall and
Spring
 New laboratory was added for Spring
2011 to address deficiencies in our pilot
year results
Outcome 1
 Lecture - Focused on Outcome 1
including the ability to recognize a
hypothesis
 Laboratory – Focused on Outcome 1
and the ability to determine what
experiment tests which hypothesis
Outcome 2
 Lecture focused on Outcome 2 and
the ability to draw conclusions from
evidence presented.
 Lab focused on students ability to
determine which numbers were
appropriate to answer a question.
Results
Overall
Outcome 1
Outcome 2
C101 Fall
2010
53%
71%
16%
C121 Fall
2010
37%
83%
16%
C101 Spring
2011
55%
75%
35%
C121 Spring
2011
35%
46%
34%
C101 Fall
2011
C121 Fall
2011
64%
46%
83%
58%
80%
40%
HISTOGRAM
Q1 & 3: O1
Q2 : O2
Outcome 1
 Overall improvement in recent Lecture scores
reflects faculty involvement in the assessment
process.
 Low outcome 1 score reflects that Students need
to have a better understanding of the theoretical
aspects of the scientific method so instructors
are finding new ways to address this.
 Instructors are placing more emphasis on the
understanding of hypothesis formulation based
on results of the data.
Outcome 2
 The results show that students have a
relatively better understanding the
process of experimentation, which
involves the design of the experiment
and drawing conclusions from the
results
 However students still struggle with
data analysis, which is being
addressed in both lecture and lab.
Implications
 Instructors have focused their teaching on the
scientific method, stressing it much more.
 This has been found to be necessary to improve
student internalization of the scientific method.
 Instructors are using OnCourse for forums and
chat rooms
 We are using different approaches to assess the
outcomes.
 Short answer type questions
 Multiple choice questions with justification
2011-2012
 Faculty were re-briefed on the
importance of assessment
 Committee formed to redraft
assessment questions
 Faculty acknowledge the importance
of emphasizing the scientific method
in the general chemistry courses
2011-2012 continued
 An OnCourse section was created to
share assessment questions
 Faculty have put readings up on
assessment in general
 Faculty have become interested in
educational research
Future plans
 The idea of using CPR (Calibrated Peer
Review) in the classes to teach and assess
the outcomes is being explored
 CPR exposes the students to material multiple
times as they:





Research a question
Write an essay
Learn to grade the essays
Grade their peers essays
Grade their own essay
Plans Continued
 The idea of using OnCourse to
facilitate group projects using the
scientific method are being explored
 The idea of using internet
assignments is being explored
Plans Continued
 Research is being conducted to
ascertain if enrollment in the optional
laboratory improves both scientific
reasoning and lecture scores.
 The Lawson test of scientific
reasoning involves both answering
questions and justifying the answer
and allows researchers to assess how
well our program teaches reasoning.
Acknowledgements
 Thanks to all our full time and part
time faculty for caring enough to be
part of the assessment committee
 Thanks to our Department Chair who
is encouraging our efforts
Questions?