QCC COURSE ASSESSMENT FORM PART I. STUDENT LEARNING OBJECTIVES

advertisement
CH-152 Fall 2012 Course assessment
Prepared by Moni Chauhan, David Sarno and Jun Shin
QCC COURSE ASSESSMENT FORM
Date: Fall 2012
Department: Chemistry
Course: CH-152
Curriculum or Curricula: LS1, PE1, HS1, EH1, SF1
PART I. STUDENT LEARNING OBJECTIVES
For Part I, attach the summary report (Tables 1-4) from the QCC Course Objectives Form.
TABLE 1. EDUCATIONAL CONTEXT
This course is the second part of general chemistry and is intended to provide students with a
fundamental knowledge of the modern theory in general and inorganic chemistry. With an
emphasis on developing problem-solving skills as well as on concepts and theories, the
course also covers topics in thermodynamics, kinetics and equilibrium that are essential
background material to many disciplines in science and technology. These include: enthalpy,
entropy, and free energy; molecular kinetic theory of gases; rates of chemical reactions;
equilibrium in gaseous and aqueous systems, especially acids and bases; electrochemistry;
and an introduction to nuclear chemistry. The students in Honors Classes will give 10 – 15
minute oral presentations using Power Point on topics and concepts chosen from the course
material and write a term paper on the topic of the presentation. This course makes
extensive use of computers and requires the development of scientific communication skills.
TABLE 2. CURRICULAR OBJECTIVES
Note: Include in this table curriculum-specific objectives that meet Educational Goals 1 and 2:
Curricular objectives addressed by this course:
Demonstrate proficiency in factual knowledge and conceptual understanding required for
transfer to the junior year in a baccalaureate program in natural science, mathematics,
engineering, or computer science or any other program in health sciences. (LS1, PE1)
Demonstrate skills in mathematics to the minimum level of basic calculus concepts, including
their applications to science and/ or engineering. (LS1)
Demonstrate proficiency in communication skills, including technical writing and oral
presentation. (LS1)
Apply concepts through use of current technology. (LS1)
1
CH-152 Fall 2012 Course assessment
Prepared by Moni Chauhan, David Sarno and Jun Shin
Demonstrate an understanding of the professional, ethical, and social responsibilities related
to the fields of natural science, forensic science, mathematics, engineering, and /or computer
science. (LS1, PE1, SF1)
Demonstrate proficiency in acquiring, processing and analyzing information in all its forms as
related to the field of concentration. (LS1)
Use analytical reasoning skills and apply logic to solve problems. (PE1)
Use quantitative skills and mathematical reasoning to solve problems. (PE1)
Demonstrate effective skills in technical writing and oral presentation (PE1); Students will
communicate effectively through reading, writing, listening and speaking. (SF1)
Demonstrate a strong foundation in the core engineering fundamentals of general chemistry.
(PE1)
Students will demonstrate competency in the concepts and methods of the foundation
general chemistry courses required for transfer to the junior year in Forensic Science at John
Jay College. (SF1)
Students will apply concepts learned in the classroom and make conclusions based on
scientific thinking. (SF1)
Students will work collaboratively in the laboratory to provide reasonable analysis of data
obtained and to solve problems. (SF1)
Students will integrate the knowledge and skills gained in previous courses with subsequent
courses to establish an all-around scientific background. (SF1)
Demonstrate mastery of mathematics and science required for transfer to the junior year in a
baccalaureate program in Environmental Health or a related program. (EH1)
Demonstrate an understanding of the principles of chemistry and how they are fundamental
to all living systems. (HS1)
TABLE 3. GENERAL EDUCATION OBJECTIVES
Gen Ed objective’s ID
General educational objectives addressed by this course: Select
number from list (1-10) from preceding list.
#2
Use analytical reasoning to identify issues or problems and evaluate
evidence in order to make informed decisions
#3
Reason quantitatively and mathematically as required in their fields
of interest and in everyday lifelong learning
2
CH-152 Fall 2012 Course assessment
Prepared by Moni Chauhan, David Sarno and Jun Shin
TABLE 4: COURSE OBJECTIVES AND STUDENT LEARNING OUTCOMES
Course objectives
Learning outcomes
1. Students will solve
qualitative and
quantitative
problems in
chemistry.
a. Students will use the varied forms of mathematical
communication: language, symbolic notation, graphs, charts, to
formulate quantitative ideas and patterns.
b. Students will interpret and solve single-step and multi-step word
problems.
c. Students will interpret diagrams and models as they relate to
qualitative concepts and quantitative problem-solving.
a. Students will understand how energy is associated with chemical
2. Students will study
reactions.
thermochemistry
b. Students will be able to calculate the heat energy changes in any
of chemical
chemical process using calorimetry and thermochemical
reactions.
equations.
3. Students will learn
about the kinetics
of chemical
reactions.
a. Students will determine the order and rate law of chemical
reactions by mathematical, graphical, and deductive methods.
b. Students will calculate reaction rate and understand its
temperature dependence.
c. Students will understand basic principles of reaction mechanisms.
d. Students will understand basic principles of catalysis.
4. Students will learn a. Students will learn to deduce and interpret the equilibrium
constant, and determine the direction a reaction will run.
and apply
b.
Students will calculate equilibrium concentrations.
equilibrium
c. Students will learn and apply LeChatelier’s Principle to equilibria.
concepts to
chemical reactions.
a. Students will learn and apply basic principles of acid-base
chemistry and equilibria.
5. Students will
b. Students will calculate the pH values and percent ionization of
demonstrate
strong and weak acids and bases.
knowledge of Acids
c. Students will interpret molecular structures and pictorial models
and Bases
to understand and describe the strength of acids and bases.
d. Students will apply acid-base concepts to salts.
3
CH-152 Fall 2012 Course assessment
Prepared by Moni Chauhan, David Sarno and Jun Shin
a. Students will understand how buffers function and be able to
determine their pH.
6. Students will
b. Students will evaluate pH when titrating acids and bases,
demonstrate
knowledge of acid c. Students will calculate molar solubility and solubility of sparingly
and base equilibria
soluble salts.
and solubility
d. Students will predict the outcome of precipitation reactions.
equilibria.
e. Students will understand the common ion effect as it applies to
acid-base equilibria and solubility equilibria.
a. Students will learn and apply basic principles of entropy and
determine the entropy of chemical reactions.
7. Students will study b. Students will comprehend and apply the second and third Laws of
Entropy, Free
Thermodynamics.
Energy and
c. Students will learn and apply basic principles of Free Energy and
Equilibrium of
predict whether reactions are spontaneous or not.
chemical reactions
d. Students will demonstrate knowledge of the relationship between
equilibrium and thermodynamics.
8. Students will learn
the introductory
concepts of
Electrochemistry.
a. Students will learn to balance redox reactions.
b. Student will explain different batteries and cells.
c. Students will comprehend standard reduction potential and
evaluate standard electromotive force (Emf) of oxidationreduction reactions.
d. Students will evaluate Spontaneity of redox reactions.
e. Students will understand the effect of concentration on the Emf of
electrochemical cells.
f. Students will apply concepts of electrochemistry to the
phenomenon of corrosion.
a. Students will learn to balance Nuclear Reactions.
9. Students will learn
b. Students will comprehend the kinetics of radioactivity decay and
about the concepts
perform related calculations.
of Nuclear
c. Students will understand basic principles of Nuclear
Chemistry.
Transmutation, Nuclear Fission and Nuclear Fusion.
4
CH-152 Fall 2012 Course assessment
Prepared by Moni Chauhan, David Sarno and Jun Shin
PART II. ASSIGNMENT DESIGN: ALIGNING OUTCOMES, ACTIVITIES, AND ASSESSMENT TOOLS
For the assessment project, you will be designing one course assignment, which will address at
least one general educational objective, one curricular objective (if applicable), and one or
more of the course objectives. Please identify these in the following table:
TABLE 5: OBJECTIVES ADDRESSED IN ASSESSMENT ASSIGNMENT
Course Objective(s) selected for assessment: (select from Table 4)
1. Students will solve qualitative and quantitative problems in chemistry.
2. Students will learn about the kinetics of chemical reactions.
3. Students will demonstrate knowledge of acid and base equilibria and solubility equilibria.
4. Students will study Entropy, Free Energy and Equilibrium of chemical reactions.
5. Students will learn and apply equilibrium concepts to chemical reactions.
6. Students will demonstrate knowledge of Acids and Bases.
Curricular Objective(s) selected for assessment: (select from Table 2)
1. Demonstrate proficiency in factual knowledge and conceptual understanding required for
transfer to the junior year in a baccalaureate program in natural science, mathematics,
engineering, or computer science or any other program in health sciences. (LS1, PE1)
2. Demonstrate skills in mathematics to the minimum level of basic calculus concepts, including
their applications to science and/ or engineering. (LS1)
3. Demonstrate proficiency in acquiring, processing and analyzing information in all its forms as
related to the field of concentration. (LS1)
4. Use analytical reasoning skills and apply logic to solve problems. (PE1)
5. Use quantitative skills and mathematical reasoning to solve problems. (PE1)
6. Students will demonstrate competency in the concepts and methods of the foundation
general chemistry courses required for transfer to the junior year in Forensic Science at John
Jay College. (SF1)
7. Demonstrate mastery of mathematics and science required for transfer to the junior year in
a baccalaureate program in Environmental Health or a related program. (EH1)
General Education Objective(s) addressed in this assessment: (select from Table 3)
GE#2: Use analytical reasoning to identify issues or problems and evaluate evidence in order
to make informed decisions
GE#3: Reason quantitatively and mathematically as required in their fields of interest and in
everyday lifelong learning
In the first row of Table 6 that follows, describe the assignment that has been
selected/designed for this project. In writing the description, keep in mind the course
5
CH-152 Fall 2012 Course assessment
Prepared by Moni Chauhan, David Sarno and Jun Shin
objective(s), curricular objective(s) and the general education objective(s) identified
above,
Also in Table 6, please
a) identify the three to four most important student learning outcomes (1-4) you expect
from this assignment
b) describe the types of activities (a – d) students will be involved with for the
assignment, and
c) list the type(s) of assessment tool(s) (A-D) you plan to use to evaluate each of the
student outcomes. (Classroom assessment tools may include paper and pencil tests,
performance assessments, oral questions, portfolios, and other options.)
Note: Copies of the actual assignments (written as they will be presented to the students)
should be gathered in an Assessment Portfolio for this course.
TABLE 6: ASSIGNMENT, OUTCOMES, ACTIVITIES, AND ASSESSMENT TOOLS
Briefly describe the assignment that will be assessed:
American Chemical Society Assessment Exam for General Chemistry II
Student will take the national standardized exam at the end of the semester. Five of the exam
questions have been selected to analyze the understanding of concepts in General Chemistry II.
The selected problems emphasize on critical thinking, visual interpretation, and multiple step
problems solving involving math applied to chemical concepts. The questions chosen are key to
determining the students’ understanding of this course and also represent some of the topics
that are critical to student success in STEM fields in general. The exam questions are multiple
choice and each choice can be correlated to a certain level of understanding or mastery of the
concepts.
Desired student learning
outcomes for the assignment
(Students will…)
List in parentheses the Curricular
Objective(s) and/or General
Education Objective(s) (1-10)
associated with these desired
learning outcomes for the
assignment.
Briefly describe the range of
activities student will
engage in for this
assignment.
What assessment tools will
be used to measure how
well students have met each
learning outcome? (Note: a
single assessment tool may
be used to measure multiple
learning outcomes; some
learning outcomes may be
measured using multiple
assessment tools.)
1. Students will use the varied
forms of mathematical
communication: language,
symbolic notation, graphs,
charts, to formulate
quantitative ideas and
a. Students will attend class
to learn necessary
concepts, including
chemical terminology,
visualization of matter
from a chemical
A. Student responses to five
selected exam problems
on the ACS assessment
exam will be analyzed.
Students’ choices on the
multiple choice exam will
6
CH-152 Fall 2012 Course assessment
2.
3.
4.
5.
6.
7.
8.



patterns.
Students will interpret and
solve single-step and multistep word problems.
Students will interpret
diagrams and models as they
relate to qualitative concepts
and quantitative problemsolving.
Students will determine the
order and rate law of
chemical reactions by
mathematical, graphical, and
deductive methods.
Students will learn to
calculate the molar solubility
and solubility of sparingly
soluble salts.
Students will demonstrate
knowledge of the
relationship between
equilibrium and
thermodynamics.
Students will learn and apply
LeChatelier’s Principle to
equilibria.
Students will understand the
relationship between
ionization and acid strength.
Learning outcome 1 is
associated with Curricular
Objectives #1, 2, 5, 6, 7 in
Table 5 and Gen Ed Objective
#3.
Learning outcome 2 is
associated with Curricular
Objectives #1, 2, 4, 5, 6, 7 in
Table 5 and Gen Ed Objective
#2, 3.
Learning outcome 3 is
associated with Curricular
Objectives #3, 4, 6 in Table 5
and Gen Ed Objective #2
Prepared by Moni Chauhan, David Sarno and Jun Shin
perspective, and methods
for solving logical and
mathematical problems
b. Students will engage in
problem solving through
graded and ungraded
assignments with
feedback from the
instructor
c. Students will perform
laboratory experiments
that require
understanding and
application of chemical
principles
d. Students will take the ACS
Assessment Exam for
General Chemistry II at
the end of the semester.
be correlated to their level
of understanding of the
particular concepts.
7
CH-152 Fall 2012 Course assessment
Prepared by Moni Chauhan, David Sarno and Jun Shin

Learning outcomes 4, 5 are
associated with Curricular
Objectives #1, 2, 4, 5, 6, 7 in
Table 5 and Gen Ed Objective
#3.
 Learning outcomes 6, 7, 8 are
associated with Curricular
Objectives #1, 3, 4, 6, in Table
5 and Gen Ed Objective #2, 3.
PART III. ASSESSMENT STANDARDS (RUBRICS)
TABLE 7: CH-152: ASSESSMENT STANDARDS (RUBRICS)
Brief description of assignment: (Copy from Table 6 above)
American Chemical Society Assessment Exam for General Chemistry II
Student will take the national standardized exam at the end of the semester. Five of the exam
questions have been selected to represent fundamental concepts in General Chemistry II. The
selected problems emphasize logical reasoning, visual interpretation, and application of
mathematical methods to chemical concepts. They also represent some of the topics that are
critical to student success in subsequent chemistry courses. The exam questions are multiple
choice and each choice can be correlated to a certain level of understanding or mastery of the
concepts.
Desired student learning
outcomes
(Copy from Column 1, Table 6
above; include Educational
Goals and/or General Education
Objectives addressed)
Assessment measures for
each learning outcome
(Copy from Column 3,Table 6
above)
Standards for student
performance:
 Describe the standards or
rubrics for measuring
student achievement of
each outcome in the
assignment.
 Give the percentage of
the class that is expected
to meet these outcomes
If needed, attach copy(s) of
rubrics.
1. Students will use the varied
forms of mathematical
communication: language,
symbolic notation, graphs,
charts, to formulate
quantitative ideas and
patterns.
A. Student responses to five
selected exam problems
on the ACS assessment
exam will be analyzed.
Students’ choices on the
multiple choice exam will
be correlated to their
Each question requires more
than one step to solve or
requires the student to make
use of assumed fundamental
knowledge. Each response
on the selected multiple
choice questions is assigned
8
CH-152 Fall 2012 Course assessment
2. Students will interpret and
solve single-step and multistep word problems.
3. Students will interpret
diagrams and models as they
relate to qualitative
concepts and quantitative
problem-solving.
4. Students will determine the
order and rate law of
chemical reactions by
mathematical, graphical, and
deductive methods.
5. Students will learn to
calculate the molar solubility
and solubility of sparingly
soluble salts.
6. Students will demonstrate
knowledge of the
relationship between
equilibrium and
thermodynamics.
7. Students will learn and apply
LeChatelier’s Principle to
equilibria.
8. Students will understand the
relationship between
ionization and acid strength.
 Learning outcome 1 is
associated with Curricular
Objectives #1, 2, 5, 6, 7 in
Table 5 and Gen Ed Objective
#3.
 Learning outcome 2 is
associated with Curricular
Objectives #1, 2, 4, 5, 6, 7 in
Table 5 and Gen Ed Objective
#2, 3.
 Learning outcome 3 is
associated with Curricular
Objectives #3, 4, 6 in Table 5
and Gen Ed Objective #2
 Learning outcomes 4, 5 are
Prepared by Moni Chauhan, David Sarno and Jun Shin
level of understanding of
the particular concepts.
a performance level (point
value) of 0-3 based on how
completely the question has
been answered.
 Three (3) points indicates
that the student can
successfully solve the
problem and is able to
work with the information
that is given, as well as
with assumed contextual
knowledge based on prior
experience in the course.
 Two (2) points indicates
that the student
understands most of the
necessary concepts but
could not make the final
connection that would
completely solve the
problem.
 One (1) point indicates
that the student may have
recognized a step to
solving the problem but
could not make any
additional conceptual
connections.
 Zero (0) points indicate
that the student either did
not recognize the type of
problem presented or did
not know how to begin
solving it.
See rubric below.
9
CH-152 Fall 2012 Course assessment
associated with Curricular
Objectives #1, 2, 4, 5, 6, 7 in
Table 5 and Gen Ed Objective
#3.
 Learning outcomes 6, 7, 8
are associated with
Curricular Objectives #1, 3, 4,
6, in Table 5 and Gen Ed
Objective #2, 3.
Prepared by Moni Chauhan, David Sarno and Jun Shin
Projected outcomes:
Question #7 (Learning
outcomes #1, 2 and 4)
 40% expected to be 3
 25% expected to be 1
 35% expected to be 0
Question #21 (Learning
outcomes #2 and 5)
 30% expected to be 3
 30% expected to be 2
 30% expected to be 1
 10% expected to be 0
Question #27 (Learning
outcomes #1, 2 and 6)
 30% expected to be 3
 25% expected to be 1
 45% expected to be 0
Question #30 (Learning
outcomes #2 and 7)
 60% expected to be 3
 25% expected to be 1
 15% expected to be 0
Question #33 (Learning
outcomes #1, 3 and 8)
 40% expected to be 3
 20% expected to be 2
 40% expected to be 1
 Since 1, 2 and 3 add up to
100%, 0% will be 0
10
CH-152 Fall 2012 Course assessment
Prepared by Moni Chauhan, David Sarno and Jun Shin
RUBRIC FOR SELECTED QUESTIONS ON ACS ASSESSMENT EXAM FOR CH-152
Question 7
Choice
D
B
A
C
Performance
Evaluation
level
Correct response; able to deduce the order of the reaction based on
3
the exponential relationship between initial rate and concentration.
Student may have determined the order of the entire reaction rather
1
than just for the single reactant. (It is 1st order in A, 1st order in B and
2nd order overall).
Student has set the coefficient of the species in the chemical reaction
0
equal to its order, or may have partially applied the correct method
and rounded the result.
Student unable to determine the relation between concentration and
0
initial rate and/or does not know the method used to solve the
problem.
Question 21
Choice
C
A
D
B
Performance
Evaluation
level
Student has correctly determined how the compound dissociates and
3
applied the proper method to calculate its molar solubility.
Student may have correctly determined how the compound
2
dissociates, but did not completely solve the problem (calculated as far
as cube root of given Ksp)
Student solved the problem based on an incorrect dissociation of the
1
compound (calculated as square root of Ksp)
Student has not shown any clear understanding of the dissociation or
0
how solubility is commonly determined.
Question 27
Choice
C
A, D
Performance
Evaluation
level
Student understands that the largest equilibrium constant will come
from the largest negative Free Energy change, which requires a
3
favorable (negative) Enthalpy change and a favorable (positive)
Entropy change.
Student may understand that these choices can give a negative free
energy change, and thus a large equilibrium constant. However, since
1
only one of the factors (ΔH or ΔS) is favorable, the magnitude of the
free energy and the corresponding equilibrium constant will
necessarily be smaller than in choice C. It is also possible that the
11
CH-152 Fall 2012 Course assessment
B
0
Prepared by Moni Chauhan, David Sarno and Jun Shin
student does not know how equilibrium constant is related to free
energy or how free energy is related to Enthalpy and Entropy, or both.
Student may not know how to deduce the positive or negative signs
with integers.
This combination will always give a positive free energy change and
therefore the smallest equilibrium constant. It is also possible that the
student does not know how equilibrium constant is related to free
energy or how free energy is related to Enthalpy and Entropy, or both.
Student may not know how to deduce the positive or negative signs
with integers.
Question 30
Choice
D
B, C
A
Performance
Evaluation
level
Understands Le Chatelier’s Principle and also comprehends the
3
ionization of substances in water.
Recognizes that the removal of a species from the equilibrium mixture
1
will shift the equilibrium, but has incorrectly applied Le Chatelier’s
Principle.
0
Fails to understand that catalysts do not shift the equilibrium position.
Question 33
Choice
A
D
B
C
Performance
Evaluation
level
Understands the ionization concept of acids in water as it applies to
3
acid strength and can visually depict it with a model.
Reverse order; student recognizes a pattern from the models, but does
2
not correctly apply it to the concept of acid ionization or strength.
Student is partially correct in applying the visual model based on
1
strength of acids.
Student is partially correct in applying the visual model based on
1
strength of acids.
12
CH-152 Fall 2012 Course assessment
Prepared by Moni Chauhan, David Sarno and Jun Shin
PART IV. ASSESSMENT RESULTS
TABLE 8A: CH-152: SUMMARY OF ASSESSMENT RESULTS, FALL 2012, N=92 STUDENTS/4 SECTIONS
Question 7
Performance Level
A
0
B
1
Evaluation
Student has set the
coefficient of the species
in the chemical reaction
equal to its order, or may
have partially applied the
correct method and
rounded the result.
Student may have
determined the order of
the entire reaction
rather than just for the
single reactant.
21
35
17
19
22.8 % (25%)
38 % (25%)
18.5 % (10%)
20.7 % (40%)
Question 21
Performance Level
A
2
B
0
C (correct)
3
D
1
Evaluation
Student may have
correctly determined
how the compound
dissociates, but did not
completely solve the
problem (calculated as
far as cube root of given
Ksp)
Student has not shown
any clear understanding
of the dissociation or
how solubility is
commonly determined
20
21
32
19
21.7% (30%)
22.8 % (10%)
34.8 % (30%)
20.7 % (30%)
Question 27
Performance Level
A
1
B
0
C (correct)
3
D
1
Evaluation
Student may understand
that these choices can
give a negative free
energy change, and thus
a large equilibrium
constant. However, since
only one of the factors
(ΔH or ΔS) is favorable,
the magnitude of the
free energy and the
corresponding
equilibrium constant will
necessarily be smaller
than in choice C. It is also
possible that the student
does not know how
equilibrium constant is
related to free energy or
how free energy is
related to Enthalpy and
Entropy, or both.
Student may not know
how to deduce the
positive or negative signs
with integers
Student understands
that the largest
equilibrium constant will
come from the largest
negative Free Energy
change, which requires a
favorable (negative)
Enthalpy change and a
favorable (positive)
Entropy change.
Student may understand
that these choices can
give a negative free
energy change, and thus
a large equilibrium
constant. However, since
only one of the factors
(ΔH or ΔS) is favorable,
the magnitude of the
free energy and the
corresponding
equilibrium constant will
necessarily be smaller
than in choice C. It is also
possible that the student
does not know how
equilibrium constant is
related to free energy or
how free energy is
related to Enthalpy and
Entropy, or both.
Student may not know
how to deduce the
positive or negative signs
with integers
# of Students
Outcome: 2012
Actual (Expected)
# of Students
Outcome: 2012
Actual (Expected)
This combination will
always give a positive
free energy change and
therefore the smallest
equilibrium constant. It is
also possible that the
student does not know
how equilibrium
constant is related to
free energy or how free
energy is related to
Enthalpy and Entropy, or
both. Student may not
know how to deduce the
positive or negative signs
with integers.
C
0
Student unable to
determine the relation
between concentration
and initial rate and/or
does not know the
method used to solve
the problem.
Student has correctly
determined how the
compound dissociates
and applied the proper
method to calculate its
molar solubility.
D (correct)
3
Correct response; able to
deduce the order of the
reaction based on the
exponential relationship
between initial rate and
concentration.
Student solved the
problem based on an
incorrect dissociation of
the compound
(calculated as square
root of Ksp)
13
CH-152 Fall 2012 Course assessment
# of Students
Outcome: 2012
Actual (Expected)
Question 30
Performance Level
Evaluation
# of Students
Outcome: 2012
Actual (Expected)
Prepared by Moni Chauhan, David Sarno and Jun Shin
18
36
32
6
19.6% (10%)
39.1 % (45%)
34.8 % (30%)
6.5% (15%)
A
0
B
1
C
1
D (correct)
3
Fails to understand that
catalysts do not shift the
equilibrium position.
Recognizes that the
removal of a species
from the equilibrium
mixture will shift the
equilibrium, but has
incorrectly applied Le
Chatelier’s Principle.
Recognizes that the
removal of a species
from the equilibrium
mixture will shift the
equilibrium, but has
incorrectly applied Le
Chatelier’s Principle.
Understands Le
Chatelier’s Principle and
also comprehends the
ionization of substances
in water.
28
15
16
33
30.4 % (15%)
16.3 % (15%)
17.4 % (10%)
35.9 % (60%)
Question 33
Performance Level
A (correct)
3
B
1
C
1
D
2
Evaluation
Understands the
ionization concept of
acids in water as it
applies to acid strength
and can visually depict it
with a model.
# of Students
Outcome: 2012
Actual (Expected)
Student is partially
correct in applying the
visual model based on
strength of acids.
Student is partially
correct in applying the
visual model based on
strength of acids.
Reverse order; student
recognizes a pattern
from the models, but
does not correctly apply
it to the concept of acid
ionization or strength.
40
6
15
31
43.5 % (40%)
6.5 % (20%)
16.3 % (20%)
33.7 % (20%)
14
CH-152 Fall 2012 Course assessment
Prepared by Moni Chauhan, David Sarno and Jun Shin
TABLE 8B: SUMMARY OF ASSESSMENT RESULTS
Desired student learning
outcomes:
(Copy from, Column 1,Table 6
above; include Educational Goals
and/or General Education
Objectives addressed)
Student achievement: Describe the group achievement of
each desired outcome and the knowledge and cognitive
processes demonstrated.
1. Students will use the varied
forms of mathematical
communication: language,
symbolic notation, graphs,
charts, to formulate
quantitative ideas and patterns.
2. Students will interpret and
solve single-step and multi-step
word problems.
3. Students will interpret diagrams
and models as they relate to
qualitative concepts and
quantitative problem-solving.
4. Students will determine the
order and rate law of chemical
reactions by mathematical,
graphical, and deductive
methods.
5. Students will learn to calculate
the molar solubility and
solubility of sparingly soluble
salts.
6. Students will demonstrate
knowledge of the relationship
between equilibrium and
thermodynamics.
7. Students will learn and apply
LeChatelier’s Principle to
equilibria.
8. Students will understand the
relationship between ionization
and acid strength.
 Learning outcome 1 is
associated with Curricular
Question #1 on the exam tested learning outcomes #1, 2, and
4: 20.7% of students scored 3, 38% scored 1, and 41.3%
scored 0 (22.8% + 18.5%). The percentage of students who
chose the correct answer was much lower than expected. The
result for choice A (0 pt) was similar to the expected outcome.
For choice B (1 pt) and C (0 pt), the outcome was higher than
expected. This problem tested the students’ ability to solve
multi-step quantitative problems related to chemical kinetics.
It requires recognition of a specific problem type,
interpretation and application of tabulated data, and
knowledge of discipline-specific terminology.
Question #21 on the exam tested learning outcomes #2 and
5: 34.8% of students scored 3, 21.7% scored 2, 20.7% scored
1, and 22.8% scored 0. The percentage of students who chose
the correct answer was higher than expected. Scores of 2 and
1 were lower than expected, but a score of 0 was much higher
than expected. This problem tested the students’ ability to
solve multi-step quantitative problems related to chemical
equilibrium. It requires recognition of a specific problem type,
knowledge of discipline-specific terminology, and application
of knowledge gained from the prior course, CH-151
(dissociation of ionic compounds).
Question #27 on the exam tested learning outcomes #1, 2,
and 6: 34.8% of students scored 3, 26.1% scored 1 (19.6% +
6.5%) and 39.1% scored 0. The result for the highest score
was greater than the expected outcome. In total, the result
for a score of 1 was about the same as expected, but did not
match the expectation for each individual choice. (See table
8a.) The result for a score of 0 was less than expected, though
still quite high. This problem tested the students’ ability to
apply conceptual and mathematical/algebraic approaches to
solving a problem that involves the relationship between
equilibrium and thermodynamics.
15
CH-152 Fall 2012 Course assessment




Objectives #1, 2, 5, 6, 7 in Table
5 and Gen Ed Objective #3.
Learning outcome 2 is
associated with Curricular
Objectives #1, 2, 4, 5, 6, 7 in
Table 5 and Gen Ed Objective
#2, 3.
Learning outcome 3 is
associated with Curricular
Objectives #3, 4, 6 in Table 5
and Gen Ed Objective #2
Learning outcomes 4, 5 are
associated with Curricular
Objectives #1, 2, 4, 5, 6, 7 in
Table 5 and Gen Ed Objective
#3.
Learning outcomes 6, 7, 8 are
associated with Curricular
Objectives #1, 3, 4, 6, in Table 5
and Gen Ed Objective #2, 3.
Prepared by Moni Chauhan, David Sarno and Jun Shin
Question #30 on the exam tested learning outcome #2 and 7:
35.9% of students scored 3, 33.7% (16.3% + 17.4%) scored 1,
and 30.4% scored 0. The result for the highest score was
much lower than the expected outcome. Results for a score of
1 or 0 were higher than expected. This problem tested the
students’ knowledge of chemical equilibrium, their ability to
apply LeChatelier’s Principle. It also required application of
knowledge gained from the prior course, CH-151 (dissociation
of ionic compounds).
Question #33 on the exam tested learning outcomes #1, 3,
and 8: 43.5% of students scored 3, and 33.7% scored 2, both
higher than the expected outcomes. 19.8% (6.5% + 16.3%)
scored 1. None of the choices were assigned a value of 0
because they could all be justified as “partially” correct (see
Table 9, Section A). The results for a score of 1 were both
lower than expected. This problem tested the students’ ability
to solve qualitative problems in chemistry by interpreting
visual models and applying them to the concept of acid
strength.
TABLE 9. EVALUATION AND RESULTING ACTION PLAN
In the table below, or in a separate attachment, interpret and evaluate the assessment
results, and describe the actions to be taken as a result of the assessment. In the
evaluation of achievement, take into account student success in demonstrating the types
of knowledge and the cognitive processes identified in the Course Objectives.
A. Analysis and interpretation of assessment results:
What does this show about what and how the students learned?
Question #7: This question asks students to determine the order of a reaction in terms of a
specific reactant. The balanced equation and an appropriate data table are provided. To solve
this problem, the students must analyze the data and then perform a specific sequence of
steps. The most commonly chosen incorrect answer could be indicative of two things. The
simplest explanation is that the students did not recognize the type of problem or if they did,
simply could not solve it. However, considering that this is a very common type of problem,
another likely possibility is that the students did not read the question carefully and determined
the order of the entire reaction, rather than just in terms of the particular reactant. This could
account for the unexpectedly high number of students who chose this answer. Further,
students who chose this response could have actually reduced the number of students who
picked the correct answer. In other words, they may have known how to solve this type of the
problem, but did not solve the actual problem that was asked. Finally, the relatively high
16
CH-152 Fall 2012 Course assessment
Prepared by Moni Chauhan, David Sarno and Jun Shin
percentage of students who picked choice A confirms that students continue to mistake the
coefficients of a chemical equation for its order with respect to reaction kinetics. Choice C was
chosen least often and suggests that those students did not understand the problem or simply
could not solve it.
Question #21: This question asks students to determine the solubility of a slightly soluble salt. It
requires students to have knowledge of chemical equilibrium and dissociation of ionic
compounds. The calculation is very typical of this kind of problem and the question is very
direct. The actual outcome for the correct choice was slightly higher than our predicted
outcome and suggested that these students were able to successfully dissociate the salt into its
ions, properly solve for the equilibrium concentrations, and correctly apply the terminology to
understand that the equilibrium concentration is equivalent to the molar solubility.
Approximately 22% of the students solved this problem nearly completely, but appeared to
have stopped before the last step of the calculation (choice A). It is possible that when those
students were performing their calculations, they simply saw this value as one of their choices
and decided the problem had been solved. More important is that nearly 22% picked choice D
which they would obtain by incorrectly dissociating the salt into its ions. This particular mistake
frequently occurs in this topic, which is first introduced in CH-151, taken prior to this course. It
shows that these students either do not fully understand how ions combine or dissociate to
form neutral ionic compounds, or are still having difficulty interpreting chemical formulas and
equations.
Question #27: This question requires students to make several connections between concepts
of thermodynamics (enthalpy, entropy, and free energy) and equilibrium. It also requires them
to recall key thermodynamic equations (ΔG = ΔH–TΔS and ΔG = –RTlnK). Since no numerical
values are given, there is no calculation to be performed. Instead, this problem can be solved by
considering algebraic relationships among the variables; by considering the physical
interpretation of the information given; or by simply memorizing a few basic relationships
(often summarized on charts in textbooks). This problem was made more complicated because
the four choices had to be compared to each other to answer the question. Two of the choices
would give a “large” equilibrium constant, but the question asked for the “largest”. Considered
separately, choice A and choice D could both give a “large” equilibrium constant. More students
picked choice A than D, but there does not seem to be any reason, except perhaps that the
word “positive” used with the enthalpy and entropy was mistakenly thought to correlate to a
“large” equilibrium constant, and “negative” with a “small” constant. That many more students
picked the correct answer to this problem shows higher-order thinking in connecting several
physical and chemical concepts with the mathematics used to describe them (or perhaps strong
recall skills, as suggested above). Most students picked the response worth zero points. This
could be interpreted as the students having no understanding of the problem or how to
approach it. However, since it is a two-step (or two-concept) problem, it could be that some
students in this group correctly understood the first part, but not the second.
Question #30: This problem requires students to apply LeChatelier’s Principle by asking what
kind of change would shift the equilibrium in the forward direction. Most of the students picked
17
CH-152 Fall 2012 Course assessment
Prepared by Moni Chauhan, David Sarno and Jun Shin
the correct choice, which tested two concepts. First, they had to understand how the given
compound dissociates when dissolved in water and second, they had to correctly determine
how it would affect the equilibrium. The two choices worth only one point each were based on
the same kind of “mistake” in reasoning and these were picked by the fewest number of
students. A surprisingly high number of students incorrectly chose “addition of a catalyst”,
which they should know affects the kinetics of a reaction, but not its equilibrium position.
Question #33: This question uses visual models for the interpretation of acid strength based on
ionization in water. It requires students to not only understand the concepts, but also compare
the diagrams and discover the patterns they contain so that they can be ranked. Most students
correctly answered this question, suggesting that the diagrams clearly depicted the ionization
phenomenon and the students knew greater ionization equals greater acid strength. The next
largest group of students ranked them in reverse order. This frequently occurs with ranking
problems and suggests that the students recognize the pattern and can rank them from “most
to least”, but not necessarily in terms of the concept being tested. Smaller numbers of students
picked seemingly random rankings, though it could be argued that in both cases, they correctly
ranked two of the three acids.
B. Evaluation of the assessment process:
What do the results suggest about how well the assignment and the assessment process worked
both to help students learn and to show what they have learned?
This particular assignment is given at the end of the course. Its purpose is to show what
students have learned with respect to several fundamental chemical concepts that they will
need to use in subsequent classes. The evaluation of the outcomes will be discussed with the
members of the department to improve learning in the desired areas. This assessment will be
repeated in subsequent semesters, and the collected data will be evaluated over time.
The questions are written in very simple straightforward sentences. There is little to distract
and little to misinterpret. The multiple choice answers give the correct response plus responses
that anticipate the most commonly made errors. Questions #7 and #21 require a logical and
widely applicable sequence of steps to arrive at the correct answer. They also require an
understanding of quantitative relationships including simple algebra, ratios, and multistep
calculations. Rote memorization is only useful to a limited extent in question #27. Question #33
assesses the students’ ability to interpret simple visual models in the context of key chemical
concepts. This is a critical skill in chemistry since the phenomena discussed are frequently based
on the behavior of particles that cannot be seen. Thus various 2D and 3D models and
interpretations are necessary.
These questions were well chosen because several of them can only be answered after the
student has compared all of the choices to each other. Further, some of them require higherorder thinking by connecting two or more concepts. However, because it was a multiple choice
exam, when students chose the wrong answer, it was hard to tell if their choices were based on
a certain type of mistake or misconception, or if they were simply random choices. This made
18
CH-152 Fall 2012 Course assessment
Prepared by Moni Chauhan, David Sarno and Jun Shin
interpretation of the data more difficult. Future versions of this assessment may be improved
by using questions whose incorrect choices can be unambiguously correlated to a single error.
C. Resulting action plan:
Based on A and B, what changes, if any, do you anticipate making?
Question #7: Based on the data provided, there is only one correct way to solve this problem,
and it is typically taught as a specific sequence of steps. We therefore expected a higher
percentage of students to solve it correctly. Looking more closely at the results, we have
realized that the simplest explanation for the most frequently chosen (incorrect) answer was
that the question was simply misread. It is possible that many students determined the order of
the entire reaction (2nd order), rather than the order in terms of the particular reactant (1 st
order). There is nothing wrong with its wording. However, when students see the same
question too frequently, they may begin to ignore the details. As a result, when something has
changed, it may go unnoticed. In this case, they may have correctly determined the answer, but
then went on to unnecessarily perform additional steps that commonly follow. By
deconstructing the steps the students perform and by asking different questions based on the
same given data, it may be possible to prevent students from becoming too comfortable. This
should encourage them to make sure they are answering the actual question and not the
question they think they have been asked. This can be accomplished in class and also with
homework assignments.
Question #21: As noted in Section B, the most likely error that occurs in this type of problem is
that the students do not correctly figure out how to dissociate the salt into its ions. Those that
can properly do this are typically able to solve this kind of “entry-level” solubility problem.
However, “AB2” salts are often dissociated into A+ and B2–, instead of A+2 and 2B–, for example.
Though the rest of the calculation may be performed correctly, it begins with an incorrect
premise and leads to an incorrect result. The only way that students’ understanding of this
concept will improve is with exposure and practice. It can be practiced and applied at several
points in CH-151 and it should be reviewed again when solubility equilibria are introduced in
CH-152. Students should especially be encouraged to write complete chemical equations for
every problem they encounter, both in class and on homework assignments.
Question #27: This problem ties together many aspects of thermodynamics and relates it back
to equilibrium. Most students will probably approach it from a purely algebraic standpoint,
trying to figure out how the signs of ΔH and ΔS determine the sign of ΔG and how that is
subsequently related to the equilibrium constant. To do this, they must have memorized the
relevant equations, which is certainly possible given sufficient practice. However, students will
likely perform better on this kind of question if they are able to understand the physical
significance of the magnitudes and signs of equilibrium constants and thermodynamic
quantities. This will reduce the errors made, for example, if a student leaves out the negative
sign in an equation like ΔG = – RTlnK. And in addition to thinking solely in terms of positive and
negative values for ΔH and ΔS (algebraic approach), students should be encouraged to think
about whether an exothermic reaction or an increase in entropy is typically favorable or
19
CH-152 Fall 2012 Course assessment
Prepared by Moni Chauhan, David Sarno and Jun Shin
unfavorable with respect to spontaneity. Simple, relatable events (reactions) such as
combustion, splitting water, or reactions of nitrogen and oxygen in air can provide
opportunities to calculate and then interpret physical values. Students can then be asked if
their results make sense based on their experiences.
Question #30: This problem requires the application of LeChatelier’s Principle to determine
how the formation of a product may be increased if a reaction is at equilibrium. Most students
answered correctly and relatively small percentages picked choices that would favor the
reverse reaction. However, many students also said that the addition of a catalyst would
increase the concentration of the product by shifting the equilibrium to the right. By offering
this as one of the possible answers to the question, it probably reduced the number of those
who chose correctly. Students know that a catalyst will increase the reaction rate, but they
often mistakenly believe that forming a product more quickly is equivalent to forming more
product overall. Further, they may not know or recall that a catalyst increases the rate in both
directions for a reversible reaction, so it will not affect the equilibrium position. Other than
being sure that students clearly understand the basic properties of catalysts, there is little more
that can be done to improve the outcome on this question. More broadly, however, instruction
in LeChatelier’s Principle could be improved by posing questions that involve more than the
direct addition or removal of one of the species in the chemical equation. As noted in the
analysis of question #7, students may get too comfortable when they always answer the same
question. By posing more complex examples, such as the addition of species to cause reactions
that will add or remove reactants or products, students will be encouraged to consider cause
and effect. This will also serve to better prepare them to understand the common-ion effect
and buffers, which are both based upon LeChatelier’s Principle.
Question #33: It is enormously useful to be able to visualize chemical concepts and
phenomena. In this problem, the concept of acid strength and acid ionization are linked to
visual models. It is notable that relatively few students ranked the diagrams out of order, while
nearly 44% correctly ranked them and 34% put them in reverse order. This suggests that most
students were able to discern the pattern. In this case, therefore, interpretation of the
diagrams does not appear to be the problem. Rather, the relationship between ionization and
acid strength may not be well understood. This is a fundamental concept that can easily be
overlooked in favor of performing calculations. More qualitative or descriptive questions could
be asked in class to probe students’ understanding, both before and after introducing more
typical calculation-based problems.
Our analysis and our experience indicates that students often favor learning how to solve
specific problems over understanding why they are set up as they are, how to interpret their
results, how to make predictions, etc. Unfortunately, such an approach results in students
who cannot proceed when confronted with unfamiliar problems or scenarios. It is up to the
instructors to find a balance between mechanical problem solving and actual critical thinking.
Overall, for students to improve in the areas assessed, the course coordinators recommend
practice (in and out of class) and exposure to a wider variety of problems. This should be
coupled with an effort to demonstrate how the math is connected to the concepts. A synopsis
20
CH-152 Fall 2012 Course assessment
Prepared by Moni Chauhan, David Sarno and Jun Shin
of our findings, plus a bulleted action plan will be distributed to the instructors who will be
urged to act on the results and recommendations.
21
Download