Flash Five Assessment Plans and Results Cohorts #1 and #2

advertisement
Flash Five Assessment
Plans and Results
Cohorts #1 and #2
Biology Teaching and Learning
Option 1 Discipline Outcomes
NASA scientists have recently sent an independently acting robotic probe (named
Curiosity by a 12 yo. girl from Lenexa, KS) to Mars in hopes that it may uncover
important geological and chemical clues for the existence of life, both past and/or
present.
Curiosity is equipped with an onboard “state of the art” analytical chemistry lab
and is capable of sending the data it collects back to Earth’s scientists by way of
radio transmission. From a biologist’s perspective, describe what specific
biochemical evidence the probe is “looking for” that would support or prove that
life has or presently exists on Mars.
Proposed Rubric
1.
Minimal or no discussion of biological chemistry i.e. the student
does not discuss organic compounds found in living systems or
cells or cell theory at all.
2.
Some discussion of organic chemistry as it relates to life’s
processes (i.e. the top four elements: C, H, O, N), or the presence
of DNA. Or mentioning radiometric dating and/or fossil formation
and/or the mention of cells, bacteria, or organisms.
3.
Continued discussion and elaboration of more advanced organic
chemistry such as monomers  polymers e.g. carbohydrates,
phospholipids, proteins, and nucleic acids, and/or their respective
roles in cells.
Complete reiteration of cell theory, and/or the idea of selfreplicating system and/or list of things all cells contain, e.g. plasma
membrane, cytoplasm, DNA, RNA, ribosomes. Qualities of life
like movement, reproduction, growth, respond to stimuli, etc…
4.
5.
Exemplary discussion of all of the previous criteria with additional
details of biological concepts, such as: prokaryote vs. eukaryote,
endosymbiotic theory, cell wall composition, classification of life
into domains and/or kingdoms, and RNA world hypothesis,
metabolism, etc…
Option 2 Discipline Outcomes
• A characteristic of all living things is that they
a.
b.
c.
d.
Arise from pre-existing life
Require oxygen
Be able to learn
a and b are correct
• The primary source of energy for most life on
earth is
a.
b.
c.
d.
Food
Water
ATP
The sun
Option 1 Gen Ed Outcome
Algae were grown in two aquariums—aquarium A without
herbivores and aquarium B with herbivores. The dry weights
of living algae and herbivores were determined at the start of
the experiment (day 1) and again five days later (day 6);
weights of dead algae and herbivores were ignored. The
results of this experiment are given in the following table:
Day
Aquarium A
Aquarium B
Algea (g)
Algae (g)
Herbivore (g)
1
0.5
0.5
0.1
6
0.7
0.6
0.2
Which of the following is the best
interpretation?
a. The algae produced the same amount of
biomass in aquarium A and B
b. The algae produced more biomass in
aquarium B, but most was eaten
c. The algae produced more biomass in
aquarium A, but most algae died
d. The data cannot be correct as presented
e. The data may be correct, but they do not show
in which aquarium the algae produced the
most biomass.
Option 2 GenEd Outcome
• Adapted from Sieberg, Jennifer Lynn. Measuring
Experimental Design Ability: A Test to Probe Critical
Thinking. MS Thesis Bowling Green University. Bowling
Green OH. 2008
• “Thousands of years ago ancient healers trusted apple
cider vinegar, and modern research shows – vinegar truly
is a wonder cure! In fact, apple cider vinegar’s biggest
fans believe this golden liquid can help solve the most
troublesome of human afflictions. Since even the earliest
of times, a daily vinegar cocktail was used to help control
appetite to lose weight and continue good health.”
• Design an experiment that would determine the scientific
validity of this statement.
1.
2.
3.
4.
5.
6.
Recognition that an experiment can be done to test the claim
(vs. simply reading the product label).
Identification of what variable is manipulated (independent
variable is ginseng vs. something else).
Identification of what variable is measured (e.g., how far
subjects run will be measure of endurance).
Description of how dependent variable is measured (e.g., how
far subjects run will be measure of endurance).
Realization that there is one other variable that must be held
constant (vs. no mention).
Realization that there are many variables that must be
held constant (vs. only one or no mention).
7. Understanding that the larger the sample size or number
of subjects, the better the data.
8. Understanding that the experiment needs to be
repeated.
9. Understanding of the placebo effect (subjects do not
know if they were given ginseng or a sugar pill).
10. Awareness that one can never prove a hypothesis, that
one can never be 100% sure, that there might be
another experiment that could be done that would
disprove the hypothesis, that there are possible sources
of error, that there are limits to generalizing the
conclusions (credit for any of these).
Economics – Cohort #1
Hossein Bahmaie – LV
Jill Kingsbury - MW
The student will be able to:
1.
Define scarcity and explain the implications for the allocation of resources and
decision making by individuals, firms, and the government.
2.
Describe how a market works and employ the market model to explain how price is
determined.
3.
4.
5.

Access and apply information on macroeconomic variables and the business cycle
including Gross Domestic Product, Unemployment, and Inflation. In addition, the
student will be able to evaluate the accuracy and credibility of each measurement.
Explain the functions and types of money. The student will also be able to
demonstrate knowledge of how commercial banks work, how money is created, and
how interest rates are determined.
Describe the four components of aggregate demand and explain the significance of
each component for the national economy.
General Education Outcome – Information Literacy/Critical Thinking
Method -
Three multiple choice questions were given to
Macroeconomic Students on the Second Exam
during the Spring 2012 Semester by full-time
faculty.
◦ Note: The same assessment tool was used to assess both the
Discipline Outcome (#3; see below) and the General Education
Outcome (Information Literacy/Critical Thinking)
3.
Access and apply information on macroeconomic variables and the
business cycle including Gross Domestic Product, Unemployment, and
Inflation. In addition, the student will be able to evaluate the accuracy and
credibility of each measurement.
Table B
Categories
Population
Numbers
310,000,000
People younger than 16 years
89,400,000
Retired
45,500,000
Disabled under 65 years
13,700,000
Number of employed
141,900,000
Institutionalized people
Number of unemployed
Noninstitutional adult
population
4,700,000
14,800,000
215,900,000
Table of Data Provided
Based on the data in Table B, what is
the employment-population ratio?
A. 65.7%
B. 69.6%
C. 45.8%
D. 152.1%
Based on the data in Table B, what is
the unemployment rate?
A. 9.4%
B. 9.05%
C. 28.8%
D. 10.4%
Based on the data in Table B, what is
the size of the labor force?
A. 156,700,000
B. 169,500
C. 154,700,000
D. 152,000,000
Multiple Choice Questions

Total Classes Assessed = 5

Total Students Assessed = 130

First Question Answered Correctly – 55 or 42%

Second Question Answered Correctly –78 or 60%

Third Question Answered Correctly –114 or 88%
◦ Kingsbury (4); Bahmaie (1)
◦ Kingsbury (91); Bahmaie (39)
◦ Kingsbury (37 or 41%); Bahmaie (18 or 46%)
◦ Kingsbury (60 or 66%); Bahmaie (18 or 46%)
◦ Kingsbury (88 or 97%); Bahmaie (26 or 67%)
Method of Determining
Discipline Outcomes





Accreditation Board for Engineering &
Technology (ABET)
Outcomes are keyed to measurement tools in
a specific course or courses
Relationship with UMKC Civil & Mechanical
Engineering
Examined Mechanical Engineering Outcomes
Selected four outcomes that can be
measured in the first two years
Outcomes
Design a system, component, or process to meet
desired needs within realistic constraints such as
economic, environmental, social, political, ethical,
health and safety, manufacturability, and
sustainability. (ENGR 113)
2.
Apply knowledge of mathematics, science, and
engineering to solve engineering problems. (ENGR
229)
3.
Use the techniques, skills and modern engineering
tools necessary for engineering practice to model
physical phenomena. (ENGR 223)
4.
Express knowledge of contemporary issues. (ENGR
101)
General education outcome: Communications measured
in ENGR 113 using a modification of an existing rubric.
1.
Measuring Outcomes #2 & #4
o
For #2, 10 multiple choice questions added to
ENGR 229 final. Questions were drawn from a
set of FE (fundamentals of engineering)
review questions – will help students be better
prepared for this exam
o
For #4, a new requirement was added to the
ENGR 101 semester research paper. The
students must present data from at least one
source related to modern challenges that
engineers face in the area of research and
should include a discussion of how that issue
affects the student’s career plan
Recommendations for
General Education Outcome
 Make
a few sections on the rubric clearer.
 Give a time limit on the presentation
 Enforce the requirement that each
student present an equal amount of time.
Recommendations for #4




The current example essay does not contain a
Contemporary Issues section because this is the first
semester where it was required. Replace the current
example essay with a good paper from this semester.
The assignment document only explains the
Contemporary Issues at the end of the document
where the metric is explained. Explain the
requirement earlier in the document.
The video that explains the assignment was filmed
before this requirement. Update the video or add a
supplemental video.
24% of the passing students did not attempt this
particular assignment. Use a second metric to for
those students.
Foreign Language Assessment Project
What do we want to know?
• By the end of 101, do first time language
students perform at the Intermediate-Low level
(as determined by American Council for
Teachers of Foreign Languages) for writing?
▫ Accurately uses formulaic phrases
▫ Can supply basic personal info
▫ Can write on less familiar topics but with less
accuracy
Foreign Language Assessment Project
What do we want to know?
• By the end of 101 do first time language students
meet the gen ed Communications outcome: The
student will be able to use receptive and productive
skills to interpret, synthesize, and integrate ideas of
others and their own to communicate?
• Productive Skills – The student will be able to
organize material coherently into a meaningful
whole.
Foreign Language Assessment Project
How will we assess our students?
•
•
•
•
Writing assignment already part of class
Administered in Spanish, French and German
All have a common assignment sheet
Full-time faculty team up to evaluate writing
samples
Foreign Language Assessment Project
What has been done thus far?
• Administered Spring 2012
• Faculty have met to evaluate writing samples
Foreign Language Assessment Project
Where do we go from here?
• Gather full-time faculty together in the fall to go
over results
• Revise curriculum to better reflect National
Standards
PHYSICS DISCIPLINE’S COHORT WORK
Fall 2011 Semester:
• Determine 3-5 Physics Discipline outcomes:
Analyze physical phenomena by correctly applying relevant
conservation laws.
Analyze physical phenomena by correctly applying Newton’s
Laws.
Given an experimental scenario, critique the method and results
based on accepted scientific methods and principals.
Relate course topics to personal experience and societal and
environmental issues.
PHYSICS DISCIPLINE’S COHORT WORK
Fall 2011 Semester:
•
Choose 1 Discipline Outcome to
measure and adapt an
assessment tool
Analyze physical
phenomena by correctly
applying Newton’s Laws.
Assessed in all classes
using 10 common
embedded exam
questions from the Force
Concept Inventory.
10. In the figure, student “a” has a mass of 95 kg and student “b” has a mass of 77 kg. They sit in
identical office chairs facing each other. Student “a” places his bare feet on the knees of student “b”, as
shown. Student “a” then suddenly pushes outward with his feet causing both chairs to move.
During the push while the students are still touching each other:
A. Neither student exerts a force on the other.
B. Student “a” exerts a force on student “b”, but “b” does not exert any force on “a”.
C. Each student exerts a force on the other, but “b” exerts a larger force.
D. Each student exerts a force on the other, but “a” exerts a larger force.
E. Each student exerts the same amount of force on the other.
PHYSICS DISCIPLINE’S COHORT WORK
 Choose 1 General Education Outcome Attribute to measure and create an
assessment tool
 General Education Outcome Attribute:
Information Literacy:
(4) Interpret and apply quantitative and/or qualitative
information embedded in text, real-life situations, tables, or
graphs to analyze complex situations and/or solve
quantitative or qualitative problems.
 Assessed in all classes by embedded Inverse Square Law
prompt created by Physics Faculty
 Scored by the Physics Faculty using the Common Rubric
PHYSICS DISCIPLINE COHORT WORK
Spring 2012 Semester:
• Administered the 2 chosen assessments
Fall 2012 Semester:
• Analyze results with IR and DACC
• Determine Interventions and next
Assessments
• We would also like to give these same
assessments again.
Inverse Square Law Question:
Earth is the 3rd planet from our Sun at a distance of about 1.50 x
1011 m. Earth has a mass, MEarth, of approximately 6.0 x 1024 kg
and a radius, REarth, of about 6,400,000 m. At Earth’s surface, a
body’s weight can be calculated simply by multiplying the body’s
mass, mbody, by acceleration due to gravity at Earth’s surface, g,
which is approximately 9.8 m/s2. However, to find the gravitational
force exerted by Earth on a body at substantially larger distances
from Earth’s surface, one would need to use Newton’s Universal Law
𝐺𝑀𝐸𝑎𝑟𝑡ℎ 𝑚𝑏𝑜𝑑𝑦
of Gravitation, 𝐹 =
, where r represents the distance
𝑟2
from the center of Earth to the center of the other body. If the
Universal Gravitational Constant, G, is 6.67 x 10-11 N-m2/kg2.
PART I. Calculate the force of gravity on a 65-kg person in the following
circumstances:
At the surface of the Earth (Show all your work.)
At twice the Earth’s radius (Show all your work.)
At four times Earth’s radius (Show all your work.)
Discipline
Outcomes
Assessment
PART II. Choose the Force verses distance graph below that best
represents the gravitational force exerted by Earth on the 65-kg
person at distances ranging from Earth’s surface to larger and larger
distances from Earth and explain why you chose that particular
graph. (Note that Force (in Newtons) exerted on the person by Earth
is on the vertical axis and distance (in meters) from the center of the
Earth to the person is on the horizontal axis. Neglect the
gravitational effects of all other bodies including the Sun, Moon, and
other planets.)
Graph C
800
600
Improvement of
Student Learning
400
Force
(Newtons)
200
0
0
100000000
200000000
Distance from the center of Earth to the person (meters)
an·thro·pol·o·gy n. the science of humans
concerned with the origins, physical and
cultural development, biological
characteristics, and social customs and beliefs
of humankind.
Melissa Eaton
ANTH Discipline Outcomes
 Construct narratives of cultures based on
anthropological data and theories.
 Discuss the methods by which humans adapt
to various environments.
 Explain the importance of cultural relativity in
the study and evaluation of cultures.
 USE THE SCIENTIFIC METHOD OF INQUIRY TO
SOLVE PROBLEMS RELATED TO
ANTHROPOLOGY.
 Evaluate the methods and perspectives of
anthropology that contribute to applied
science.
ANTH Assessment Plan: Fall 2012
 General Education Learning Outcome:
 Information Literacy

(4) Interpret and apply quantitative and/or qualitative
information embedded in text, real-life situations, tables, or
graphs to analyze complex situations and/or solve
quantitative or qualitative problems.
 Discipline Learning Outcome:
 Use the scientific method of inquiry to solve problems
related to anthropology.
 Both learning outcomes will be studied using a single
exercise in all ANTH classes on all campuses.
ANTH Assessment “Artifact”
 Mortuary analysis, similar to exercises used in
Price’s Principles of Archaeology (2007).
 After reading a brief introductory paragraph,
students will use data from a table describing
mortuary information to make conclusions about:

Demographics, health indicators, pathology, burial customs,
social stratification, gender roles, division of labor, belief
systems, technology, subsistence, etc.
 Pertains to cultural and biological information
learned in all anthropology classes.
Gathering and Analyzing Information
 For seated classes, multiple choice questions related
to a descriptive paragraph and data table shall be
embedded in a scheduled exam.
 For online classes, an independent assignment using
the same data will be administered.
 No grading rubric is necessary.
 The anthropology discipline will be able to assess the
current instruction and retention of information
pertaining to the scientific method and the
interpretation of data based on demographics,
number of credit hours completed, GPA and Compass
scores, hours completed in related disciplines (SOCI,
SOSC, GEOG), and modes of delivery (“seated”,
online, WI, learning community).
Outcomes and Student
Learning
Chemistry
General Outcome
• We will assess Criteria #1
• Critical thinking
Discipline Outcome
• Use Atomic and Molecular theory
• Carry out math calculations/relationships
• Write formulae, balanced equations,
Chemical Names and terms
• Assess validity of data, measurements
Status
• 9 questions were developed covering the
3 main areas of Chem 105.
General/Organic/Biochem
• Questions increased in difficulty for each
area
• Questions were imbedded into Sp 2012
Final exam in 4 MW classes (94 exams)
Results and Future Work
• Only 3 Questions were found to be valid.
• Huge variation in the way material is
covered and learned.
• Rewrite Exam questions….special
attention to verbage. Retest Su 2012
• Issue Essentials list, sample exams, and
imbedded questions to all F12 105 Faculty
GEOLOGY/GEOGRAPHY
PROGRAM
ASSESSMENT
GEOLOGY DISCIPLINE OUTCOMES
Students will be able to:
1. describe and explain the evidence leading to the Theory of
Plate Tectonics and its relationships to earthquakes, volcanoes, mountain
building, and surficial processes.
2. describe the interactions between the lithosphere, atmosphere,
hydrosphere, and biosphere.
3. describe the processes by which rocks are formed and explain
how they are classified.
GENERAL EDUCATION OUTCOMES
INFORMATION LITERACY
The student will be able to:
Interpret and apply quantitative and/or qualitative information embedded
in text, real-life situations, tables, or graphs to analyze complex situations
and/or solve quantitative or qualitative problems.
The map is of an area in southern Indiana. The region receives approximately
40” of rainfall annually and is underlain by sedimentary rock. The landscape
is dominated by numerous dissolution features. With the information provided
and by using the map, answer the following questions.
Multiple Choice Questions
1. In the northwest portion of the map are numerous
hachured contour lines. What do they represent?
2. Considering the abundance of these features and the quarry,
what is the likely type of bedrock found in the subsurface?
3. Along Goose Creek is a trout fish hatchery. Trout require clear,
clean cool water to survive. Why is this a good locality for the
hatchery?
4. Dark Hollow (creek), north of the Experiment Farm flows to
the ___________ (general direction).
5. What type of weathering is most responsible for the irregular
landscape found in the western portion of the map?
Multiple Choice
1. Which of the following sequences
correctly represents the relative age
of earth’s crust (from oldest to
youngest)?
2. A divergent boundary occurs at
location ___ whereas a convergent
margin occurs at ___.
3. Earthquake depth is typically
shallowest along areas of tectonic
plate ___________________
(convergence or divergence)?
4. Which of the following best
represents the following
compositions of crustal rock?
5. The subduction of the upper mantle
and the oceanic crust at location 8 is
primarily due to:
Assessing the “Miracle”: History
Discipline Cohort Work
History Discipline Outcomes
#1. Analyze and contrast the experiences of distinct groups of people during specific historical periods.
#2 Identify and explain the spectrum of political theories and principles in a particular historical period
or civilization.
#3 Employ primary source documents to demonstrate the historical method of inquiry.
History Assessment Rubric
History Assessment Rubric
History Discipline Outcome #1 “Analyze and contrast the experiences of distinct groups of people during
specific historical periods.”
Attribute
Adequate to the level of the
course
Analysis
Describes the experiences of
different groups participating in
a historical event
Comparison
Applies the relevant historical
theories, themes, ideas,
understanding or historical
context to explain similarities
and/or differences in (or
meaning of) those experiences.
Select one box for Analysis and one for comparison
Inadequate to the level of the
course
General Education Outcome to be
Assessed: Communication
• Organize material into a meaningful whole
Assessment to be done by all FT
faculty on the campuses Fall 2012
History 120 Assessment Question
Antebellum Southern society traditionally was described as a backwards slave society,
resistant to change of any kind. Yet we now know that while slavery was the dominant
feature of Southern culture, many areas of the Antebellum South experienced dynamic
change between 1815 and 1865. Explain the importance of chattel slavery to, and impact
on, each of the following groups: wealthy slave owning gentry, other slave owners, yeoman
farmers, urban inhabitants, poor white, and African Americans.
History 121 Assessment Question
Author James Baldwin said the civil rights movement challenged the United States to
rethink “what it really means by freedom.” This assertion could include whether freedom
applies to all Americans, from every ethnic, religious, age and gender group. Between 1933
and 1975 how was freedom defined by each of the following groups? To what extent did
each achieve equal rights with the rest of traditional white, male American society?
a. African Americans
b. Women
c. Hispanic Americans
d. Students aged 18-25
e. Elderly citizens
f. Gays and lesbians
Philosophy
Assessment Plans
Spring 2012
MCCKC
Final report to the DACC
20 July 2012
Philosophy course offerings
most closely fit the Critical
Thinking outcome under the
General Education Outcomes
• We propose that philosophy course work assess outcome 3
of the General education outcomes, which states,
“Defend conclusions using relevant evidence and
relevant scientific, mathematical, logical, or other
formal disciplinary argument(s).”
To reach this outcome, we offer
the following Discipline
Outcomes
• Demonstrate critical thinking ability by:
• 1. Identifying the premises and conclusion of an argument.
2. Evaluating the acceptability of the premises of a given
argument.
3. Evaluating the relevance of the premises of a given
argument to its conclusion.
4. Evaluating and constructing arguments with adequate
grounds, thereby showing the conclusion to be more
probable or plausible than not.
5. Applying defensible reasoning in the evaluation of
traditional and contemporary philosophical arguments, as
well as those found in non-philosophical writing.
To assess this outcome, we
propose the following
• We will embed an assessment question in either an
examination or a writing assignment.
• Assessment will be made according to the rubric to follow.
These will probably be questions about inductive arguments,
but they may also use deductive, abductive, or causal
arguments with the rubric.
• We have provided sample questions that might be used, or
instructors may choose to use questions that may be assessed
using the same rubric.
• We further propose that instructors embed this this question
in time to have the raw data to bring to the October 16 Inservice, when we will use our discipline meeting time to work
on standardizing grading of the assessments.
Proposed Grading Rubric for
Philosophy Assessment
EXEMPLARY
4
MEETS
EXPECTATIONS
3
DEVELOPING
2
NOT YET
1
Thesis/verdict
The student presents a clear statement of
their thesis/verdict on the argument.
The student’s thesis/verdict is obvious,
but there is no single clear statement of
it.
The thesis/verdict is present, but
must be reconstructed from the text
of the paper.
There is no thesis/verdict on the
argument.
Evaluation of the
premises
The support offered for the premises is
clearly and sufficiently explained, and,
where appropriate, illustrated with
relevant examples. Criticisms of the
premises meet the same conditions.
The support for the premises is present,
as are the criticisms. However, support
and/or criticisms are missing some detail
and/or illustrative examples.
Either (i) some support for or
criticisms of the premises must be
reconstructed from the text of the
paper, or (ii) some main line of
support for or criticism of a premise
is absent.
There is no clear statement of the
support for or criticisms of the
premises.
Evaluation of the
inference from
premises to
conclusion
The argument is clearly and correctly
shown to be either (i) deductively valid,
(ii) deductively invalid, (iv) inductively
strong, (v) inductively weak, or (vi)
otherwise such that the premises have no
bearing on the conclusion.
The argument is shown to meet one of
conditions (i)-(vi). However, the
explanation or demonstration of this fact
is missing important detail.
The argument is stated to meet one
of conditions (i)-(vi). However, the
explanation or demonstration of this
fact is absent.
The inference from premises to
conclusion is left unevaluated.
Consideration of
objections and
replies
The student considers obvious objections
or opposing positions, and possibly less
obvious ones as well. The student also
offers thoughtful and original responses.
The student considers the obvious
objections or opposing positions, and
offers standard responses.
Some obvious objections, opposing
positions, or responses thereto are
absent or inadequately developed.
No objections or opposing positions
are considered.
Kim Glackin; Matthew Westra; Julie Bishop;
Angela Bahner; Cebra Sims; Susan Benoit;
Bob Williams; Monica Gimenez;

Determine Discipline Outcomes for Psychology
◦ APA Goal 1: Knowledge Base of Psychology
 Suggested learning outcomes
 Students will learn the nature of psychology as a discipline
 Students will use the concepts, language, and major
theories of the discipline to account for psychological
phenomena
 Students will learn major perspectives of psychology
 Students will evaluate the quality of information; identify
and evaluate the source, context, and credibility of
behavioral claims; challenge claims that arise from myths,
stereotype, or untested assumptions; evaluate popular
media reports of psychological research and make linkages
or connections between diverse facts, theories and
observations.

Seven questions were compiled to assess
student understanding of knowledge base of
psychology
◦ 1 A major premise underlying psychoanalytic or psychodynamic theories of personality is that
_____
◦ 2.Kathy was in a car accident and sustained a significant brain injury. Although she recovered
most of her brain functions, she continues to have difficulty in planning day to day activities
and is often socially inappropriate. The accident likely damaged which lobe in Kathy’s brain?
◦ 3.Which of the following is an example of negative reinforcement?
◦ 4.Today, psychology can best be defined as the
◦ 5. Joanna has suffered a series of personal setbacks, including the death of a family member
and a divorce. She feels sad, upset, and lonely, and she has been having trouble at her job
due to her inability to concentrate on her work. Joanna could probably best be helped by
which type of psychologist?
6. Martin is a clinical psychologist who works for a social services agency. Twice a week, he
makes his rounds throughout the city. Under one of the city bridges lives Kirby, whose
symptoms include flat affect, disordered or chaotic speech and behavior, and giggling for no
apparent reason. Kirby’s symptoms suggest which of the following disorders?
◦ 7. A puff of air to your eye will make you blink every time it hits your eye. If we sound a horn
then immediately follow it with a puff of air that hits your eye, and repeat this procedure
twenty times, you will soon blink to the sound of the horn alone. Thus, blinking to the sound
of the horn illustrates…



The general education goal
we choose is critical
thinking.
Critical thinking is also APA
goal 3.
We have chosen to focus on
attribute number one:
evaluate the validity and
soundness of scientific,
mathematical, logical, or
other formal disciplinary
arguments.
We have selected three questions
to assess student
understanding of critical
thinking.



Which of the following
conditions would increase
scientific confidence in a
particular research finding?
When psychological research is
reported in the mass media,
which of the following is a
good indicator of credibility?
How might the different goals
of media and science clash?
Fall 2012


We will distribute our 10
item inventory to one
section of 140 per full-time
faculty member on each
campus.
It will be given as an
appendix to the final and
scored on a separate
scantron.
Spring 2013



We will analyze our data
Depending on these results
we will consider adding
courses from adjunct
faculty.
We will consider possible
additions and/or
modifications to the
inventory once results are
received.
Sociology - Cohort 2, Spring 2012
Discipline Outcomes
After completing a Sociology 160
course, students will be able to:
1. Analyze a social issue using the
theoretical perspectives of
sociology.
2. Apply the sociological
imagination to a past or present
social issue.
3. Demonstrate a basic
understanding of the research
methods used in sociology.
4. Apply cultural relativism to a
contemporary social practice.
General Education Outcome
The Sociology faculty decided to assess
Outcome 3 under the General Education
Outcomes.
Critical Thinking - The student will be able
to evaluate and apply information
gathered from observation, experience,
reflection, reasoning, or communication.
The student should be able to:
1. Evaluate the validity and soundness of
scientific, mathematical, logical, or other
formal disciplinary arguments.
2. Analyze and synthesize information
from a variety of sources and apply the
results to resolve complex situations and
problems.
3. Defend conclusions using relevant
evidence and relevant scientific,
mathematical, logical, or other formal
disciplinary argument(s).
Sociology - Cohort 2, Spring 2012
Assessment Method
• This discipline will be using an embedded essay question
included on the final exam to measure the first outcome,
theoretical perspectives and the third general education
outcome under Critical Thinking. The essay question will
be administered in all Introduction to Sociology courses
taught at each campus by full-time faculty. Full-time
faculty will also strongly recommend that adjunct faculty
use the question as well.
• The prompt will ask students to, “Define/describe the
three major theoretical paradigms then critically analyze
marriage from the vantage point of each paradigm.”
Sociology - Cohort 2, Spring 2012
Measurement
• Full-time faculty will meet as a group for a
norming session, which will likely take 2-3
hours. Instructors will evaluate their own
assessments. Instructors will first grade the
final exams to determine the student’s grade for
the course. Following the submission of final
grades, each instructor will go back through the
essays and using the rubric assess the responses.
Sociology - Cohort 2, Spring 2012
Rubric
Capstone
Acceptable
Emerging
Ineffective
Identifies and
discusses
conclusions, and
consequences
considering
relevant theories,
principals,
assumptions,
data, and
evidence .
(reflects upon
their own
assertions)
Identifies
conclusions and
relates them to
relevant theories
and evidence.
Mentions
conclusions and
relevant theories
and evidence.
Fails to identify
conclusions,
implications, and
consequences of
the issue or the
key relationships
between the other
elements of the
problem, such as
theories,
assumptions, data
and evidence.
(presents the
context of the
issues and the
importance of the
audience)
(Presents
conclusions and
mentions
evidence and
theories)
Sociology - Cohort 2, Spring 2012
Last but not least . . .
• Full-time Faculty will reconvene to discuss the findings,
discuss the impact on curriculum and plan for future
semesters based on what we have found in our
assessment results.
• We hope to gain information about students’
understanding regarding the theoretical perspectives,
insights into strengths and opportunities for
improvement in our teaching of the perspective material,
and an overall understanding of what is working on
various campuses. We also expect this will assess the
students’ ability to think critically using the theoretical
perspectives as a framework for written discussion.
Noel Levitz Student
Satisfaction Inventory (SSI)
Kristy Bishop
Office of Institutional Research and Assessment
Metropolitan Community College
Download