Using Local Best Practices to Encourage Development of a Campus

advertisement
Stony Brook Model for
General Education
Assessment
Pilot Report
November 13, 2003
•
•
GEAR as a Catalyst for Change
Beginning to Build a CampusWide Culture of Assessment
BIO 150: Gateway to the Sciences
• Ideal for Gen Ed Assessment.
• Critical Foundational Course for sciences.
Prerequisite to all biology major courses.
Strategically positioned to capture most science
majors at the beginning of their academic careers.
• 1,000 students per year or approximately 40% of
the freshman class.
• Success: Achieving the learning outcomes of the
course, particularly growing fundamental skills, is
critical for student success.
General Education Goal for
Natural Sciences
Demonstrate
understanding
of methods
scientists use
to explore
natural
phenomena
General Education Areas
Assessed in BIO 150
• Critical Thinking
• Natural Sciences
• Writing
• Basic Communication
• Information Management
• Mathematics
Shared
BIO 150 and General Education Goals
Scientific Method
Reading, Writing, Problem Solving
Computation, Graphing
Laboratory skills and tools, Technology
Working in Groups, Oral Communication
Observation and Hypotheses
Experiment Design, Data Analysis
Critical Thinking
Fundamental concepts in biology
BIO 150
Aquatic Ecology Experiment
Observations,
hypothesis formulation,
experimental design, recording,
data analysis, reporting,
revisions
Measurement and
Data Collection
Observation
Experimentation
Preparing Students for
Research Projects
Inductive reasoning activity: Draw conclusions
from observations
Reading methodology: Practice on a published
scientific paper
Further activities elicit and elevate critical thinking
Laboratory tool methodology: Develops ability to
work with new laboratory tools safely and effectively
Data tabling and graphing skills:
Group Work
• Group project planning
• Shared data records
• Scheduling
• Recording consistency
• Interpersonal
communication skills
Data
interpretation
culminating in
a written
report
Learning Outcomes
Assessed
in Pilot Project
•
•
•
•
Natural Sciences (8 Criteria)
Critical Thinking ( 2 Criteria)
Writing and Communication (6 Criteria)
Information Management (3 Criteria)
Goals and Rubrics: Natural Sciences
Criteria
Observation
Not Meeting
1
Approaching
3
Thin on
Important
detail. Most
characteristics
essential
of objects
aspects of an
being studied
object are
are missed identified and
documented
Meeting
5
Critical and
related details
of objects are
documented
meaningfully
in descriptive
language
Goals and Rubrics: Critical Thinking
Criteria
Identify,
analyze,
and
evaluate
arguments
Not Meeting
1
Approaching
3
Student
Values
accepts all
substantive
information as
knowledge
equally valid
Uses false
Develop an premises and
argument invalid
deductions
Selectively uses
premises to
evolve simple,
mostly errorfree arguments
Meeting
5
Critically
assesses outside
knowledge and
information
Uses appropriate
and valid
premises and
tested and
validated logic
BIO 150 Laboratory Report
Assessment
•
•
•
•
•
Pilot Project
Freshmen: Entry-level assessment
Sample size – Small (6%)
Most categories “Approaching”
Critical Thinking - Area for Greatest Improvement
Summary of Preliminary Data
BIO 150 Laboratory Report Pilot Study
Natural Sciences
Critical Thinking
80
Percent of Total
70
60
50
40
30
20
10
0
Not meeting Approaching
Meeting
Performance Level
Exceeding
1: Observation
2: Questioning
3: Measurement and
data collection
7
6
Performance
4: Experimentation
5: Mathematical
analysis
6: Evaluation of
evidence
7: Self-evaluates quality
of lab process
Natural
Sciences
Criteria
8: Concepts and
modeling
1=Not Meeting 3 = Approaching
5
4
3
2
1
0
1
2
3 4
5 6
7
8
Criteria
5 = Meeting
7 = Exceeding
NAME Rating
1 = Not meeting 3 = Approaching 5 = Meeting 7 = Exceeding
Written Communication
7
6
7
5
4
3
2
1
0
5
6
Performance
Performance
Information Mangement
4
3
2
1
0
1
2
Criteria
3
1
2
3
4
Criteria
5
6
Performance
Crtical Thinking Criteria
7
6
5
4
3
2
1
0
Identify, analyze, evaluate
arguments
Develop an argument
Criteria
1=Not Meeting 3 = Approaching
5 = Meeting
7 = Exceeding
General Education Assessment
at Stony Brook University
• Focused on learning outcomes and
improving student performance
• Improve teaching effectiveness
• Increase interdisciplinary
communication
• Assessment for State General
Education requirements
Improving Learning
Outcomes
• Coordinate learning goals across
undergraduate academic programs
• Build skills important to future
success within academic field
• Develop learning skills
Assessment Program
• Define and test rubrics
• Cycle for improvement,
assessment and curriculum
changes
• Improve alignment of course
goals and measures
Why a Culture of Assessment?
• Opportunities
–
–
–
–
Faculty dialogue
Community-building / Teaching network
Enhanced learning outcomes
Student engagement
• Process
–
–
–
–
Early adopters (personal touch)
Growing cadre (peer encouragement)
Integrated Network (“Tipping Point”, Malcolm Gladwell)
Sustained culture of assessment (campus framework)
Contact Information
Stony Brook University
• Manuel London, Associate Provost
manuel.london@stonybrook.edu
• Janice Grackin, Center for Excellence in
Learning and Teaching,
janice.grackin@stonybrook.edu
• William Collins, Director Undergraduate
Biology, william.collins@stonybrook.edu
• Joan Miyazaki, Undergraduate Biology,
joan.miyazaki@stonybrook.edu
Download