Gordon Hodge, University of New Mexico, Psychology

advertisement
General Psychology is the largest of UNM’s
20 “killer” courses for lower division
undergraduate students.
Before the Pew Grant for Redesign (2001),
41% of students failed to attain a grade of
C or better.
Goals:
(1) Improve success while
(2) lowering cost (49% after redesign)
Solutions: (1) Programmed Self-Instruction (PSI)?
(2) Consolidation of sections
Redesign Alliance Conference • Orlando, FL, March 19th, 2007 • © 2007 by Gordon Hodge • ghodge@unm.edu
WebCT Quizzes Instead of PSI?
 3 Quizzes per week
 20 Questions per quiz
 Timed (20 min)
 Unlimited repeats
 Highest score counts
 1 Point per question
Do Quizzes Matter?
Redesign Alliance Conference • Orlando, FL, March 19th, 2007 • © 2007 by Gordon Hodge • ghodge@unm.edu
Do
(Required) Quizzes Matter?
Spring 2002: Same Instructor
Percentage of Students
Quizzes Optional
QuickTime™ and a
Graphics decompressor
are needed to see this picture.
QuickTime™ and a
Graphic s decompress or
are needed to see this pic ture.
Ave. Duration (min)
Number Attempts
High Score
Quizzes Required
QuickTime™ and a
Graphic s decompress or
are needed to see this pic ture.
Weekly Mastery Quizzes
Weekly Mastery Quizzes
Students performed better when quizzes were
required (top). With required quizzes (far left),
Students who received course grades of A
received higher quiz scores and attempted more
quizzes than students who received other
grades; A students took less time to complete
quizzes than B or C students. When quizzes
were optional (near left), few students performed
as well on quizzes (or exams) than students in
the section where quizzes were required.
Redesign Alliance Conference • Orlando, FL, March 19th, 2007 • © 2007 by Gordon Hodge • ghodge@unm.edu
Do
(Required) Quizzes Matter?
Spring 2005: Different Instructors
Psych 105 Grades б Spring 2005
Class Percentage
60%
Sec 1 (Quizzes Required)
Sec 2 (Quizzes NOT Required)
43%
50%
40%
27%
22%
18%
20%
10%
20%
10%
0%
A
B
C to C+
C- or
below
Redesign Alliance Conference • Orlando, FL, March 19th, 2007 • © 2007 by Gordon Hodge • ghodge@unm.edu
Do (Required) Quizzes Matter?
Total Exam Points by Total Quiz Points
(Quizzes Required; S05)
Total Exam
(1280)
Percentage
ClassPoints
1200
1000
800
600
400
200
Total Exam Points by Total Quiz Points (S05)
Linear Trend (Correlation, r = .91)
0
0
200
400
600
Total Quiz Points (1000)
800
1000
Redesign Alliance Conference • Orlando, FL, March 19th, 2007 • © 2007 by Gordon Hodge • ghodge@unm.edu
Do Quizzes Matter?
Total Exam Points by Total Quiz Points F05
Exam Points
1200
r = .93
1000
800
600
400
200
0
0
200
400
600
800
1000
Quiz Points
Redesign Alliance Conference • Orlando, FL, March 19th, 2007 • © 2007 by Gordon Hodge • ghodge@unm.edu
Average Score (80 Questions)
Do
Quizzes
Matter?
Pre- vs. Posttest Scores by Course Grade F05
80
Pretest
Posttest
60
62
40
45
37
32
20
45
31
33
21
0
A
B
C
Course Grade
C- & Below
Average Pretest and Posttest scores; quizzes required. During the first two weeks, students who took
the Pretest received extra credit for taking a computer version of the Final Exam (they did not know it
was the Final); the Posttest was the Final Exam (week 17).
Redesign Alliance Conference • Orlando, FL, March 19th, 2007 • © 2007 by Gordon Hodge • ghodge@unm.edu
DoPassing
Quizzes
Matter?
Grades for Psych 105
77%
Class Percentage
80%
71%
78%
74%
77%
77%
80%
81%
73%
75%
63%
60%
59%
41%
40%
37%
29%
27%
26%
23%
22%
23%
23%
20%
0%
20%
25%
19%
C or Above
C- or Below (& Ws)
F00 F01
Tradi- Pilot
tional
S02
F02
S03
F03
S04
F04
S05
F05
S06
F06
Semester
Percentage of students receiving grades of C or better in General Psychology 105.001, fall 2000 through
spring 2006. Fall 2000 was taught in a traditional manner; i.e., students attended lectures, read the textbook,
and took exams. Beginning with the pilot study in fall, 2001, students were required to complete three sets of
mastery quizzes per week (approximately 45 quizzes, total).
Redesign Alliance Conference • Orlando, FL, March 19th, 2007 • © 2007 by Gordon Hodge • ghodge@unm.edu
Download