The Implementation of Kellerization Using Online Learning Tools Elise Turner

advertisement

The Implementation of

Kellerization Using Online

Learning Tools

Elise Turner

Alexandra Greenfield

Kristina Patrick

Douglas Chute

Background on Kellerization

Teaching theory developed by Fred Keller

First implemented in 1963 in a short-term laboratory at Columbia University

Pilot study employed at Brasilia during the following year

Also called: o The Fred Keller Plan o Personalized System of Instruction (PSI)

Key Features of Kellerization

1. Self-Pacing o Students take quizzes in sequence and at a pace set by themselves o No arbitrary deadlines for quizzes o Advantages:

1. Allows students to work according to their schedule

2. Accounts for the fact that students read, study

and learn at different rates

3. Incentive to complete the course early

Key Features of Kellerization

2. Unit Mastery o Students master each unit before they are permitted to study the next one o Unit: small parcels of information o No ‘cost’ assigned to retaking quizzes o Advantage:

 Allows students to learn the material completely before moving on to the next unit

Key Features of Kellerization

3. Lectures and demonstrations for motivational purposes o Attendance is not required o Quizzes and tests will not include questions regarding material presented in lecture o A motivational tool to inspire students to study further

Key Features of Kellerization

4. Emphasis on the written word o Communication between student and teacher and student and proctor occurs within the medium of the written word o Teacher provides students with written resources which the student studies o Quizzes cover material on these written

resources o Students must actively read, study and respond

in writing to questions over textual material

Key Features of Kellerization

5. Use of undergraduate proctors o Chose for previous mastery of course content o Administers quizzes, provides feedback and available for help o Advantages:

 Permits:

1. Repeated testing

2. Immediate scoring of quizzes

3. A personal/social aspect of the course

Kellerization vs. Traditional Courses

Kellerization has shown to produce better test performance in: o Multiple Choice

Examinations o Final Examinations o Essay Examinations

Kulik et al. (1979) Meta Analysis

Kellerization was superior in: o 1. Final examination scores

 When aptitude is controlled for, students taking Kellerization courses scored higher on final examinations than those taking traditional courses

 Variance in grades was lower in Kellerization courses o 2. Instructor-assigned course grades o 3. Course ratings

 Overall quality

 Learning

 Enjoyment

 Workload

Kulik et al. (1979) Meta Analysis

No difference between Kellerization and traditional courses in: o 4. Course completions o 5. Student study time

Components Analyses of Kellerization

Essential to student performance in a Kellerization course: o 1. Unit mastery o 2. Many short unit quizzes o 3. Immediate feedback on quiz performance o 4. The number of review units built into the course

Component Analyses of Kellerization

Not vital to student performance in a Kellerization course: o 1. Self-pacing o 2. Amount of tutorial help from proctors o 3. Optional Lectures

These components enhance student performance within Kellerization and traditional courses

Decline of Kellerization

Disagreement amongst researchers as to what constitutes a true

Kellerization course

Universities block Kellerization courses from being offered

Faculty complain of time-intensive nature of administering a Kellerization course

Kellerization and Technology

Computer Aided Personalized System of Instruction (CAPSI) o Developed by University of Manitoba in 1984 o Chief functions:

 1. Deliver the unit tests, midterm and final examination

 2. Assign short, essay-type completed unit tests and examinations to markers

 3. Keep track of all course data o Differences between traditional Kellerization:

1. No class meetings

 2. Peer reviewers rather than proctors

 3. Unit tests graded by two peer reviewers

 4. Involves a midterm and final

5. Exams graded by the teacher

Kellerization and Technology

Benefits of CAPSI: o 1. Can increase the number of students that one instructor can teach in a given course o 2. Allows for more proctors o 3. Universities offer a richer educational experience by offering a variety of different approaches to teaching

CAPSI vs. traditional teaching methods o Student performance was higher in CAPSI sections than non-CAPSI sections

Web-based CAPSI

Unit exams are available online rather than through a software

Became available in 1994

Use of online learning environment (OLE)

CAPSI implemented through OLE o Increased class attendance and use of discussion boards o Motivations and learning approaches did not change o Learning approach (deep vs. surface) was not important for success o Unit test grades were higher in the web-based CAPSI course o Higher student appreciation in web-based CAPSI course

Methods

General Psychology course at Drexel University for non-Psychology majors

N = 609 o Live class n = 577

• o Online class n = 32 •

No demographic data available

Course components o Live or online lectures o Resources and discussion boards available on Blackboard Learn o 5 open-book online exams

Methods: Course Exams

Open-resource

20 questions o 15 randomly pulled from question bank of 1,000-2,000 questions o 5 randomly pulled from 20-30 lecture-based questions created by

• instructor

1 hour long

As many exam attempts as desired within 2 week period

Highest score achieved was counted as exam grade

Adaptations of Traditional Kellerization

Traditional

Kellerization Psychology 101

Self-pacing with no arbitrary deadlines for quizzes

2-week exam windows to take tests as many times as desired

Adaptations of Traditional Kellerization

Traditional

Kellerization

Unit mastery

Psychology 101

Students not required to master unit before progressing to next unit

Adaptations of Traditional Kellerization

Traditional

Kellerization Psychology 101

Lectures and demonstrations for motivational purposes

Optional attendance for lectures, but several lecture-based exam questions

Adaptations of Traditional Kellerization

Traditional

Kellerization o Emphasis on written word •

Psychology 101 o Lecture slides not provided o Discussion boards replaced short answer exam questions

Adaptations of Traditional Kellerization

Traditional

Kellerization Psychology 101

Feedback provided by undergraduate proctors

Computer provided exam feedback; graduate TAs were available for additional help

Results

Online class had significantly lower overall grade ( M = 83.06, SD = 10.53) than the in-person class ( M = 87.94, SD = 6.83), t (32.46) = 2.59, p = .01

Results

Overall, participants attempted the exams a mean of 3.97 times ( SD =

2.73).

Number of attempts significantly differed by exam for both class types, p < .001

Results

Number of attempts was significantly lower for online than face to face students across exams, p = .009

Significant interaction effect of exam number and class type, p = .04

Results

Across exams and classes, there is a significant negative relationship between attempt number and grade, p < .001

Students with fewer attempts performed better ( p < .001)

Results

Students’ performance declined based on number of attempts ( p <

.001)

No interaction effect for class type and attempt on grade

Results

Subjectively, students reported: a. Reading more of the textbook b. Utilizing online resources presented through the course website

Live lecture attendance decreased from historical records for the same lecturer

Conclusions

Repeated attempts do not improve performance

Performance improved across exams while attempts decreased, with the exception of the final exam

Class format differed by: o Performance o Number of attempts per exam

Discussion

Implementation of a modified form of Kellerization was possible for both live and online courses using

Blackboard Learn

Kellerization did not lead to grade inflation

Students became better at finding correct answers while needing fewer attempts

Confirmed component analysis regarding effect of proctor interaction

Limitations and Future Research

Limitations o No information available on demographic differences between online and live course o Analysis did not account for attrition

Future Research o Examine relationship between student self-pacing of examinations and performance o Investigate cases of suspected cheating and cap future maximum exam attempts at 10

Questions?

Thank you!

Download