The Human Element: Still Relevant With Ubiquitous Use of Technology Kyle Anderson

advertisement

The Human Element: Still Relevant

With Ubiquitous Use of Technology

Kyle Anderson

Department of Biochemistry

University of Saskatchewan kyle.anderson@usask.ca

or @drkyle

Overview

Lecture attendance is correlated to student performance

Accessibility of course materials outside of lectures is viewed as a hindrance to attendance

As technology leads us into more hybrid-format courses, lectures may become unnecessary for student learning

If the lecture experience is faithfully recreated online, will students still come to lecture?

Should instructors withhold information to ensure students attend and have better learning outcomes?

Factors Affecting Lecture Attendance

Positive Factors Negative Factors

Active Participation/Engaging Class Passive Lecturing

Small, intimate classes Large classes & classrooms

Provide current information or applications for course material

Lectures perceived as not valuable

(provide information available elsewhere)

Lecturer clarifies course material Low quality lectures

(unclear, inaudible, pitched to a level too high/low, etc.)

Conflicts from other courses

(assignments due, midterms)

Inconvenient lecture time (early morning, late afternoon, evenings)

Illness

Attendance & Performance

Several studies over recent decades have shown a moderate positive effect of attendance on student performance

– even studies which control for previous student performance

Also reported are attendance rates of 60-80% for large classes (100+ students)

Should lecture-based classes enforce attendance, or otherwise reduce efforts that encourage absenteeism?

Moore et al. Showing up: the importance of class attendance for academic success in introductory science courses. 2003

The Evolution of Hybrid Courses

http://www.neatoshop.com/product/Something-Somewhere-Went-Terribly-Wrong

Oral lectures

Typed/Handwritten notes on reserve

Overhead transparencies on reserve

Summary notes available online

PowerPoint notes available online

Audio podcasting

Video podcasting

Case Study: Biomedical Sciences 240

About this course:

A course on basic laboratory techniques with 3 hours lecture (theory) and 3 hours lab (practice) every week

A large lecture class, with 110-180 students per term

Offered at 8:30-9:50, Tuesday/Thursday

First offered in Fall 2009, offered every Fall and

Winter term

No textbook

What makes this a hybrid course?

Lecture notes are posted at least a day in advance

Annotated lecture notes (with digital inking) are posted a few hours after the lecture is completed

An external microphone records audio and software records all projected video

Files are synchronized and rendered into a highresolution video hours after lecture

Lecture attendance is recorded through clicker usage, but students may opt-out of the 5% of their grade and transfer it to the final exam

Student suggested after Y1T1

Short Example of a Lecture Video

Student Grade vs Student Attendance in BMSC 240 F'10-W'13

100

90

80

70

60

50

40

30

20

10

0

0 10 y = 0.2742x + 53.687

R² = 0.327

20 30 40 50

Attendance

60

551 students

Average grade = 74.6%

Average attendance = 76.4%

70 80 90 100

Grade Distribution of Non-attenders

20%

18%

16%

14%

12%

10%

8%

6%

4%

2%

0%

5 10 15 20 25 30 35 40 45 50

Grade

55 60 65 70 75 80 85 90 95 100

Class Distributions (Attenders vs Non)

0.2

0.18

0.16

0.14

0.12

0.1

0.08

0.06

0.04

Attending

Non-attending

0.02

0

5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100

P=0.026

Number

Average Grade

Proportion <50%

Proportion >90%

Attending Classes Opting-out of

Attendance

551 127

74.6%

1.8%

5.1%

71.9%

7.9%

0%

Utilization of Online Materials (Winter ‘13)

Videos

Annotated pdf’s

Pre-lecture pdf’s

25

20

15

10

5

0

0

Viewing vs Attending (Winter ’13)

Winter 2013

20 40 60

# of views

80 100 120

For students attending class:

Mean number of lecture videos viewed = 14.6

Median = 9

For students who opted-out of attendance

Mean = 23.9

Median = 21

Actual lectures = 23

Viewing vs Grade

80

60

40

20

120

100

R² = 0.0027

0

0 10 20 30 40 60 70 80 90 100 50

Grade

Unlike attendance, viewing lectures online has no significant effect on final grade

Selection of Student Comments

“podcasts were nice to have available to help with studying”

“Excellent use of podcasts for lectures (very helpful!)”

“Really appreciated his use of podcasts and examples.”

“The Podcasts were awesome!”

“Video podcasts were invaluable.”

“Podcasts were greatly appreciated, mostly because, often important details were left out on the slides. So much material was discussed orally that it was impossible to write it all down during class. Without the podcasts, studying would have been very difficult.”

Summary

There remains a correlation between attendance and performance, even when missed lectures may be watched online

Overall, students report the hybrid-course material to be useful as a study-aid and to enable reviewing of materials

Attendance with hybrid materials remains acceptably high (~75%) and within expected levels compared to traditional lecture courses

Conclusions

Online materials can supplement, but not fully substitute for, in-person lecturing

Students relying on online materials come from all grade levels

Give students whatever tools/resources you can – some underachieving students may abuse them, but the overall effect will be better learning outcomes for your class

What Next?

I want to investigate attendance and video usage coupled with student surveys to try to make more meaningful connections

Are there groups of students more or less likely to succeed when opting out of attendance?

Is previous experience with an online course a predictor of success?

What sections of videos are viewed most often, and how can this be used to improve the course in the future?

Collaborations/Suggestions?

IT backend analytics people?

Research methods people?

Download