Demographics and Learner Behavior in
MITx and HarvardX MOOCs
NIPS Workshop on Data-Driven Education
Research Collaborators
HarvardX
Isaac Chuang
Daniel Seaton
Cody Coleman
Curtis Northcutt
Research and
Analytics
Andrew Ho
Sergiy Nesterko
Justin Reich
Tommy Mullaney
Carlos Rocha
Miki Goyal
Olga Stroilova
Gabe Mulley
Brian Wilson
Workshop on Data Driven Education - Dec. 2013
dseaton@mit.edu
MITx (22 Courses)
Workshop on Data Driven Education - Dec. 2013
HarvardX (17 Courses)
dseaton@mit.edu
Workshop on Data Driven Education - Dec. 2013
dseaton@mit.edu
8.02x
Workshop on Data Driven Education - Dec. 2013
dseaton@mit.edu
8.02x
6.002x
Workshop on Data Driven Education - Dec. 2013
14.73x
2.01x
dseaton@mit.edu
Outline
• Introduction
• Who are our registrants? “Massiveness” and Demographics
• How are these registrants behaving? Review and Video Use
• Do demographics impact behavior? Country-of-origin
Workshop on Data Driven Education - Dec. 2013
dseaton@mit.edu
Course Data from Fall 2012 to Spring 2013
HarvardX
MITx
•
•
•
•
10 Courses
~650K unique users
~18K unique resources
~600M records
•
•
•
•
5 Courses
~450K unique users
~5K unique resources
~200M records
• MITx data alone is over a terabyte (mainly click-stream)
Workshop on Data Driven Education - Dec. 2013
dseaton@mit.edu
HarvardX: Enrollment and Participation
Workshop on Data Driven Education - Dec. 2013
dseaton@mit.edu
HarvardX: Enrollment and Participation
Workshop on Data Driven Education - Dec. 2013
dseaton@mit.edu
Who are our registrants? Demographics
Age
Gender
Workshop on Data Driven Education - Dec. 2013
Level of Ed.
Country
dseaton@mit.edu
Who are our registrants? Country of Origin
Evaluating Geographic Data in MOOCs
( Sergiy Nesterko, et. al, POSTER SESSION )
Workshop on Data Driven Education - Dec. 2013
dseaton@mit.edu
Who are our registrants? Level of Education
Workshop on Data Driven Education - Dec. 2013
dseaton@mit.edu
Certification and Level of Education
Workshop on Data Driven Education - Dec. 2013
dseaton@mit.edu
8.02x Case Study
105
Count
Count
Enrolled 43758
Active
7285
Midterm 1 3479
Midterm 2 2370
Midterm 3 2068
Final
1878
104
103
ve
ed
i
l
t
l
ro
Ac
n
E
1
2
rm
rm
rm
e
e
e
idt
idt
idt
M
M
M
3
l
a
n
Fi
Participation and Performance in 8.02x: the first physics MOOC from edX
Rayyan, Seaton, Belcher, Pritchard, Chuang ( In Press - Physics Ed. Research Conference )
Workshop on Data Driven Education - Dec. 2013
dseaton@mit.edu
Outline
• Introduction
• Who are our registrants? “Massiveness” and Demographics
• How are these registrants behaving? Review and Video Use
• Do demographics impact behavior? Country-of-origin
Workshop on Data Driven Education - Dec. 2013
dseaton@mit.edu
Learning behavior: Inaugural MITx Course, 6.002x
•
Access frequencies for 6.002x components:
-
Homework, Lect. Questions, Lab,
Lect.Video, Tutorials, Textbook, Discussion, Wiki
Assessment
Learning Components
Studying Learning in the Worldwide Classroom: Research into edX’s First MOOC
Breslow, Pritchard, DeBoer, Stump, Ho, Seaton ( Research & Practice in Assessment - 2013 )
Workshop on Data Driven Education - Dec. 2013
dseaton@mit.edu
Learning behavior: Inaugural MITx Course, 6.002x
Studying Learning in the Worldwide Classroom: Research into edX’s First MOOC
Breslow, Pritchard, DeBoer, Stump, Ho, Seaton ( Research & Practice in Assessment - 2013 )
Who does what in a Massive Open Online Course?
Seaton, Bergner, Mitros, Chuang, Pritchard ( To Appear March 2014 - CACM )
Workshop on Data Driven Education - Dec. 2013
dseaton@mit.edu
Lecture video use in MITx MOOCs
• 6.002x distinctly bimodal
- Does pattern persist in re-runs?
Characterizing video use in the catalogue of MITx MOOCs
Seaton, Nesterko, Reich, Mullaney, Ho, Chuang ( Accepted - 2014 European MOOC Summit )
Workshop on Data Driven Education - Dec. 2013
dseaton@mit.edu
Lecture video use in MITx MOOCs
• 6.002x distinctly bimodal
- Does pattern persist in re-runs?
- Does pattern exist in other courses?
Workshop on Data Driven Education - Dec. 2013
dseaton@mit.edu
Outline
• Introduction
• Who are our registrants? “Massiveness” and Demographics
• How are these registrants behaving? Review and Video Use
• Do demographics impact behavior? Country-of-origin
Workshop on Data Driven Education - Dec. 2013
dseaton@mit.edu
What might correlate with this behavior?
• Is it a question of access?
- Country code as a proxy for access.
Workshop on Data Driven Education - Dec. 2013
dseaton@mit.edu
What might correlate with this behavior?
• Are all courses impacted?
- US and IN only
Workshop on Data Driven Education - Dec. 2013
dseaton@mit.edu
What might correlate with this behavior?
• Natural step to analyze course structure.
• As well as “in-video” interactions (content itself).
Understanding in Video Dropouts and Interaction
Peaks in Online Videos
Kim, Guo, Seaton, Mitros, Gajos, Miller (Submitted)
Workshop on Data Driven Education - Dec. 2013
dseaton@mit.edu
Conclusions and future/current efforts
• Much early progress in analyzing MITx and HarvardX data sets.
• Hope I imparted the scale and diversity of these courses, and the need to
account for diversity in measuring behavior.
• Will expand these analyses in the upcoming year.
• Thank you for your time!
Studying Learning in the Worldwide Classroom: Research into edX’s First MOOC
Breslow, Pritchard, DeBoer, Stump, Ho, Seaton ( Research & Practice in Assessment - 2013 )
Who does what in a Massive Open Online Course?
Seaton, Bergner, Mitros, Chuang, Pritchard ( To Appear March 2014 - CACM )
Characterizing video use in the catalogue of MITx MOOCs
Seaton, Nesterko, Reich, Mullaney, Ho, Chuang ( Accepted - 2014 European MOOC Summit )
Workshop on Data Driven Education - Dec. 2013
dseaton@mit.edu