Background and context
Implementation
Student participation and responses
Assessment and lessons
Using online quizzes through Blackboard
Ed Chadwick, Ph.D.
Department of Sport and Exercise Science,
Aberystwyth University
10 Nov 2011
Using online quizzes through Blackboard
Ed Chadwick, Ph.D.
Background and context
Implementation
Student participation and responses
Assessment and lessons
Sport and exercise science
B.Sc. degree with core components of physiology, psychology and
biomechanics.
The application of scientific methods to the study of sport
and exercise performance and participation.
A science degree that attracts a diverse group of students.
Mechanics is the branch of physics concerned with the
behaviour of objects subjected to forces and
motions.
Biomechanics is the application of the principles of mechanics to
biological systems.
Using online quizzes through Blackboard
Ed Chadwick, Ph.D.
Background and context
Implementation
Student participation and responses
Assessment and lessons
Sport and exercise science
B.Sc. degree with core components of physiology, psychology and
biomechanics.
The application of scientific methods to the study of sport
and exercise performance and participation.
A science degree that attracts a diverse group of students.
Mechanics is the branch of physics concerned with the
behaviour of objects subjected to forces and
motions.
Biomechanics is the application of the principles of mechanics to
biological systems.
Using online quizzes through Blackboard
Ed Chadwick, Ph.D.
Background and context
Implementation
Student participation and responses
Assessment and lessons
Sport and exercise science
B.Sc. degree with core components of physiology, psychology and
biomechanics.
The application of scientific methods to the study of sport
and exercise performance and participation.
A science degree that attracts a diverse group of students.
Mechanics is the branch of physics concerned with the
behaviour of objects subjected to forces and
motions.
Biomechanics is the application of the principles of mechanics to
biological systems.
Using online quizzes through Blackboard
Ed Chadwick, Ph.D.
Background and context
Implementation
Student participation and responses
Assessment and lessons
Biomechanics modules
Sample Learning Outcomes
On completion of the module, students should be able to:
1
Demonstrate basic knowledge of kinematics, kinetics, impulse,
change in momentum, stress and strain. . .
2
Demonstrate knowledge of use of various measurement
systems and computation of biomechanical parameters.
3
Interpret biomechanical data associated with complex
movements, e.g. kinematic and kinetic gait data.
4
Appreciate the nature and significance of error in
biomechanical measurement techniques.
Using online quizzes through Blackboard
Ed Chadwick, Ph.D.
Background and context
Implementation
Student participation and responses
Assessment and lessons
Rationale for e-assessment
Feedback is essential for learning, so we wanted to introduce
intermediate assessments for students during the semester.
Online assessment can provide instant feedback to students,
while they are still engaged in the task.
E-assessment can reduce the amount of staff time spent on
marking and providing feedback.
Using online quizzes through Blackboard
Ed Chadwick, Ph.D.
Background and context
Implementation
Student participation and responses
Assessment and lessons
Method of delivery
Various question types deployed through Blackboard at the
end of a learning unit.
Students given a fixed time to complete the quiz, usually one
week (not exam conditions).
Positive feedback in the case of right answers, directed to
further reading and lecture notes in the case of wrong answers.
Using online quizzes through Blackboard
Ed Chadwick, Ph.D.
Background and context
Implementation
Student participation and responses
Assessment and lessons
Types of question
Multiple choice
Multiple answer
Calculation
Choose one correct answer from
among several distractors.
Hotspot
Pair matching
Using online quizzes through Blackboard
Ed Chadwick, Ph.D.
Background and context
Implementation
Student participation and responses
Assessment and lessons
Types of question
Multiple choice
Multiple answer
Calculation
Choose multiple correct answers
from a list of options.
Hotspot
Pair matching
Using online quizzes through Blackboard
Ed Chadwick, Ph.D.
Background and context
Implementation
Student participation and responses
Assessment and lessons
Types of question
Multiple choice
Multiple answer
Calculation
Hotspot
Blackboard can pre-calculate multiple set of questions and answers
based on a formula. Set chosen at
random for each student.
Pair matching
Using online quizzes through Blackboard
Ed Chadwick, Ph.D.
Background and context
Implementation
Student participation and responses
Assessment and lessons
Types of question
Multiple choice
Multiple answer
Calculation
Click on a specified area of a figure; identify an anatomical landmark, for example.
Hotspot
Pair matching
Using online quizzes through Blackboard
Ed Chadwick, Ph.D.
Background and context
Implementation
Student participation and responses
Assessment and lessons
Types of question
Multiple choice
Multiple answer
Calculation
Match quantity with units, for example, or match a word with its
definition.
Hotspot
Pair matching
Using online quizzes through Blackboard
Ed Chadwick, Ph.D.
Background and context
Implementation
Student participation and responses
Assessment and lessons
Methods of evaluation
Questionnaire of student satisfaction
Participation level
Student performance in quizzes and exam
Lecturer’s experience
Using online quizzes through Blackboard
Ed Chadwick, Ph.D.
Background and context
Implementation
Student participation and responses
Assessment and lessons
Responses to questionnaire
Strongly disagree
Moderately disagree
Neither
Moderately agree
Strongly agree
5
The online quizzes helped to reinforce
what we learnt in the lectures and practicals.
4
The online quizzes helped me to check my progress.
3
The online quizzes motivated me to
attend practicals more regularly.
2
The online quizzes were fair.
1
The quizzes helped me to identify
areas of strength and weakness.
0
5
10
Responses
Using online quizzes through Blackboard
15
Ed Chadwick, Ph.D.
Background and context
Implementation
Student participation and responses
Assessment and lessons
Student comments
“When they say points to gain per question, i think it
would be better for the end of the question that they
should notify the students how many boxes to pick.”
“How the computer recognised units and deemed them
right or wrong wasn’t always fair.”
Using online quizzes through Blackboard
Ed Chadwick, Ph.D.
Background and context
Implementation
Student participation and responses
Assessment and lessons
Second year module performance
Median mark for the class (%)
70
60
50
*
*
Quiz
Essay
Exam
Overall
40
30
20
10
0
2009−10
Using online quizzes through Blackboard
2010−11
Ed Chadwick, Ph.D.
Background and context
Implementation
Student participation and responses
Assessment and lessons
Summary of data
Responses to questionnaire
Quizzes were fairly popular – students have requested them
for other modules
Some concerns about fairness in marking – more to do with
harshness?
Student performance in assessments
Quizzes were completed by typically > 95% of students
When offered practice quizzes, uptake was very low
Performed slightly better in quizzes than in other assessments
Using online quizzes through Blackboard
Ed Chadwick, Ph.D.
Background and context
Implementation
Student participation and responses
Assessment and lessons
Pitfalls and limitations
Multiple answers and partial
credit
Decimal places and units
Accuracy of hotspots
With partial credit, BB awards
one point for a correct answer and
takes one away for a wrong one.
Limited feedback options
Using online quizzes through Blackboard
Ed Chadwick, Ph.D.
Background and context
Implementation
Student participation and responses
Assessment and lessons
Pitfalls and limitations
Multiple answers and partial
credit
Decimal places and units
Accuracy of hotspots
Numerical answers must be given
to an exact number of decimal
places, and there is no flexibility
on units.
Limited feedback options
Using online quizzes through Blackboard
Ed Chadwick, Ph.D.
Background and context
Implementation
Student participation and responses
Assessment and lessons
Pitfalls and limitations
Multiple answers and partial
credit
Decimal places and units
Accuracy of hotspots
You need to give a fairly large target area for clicking, as accuracy
is poor.
Limited feedback options
Using online quizzes through Blackboard
Ed Chadwick, Ph.D.
Background and context
Implementation
Student participation and responses
Assessment and lessons
Pitfalls and limitations
Multiple answers and partial
credit
Decimal places and units
Accuracy of hotspots
Feedback can only be given at the
end of a test, not after each question.
Limited feedback options
Using online quizzes through Blackboard
Ed Chadwick, Ph.D.
Background and context
Implementation
Student participation and responses
Assessment and lessons
Openmark from Open University
Using online quizzes through Blackboard
Ed Chadwick, Ph.D.
Background and context
Implementation
Student participation and responses
Assessment and lessons
Openmark from Open University
Using online quizzes through Blackboard
Ed Chadwick, Ph.D.
Background and context
Implementation
Student participation and responses
Assessment and lessons
Openmark from Open University
Using online quizzes through Blackboard
Ed Chadwick, Ph.D.
Background and context
Implementation
Student participation and responses
Assessment and lessons
Conclusions
The quizzes were useful for assessing student performance
throughout the module without a large extra time
commitment from the lecturer.
From the student perspective, they gained (instant) feedback
on their own performance at intermediate stages, as well as
the chance to earn credit toward the overall module mark.
Finally
Recommended, but software could do with a polish. Be careful to
work within the limitations of Blackboard.
Using online quizzes through Blackboard
Ed Chadwick, Ph.D.
Background and context
Implementation
Student participation and responses
Assessment and lessons
Conclusions
The quizzes were useful for assessing student performance
throughout the module without a large extra time
commitment from the lecturer.
From the student perspective, they gained (instant) feedback
on their own performance at intermediate stages, as well as
the chance to earn credit toward the overall module mark.
Finally
Recommended, but software could do with a polish. Be careful to
work within the limitations of Blackboard.
Using online quizzes through Blackboard
Ed Chadwick, Ph.D.