Vivian Schoner and Katrina Strampel
Centre for Learning and Teaching through Technology (LT3)
University of Waterloo





Student Encounters with the Blended
Learning Experience
Technically Viable? Yes
Pedagogically Sound? Yes, No, Maybe,
Depends…
Survey Research Results

 We asked students to tell us about their experiences with

Online Learning Activities

Online Collaborative Learning (small group)

Technology Function

Student Satisfaction

Online Instructor Feedback

Faculty Quest Enrolment % Survey
AHS 1525 6
Arts
ENG
3041
739
6
5
ENV
MATH
SCIENCE
1414
3170
9474
7
4
4

90
80
70
60
50
40
30
20
10
0
Technology Function
Student Satisfaction
Online Instructor
Feedback
Online Learning
Activities
Online Collaborative
Learning

26. logging in to be…
27. accessing my courses to be…
28. navigating around the UWACE course pages to be…
29. accessing the course tools/announcements to be…
30. posting, reading, responding to messages in the online discussion forum to be…
31. accessing feedback on submissions to be…
32. accessing my grades to be…
33. submitting assignments to be…
34. accessing quizzes to be…
35. accessing team or small group resources to be…

Technology (alpha .953)
Faculty % Very
Difficult
SCIENCE 2
FES
ARTS
AHS
MATH
ENG
Av for %
Combined
1
3
1
6
6
Neg 9
5
6
4
5
11
%
Difficult
4
12
9
12
14
%
Undecided
8
16
UnD 12
%
Easy
%
Very Easy
32 53
35 38
32 51
26 56
34 48
32 35
Pos 79
83
83
82
74
67
Cum.
Positive%
85

 “quick access to grades and assignment feedback, access to past lecture notes, announcements, additional resources”
 “UW-ACE helped a lot in centralizing my courses online”
 “the fact that you can connect anytime/anywhere”
 “a safe online environment”
 “easy to use, helpful, good interactions with profs and peers”
 “I could sign in and have everything at my fingertips”






“it enhances the learning process by offering supplemental resources for course related topics”
“it is certainly appropriate to post lecture notes and other resources, but the absolute most important thing to remember is not to invent uses just because the UW-ACE software is there. Legitimate uses are great, but online activities just for the sake of doing them are frustrating”
“it is desirable because it gives students an alternative way to find information about the course, also allows them to communicate with others who need help and who can offer help”
“if you have a question, but hate raising your hand and asking in front of all your peers, it can be asked and answered online”
“I believe it’s an integral part of the university to have students using technology which will be useful once we are out there in the workforce. Developing this skill is essential for us to be able to learn to be technologically diverse”

36. the organization of the course content and activities?
37. the instructions for completing learning activities?
38. the number of course learning activities through the term?
39. the distribution of course learning activities through the term?
40. the technical support?
41. the professional look of the course web page(s)

Overall Student Satisfaction (alpha .916)
Faculty Very
Unsatisfied
Unsatisfied Undecided Satisfied Very
Satisfied
AHS 2
SCIENCE 3
ARTS
FES
ENG
5
3
3
MATH 5
Av for %
Combined Neg 10
7
6
8
4
4
9
17
16
14
17
22
24
UnD 18
38
42
44
4
35
427
39
35
30
30
32
15
Pos 72
74
74
67
Cum
Positive
%
77
77
62

42. instructor feedback helped me learn and understand difficult concepts
43. the frequency of instructor feedback met my information needs
44. the quality of instructor feedback was helpful and informative
45. the timeliness of instructor feedback was appropriate for my needs
46. the amount of instructor feedback was appropriate for my needs

Online Instructor Feedback (alpha .972)
Faculty Strongly
Disagree
Disagree Undecided Agree Strongly
Agree
ARTS
AHS
5
4
SCIENCE 5
FES 13
ENG 2
MATH
Av for %
Combined
23
Neg 18
6
7
10
8
18
9
17
22
21
24
26
25
UnD 23
39
36
26
31
41
26
33
31
38
24
13
17
Pos 59
Cum.
Positive
%
72
67
64
55
54
43

 “I got assignments back sooner and easier with the site”
 “the professor always kept us informed of news by posting announcements frequently on the UWACE website”
 “the immediate feedback from quizzes written as well as the correct answers is a definite asset”
 “took too long for marks to be posted”
 “not being able to see answers on actual quizzes”
 “grades are not properly recorded”
 “there was an announcement that marks for an important section would be posted which they never were”

1. Discussion forum activities
2. Self-Assessment (un-graded)
3. Self-assessment (graded)
4. Collaborative/Peer Review submissions
5. Individual Submissions
6. Lecture notes
7. Links to external resources
8. Information literacy/library modules
9. Lab modules/activities
10. helped me learn the new skills and concepts for this course
11. helped in that it reduced the amount of time spent studying text or notes in order to grasp the material to be learned
12. helped me to better analyze and apply key points in the material to be learned
13. encouraged me to take responsibility for my own learning
14. I found that working online improved my performance on graded course assessments
15. I found that the online component(s) were well integrated with the other course components not offered online

Online Learning Activities (alpha .965/.935/.919)
Faculty
ENG
FES
AHS
6
7
SCIENCE 11
Strongly
Disagree
6
Disagree Undecided Agree Strongly
Agree
5 27 36 26
11
13
11
21
22
24
35
30
33
27
28
21
Cum. %
Positive
62
62
58
57
ARTS
MATH
Av for %
Combined
11
12
Neg 20
12
14
20
25
UnD 23
33
34
24
15
Pos 57
57
49





“I’m sure there are situations where it would be desirable to “use technology to support teaching and learning”, but that in itself is too broad a goal. You should be using technology to solve a particular problem, or to compensate for a recognized weakness in existing methods. In the case of my course, I can’t see how UW-ACE has added anything to the course. I found the written quizzes far more helpful than the online ones, and I prefer to read printed course notes rather than getting course material from the web (you can’t highlight/underline/scribble on a webpage)”
“it helped me develop the habit of studying for the course regularly. It allowed me to learn course material through practice questions. A chance to do the same quizzes again and again which helped me learn and understand course concepts better. Unlimited time to do the quiz”
“a good way to practice concepts learned in class. Particularly I found the ‘fill in the blank’ type exercises to be very helpful”
“the information was very complete and organized. I feel that the textbook for the course would not have been sufficient on its own to learn all the course material. The resources offered on UW-ACE enhanced my ability to learn the material”

16. Team or small group graded assignments
17. Whole class discussion activities
18. Peer review submissions
19. Team or small group un-graded assignments
20. Giving/receiving peer feedback
21. I was able to develop a better understanding of the material because of my interaction with my peers
22. I put more thought into my comments when interacting with others online
23. I felt part of a learning community when working online
24. I found that working online encouraged me to take responsibility for my group contribution
25. I am more comfortable asking questions to members of my group in an online setting

Online Collaborative Learning (alpha .961/.964/.895)
Faculty Strongly
Disagree
Disagree Undecided Agree Strongly
Agree
Cum. %
Positive
ARTS 10 14 22 33 21 54
AHS 10
SCIENCE 12
FES
ENG
8
19
MATH
Av for %
Combined
14
Neg 25
17
7
16
13
12
20
28
27
18
35
UnD 25
34
29
43
35
35
19
24
17
14
4
Pos 50
53
53
49
49
39

 “the group discussion page made it a lot easier to communicate with my group members since we are all in different classes and communication for projects is an issue”
 “I don’t mind the discussions online, I’m more comfortable since it gives the sense of anonymity (privacy thing)”
 “It depends on what type of activities: I think group tutorials are a good way to learn, whereas group projects are hard to realize”
 “they allow me to communicate with others, evaluate their thoughts and compare them to my own”
 “the addition would benefit learning because it would provide a place for quick review and knowledge testing as well as the style of the lecturers questions”

Correlations (Unadjusted)
S1OnlineEnvironment
S2OLEHelpedMe
S3CAExperience
S4CALearning
S5Eas eOfUs e
S6Satis faction
S7FeedbackExperience
Pears on Correlation
Sig. (2-tailed)
N
Pears on Correlation
Sig. (2-tailed)
N
Pears on Correlation
Sig. (2-tailed)
N
Pears on Correlation
Sig. (2-tailed)
N
Pears on Correlation
Sig. (2-tailed)
N
Pears on Correlation
Sig. (2-tailed)
N
Pears on Correlation
Sig. (2-tailed)
N
S1Online
Environment
1
.
602
.573**
.000
561
.604**
.000
245
.572**
.000
267
.483**
.000
582
.581**
.000
571
.526**
.000
241
**. Correlation is s ignificant at the 0.01 level (2-tailed).
S2
OLEHelped
Me
.573**
.000
S3
CAExperience
.604**
.000
561
1
726
.
.493**
.000
251
245
.493**
.000
251
1
.
265
.626**
.000
287
.371**
.000
710
.568**
.000
693
.598**
.000
266
.623**
.000
217
.493**
.000
258
.477**
.000
255
.507**
.000
165
S4
CALearning
.572**
.000
267
.626**
.000
287
.623**
.000
217
1
.
296
.460**
.000
294
.510**
.000
289
.556**
.000
180
S5Eas eOf
Use
.483**
.000
582
.371**
.000
710
.493**
.000
258
.460**
.000
294
1
812
.
.642**
.000
773
.521**
.000
273
S6
Satisfaction
.581**
.000
571
.568**
.000
693
.477**
.000
255
.510**
.000
289
.642**
.000
773
1
.
778
.661**
.000
274
S7Feedback
Experience
.526**
.000
241
.598**
.000
266
.507**
.000
165
.556**
.000
180
.521**
.000
273
.661**
.000
274
1
275
.

Science:
Technology (85) and Student Satisfaction (77)
Instructor Feedback (64) , Learning Activity (57), Collaborative Learning (53)
Applied Health Sciences:
Technology (82) and Student Satisfaction (77)
Instructor Feedback (67) , Learning Activity (58), Collaborative Learning (53)
Environmental Studies:
Technology (83) and Student Satisfaction (74)
Learning Activity (62), Instructor Feedback (55) , Collaborative Learning (49)
Arts:
Instructor Feedback (72) , Technology (83), Student Satisfaction (74)
Learning Activity (57) and Collaborative Learning (54)
Math:
Technology (74) and Student Satisfaction (62)
Learning Activity (49), Instructor Feedback (43) , Collaborative Learning (39)
Engineering:
Technology (67), Student Satisfaction (67), Learning Activity (62)
Instructor Feedback (54) and Collaborative Learning (49)
81%
57%
80%
59%
79%
55%
76%
56%
68%
44%
65%
52%




Technology function and student satisfaction scales represent the more straightforward scales group addressing technical support and student workload in all
Faculties
Online Learning Activity, Online Collaborative Learning
(Small Group) and Instructor Feedback scales represent the teaching and learning pedagogy group in four of the six Faculties
Exceptions


Instructor Feedback, a pedagogy scale, grouped with technical support and student workload
Learning Activity, a pedagogy scale, grouped with technical support and student workload

AHS: All Categories
60
50
40
30
20
10
0
Strongly
Disagree
Disagree Undecided
Ratings
Agree Strongly
Agree
Online Learning Activity
Collaborative Learning
Technology Function
Student Satisfaction
Online Instructor Feedback
Arts All Categories
60
50
40
30
20
10
0
Strongly
Disagree
Disagree Undecided Agree Strongly
Agree
Ratings
Online Learning Activity
Collaborative Learning
Technology Function
Student Satisfaction
Online Instructor Feedback

Engineering All Categories
50
40
30
20
10
0
Strongly
Disagree
Disagree Undecided
Ratings
Agree Strongly
Agree
Online Learning Activity
Collaborative Learning
Technology Function
Student Satisfaction
Online Instructor Feedback
FES: All Categories
60
50
40
30
20
10
0
Strongly
Disagree
Disagree Undecided
Ratings
Agree Strongly
Agree
Online Learning Activity
Collaborative Learning
Technology Function
Student Satisfaction
Online Instructor Feedback

Math: All Categories
50
40
30
20
10
0
Strongly
Disagree
Disagree Undecided
Ratings
Agree Strongly
Agree
Online Learning Activity
Collaborative Learning
Technology Function
Student Satisfaction
Online Instructor Feedback
Science: All Categories
60
50
40
30
20
10
0
Strongly
Disagree
Disagree Undecided Agree Strongly
Agree
Ratings
Online Learning Activity
Collaborative Learning
Technology Function
Student Satisfaction
Online Instructor Feedback

UW-ACE All Faculties All Scales
40
35
30
25
20
15
10
5
0
Strongly
Disagree
Disagree Undecided Agree Strongly
Agree
Ratings
AHS
ARTS
ENG
ES
MATH
SCI

Faculty Strongly
Disagree
Disagree Undecided Agree Strongly
Agree
Total #
Responses
Total #
Course
AHS
ARTS
ENG
ES
MATH
5
7
7
6
12
9
9
11
9
10
18
16
22
29
25
33
36
36
36
35
35
32
24
29
18
1924
4013
904
1836
2628
12
42
6
16
9
Total #
Students
Taking
Survey
90
185
37
96
120
SCI
Av. %
%
Rounded
7
7.33
7
7
9.16
9
20
20.17
20
32 34
34.67
28.67
35 29
6299
17,604
28
113
337
865





Students are aware of the benefits of technology in the classroom and commented frequently on instructors under use of this resource.
They responded positively to technology use perceived to add real value to learning outcomes as evidenced in improved performance on quizzes, tests, assignments or projects.
Students provided suggestions for improvements and/or described new features they would like to see developed for UW-ACE.
They did not see value-added in working in small groups or teams online when they could readily interact with their peers in person.

 We need to further explore ways to improve instructional design and teaching techniques for online learning and collaborative learning activities. (LT3 Centre interface)
 Some of the needed changes suggested by the students should be considered for implementation either in the technology itself, using the technology more fully to support learning, and reducing the ambiguity
(undecided) noted in all the Scales except
Technology Function.




We need to think how to reduce the “undecided” rates,

Rethink providing this as a response choice



Forced choice is one option
Use “intermediate” instead of “undecided”
Provide instructors with key information on the pedagogy of online teaching and learning
Encourage instructors to direct their students to the online survey available in students’ course pages
Analysis of the features of individual course profiles should be undertaken (Liaisons)

Learning technologies should be used to support, enhance, supplement and/or expand learning opportunities; Technology should NEVER be used to replace teaching and learning in the classroom setting.