KU Blackboard Utilization
Study and Survey
Spring 2003
Craig Gerdes (cgerdes@ku.edu)
Toshi Urata (turata@ku.edu)
Instructional Designers
Instructional Development and Support (IDS)
University of Kansas
Background
At the time of the study, KU was using
Version 5.6. Currently 6.1.5.
Most Bb courses at KU are web-enhanced
and not fully online.
Using Blackboard in teaching is not
required but rather voluntary at KU.
Instructors planning to use Blackboard are
required to attend a training session.
Why survey faculty and
review courses?
1. To understand how instructors are using
the system.
2. To make future decisions about add-ons,
training, budgeting, etc.
What did KU want to know
generally?
Access and Utilization
Training and Support
Impact on Teaching and Learning
What did IDS (Instructional Development and Support)
want to know specifically?:
– Who are the faculty/staff using the system?
• What schools do they represent?
• What was their initial motivation for using Bb?
• What barriers prevent them from using Bb more?
– How are they using Bb for their courses?
• What Bb course and system tools do they use?
• What learning activities have they used effectively in
Bb?
• How has Bb changed their teaching methods?
–
–
–
–
How frequently do they access their Bb courses?
How easy is it for them to use Bb?
What are their training needs and preferences?
What is their satisfaction with Bb and IDS?
2 Step Process
– Step 1: Reviewing Courses
– Step 2: Surveying Faculty
Course Reviews
Develop a scoring rubric.
Determine consistent guidelines for what
constitutes actual use.
Make special notes about unique design
elements or learning situations you
witness (good and bad).
Consider the variation in tools used by
different disciplines.
Faculty Survey: Design
Choose a reasonable number of questions
and completion time. (We had 16
questions with an estimated time of 5 min.)
Make the process easy to complete. (We
used Blackboard to deploy our survey)
Provide opportunities for general feedback
with a few open-ended items. (We had
25% of our questions as essay)
Provide anonymity.
Faculty Survey:Timing & Delivery
Created Bb announcements.
Emailed all instructors.
Sent periodic reminders.
Provided a two-week window for
responses.
Avoided the end of semester rush.
Faculty Survey: Limitations
Bb survey respondents were selfselected—automatic bias.
Bb survey notification and access
excluded faculty and students who were
NOT Bb users.
Responses were general, and not coursespecific.
Individual user results were not available.
What our course usage study told
us:
 977 total number of KU web-enhanced courses
in system
 8.6% were non-active and under development
 17% used all or nearly all tools in Blackboard
 47% used only basic functions
 3% used some communication tools
 11% used most assessment features
 Most widely used purpose for using Bb was to
post documents (66%)
 Least widely used tool was the Virtual
Classroom (0%)
What our faculty survey told us:
 1,205 instructors in the system (Faculty,
Adjuncts, Staff, TA’s)
 665 randomly selected for sample (55% of all
instructor users)
 150 instructors responded (22.5% of sample
size)
 58% faculty, 31% GTA, 11% staff
 58% Liberal Arts, 9% Business, 7% Education,
5% Nursing
More Results…
68% of respondents access Bb two or
more times per week
77% of instructors have been using Bb for
at least a semester
Primary motivators for using BlackboardImprove student learning (75%) and
Enhance teaching and technology skills
(63%)
Primary barrier to greater adoption-Lack of
time (61%)
C
se
An Doc
no um
un en
ce ts
m
en
C
on
t
ta E s
c m
Ex t In ail
te fo/
rn B
al io
G Li
r a nk
de s
D
b
is
cu Sta ook
ss tis
io tic
n
Bo s
Q
ui Dr ard
zz op
es B
/S o
G ur x
ro v e
up y
To s
Vi
rt u C o
al ale ls
C nd
la
s s ar
ro
om
Ta
sk
s
ou
r
Percentage
Features/Tools Used
Features/Tools Used
120
100
80
60
40
20
0
97 93
80
68 67 65
42 38
25 23 21 18
Feature/Tool
7
3
Principles
Quanity/Quali
ty of Student
Work
24
Student
Cooperation
31
Active
Learning
33
Diverse
Learning
Styles
42
Cover More
Material
45
Student
Contact
50
40
30
20
10
0
Prompt
Feedback
Percentage
Bb Class Enhancements
Blackboard Class Enhancements
19
9
Type
25
24
Informally w/
Colleague
29
Online
Videos/Tutorials
Conference
One-on-One
51
Small Group
60
50
40
30
20
10
0
Own Pace
Percentage
Training Preferences
Training
51
39
Course
Packs/Reserve
Materials
50
40
30
20
10
0
29
27
25
25
23
Guest Lectures
Group Projects
Peer Editing
Online
Journaling
30
Simulations
and Tutorials
31
Online Testing
33
Virtual Field
Trips
Discussion
Percentage
Future Instructional Activities
Instructional Activities
46
Type
Misc. Items
92% would use Bb again
89% felt Blackboard was easy to use
87% would recommend Bb to others
83% felt IDS training was useful
79% felt IDS support was helpful
78% thought Bb enhanced their course
Misc. Comments & Other Findings
The gradebook, assessment tools, virtual
classroom, and digital drop box were
mentioned as the most difficult to use.
Complaints were typically a result of
misunderstandings regarding process/
procedures or Blackboard functionality.
Version 6 addressed many of the issues
raised.
Summary of Findings
Instructors were not widely using
communication and assessment features.
Instructors wanted to incorporate more
interactive activities but lack of time or
expertise were barriers in doing so.
Instructors apprehension of student
technology skills made them hesitant to
use some Bb tools.
Instructors wanted more options for
training and support.
Accomplishments based on Results
 Training
– Blackboard Strategies and Tools course (Pedagogy &
Overview of all Tools/Features)
– JayBbug-Users Group Meetings & Listserv
– Other Software: LessonBuilder, EDU, Impatica, etc.
 Course Makeover Project
– Personalized, private review and redesign
– Technical Support, Production Services, & Academic
Guidance
Accomplishments based on Results
 Online Resources & Supplements
(Creation of 2 Blackboard Courses)
– Written & Video Tutorials on Blackboard Tools
– Demos of Other Software & Resources
 Ongoing Evaluation & Needs Assessment
– Formal questionnaire (immediately after training)
– Informal “Check-up” (1 month after training)
 Student Training and Support
– FAQ’s (accessible from Bb login page and IDS site)
– Video Tutorials
Future Plans
Conduct a similar survey in Spring 2005.
– Collect evidence if actions taken resulted in
increased utilization.
• Refine the survey questions and rubric guidelines.
• Improve delivery methods.
• Adjust the focus to meet current needs.
Thank You!
 Detailed results and/or the sample questionnaire
can be emailed upon request.
 This presentation will be available from the KBUG website.