How to Make Stained Glass
Formative Evaluation
By
Steven Whitehead &
Felson Thomas-Watson
EDTEC 572 Technology for
Course Delivery
April 2012
1
Table of Contents
Executive summary ...........................................................3
Abstract .............................................................................4
Site creation ......................................................................6
Beta test ............................................................................7
Personal Reflection ................ERROR! BOOKMARK NOT
DEFINED.
2
Executive Summary
Project Goal
Determine usability needs related to the course design and
navigation for the How to Make Stained Glass online training
course.
Process
There were three parts to the evaluation process:
1. Online modules
2. Instructor Guide
3. Feedback regarding usability, ease of navigation, etc;
Findings
Overall, the reaction to the course was very positive. The Beta Test
revealed this new course design was effective in the delivery of
information leading to learner achievement and satisfaction. The
new course design also tested well from a usability perspective.
The feedback on the Instructor Guide will require some
modifications to provide sample images of best practices detailed
in the summary of findings as a negative. We will later incorporate
this change into the new design.
Of significance was the positive user feedback regarding the online
modules on mobility, content, and overall usability, supporting the
viability of this blended e-learning design.
3
Abstract
Stained glass is the art of putting together pieces of colored glass to form images or
mosaics that depict a general image and either foiling the edges with copper foil or
fitting them into channeled lead strips. Stained glass was used as early as the 4th
century in the homes of wealthy Romans. However, it was not until the 11th and 12th
centuries that the demand for stained glass increased significantly with the construction
of large cathedrals and churches. Today, stained glass art is a popular hobby, and
many people enjoy cutting and fitting together pieces to produce panels, windows or
three dimensional pieces.
Figure 1. Main page of the How to Make Stained Glass Website
The stained glass course is an introductory course into the art of stained glass making.
Throughout this course, students study the copper foil method. Students gain practice in
drafting patterns, cutting glass, grinding and soldering the glass together. Safety tips are
discussed, as well as the common tools used.
Figure 2. Module page of the How to Make Stained Glass Website
T
4
Context
The live portion of the course is intended to be delivered via Adobe Connect®. A
Course blog will be provided to enhance community features and peer to peer learning.
Individual modules are available on the course site. Students will receive an initial
orientation on the first day of class. The instructor will explain the functionality of the
website, explain, his/her expectations and present finished projects from the last class
to the new students to provide initial motivation.
Students are required to complete the weekly module prior to class, pass assessments
prior to progressing and deliver all assignments on time.
Students will be required to post to the course blog per the schedule, but will always
have the ability to post their questions, advice or feedback to benefit the community.
Class size will range from 6-10.
Meetings will be held weekly from 30-60 minutes depending on the module.
Instruction will require a minimum of:
 Computer
 Internet access
 Microphone
 Camera
 Stained glass tools and equipment
 Associated software
The instructor will need to be an experienced stained glass artist, have strong
communications skills and a basic knowledge of computers. The instructor guide is
detailed and formatted in Gagne’s Nine Events to help guide the instructor through the
course.
5
The Web site includes four categories: Modules, Helpful Links, Instructor Contact and
an Instructor Guide.
How to Make
Stained Glass
Modules
Helpful Links
Instructor
Contact
Instructor
Guide
Figure 3. Basic site hierarchy
The Modules section provides video tutorials of eight separate stages in the stained
glass making process: Tools & Equipment, Patterns, Glass Selection, Cutting, Grinding,
Foiling, Soldering and Framing. The Helpful Links section provides useful links to
resources. The Instructor Contact section provides avenues for the students to
interact with the instructor and the Instructor Guide provides a framework for the
Instructor to deliver the course material.
Site Creation
The Web site was created using Google Sites ®. The blog was created using
Blogspot.com. Modules were created using Brainshark® and then converted to movies
using Youtube®.
Figure 4. Module 1 landing page
6
Beta Test
Population
The population was a combination of educational professionals.
The participants were purposefully chosen based on their lack of
knowledge of stained glass.
Of the five participants, two had advanced degrees in Educational
Technology, one from Boise State University and one from San
Diego State University. The other three participants hold secondary
degrees in non-education related fields, yet actively engaged in
training.
Process
This Beta Test was multi-faceted and covered student and
instructor aspects of the course. The process consisted of an initial
interview that provided general information about their level of
experience in the subject matter, taking the course, post-testing
and a reaction survey.
Beta testers were then directed to view the individual modules,
answer the associated quiz questions, and document their
reactions to the instructor guide and usability of the website on the
Instructional Utility and Functionality Forms (see Appendix A&B).
Summary of
Findings
Instructional Utility: All of the learners were able to access the
modules and answer the quiz questions with a passing score.
Learners commented that they liked the objective statement at the
beginning of the modules. Additionally, beta testers commented
positively on the use of YouTube. The ability to take the course
anywhere was ideal, resulting in a more accessible mobile friendly
delivery. When asked if they felt they could use this knowledge
immediately, two individuals reported they were only somewhat
confident, while the remaining three felt very confident. The
learners, who were only somewhat confident, stated their
reservations were based on the inability to practice the practical
applications. Two learners commented on the lack of examples of
an ideal end state for each module.
Learners commented that they liked the course blog and the ability
to post questions and comments to their fellow students.
Learners They also liked that the instructor guide was broken down
into Gagne’s Nine Events, providing the instructor with an outline to
help guide the class discussions and reduce class preparation time.
Site Usability: All of the learners found the site navigation easy.
Three of the learners commented positively on the graphics. All of
the users indicated they liked the ability to control the functionality
of the YouTube videos. One learner commented positively on the
weekly schedule providing easy access to modules and tests.
7
Appendix A-Instructional utility
HOW TO MAKE STAINED GLASS
Thank you in advance for providing specific feedback.
QUESTION
COMMENT
Was the instruction interesting? Did it
hold your attention?
Did you understand everything you were
supposed to learn?
Did the objectives directly relate to the
instruction?
Did you feel your knowledge was
measured?
Did you feel confident when answering
questions?
Did you feel that you will be able to use
this knowledge immediately?
Do you feel the social interaction would
enhance your ability to learn the topic?
What aspects inhibited your learning or
transfer of knowledge?
How might training be improved?
Was it too long or too short?
What did you like most? Least? What
would you change if you could?
8
Appendix B-Functionality Form
How to Make Stained Glass
Thank you in advance for providing specific feedback for each page.
Page: ________
Feedback:
____________________________________________________________________________
____________________________________________________________________________
________________________________________________________________
Page: ________
Feedback:
____________________________________________________________________________
____________________________________________________________________________
________________________________________________________________
Page: ________
Feedback:
____________________________________________________________________________
____________________________________________________________________________
________________________________________________________________
Page: ________
Feedback:
____________________________________________________________________________
____________________________________________________________________________
________________________________________________________________
Page: ________
Feedback:
____________________________________________________________________________
____________________________________________________________________________
________________________________________________________________
Page: ________
Feedback:
____________________________________________________________________________
____________________________________________________________________________
________________________________________________________________
9
Personal Reflection
In completing this project we were faced with creating instructional material that could
be used to teach the art of creating stained glass. This was a challenge because
instead of a traditional classroom, the course was to be offered online. We had to take
into account the site navigation, modular structure of the lessons, assessments,
discussions and feedback from both an instructor and student standpoint. After the beta
testing we experienced the importance of getting feedback from other users to improve
usability and instructional content.
10