CET Self Study Notes - University of Oregon

advertisement
Center for Educational Technologies (CET) Self Study
June 21, 2007
Overview
The Center for Educational Technologies (CET) was established in October, 2004, with
the mission to promote active learning through innovative use of technology. Services
include training, consulting, media production, and project management. In addition to
providing direct services, CET provides reference and referral to other UO units that
may cater to specific instructional needs.
For more information, see the website at http://libweb.uoregon.edu/cet/.
History
Prior to 2004, the services provided by CET were spread through four separate library
units:
• Established in 1994, the Academic Education Coordinator was a staff position focused
on technology-related faculty development and training). Reported to University
Librarian and later, to the Associate University Librarian (AUL) for Instructional
Services.
• Established in 1999, the Faculty Information Technology Training (FITT) Center
provided drop-in training, consulting, and access to production tools. The FITT Center
was managed by a part-time manager who also supervised the oordinator reported to
AUL for Instructional Services.
• Blackboard (course management system). Initially implemented in 1999 and managed
by the Academic Education Coordinator in partnership with Library Systems; expanded
in 2003 in partnership with UO Information Services.
• Interactive Media Group (multimedia production). Formerly UO New Media Center
and became part of the Library system in 2000. Director reported initially to Head of
Media Services and later, to the AUL for Instructional Services.
In summer 2004, in response to concurrent library initiatives and recommendations from
the Educational Technology Coordinating Committee, the Provost’s Office provided
recurring support that established CET as a permanent department. Refer to Appendix
___ for further background on this allocation.
Staffing
Current organizational chart (6.5 FTE plus approximately 6600 hrs/year student labor):
16 May 2007
CET Self Study Notes
JQ Johnson
Director
Kirstin Hierholzer
Assistant Director
Tim Boshart
Blackboard Coordinator, ITC 2
David McCallum
ITC 2
Nargas Oskui
Consulting Manager, .5 FTE ITC 1
Students
5; ~2600 hrs/year
Azle Malinao-Alvarez
ITC 2
Shayne Huddleston
tech lead, ITC 2
Students
4-5; ~4000 hrs/year
Facilities
CET Consulting is located in Knight Library, Room 19. Hours of operation are
9 a.m. to 6 p.m., Monday through Friday.
CET: Interactive Media is located in Knight Library Room 30, with staff available on an
appointment basis
Services overview
To a first approximation, CET services can be seen as divided into 4 components:
1. Technology consulting and training, primarily for faculty
2. Management of the UO Blackboard system
3. Media production
4. Support for faculty technology innovation
Consulting currently provides a reception area for CET and a library service point for
faculty, GTFs, and staff, with a heavy focus on consulting and training in educational
technologies and specific applications to UO courses. The service point is studentstaffed, and open 45 hrs/week throughout the year. Although the staff have a wide range
of software expertise, they are seen as particularly strong in Blackboard and media
production (especially video). In addition, Consulting provide access to hardware for its
customers, organizes campus training events, office visits, symposia, etc., and provides a
few additional production services for instructors such as occasional slide scanning or
video encoding.
The Blackboard system provides coursesite support for all UO courses. It is used in a
typical term by perhaps 1300 courses, 1500 faculty and GTFs, and 17,000 students. For
example, during spring term 2007, approximately 55,000 student credit hours (2/3 of all
hours) had a Blackboard component.
CET:IM (Interactive Media) designs and implements major media intensive projects.
Most CET:IM projects are standalone database driven graphically-intensive websites,
produced using a waterfall and team-based development paradigm. CET:IM typically
2
16 May 2007
CET Self Study Notes
works on 4 to 6 projects at any given time, with a target of completing at least 2 major
projects each quarter. The primary target is instructional-support projects for CRN
courses, which we internally fund. As capacity exists we also do grant-funded projects
based on an hourly billing rate, and do additional projects, particularly projects with an
internal library component.
Additional CET activities not neatly categorized above range from support for
educational technology workshops taught by other departments, to the hosting of faculty
IT Fellows, to sponsorship of initiatives bringing together faculty and computing staff to
investigate new technologies. CET regularly assists in summer IT courses for faculty
taught by other departments, including a “Basic IT” taught by the Teaching Effectiveness
Program (TEP), “Multimedia for Teaching and Research,” taught by our Yamada
Language Center and Social Science Instructional Lab, and “Course Redesign for Hybrid
Learning,” originally developed by CET and TEP and this summer taught primarily by
TEP. During 2006-07 CET hosted two IT Fellows (fellowships awarded and funded by
the Provost), one to Kathleen Scalise, Educational Leadership, for applying her research
in “Differentiated e-Learning Strategies for Instructional Design” to UO CRN courses,
and one to Jane Ritter, Computer & Information Science, for “Teaching a ‘Plugged-In’
Audience: Podcasts in Intro CIS Classes.” Initiatives during 2006-07 where CET was the
lead organization have included evaluation of podcasting support, antiplagiarism
software, and classroom clicker technology; CET staff have also participated in several
other collaborative initiatives and planning groups including development of the library
Learning Commons, Information Services task forces, an eportfolio group, etc.
Budget notes





Total recurring budget is about $620K/year, plus ~ $10K income
Expenditures for 2006-07 likely to be $730K
60% of funding is from Technology fee
Media production is about 1/2 of total expense
About 80% of expense is for salaries, 10% Blackboard license, 10% other
ICC 4%
Other 9%
Other
20%
General
Fund 28%
Black
board
16%
Ed Tech
59%
Consult
10%
CET-IM
54%
In addition to recurring budget, CET presently has a non-recurring carryforward of
approximately $250,000, most of which dates from the Library’s absorption of the UO
New Media Center. It manages a fairly large amount of hardware, including the nondatabase components of the UO Blackboard system (including 8 servers), CET
Consulting (6 patron-access workstations plus miscellaneous media production
equipment), and staff workstations. Initial funding for acquisition of the Blackboard
3
16 May 2007
CET Self Study Notes
system came from a 1-time Ed Tech Committee (Technology fee) allocation in 2003.
Ongoing maintenance and replacement of all of the hardware is currently funded from the
recurring budget or from carryforward.
The average cost of providing drop in consulting service is moderate. We typically have
about 30 hours/week of consulting patron presence, and the cost of the facility including
staffing and equipment amortization is perhaps $900/week, so cost per patron hour is
about $30; since we have some spare capacity marginal cost is near 0.
The total annual cost of providing Blackboard, including direct costs (about $180K/year),
database services provided by Information Services, and equipment amortized over 4
years is about $250K/year. During the 2006-07 academic year, we provided Blackboard
service to about 4500 term-long coursesites and 220K student enrollments. This works
out to about $55 per coursesite or about $1.15 per student enrollment in a course that uses
Blackboard.
The total cost of providing CET:IM services is about $335K/year, perhaps $300K of
which is devoted to projects and overhead. We typically complete about 6 to 8 projects
per year. Although projects differ dramatically in scope, this suggests an average project
cost of about $35K to $40K.
Results of Group Self Study Meetings, May 2007
As part of preparation for this self-study, the seven regular CET employees met for 3
hours of “retreat” to discuss several questions posed by library administration. This
section describes some of the opinions expressed and conclusions.
Alignment with Library Mission and Goals
CET’s stated goal is to be “a one-stop shop for UO instructors who want to make more
effective use of technology in their teaching. CET provides assistance and referrals for
educational technology training, support and production. Our mission is to promote
active learning through innovative use of technology. The Center's professional staff
offers training, consulting and project management as needed to address instructional
goals.”
The CET staff see the department as offering:
 pedagogical tool development, administration (Blackboard, CET:IM projects)
 user experience expertise (even beyond the web)
 training of faculty
 access for instructors to teaching tools (Blackboard, Consulting facilities)
 campus leadership in deployment of new educational technologies
One concern is that since our primary clientele are faculty we are one step removed from
students as we attempt to support the library’s goal of enriching the student learning
experience. Our only significant direct relationship with students is through our use of
student employees.
4
16 May 2007
CET Self Study Notes
The staff also noted our focus on instruction, including our pricing model for
development projects, which is free for CRN courses but quite expensive for other work,
and our skill set which is strong in website design, graphics, and instructional
applications but is quite limited in research methods and tools. Members of the group
expressed the concern that this focus may lead us to miss opportunities to support
research.
Our self study discussion suggested that we might modify our goal statement to focus
more on:
 Directly promoting active learning
 Providing more support for research rather than instruction
 Offering workshops (we are actually quite active in this area, with “on demand”,
multimedia boot camp, Hybrid course, the April Symposium, etc.)
 Outputs: the impact we have on faculty, other campus orgs. (TEP, etc.), students
Stakeholders
The self-study group attempted to answer the question “Who else on campus cares, or
should care, about what we do?” We see primary stakeholders as:
 Faculty customers
 TEP (Teaching Effectiveness Program)
 Information Services
 Library Admin
 Other library departments
CET Accomplishments in the past year
This list was produced in discussion without much review, so it probably misses several
significant items. For more details about specific projects, visit the CET Portfolio site at
http://libweb.uoregon.edu/cet/portfolio/index.html
















Sports History website
Scribe tutorials
Alaskan Rock Art database
Library website
Course Connector website
Shaping the Way we Teach website
Sports Sponsorship Flash Races
Online English Language Center website
IT Directory website
Peer coaching
Azle's CSS workshops
Multimedia summer workshop participation (tutors, panel)
Workshops on Demand
Hybrid Course summer workshop
In-Office Consultation initial implementation
Collaboration with TEP
5
16 May 2007












CET Self Study Notes
Marketing materials: Rulers, Brochure
Blackboard upgrades – we tend to be successfully on the leading edge
Improved Blackboard statistics gathering
Improved communication with Information Services
Blackboard high system availability and overall increases in usage
Blackboard Committee as example of successful patron input
Pacific Northwest Blackboard Users Group
WebDev participation
Censorship exhibit
Summit Short Term Usability Group
OLA panel presentation - website redesign
Symposium - Computers in Teaching and Learning
Comparators
Who should we evaluate ourselves against? We observed that different comparators may
be appropriate for different services within CET. For example, Second Story, a Portland
media production firm, was identified by CET:IM staff as appropriate for our production
work but not for Blackboard or Consulting. Microcomputer Support in Information
Services is an appropriate comparator for our consulting services. Princeton is perhaps
appropriate as a well-run Blackboard site, but their funding situation is very different.
On-Campus Comparators









SSIL
Yamada Language Center
Wired Humanities Program
InfoGraphics
TEP
Creative Publishing
Media Services
Library ITCs
IS Microcomputer Help Desk
External Comparators
CET does not systematically track external comparators. Standard university
comparators include institutional comparators (U C Santa Barbara, U Colorado, Indiana
U, U Iowa, U N Carolina, U Virginia, U Michigan, U Washington), four CAS
comparators (U Maryland, U Mass Amherst, U Pittsburgh, U Wisc Madison), and a range
of computing comparators (e.g. Emory U, Oregon State U). Our perception is that many
of the standard comparator institutions have very different computing organizations from
the UO’s, hence are difficult to use as CET comparators. In brainstorming, we identified:

Other universities, general
1. MIT
2. Iowa – Instructional Services
3. Duke (similar organization also part of the university library)
6
16 May 2007


CET Self Study Notes
4. Oregon State U
5. Portland State U
6. U Washington
7. U Colorado
Other universities with comparable Blackboard systems:
1. U North Carolina
2. U of Kansas
3. Emory U
4. U Pittsburgh
5. Oregon State
6. U Chicago
Second Story, http://www.secondstory.com
What Assessment should we be doing?
Our overall perception is that we need more assessment. We want to be able to
determine whether what we are doing is contributing to improved student learning
outcomes. At the moment, we don’t even know which CET:IM website design projects
from previous years are still being actively used.
Current:
 Blackboard is keeping good usage stats, but not assessing outcomes. See for
example http://blackboard.uoregon.edu/local/mrtg
 Consulting stats include identities of patrons, but not any measures of satisfaction or
outcomes.
 CET:IM is currently doing only irregular followup on projects.
Future:
 Overall: we should get more feedback from clients
 Overall: we should look at usage statistics and satisfaction reports to help shape how
development projects are chosen in the future
 Need some web assessment and statistics on main cet site
 Need to reinstate project evaluations (pre and post-?)
 We should look at traditional software engineering metrics
 Measure number of service inquiries, type of inquiry and why service was or was not
provided
 Conduct surveys of (faculty) demand for services
 Conduct surveys of former clients/patrons
 Consider instrumenting all CET:IM delivered projects to measure usage with google
analytics
SWOT
We conducted a SWOT analysis, followed by a partial USED analysis. This analysis
reflects the items mentioned by the group, and does not always reflect JQ’s perceptions.
7
16 May 2007
CET Self Study Notes
Strengths:
 Team work
 Staff technical knowledge
 Awareness of campus computing
resources
 Process / support (especially
CET:IM intake process)
 Up to date technology
 Competent students
 Variety of services
 Customer service
 Personal relationships with faculty
Weaknesses:
 Integration among parts of CET
 Marketing
 Assessment
 Professional development (too
narrowly tech focused?)
 Funding: recurring funding doesn’t
cover existing expenses, and not
adequate for expansion in FTE
 Lack of connection / coord. with
other library services
Weaknesses specific to cet:im:
 Not enough programmers
 No unified development
environment
 Inadequate centrally supported
delivery environment
Threats:
 Funding at risk if Ed Tech process
changes
 Competition with other service
units (e.g. SSIL, Information
Services)
 Difficulty finding high-quality
programming staff/students
 Dependence on Library Systems
 Staff retention due to wages
Opportunities:
 Campus Trouble ticketing system
 Workshops / presentations
 Can offer set of tools (e.g. timeline)
 Our location in library (relationship
with Library subject specialists)
 Rapid growth in Web 2.0
 Blackboard Scholar
 Learning Commons extension
 Sharing/collaboration with other
campus services, e.g. TEP
 New IS Director of Academic
Technologies
 UO Portland Center
 Ed Tech Committee good/bad
 Student Interns ~ cet:im production
Some Decision Points
We identified a few decision points we expect in the next few months.
Podcasting and Eportfolios?
Each of these are new technologies that we don’t currently have a plan for systematically
supporting:
 We hope to join Apple’s iTunes U. If we do so, how should we integrate that service
into our existing services and how should we leverage it for maximum instructional
benefit? How should CET’s podcasting support relate to the existing streaming
media support services in Media Services?
8
16 May 2007
CET Self Study Notes
 A group of UO faculty and staff has been meeting for the past year to explore the
potential for eportfolios. Several schools now have eportfolio projects using a
variety of technologies ranging from indexes of student web sites, to blogs and wikis,
to Second Life. Last year CET experimented with Sakai and the Open Source
Portfolio Initiative, and has participated at a fairly low level in the ongoing eportfolio
ad hoc task force. What role should CET have in supporting eportfolio use at UO
over the coming year?
Blackboard upgrade?
The Ed Tech committee has approved funding for a significant upgrade to the database
component of the Blackboard system. We need to develop plans for the timing of the
upgrade, and to explore what it will mean for our overall management of the system.
Additional issues include specifics of software upgrades this summer (Aug 18), and
whether to pursue various add-ons to Blackboard including plagiarism detection
software, secure exam software, blogs and wikis within Blackboard, etc. A second major
issue will be how to open up Blackboard access to a wider range of instructional
personnel, especially visiting lecturers, practicum supervisors, etc.
Servers for CET:IM project delivery?
CET:IM feels constrained by the lack of a coherent delivery platform for its projects.
The most natural such platform, the Information Services shell/www server system, does
not offer adequate programming facilities and has policies that make it difficult to deploy
modern websites. Should we purchase our own server and host such projects in-house?
Alternatively, should we move away from custom DB driven websites?
Change relationship w/ Media Services?
Given strong connections between some of the services offered by CET and Media
Services, and given the changes likely driven by replacing Tom Matney (recently retired
head of Media Services), should we reassess organizational structure?
Balance of Instructional vs Administrative/Research Support?
What should our criteria be for taking on development projects, who should we serve in
CET Consulting, and for what sorts of applications (in addition to CRN courses) should
we encourage Blackboard use?
Balance of CET Services?
Is the balance in expenditure for the various CET services appropriate, and does it
maximize the impact of our funding on teaching and learning?
9
Download