iLearn Drop-in Clinic Report Summary

advertisement
iLearn Launch Report
Summary
April 2012
prepared by Margot McNeill
with input from Elaine Huber, Kathy Sewell, Lucy Arthur, Yvonne Breyer, Craig Pippen,
Amanda Parker, Carlos Dominguez, Alison Schloss, Chris Lavina, Tony Dwyer
Session 1 Launch
Following the successful launch of iLearn for Session 1, 2012, this report provides an overview of Change Stream activities
in the weeks immediately after the implementation.
While there are many successes that have emerged from the project so far, it is particularly telling that almost 85% more
online units were delivered for Session 1, 2012, using the new learning platform than for the Semester 1 2011 (from 760
to 1402 as a snapshot of day 1 of semester). This was partly due to changes in policy, where all faculties used the extra
support offered during the implementation as an opportunity to progress the policy of all units having an online presence.
Given this marked increase in online offerings, along with the additional complexity of changed processes for iTeach and
Echo360 and the IT Support Team’s reported drop in Help tickets of 32% is remarkable. More detail is provided later in
the report, however some highlights include:
Transformation
The establishment of iLearn Faculty Implementation Plans enabled faculties to initiate targets for numbers and minimum
standards for units of online that were not previously available. 970 were targeted for these minimum standards in iLearn
for Session 1, with all but 28 meeting the faculty minimum standards. Processes are still underway to:

encourage these individuals and

review the minimum standards for the next phase in preparation for Session 2.

Reflections from project team members as part of the overall evaluation capture the evidence of transformation
to date, such as the types of requests changing from using the tools to adding new tools or strategies. Although
transformation is seen as a longer term goal, there is already evidence of success, for example, many staff
members followed up attendance at workshops with a call to the Drop In Clinic to ask for a refresher or
‘someone to just check over their unit.’
Capability Building
The iLearn training program was very successful in supporting the move to iLearn. The program was designed to progress
from an introductory tour, to sessions providing basics, opportunities for hands-on moving and exploration of specific
tools. There were 1973 attendances recorded, excluding the Drop In Clinic.
Change Stream April 2012
Faculty and Department details have been removed
1|Page
The Drop In Clinic was conducted during the week prior to start of session one and continued for the next two weeks and
recorded 428 attendances. These sessions, as part of the wider training and support program, have helped in building up
goodwill and engagement and plans are being considered to extend the clinics on an ongoing basis.
Support Plan. For most faculties, all requests were managed through ilearn.help@mq.edu.au and requests forwarded to
ITSOs as required. This enabled tracking of requests and feeding of issues back in to FAQs and training plans. ILOs were
then briefed about priorities and issues. The support plan was successful in streamlining support procedures in most
cases, although processes will be reviewed with the ILOs, ITSOs and Helpdesk team to reduce duplication and streamline
reporting.
In terms of support, iTeach, login issues associated with OneID and Echo360 were the main issues. These were aspects
of the project that were not able to be integrated into the change management processes during 2011, again suggesting
the value of the longer lead time before launch. Those relating to specific tools in iLearn have been condensed into Quick
Guides and integrated into the training suite. Overall, there were 5,378 views of the iLearn Quick Guides page. There
were also other significant views to the FAQ area 1,440 and the training page received 4,630 views.
Overall, the faculty liaison teams were key enablers of both transformation and capability building. These teams built
positive relationships with Associate Deans (L & T), planned faculty specific implementation strategies and worked with
groups and individuals to develop confidence in using the new system. Previous studies (McNeill, Gosper & Xu, in press)
reiterate the link between confidence and their design of curriculum to target higher order outcomes in learning and
assessment.
Issues and Priorities for the Next Phase
While the project has been highly successful so far in encouraging transformation and capability building, it has also
resulted in tensions as traditional practices are changed. For example the move was used as a catalyst for introducing
new policies such as limiting access to the LMS to those with MQ login details. Some academics expressed frustration
when they were not able to instantly enrol guest lecturers or students as observers in their units. Policies and procedures
articulating more flexible enrolment procedures are currently being developed and will be communicated to staff during
preparation for Session 2.
Quality Assurance and enhancement measures are to be prioritised in preparation for Session 2. Checklists to support
faculty staff in QA checking of iLearn units are under development and procedures will be incorporated into the next
round of Implementation plans. Discussions of analytics and reporting mechanisms are also underway to equip faculties
and departments to monitor quality. Quality Enhancement measures such as Peer Observation, revised templates and
showcases are also being incorporated into these plans.
The next priority for the Change team is the development of the faculty implementation plans for Session 2. ILOs will be
working with Associate Deans L&T on strategies to encourage those convenors who have not yet met the minimum
standards, along with reviewing standards for Session 2, embedding QA and QE processes.
Some processes will be reviewed prior to Session 2, for example, movement of all content from Blackboard to iLearn. In
those faculties where this didn’t happen, there were very few requests for this to be done as most convenors seemed
happy to design units from scratch. For Session 2, emphasis will be placed on supporting academics to undertake tasks to
help build their confidence levels prior to a drop in support for 2013.
MQs reliance on Sessional staff emerged from the initial pilot as a barrier to the achievement of both transformation and
capability building. With Sessional staff members engaged as unit convenors, as highlighted in the pilot, there is little
encouragement for transformation of online units. Drawing on the experience from the pilot, the ILOs led the
development of plans to support Sessional staff in the lead up to the launch in Session 1, however there was still a spike
Change Stream April 2012
Faculty and Department details have been removed
2|Page
in the need for training to prepare these staff members for using iLearn. ILOs will work with the Associate Deans (L&T)
on plans for next session.
While the support plans and drop in clinic were very successful in meeting many immediate support needs, a new spike in
requests for help has begun to emerge a few weeks into the session. For example, convenors have reported of issues
with activities such as quizzes and forums which were visible only when the students began using the tools and not in the
lead up to the session. While the technical team is working to address these issues, it suggests the need for more agility
in LTC planning planned in case the drop in clinic is continued for more weeks into the session. The technical team is also
looking into providing for a demo student login for Session 2 and more broadly at request for enhancement processes.
More detail is provided under the following sections:
Contents
iLearn Launch Report ............................................................................................................................................... 1
Summary ................................................................................................................................................................ 1
April 2012 ............................................................................................................................................................... 1
Session 1 Launch ................................................................................................................................................. 1
Overview of Faculty Activity................................................................................................................................... 4
Communications Strategies .................................................................................................................................. 4
Students .......................................................................................................................................................... 4
Feedback ......................................................................................................................................................... 6
iLearn Drop-in Clinic Report Summary .................................................................................................................... 8
Total Attendance .............................................................................................................................................. 8
Repeat Attendance ........................................................................................................................................... 8
Types of Help Requested ................................................................................................................................... 9
Biggest Issues Faced......................................................................................................................................... 9
iLearn Website Statistics ..................................................................................................................................... 10
iLearn Session 1: LTC Service Desk ..................................................................................................................... 11
Change Stream April 2012
Faculty and Department details have been removed
3|Page
Overview of Faculty Activity
A database was established early in the project to capture activities from the faculties. This information has been used in
overall reporting and by Associate Deans L&T for faculty-specific reports. Reports were generated weekly on units:

That were accessed by the convenor

Where convenor had requested help in moving BB content and adding some iLearn elements such as Echo block

Where convenor had requested ED/OED input = instructional design advice and assistance

that haven’t met faculty minimum standards.
These have been removed for the public report.
Communications Strategies
Students
Advertising Campaigns
Awareness campaigns were started in 2011 for the student audience. There were advertisements in Grapeshot magazine
and on the Student homepage in 2011 to advise the change of online learning management system for S1, 2012. These
were targeted to catch students before they left campus for the year and as such this information was mainly an
awareness campaign directing students to the iLearn website where information would be found when available. At this
time much of the information and guides now found on the iLearn website > Student Information were not created or
available, however there was a small amount of content there as a place marker.
For S1, 2012, student postcards were printed and distributed across campus, for example:

On desks in centrally managed computing labs

On Library tables/desks in the study and seating areas

Library Help Desks (2)

Student Help Desk

Orientation booths

Drop In Clinic

Any other area the project team, eg. ILOs may have distributed them, eg. Departmental Student Enquiry Desks
Student focused iLearn advertisements ran on the big screens around campus for an awareness campaign starting
from O-week for a fortnight. Content on the big screens is only screened for a two week period but any students
coming to campus earlier than that particular fortnight would also the see the campaign run for Staff (Are you
ready?) which was very similar and may have prompted some notice and possibly action by students.
The Enrolment pack and Student Diary for 2012 also contained a half page advertisement on iLearn.
Change Stream April 2012
Faculty and Department details have been removed
4|Page
Student postcards, campaigns around campus, publications and ask.mq.edu.au provided information focused on:

What iLearn was

Where to login

Where to get more information and resources

And where to find technical assistance (OneHelp)
Similar campaigns will be run in the lead up to S2, 2012.
Resources
Once the priority resources and training required for convenors was produced or established so they could start work on
their S1, 2012 units, the Training Resources team focused on the needs of students. The originally minimal iLearn
website > Student information expanded to contain the following information and materials:

GETTING STARTED – slide shows narrated by students on how to access iLearn and get started using the system

ACCESS ILEARN – information necessary to log in to iLearn, eg. student ID number, passwords, getting technical
help to access iLearn

Technical Information – browser recommendations and security and policy information.

STUDENT GUIDES – Quick Guides for students to follow on how to use iLearn, covering such things as Netiquette,
Forums, setting up your profile and guides on using the specific tools and activities within iLearn. Many of these
will go on to have screen capture/video versions available as well.

ONLINE STUDY TIPS – this was refreshed from an existing page in Bb reference material but is equally relevant for
iLearn.

CONFIDENTIALITY – Covering confidentiality and privacy – again refreshed from content existing on the Bb
reference material. In light of recent confidentiality concerns this will need to be revised when MQ Legal have
produced the documentation.

Student Feedback – inviting students to provide feedback regarding iLearn.
In addition to the above information, and in response to concerns by convenors that they would be expected to “train”
students on iLearn, a resource was produced for convenors to run for their students during the start of lectures or
orientation. This consisted of a Powerpoint slideshow containing instructions and screen shots again covering the main
topics: Where and how do I log in; where do I find training materials and more information; where and how do I get help.
Observations
Most of the emails that flooded in to the iLearn@mq.edu.au address over the month straddling the start of S1, centred on
the two following queries:

When can I see my online unit (before the start of S1)

Why can’t I see my online unit (start of S1)
As each of these were common questions that could usually be answered with a standard response, these have been
added to the ask.mq.edu.au system. Question 2 is mainly prevalent due to issues with iTeach enrolling students resolution prior to S2, 2012 should see this query greatly reduce.
Change Stream April 2012
Faculty and Department details have been removed
5|Page
Feedback
Considering the size and impact of this project at Macquarie there has been overwhelmingly positive feedback received to
the iLearn@mq.edu.au email address. This could be due to several factors, the first being that relative to Blackboard,
iLearn shows a considerable improvement – even with teething problems that may have been experienced in a new
implementation. Secondly, the number and quality of staff on the project providing resources, training and support has
greatly reduced the problems that may have arisen – additionally these staff could also have provided an alternative
stream for any issues/complaints. However, it could still be expected that a generic email address would provide an
obvious target for complaints from frustrated and angry staff and students, and happily this was not the case. Emails
received at the project email address were usually articulate, constructive and cooperative towards finding a solution or
providing feedback.
Positive Feedback regarding iLearn Team
The overall feedback regarding the iLearn team has been very positive. Praise has been received from Deans, HODs, AD
of L&T and convenors – all appreciative of the support and professionalism displayed by the team. Below are some
examples of unsolicited feedback received by team members:

Helpful, patient,

Quality of the assistance provided is great

Having had your support has made all the difference to the way in which we've been able to begin our new
semester.

Thanks for your help on Thurs and with my iLearn - you were like a guiding angel and I was in so much
distress!

But thank you again for being so brilliant and helpful!

You are a star. It really is terrific to get such timely and helpful responses.

The team has done a great job developing resources, keeping us informed and engaged, maintaining
enthusiasm, and training staff.

..i love this new iLearn platform....much, much better than blackboard...especially the discussions boards
which are big help....thanks again guys for your help...

Thank you thank you thank you!!! It works!!! SO glad and I really appreciate everything you have done. So
again, Thank you thank you thank you!!! (student)

Once again, my hero! Thanks so much!

Many thanks for your team to trying to help us. Your team has been doing a good job.
Feedback on Functionality of iLearn
Feedback received to the ilearn@mq.edu.au email address regarding improvements/changes students and staff would like
to see in the future run along the following lines (primarily from students). These are listed in order of frequency of
request:

Access to units in iLearn earlier than the first day of Session
Change Stream April 2012
Faculty and Department details have been removed
6|Page

Forums, digest of forum updates - improved functionality

Email (probably dialogue is the tool they mean) and announcement icons on the homepage and visible once
you’re logged in so you don’t have to go into each unit to see if there’s an announcement.

Email subscriptions to unit announcements and forums

Inability to add students to a unit that the student is not enrolled in via eStudent.

OneHelp tickets taking too long to resolve.

A “Links” block in iLearn as standard part of the template and containing links to pages such as eReserve .

iLearn seems to run much slower than Blackboard and tends to lag more regularly.
Change Stream April 2012
Faculty and Department details have been removed
7|Page
iLearn Drop-in Clinic Report Summary
20 February – 9 March 2012
Total Attendance
Total of 428 attendances
This included 377 staff and 51 students (see Figure 1 below)
Peak of 72 on first day of Session 1
Figure 1: Drop-in Clinic attendance 20 Feb – 9 March, 2012
Repeat Attendance
Many were repeat visitors, with 84 staff (36%) returning more than once.
232 individual staff visited the Clinic
1 Visit
148
2 Visits
39
3 Visits
20
4 Visits
8
Change Stream April 2012
Faculty and Department details have been removed
8|Page
5 Visits
4
Types of Help Requested

iTeach online was the most popular help request. The team ensured that everyone who came through the
Drop-in Clinic had activated or knew how to activate their unit.

Initially most questions in the first week related to the ‘basics’ such as adding files, setting up unit structure and
rearranging the template.

Turnitin was also an unexpectedly popular activity to set up. This should be an area to look at for further
professional development.

In the second and third weeks, many staff returned to the Clinic for additional help with setting up more
interactive elements in their unit such as online Quizzes, Assignments, Forums and Blogs. with many people
putting in a huge effort to ensure their iLearn unit was as engaging as possible for students.

Others indicated that for Session 1, they would focus on just mastering the ‘basics’ and in subsequent semesters
are hoping to learn about the other tools available to improve their unit one step at a time. Transformation will
be a gradual process, but many staff are working towards it, as long as we scaffold the training and allow them
time to adapt.

Towards the end, much more challenging requests came through such as Groups, Quiz settings and
Gradebook management. This meant that whilst total attendance dropped towards the end of the clinic, length
and difficulty of consultation increased.
Biggest Issues Faced

Duplicate units: Some Convenors accidently activated their unit twice in iTeach when clicking on create new
online instance, instead of editing the current unit already in their My iUnits. This was temporarily dealt with by
lodging a ticket to have the duplicate removed. However, will be better prepared for this in Session 2.

The Make this unit available to students button in Edit Settings when changed could override access dates
in iTeach. The tech team decided the best solution was to disable this button.

Students: We unexpectedly had quite a few students come into the Drop-in to ask in general about iLearn or to
see why they couldn't access their unit online. The “Is my unit online?” facility was a big help here
http://help.ilearn.mq.edu.au/unitsonline/ .

Sessional staff One ID access. This was a big problem where sessional/casual staff could not login to iLearn
until their One ID was activated at the start of their employment contract. This often meant they could not work
on their unit or participate properly in training. Hopefully we can work with Informatics and HR on a better
solution for this.

Convenors of large classes wanting automatic Groups created for tutorial groups. At this stage iLearn does
not recognise tutorial groups from Student One, but there is hope that we can work towards this in the future.

Dialogue: Many people were concerned that convenors in the unit could see all dialogue correspondence. As a
result this was disabled so that only iLearn admin can access these.

Echo360: There were some teething issues with the implementation of the Echo hardware meaning some
recordings were missed. Once these are resolved we’ll be looking at a much better lecture recording system.
Change Stream April 2012
Faculty and Department details have been removed
9|Page

Groups not working properly for Turnitin, Dialogue and Single simple discussion. Make sure people don’t try to
use groups for these activities.

Staff wanting to enrol individual students or students as tutors. This is really a policy decision which is
currently being discussed.
iLearn Website Statistics
iLearn website had a total of 83,078 views altogether, in the period 1 October 2011 to 16 March 2012. As evident in the
graph there was a sudden HUGE spike in usage just at the end of February.
The peak day was Monday 27 February with 2415 hits. From there it declined every day that week to about 1000 hits on
the Friday. In the last month only 23% of iLearn web site users were returning visitors. Almost 77% of hits were from
users who had never accessed the site before!
Top 10 Pages Were

iLearn home page (predictably) with 21,627 views

Student Info page with about 10,049 views (this is really amazing because the student pages have only existed
for a month or so!)

The Quick Guides page with 5,378 views

The Training page with 4,630 views

The Students' "Getting Started" page with 2,644 views

The exemplar units home page with 2,590 views

The staff resources home page with 2,493 views

The students "Access" page with 2,188 views

The FAQ page with 1,440 views

The iTeach page with 1,258 views
The pages in the resources directory were accessed a total of 20,982 times (this includes the Quick Guides, Info Sheets
and Fact sheets). The most popular of these in descending order (ignoring the landing pages) were Turnitin, Lecture
Recordings, How to Access, iTeach guides, How to edit your profile, Quizzes, Blocks, the video about navigating iLearn,
Enrolling Users, Using Groups, and the Info sheet about how to use iLearn tools to save time.
Change Stream April 2012
Faculty and Department details have been removed
10 | P a g e
The example units were accessed 3,441 times. While the home page was accessed almost 2,600 times the search
function looks like it was only used about 200 times, which indicates that most people browsed for units rather than
searching.
Student Resources - The most popular of these in descending order (ignoring the landing pages) were Getting Started
(2644 views), Access, Helpdesk, Netiquette, Lecture Recordings, Tech Info, Online Study Tips, Assignments, How to
Update your Profile (256 views).
iLearn Session 1: LTC Service Desk
Report date range: 1 Jan – 15 Mar 2012
Requests serviced:

iLearn:
1685

iTeach:
554

Echo360: 184

Total:
2,423
Top 7 Issues Raised or Requested

iTeach – student access

iTeach – staff access, non-standard accounts

Access for students not officially enrolled in cohorts

Forum digests not arriving

Sorting forum posts

Importing data into units

iLearn Quizzes – error in setting-up

Breakdown of the number of iLearn tickets raised by location:
Queries about using iLearn
These are the top queries on the use of iLearn. These are not necessarily problem reports but questions about how tools
function.
Faculty of Arts:

Forums – managing posts: un/read messages

Dialogue – alerts and privacy
Change Stream April 2012
Faculty and Department details have been removed
11 | P a g e

Groups – groups in forums

About Bb vs iLearn comparison: Reflections From Behind The Service Desk
We had the same number of training and support staff working at fulfilling service requests for both periods. The major
difference would be in the types of requests. Since we have implemented a distributed support strategy, there is no way
to count tickets for all interactions and consultations outside OneHelp. However, we can assume that consultations
outside OneHelp are less of a technical or administrative nature but tending more towards support in using the system to
support learning and teaching.
There were 540 requests for accounts/units/enrolments for Blackboard that are now distributed to other systems such as
Macquarie OneID. However there is a new enrolment system, iTeach Online, and the requests generated by this system
for Session 1 has at least equalled the previous at 554 requests.
It is worth mentioning that there were 5,378 views of the iLearn Quick Guides page. There were also other significant
views to the FAQ area 1,440 and the training page received 4,630 views.
Overall there is a 32% reduction in requests lodged to the service desk. The current resourcing of the helpdesk has meant
that we can now move forward to a more proactive approach. To further support the training efforts embedded in
faculties, the service desk can now focus on trying to pre-empt potential problems and communicate this much earlier to
the distributed network of support staff. Currently we are planning a check of iLearn tools, specifically those that require
user generated data such as Quizzes and Forums, to ensure that the expectations of users we see through the service
desk matches the current configuration of those tools. We will be working closely with the systems team to proceed with
these efforts.
The service desk expects more positives out of the structure and strategy of the iLearn project and look forward to
helping shape a much more productive learning environment at Macquarie.
Change Stream April 2012
Faculty and Department details have been removed
12 | P a g e
Download