Centre for eLearning
Dr Tony Herrington
Email: A.Herrington@curtin.edu.au
Telephone: 9266 4821
Fax: 9 9266 1734
Office of Teaching and Learning
Centre for eLearning
Flexible Learning Grant: Expression of Interest
Grant request:
Up to and including $10,000.00
Greater than $10,000.00
Date:
Feb 18, 2010
Applicant:
Jon Yorke, Connie Price
School:
Office of Teaching and Learning
Email:
c.price@curtin.edu.au
Telephone:
9266-2818
Project title:
Evaluation of Questionmark Perception as an e-Assessment solution for
Curtin
Describe your project in 300 words or less:
Prior to 2009 Curtin University utlised two separate learning management systems. One of these,
WebCT, was used to deliver e-assessments in the Computer Assisted Assessment Lab (CAA Lab). With
the decision to move to a single LMS (Blackboard) an alternative solution must be found in order to
continue to deliver e-assessments, within a controlled environment such as the Assessment Centre
(formerly the CAA Lab), and beyond.
The evaluation of potential assessment systems should consider the following desired features:

Efficient and scalable architecture to handle large server loads at peak assessment times

Question authoring environment that is easy to understand and has a shallow learning curve

Question database from which both formative and summative assessments can be drawn for a
given unit (academic staff only need to learn one system)

Offers a variety of question types and assessment patterns including random selection from a
question pool. Able to incorporate authentic learning tasks such as branching scenarios and
rich media such as video.

Rich feedback options to support student learning

Security features to limit access to a controlled testing environment such as the Assessment
Centre or to a temporary test centre (including onshore and offshore campuses)

Features that support equitable assessment in units that have a mix of internal and external
students
 Robust monitoring and reporting tools
A review of assessment systems currently available has led to the identification of one front runner –
Questionmark Perception (QMP). The purpose of this project is to trial this system within a Curtin
Page 1 of 2
context. This pilot project would involve setting up a trial server (liaising with CITS) and a small test
centre (controlled testing environment). Unit Coordinators will be recruited from each faculty (by open
and targeted invitation) to trial an assessment using QMP (initially these will be formative assessments
but may progress to summative assessments on a small scale). Units will be selected to include a mix of
assessment types and delivery types. Small focus groups will be used to get perceptions and feedback
from the Unit Coordinators (and their teaching teams), from students, and from the Assessment Centre
staff.
Insert the study package number(s) and the number of students normally enrolled in the units
concerned:
A variety of units from different faculties will be recruited to participate in the evaluation.
Details of milestones and key dates:
1. Install QMP on local server
March 5
2. Recruit participants
March 12
3. Implement assessments
March 29 – June 4
4. Focus groups
June 11
5. Submit report to Flexible Learning Committee
July 1
How will the project improve the quality of teaching and learning in your area?
This project aims to improve the quality and flexibility of e-assessment at Curtin. Improved quality will
result from a system that is efficient, stable, and secure. The chosen system should provide flexibility in
the construction of e-assessments and in their delivery to both on campus and off campus students.
How will you share the outcomes of your project/learning with other members of staff?
If QMP is adopted as the e-Assessment solution a plan will be developed to address staff training
needs. Initially the plan will focus on supporting staff in units utilizing the Assessment Centre for
Semester 2, 2010 (and Sem 1, 2011). The second phase will address staff wishing to use QMP for
summative assessments delivered through other mechanisms. The third phase will address the use of
formative e-assessment as an important learner focused teaching tool that provides important
feedback to students (Enabling initiative 2.2.1 of Curtin’s T&L Enabling Plan 2009-2013).
How will this project influence the learning delivery strategy for the remainder of the course?
It is envisioned that having a single e-assessment system that is both flexible and effective will
encourage academics to develop formative assessments that support student learning and thus
improve their performance on summative assessments (Enabling initiative 2.2.1 of Curtin’s T&L
Enabling Plan 2009-2013).. Increased provision of formative assessment should also have a positive
impact on student learning experiences and thus retention (Flexible Learning Policy).
The Assessment Centre already plays an important role in the provision of quality teaching in large
classes by providing a mechanism for assessing large cohorts (Flexible Learning Policy), this new system
will extend that role.
Page 2 of 2