Technology Options for Assessment Purposes and Quality Graduate Outcomes African Virtual University (AVU), online and e-learning students Sheila Howell RMIT University RMIT University School of Computer Science and IT Vietnam (2 campuses) China Malaysia Singapore Indonesia Africa AVU (9 learning centres) Ethiopia/Kenya Tanzania/Ghana Rwanda/Namibia Melbourne Australia Principles Underpinning Programs Educate and train students for the very dynamic and rapidly changing science and technology market Educate and train students to become lifelong learners by providing a sound base in mathematics, basic sciences, humanities and social sciences Motivate students to become innovators who can respond positively to the challenges and opportunities presented by new ideas and technologies Lay a strong foundation for, and instil confidence in, students who may want to pursue further postgraduate studies. Quality Outcomes for program delivery Provide cyclical opportunities to communicate, reflect, discuss, improve, feedback and re-evaluate in all areas Provide quality assurance for 2 different groups – the lone students – and groups of students. For group mode (Africa) appoint facilitator from Partner Institution to liaise with each course manager from Australia. Essential to maintain staff contact through visits/audits etc. For individual student provide general student support processes as well as instructional support. Delivery Model for Off-Shore Programs (online and mixed mode) Level 1 Student Support Hard copy learner guide/ workbook Learner guide/workbook provides direction and options. Student makes choices about learning styles and access levels to courseware. Level 2 Student Support CDs/DVDs For use in a local learning centre. Access to all courseware, support materials + local discussion forums. Courseware or support materials provided on CDs or DVDs. Enables student to study on any standalone computer. Level 3 Computer Laboratory support Local Area Network Supports both learning centres and individual students. Access to all Courseware and International Discussion forums Level 4 Global Internet Access Technology Options – Mixed Mode The course materials are provided in mixed mode: in paper form via books, an instructor’s guide and a learner’s guide; in electronic form on a server available at the facilitator’s institution; in electronic form on a server available worldwide (currently in New York); in electronic form via videos, CDs and lecture recordings using Camtasia. The AVU project was set up for multi-channel delivery over internet, intranet, servers, satellite TV, broadcast, video, CDROM and paper Technology Options Podcasts, RSS feeds, Camtasia, screencasts Blogs, wikis, newsgroups, bulletin boards, usenets Knowledge Resources Communication Meaningfulness Revision or version control software Authenticity Manageability Online Learning and Assessments Concerns about the authenticity of student work Inability of academic staff to ensure that the student and / or facilitator has correctly interpreted their instruction / concepts etc. Difficulty of conducting exams in a secure environment that ensures academic integrity Feelings of isolation Approach for New Online Postgraduate Program List all graduate capabilities – suggestions for how to assess each one Which courses have which graduate capabilities ? Map courses to capabilities to assessment procedures Online Programs Individual mode – Workstation with access to Internet – Provided with all necessary software – Exams in centres authorised by RMIT – All materials marked at RMIT – Capstone project at end Group mode – Face-to-face classes with Facilitator at learning centre – Facilitator marks all assessments – Mixed-mode delivery – resources online as well – Exams at learning centre – Moderation of some assessments by RMIT – Regular on-site moderation/audit visits. Graduate Capabilities 1. 2. 3. 4. 5. 6. 7. Knowledge and skills pertinent to the discipline area Critical, creative and analytical skills Communication in a variety of modes and contexts Life-long learning Work independently and collaboratively Social and ethical responsibility Self-reliance and leadership Graduate Capability 3: Communication in a variety of modes and contexts Assessment: Requires use of blogs, “voice” and/or video software such as Camtasia, discussion forum, newsgroup contributions. Map Courses to Capabilities to Assessment Procedures Course Graduate Capability Comment Programming Principles (1A and 1B) programming in Java Knowledge Analysis Problem solving Independent working All first year courses are foundation courses – Familiarise students with the environment, effective use of courseware, and work independently to achieve the course goals. Software provided for Java and the Java development environment. Weblearn quizzes and tests. Regular submission of assignment work. Assignments + mid-semester + final exams Recommendations for Assignments Assignments always presented for marking in stages - staggered submissions. Extensive use of quizzes and tests administered and marked online – generated individually. Students to use blogs as a record of their work and as a requirement for assessment Students to use version control software across a number of courses: – – familiarity with the concept of version control which is an essential part of the modern IT workplace and good records of student work for assessment and authentication purposes. Students to use some communications software to engage with staff and other students in a face-to-face or voice-over mode. Use of a capstone project to bring together all components of the program in a closely supervised short term study period with extensive interaction with our staff. Recommendations for Exams Individual study students attend an exam centre wherever possible, supervised by authorised staff. Group study environments have regular audits and moderation performed by staff from our university if neither of the above two options are possible, an independent invigilator is organised. Recommendations for Implementation of Postgraduate Online Program Extensive student support in the form of the provision of suitable software and resources, Student advisers for regular contact (this will also maximise chances for students to be authentic), have a limited number of students being looked after by any one adviser and Provision of a regular newsletter or blog for students which encourages students to contribute.