ePortfolios: Institutional Adoption Strategies E-Learning Strategies & Practices Hokling CHEUNG Office of Education Development and General Education City University of Hong Kong December 1, 2010 Innovation Adoption Visions Pragmatic Values Source: Everett Rogers, Diffusion of Innovation Theory (Everett Rogers, 1962 & VH Carr Jr, 1999) Visions Pragmatic Values Visions Visions A Personal Learning Space Personal Development Planning ePortfolios Digital Identity Social Learning & Learning Communities Approaches to Lifelong Learning User-centric e-Learning Environment “A portfolio tells a story.” “The portfolio is a laboratory where students construct meaning from their accumulated experience.” What are they? ePortfolios “A portfolio is opinion backed by fact ..” Paulson & Paulson, 1991 A teaching portfolio “summarizes major teaching accomplishments and strengths of a professor, and provides a selective account of best practices. It is both reflective and qualitative in its assembly, and involves the collection and presentation of materials in a concise manner (i.e., it's more than just a container to showcase instructional materials)." http://www.tss.uoguelph.ca/resources/idres/packagetd.html Types of Portfolios • • • • • • • Learning portfolios Employment portfolios Assessment portfolios Showcase portfolios Personal development portfolios Teaching portfolios Training portfolios These different "types“ of ePortfolios reflected the fact that ePortfolios are being produced and consumed (used) in many different processes, or to manage different processes. Serge Ravet http://www.eife-l.org/publications/eportfolio/documentation/positionpaper Paperless portfolios What are they? ePortfolios An ePortfolio is “a collection of authentic and diverse evidence, drawn from a larger archive, that represents what a person or organisation has learned over time, on which the person or organisation has reflected, and designed for presentation to one or more audiences for a particular rhetorical purpose". Educause, NLII, 2003 ePortfolios Personal particulars Biography Values & Beliefs Goals Aspirations Styles Interests & Hobbies IDENTITY product process self + Learning Development Plan Execution Documentation Reflection Collaboration MANAGEMENT (frequent update, sharing, dialogic feedback & collaboration) + Showcase Assessment Graduate Employment Professional Appraisal PRESENTATION What are they to e-Learning? ePortfolios e-Learning - role-based/hierarchical • Instructor vs Students unequal access to functions & info. distributive web 2.0: Wiki, Blog, RSS (partial) course-based teacher-owned Learning Management Systems e-Learning Internet (Web2.0) Web as a platform open for everyone to participate, share information, organize & create knowledge, initiate discussion & activities, social network & collaborate etc. Technologies have enabled everyone of us to take snapshots of different moments of life capture the motion of time and interaction record the music of laughters and tears communicate everywhere with whoever we want interact in different ways make things much more portable and sharable ePortfolios are • • • • • • repository of work & experiences personal knowledge management tools showcase of reflective learning and lifestyle! celebration of accomplishments platforms for connection lifelong learning strategies ePortfolios e-Learning user centric personal & social management goals & plans activities thoughts artifacts comments & feedback access & privileges collaboration presentation & showcase Visions Pragmatic Values Visions Pragmatic Values Communication Implementation Information Facilitation Investigation Evaluation 2009-11 ePortfolios for All: A Roadmap for Success 2007-09 Electronic Learning Portfolio 2005-06 English Language Portfolio ePortfolio for Learning Outcomes Extrinsic Motivation attend classes Reflection, Feedback & Dialogue ePortfolio: Goals, Action Plans, Accomplishment, Reflection, Collection of Artifacts, Qualifications relate complete assignments Activities + Outcomes take examinations Outcomes + Goals get the grades Goals + Actions internalise enjoy the break Intrinsic Motivation “…without a central focus on reflection, e-portfolios are in danger of becoming simply a collection of information rather than a mechanism for the development of meaningful knowledge.” Battacharya, M & Hartnett, M. E-Portfolio Assessment in Higher Education [Online]. Available: http://fie.engrng.pitt.edu/fie2007/papers/1720.pdf [Accessed June 17, 2008] Some comments from ePortfolio developers • (By using ePortfolio,) I can focus on what my goals are, and follow step by step to achieve my goals. • (ePortfolios) enable me to evaluate my learning process and outcome. • As a research student, I find ePortfolio is a useful tool for managing information and organising thoughts...thanks. • (ePortfolio) helps me plan my three years’ university life. • (ePortfolio helps us) review what we have done, evaluate our goals and express our strengths to others. • ePortfolio is useful for every students. I think that ePortfolio workshops should be promoted to all students since their first year in the university. Feedback from students Having the experience in developing ePortfolios and learning to reflect, • Many students (65%) realise many students identified that preparation and important factors or planning like goal setting, strategies that can help them action planning, knowing the learn better. course ILOs and assessment criteria, etc. are helpful for achieving better performance. (634 students responded in Semester A & B 2007-8) Feedback from students The positive effect on learning is related mainly to the practices of reflection and the process of portfolio making. Both formative and summative reflection were agreed to be important by about half of the students. • 56% reflection is very important during the process of learning. • 62% students think that the process of developing a portfolio is useful for learning. • 46% reflective review and summary at the end of a particular course or activity • 34% students think the end is important. product of the portfolio is useful for learning. (634 students responded in Semester A & B 2007-8) Integration to courses & activities Programmes Language Students Courses Exchange Staff Development Field Trip ePortfolios Job Application Academic advising Celebrities Internship Student Ambassadors University transitions Employment preparation Co-curriculum Professional Development Policies Employers Senior Management Teachers Other universities Overseas universities Secondary schools Student Learning Profile (SLP) ePortfolio Coverage Phase Departments 2005-07 2007-09 2009-11 •English Language Centre •Education Development Office •English Language Centre •Biology and Chemistry •Public and Social Administration •English and Communication •Division of Building Science and Technology •School of Graduate Studies •Computer Studies •Education Development Office •English Language Centre •Biology and Chemistry •Public and Social Administration •English and Communication •Division of Building Science and Technology •School of Graduate Studies •Electronic Engineering •Information Systems •Office of Education Development and General Education Workshop types – Course-based learning ePortfolio workshop – Course-based learning ePortfolio workshop – Learning ePortfolio workshop – Internal Teaching ePortfolio workshop – Course-based learning ePortfolio workshop – Learning ePortfolio workshop – Employment ePortfolio workshop – Teaching ePortfolio workshop – Creative use of multimedia – Portfolio information seminar ePortfolio types English Language Portfolios Electronic Learning Portfolios Learning ePortfolios Graduate/Employment ePortfolios Teaching ePortfolios Professional ePortfolios Celebrities ePortfolios Number of ePortfolios 260 3400 4800 (up till now) ePortfolios for All: A Roadmap For Success A CityU Teaching Development Grant funded project ePortfolios: Plan, Manage, Reflect and Present Your Goals, Accomplishments and Expertise Professional Portfolios Graduate/Employment Portfolios Language Portfolios Learning Portfolios Showcase Portfolios Performance Appraisal Portfolios event organisation workshops communityContinuing services recognitions projects Graduation Learning & Development Professional Development study trip courses exchange further study publications final year project competitions course work internship awards professional membership part-time jobs group projects Student unions community services Academic Advising Academic Advising Learning Teaching ePortfolios Assessment Institutional Enhancement Employment Professional Development • Self-awareness • University Study Guidance • Students at-Risk Assistance Enhancement of Learning & Teaching • • • • • • Motivation & Engagement Goal Setting & Action Planning Reflection/Reflective Practice Learning & Knowledge Management Learning Community Lifelong Learning ILOs Outcomes • Performance Assessment • Evidence Collection • Evaluation/Quality Assurance TLAs Professional Development • • • • • Articulation of Expertise & Achievements Career Planning and Preparation Tenure Review, Awards, Promotion Reflective Practice Publicity ATs ePortfolios for All: A Roadmap for Success - Project Overview ePortfolios purposes, contexts & audience Learning ePortfolios Graduate ePortfolios Personal Career Professional Development Preparation ePortfolios ePortfolios ePortfolios Project Aims: 1.lay the foundations of a university wide ePortfolio culture 2.actualise full student learning experience 3.promote the goal of becoming CityU Ideal Graduates 4.motivate students to take ownership and responsibility for their learning, development and career success 5.inform and motivate students to use available support resources & services 6.motivate teachers and coordinators of co-curricular activities to review their teaching and coaching practices and integrate reflection into the related activities Generic structure with specific strategies Investigators (PI) and Co-Investigators (Co-PI) of the Project Hokling Cheung (EDO) (PI) Dean Fisher (ELC) (PI) Andy Chan (EE) (Co-PI) Arthur Cheung (SA) (Co-PI) Paul Shin (BCH) (Co-PI) Christoph Hafner (Co-PI) Terence Cheung (Co-PI) Valerie Pickard (ELC) (Co-PI) Vicky Chan (EDO) (Co-PI) + participating teachers and activities coordinators (40 ELC Teachers, Tania Lau, Amy Mak, Ron Kwok, Jackie Lou, Connie Ng, Winnie Yee, Stephanie Lai, Anita Lam, Kevin Forde, Tak Yan Lee, Teresa Chow, William Leung & etc.) Student Learning Outcomes 1.use effective skills and strategies to design ePortfolios for specific purposes 2.select and use available tools to construct ePortfolios 3.identify how CityU's learning activities, support resources and services, etc, relate to attaining the Ideal Graduate attributes and programme outcomes 4.adopt reflective practices to manage learning and development 5.articulate and evidence their accomplishments, abilities and aspirations in the specific context of learning and development. Track I: Student Learning Design and delivery of voluntary workshops Specific students targeted (e.g. A+++ students, student ambassadors) University-wide promotion ePortfolio Competition and Award Ceremony students Self-selected students and students from participating courses & co-curricular activities. Available to all CityU students. Track II: Roadmaps ePortfolio Repository: Discipline specific ePortfolio templates to inform, recommend & direct students to specific resources, services, co-curricular activities, workshops and schemes etc. Guide students towards: programme outcomes, ideal graduate attributes and employment opportunities Celebrities’ ePortfolios Teacher Learning Outcomes 1. design & construct their own professional ePortfolios 2. guide students to become Ideal Graduates 3. recognise the importance of reflection in learning 4. adopt strategies to encourage student reflection teachers ePortfolio Commons Investigators of the project, teachers and coordinators of co-curricular activities. Departments, programme leaders and other university support units. institution Track III: Staff Development Project investigators create their own professional development ePortfolios. Collaboration with teachers and co-curricular activities coordinators to integrate ePortfolio, reflection or related skills in the programmes, courses or activities. Appreciation of the value of ePortfolios for development and learning Provide encouragement and set an example for students University Success Roadmap – ePortfolio template for transitions and university study guidance ePortfolio Workshops/Sessions Teachers/ Coordinators/ Programme leaders Research Promotion Other Universities/ Schools/ Professionals/ Employers Students/ Student Celebrities/ Helpers Outreach Training Management/ Other Related Departments – – – – – – Learning Employment Teaching Creative Use of Multimedia Strategic Teaching Enhancement Programme ePortfolio Information Seminar – – – ePortfolio HOW ePortfolio WHY ePortfolio GALLERY/Repository – – – Student celebrities Teacher celebrities Professional celebrities – – – – – – ePortfolio Pedagogies ePortfolio Technologies Impact on learning Impact on employability Generic structure of ePortfolios Publicity & information leaflets Online Guides & Resources Celebrities’ ePortfolios Research & Publications ePortfolio Competition ePortfolio Commons http://www.cityu.edu.hk/edge/eportfolio University Success Roadmap – ePortfolio template for transitions and university study guidance ePortfolio Workshops/Sessions – – – – – – Learning Employment Teaching Creative Use of Multimedia Strategic Teaching Enhancement Programme ePortfolio Information Seminar – – – ePortfolio HOW ePortfolio WHY ePortfolio GALLERY/Repository – – – Student celebrities Teacher celebrities Professional celebrities – – – – – – ePortfolio Pedagogies ePortfolio Technologies Impact on learning Impact on employability Generic structure of ePortfolios Publicity & information leaflets Online Guides & Resources Celebrities’ ePortfolios Research & Publications ePortfolio Competition ePortfolio Commons http://www.cityu.edu.hk/edge/eportfolio ePortfolio Workshops Roadmap for University Success • steers first-to-final-year students • emphasizes whole-person development & lifelong learning • facilitates student-centric information delivery • develops reflective thinking skills & other important generic skills Celebrities • Dr. Ben Au Yeung (Chinese University of Hong Kong) • Dr. Renford Reese (California Polytechnic State University, Pomona) • Mr. Andrew Fan (Nu Skin) (Alumni) • Mr. Bena Smith (WWF Hong Kong) • Mr. Charles Mok (Internet Society Hong Kong) • Ms. Elaine Cheng (Dot Asia, NetMission) • Ms. Ellen Pau (Videotage) • Ms. Fanny Chan (HeadlineJobs.hk) CityU Teachers • Dr. Annis Fung (SS) • Dr. Arthur Cheung (SA) • Dr. Linda Lai (SM) • Mr. David Woo (EL) • Mr. Dean Fisher (EL) • Ms. Penny Akers (EL) CityU Students • Mr. Andy Chu (SM) • Mr. Billy Li (CS) • Mr. Chapman Ho (IS) • Mr. Dick Lai (IS) • Mr. Jacky Man (LW) • Mr. Kafar Wong (IS) • Mr. Keith Yeung (IS) • Mr. Morgan Aasdam (SM) • Mr. Refeal Leung (BC) • Ms. Yvonne Ni (SM) Publications Fisher, D.W., Cheung, H.L., Chen, Y., Chan, Y.F. & Wong, M.C. (forthcoming). ePortfolios for higher education: A Hong Kong perspective. In D. Cambridge (ed.) Global Diffusion of E-Portfolio: Solutions for Collaborative Education. IGI Global. Kwok, C.W., Cheung, H.L., Chen, Y.J., Thadani, D., Bandyopadhyay, R., Lau, T.Y. & Wong, M.C. (forthcoming). Positive effects of reflective ePortfolio on overseas exchange learning experience. In 3rd International Conference on Computer Supported Education, the Netherlands, 6-9 May, 2011. Fisher, D.W., Cheung, H.L., Pickard, V. & Chen, Y.J. (2010). Embarking on the Journey of ePortfolio Experience: A New Approach to Enhance Graduate Employability. Learning Forum London 2010, ePortfolio 2010 and Key Competencies 2010, London, July 5-7, 2010. Kwok, C.W., Cheung, H.L., Pickard, V., Chen, Y.J., Lau, T.Y., Bandyopadhyay, R. & Wong, M.C. (2010). Effects of Reflective e-Portfolio on Students' Overseas Exchange Learning Experience. Teaching and Learning Symposium 2010, Hong Kong, June 6-8 2010. Publications Zhou, M., Cheung, H.L., Wong, M.C., Chan, Y.F. & Pickard, V. (2010). An Evaluation of Electronic Portfolio Platforms in Higher Education. e-CASE & eTech 2010 Conference, Macau, China, January 25-27, 2010. (Distinguished Paper Award) Cheung, H.L., Zhou, M., Pickard, V., Fisher, D.W. & Chan, Y.F. (2010). The Design, Implementation and Evaluation of a Generic Structure for ePortfolios/Portfolios. e-CASE & e-Tech 2010 Conference, Macau, China, January 25-27, 2010. Cheung, H.L., Fisher, D.W., Pickard, V. & Chan, Y.F. (2009). Scaffolding Student Learning: Integrating ePortfolios into the University Experience. International Conference on Improving University Teaching (IUT), Vancouver, Canada, July 14-17, 2009. Williams, F., Chan, Y.F. & Cheung, H.L. (2009). The English Language E-portfolio. In J. Zubizarreta (ed.). The Learning Portfolio. San Francisco, Calif.: Jossey-Bass. Williams. F., Chan, Y.F. & Cheung, H.L. (2007). Promoting Active and Reflective Learning Through e-Portfolios: Difficulties And Challenges. International Conference on Improving University Teaching (IUT), Jaén, Spain, July 4 -7, 2007. ePortfolio & Employability Job application Will employers view job applicants' ePortfolios if a link is provided? At which stage of the recruitment process do employers see ePortfolios as being potentially most effective? Maintaining employment & obtaining new employment if needed To what extent can ePortfolios help students develop a set of skills and strategies that are desirable for employers? Skills & strategies developed = Important in the workplace Ref: Hillage, J and Pollard, E (1998) Employability: developing a framework for policy analysis. Research Brief 85, Department for Education and Employment Student Post-Experience & Employer Surveys Employability Enhancement (Some preliminary data) Goal Setting & Action Planning Skills developed Important in the workplace Post-Experience & Employer Surveys Employability Enhancement (Some preliminary data) Goal Setting & Action Planning Identify Strengths & Weaknesses Post-Experience & Employer Surveys Employability Enhancement (Some preliminary data) Goal Setting & Action Planning Identify Strengths & Weaknesses Record Accomplishments Post-Experience & Employer Surveys Employability Enhancement (Some preliminary data) Goal Setting & Action Planning Identify Strengths & Weaknesses Record Accomplishments Provide Evidence for Performance Claims Post-Experience & Employer Surveys Employability Enhancement (Some preliminary data) Goal Setting & Action Planning Identify Strengths & Weaknesses Record Accomplishments Provide Evidence for Performance Claims Establish a Positive Image Employability Job application Employability Job application Visions Pragmatic Values Communication Implementation Information Facilitation Investigation Evaluation Why top down? What are the needs & challenges? Visions Pragmatic Values What are the possible benefits? ePortfolio Initiatives at National Level & in Tertiary Institutions Europe Europass & EPICC: increase transparency of qualifications, citizens’ mobility, lifelong learning, continuing professional development UK Personal Development Planning (PDP) Australia development of graduate capabilities US reflective learning and personal development Canada Graduation Portfolio Assessment HK Outcomes-Based Teaching & Learning (OBTL), Student Learning Profile (SLP) & Other Learning Experience (OLE) Driving Forces POLICY LEARNING OUTCOMES EMPLOYABILITY TECHNOLOGY QUALITY ASSURANCE GUIDANCE LIFELONG LEARNING – National policy (Mobility of Citizens & Competiveness) – Course/Programme/School level – Student centered learning – Graduate capabilities – Generic skills & knowledge for real-world applications – Employment, Job search/ Transparency of Qualifications – Appraisal, Tenure and promotion processes – Infusion of technology/ Empowerment of individuals – Digital, Not Physical! – Outcomes based teaching & learning – Authentic and performance assessment – Institutional achievement/ improvement – Academic advising – Career consultation – Whole Person Development – Lifelong learning Relevant Trends in Higher Education • • • • • • • • • • Authentic learning experiences Learning communities (peer learning, collegiality) Competencies & outcomes Transferable & employability skills Blending information literacy, technology fluency, communication proficiency, presentation skills and domain knowledge Treating students as big-picture thinkers and critically engaged doers Academic advising Reflective practices & continuous development (employability) Era of accountability & QA Lifelong learning Reese, M. et al & Moore, Anne H. et al http://net.educause.edu/ir/library/pdf/ERB0904.pdf Issues & Challenges Perception & Purposes – confusion caused by widely differing definitions and perceptions of the nature and functions of ePortfolios. ePortfolios are not only different things to different people, they can also be different things to the same person as perspectives and purposes change. – problems arising from the conflicting paradigms and purposes of ePortfolios (Barrett and Carney, 2005) Motivation – Benefits/Incentives (extrinsic & intrinsic motivation) – Time & efforts – Technical challenges (digital native vs consumer) Issues & Challenges What should be the content structure? Which type of ePortfolio to create? ? Who is going to view this portfolio? Is there any template to follow? Generic Structure of ePortfolios PROFILE Personal particulars, biography, values & beliefs, interests and hobbies etc SUMMARY Purpose, audience, achievements and development, reflection and future direction SHOWCASE Representative work & evidence QUALIFICATIONS Official recognition of achievements, qualifications, contribution and participation Generic Structure of ePortfolios Benefits! Enhances accessibility, usability and readability for more effective communication Develops generic and transferable knowledge and skills which eases the demands on training and support resources for future ePortfolio development Allows creativity as developers can choose to adopt or adjust the structure according to their own needs Provides a sound framework for managing and showcasing one’s accomplishments, expertise and aspirations Issues & Challenges Pedagogy – Instructional design – Faculty development – Curriculum review and design Technology – – – – – Integration with existing LMS Commercial or open sourced Universal standards (Interoperability & portability) Availability (lifelong?) Emerging features and functions The Chronology of CityU’s ePortfolio Technologies Course-based Wikis and Blogs Digital story More emphasis and facilitation on feedback Website Advanced HTML Emphasis on technologies Wiki functions in MyExpo User centric application Google Apps, Mahara, Facebook Mobile solutions Institutional commitments, integration & strategies Bb Basic Portfolio function Direct use of templates Emphasis on reflection 2005-2006 2007-2009 One-web-page (simple HTML) Digital story More emphasis on reflection 2009-2010 2011 & beyond Blackboard, Desire2Learnpilot, Fusionpilot and Google Sites Generic ePortfolio structure ePortfolios for diverse purposes Proposing the Institutionalisation of ePortfolios for Teaching and Learning Institutional Enhancement at CityU commitments & supports • enhance learning and employability • enhance teaching Curriculum & Co-Curriculum • ePortfolios should be integrated into all General Education core courses for all first year students to record, manage and reflect on their learning and development; • Students who apply for scholarships, exchange programs or internships in CityU should submit ePortfolios as a requirement for application. Faculty development • ePortfolios should be used for peer review/observation among teachers; • Teachers who apply for Teaching Excellence Awards should submit ePortfolios as a required document for application. Technical infrastructure • Technology infrastructure should address the requirements of ePortfolios for all through coordinated efforts in testing and integrating ePortfolio platforms and tools into the existing IT infrastructure such as an online learning management system; • Students should be able to continue to own and develop ePortfolios after graduation for at least three years, and ideally, life-long. Quality assurance • The ePortfolio should be used as a course evaluation tool; • The ePortfolio should be used as a performance appraisal tool for evaluating teaching performance; • The ePortfolio should be recognized as one of the means to evaluate Outcomes Based Teaching and Learning (OBTL); • The ePortfolio should be recognized as a core IT literacy skill for all students, teachers and staff. Proposing the Institutionalisation of ePortfolios for Teaching and Learning Enhancement at CityU Visions Pragmatic Values Communication Implementation Information Facilitation Investigation Evaluation What will future users do with the technologies? Web 3.0 portable personal web Web 2.0 wildly read-write web Twitter Podcasts Blog Flash Web 1.0 mostly read-only web WIKI RSS RSSvideo Podcasts WIKI Blog Facebook YouTube Image source: http://graphics8.nytimes.com/images/2005/10/10/opinion/1010opart.jpg by Randy Siegel Portfolio of Passions References • Moore, Anne H., Fowler Shelli B., Brent K. Jesiek, John F. Moore, and C. Edward Watson. “Learners 2.0? IT and 21st-Century Learners in Higher Education" (Research Bulletin, Issue 7) (Boulder, CO: EDUCAUSE Center for Applied Research, 2008), 5, available from http://www.educause.edu/ecar. • Carr Jr. V. H. (2001). Technology Adoption and Diffusion. Retrieved November 29, 2010, from http://www.au.af.mil/au/awc/awcgate/innovation/adoptiondiffusion.htm • Lambert, S. R., & Corrin, L. E. (1007). Moving towards a university-wide implementation of an ePortfolio tool. Australian Journal of Educational Technology, 23(1), 1-16. • Reese, M. & Levy, R. (2009). Assessing the future: E-portfolio trends, uses, and options in higher education. In EDUCAUSE Research Bulletin, Volume 2009, Issue 4. • Rogers, E. M. (1995). Diffusion of Innovations (4th edition). New York: The Free Press • The Telegraph. (2010). "Happy 40th birthday, the internet: 20 milestones in the net's development". Retrived on November 29, 2010, from http://www.telegraph.co.uk/technology/news/6455139/Happy-40th-birthday-theinternet-20-milestones-in-the-nets-development.html THANK YOU!