www.project-watchme.eu EU-PROJECT WATCHME • Workplace-based e-Assessment Technology for Competency-based Higher Multiprofessional Education. • 7th Framework, ICT Call 11 • Objective ICT-2013.8.2 Technology-enhanced learning, b) Learning analytics, educational data mining • March 2014 - April 2017 • 11 partners • 3.4 M€ costs / 2.6 M€ EU-declarable MOTIVATION & GOAL “Continuing education at the workplace has seen increasing demand as a crucial means of acquiring the requisite professional knowledge and skills. Electronic Portfolios (e-portfolios) for workplace training provide a global view of each trainee’s progress but offer no dynamic feedback to exploit the rich learning assessment data that could be analysed to support responsive adaptation for more efficient and rewarding training.” WATCHME effectively deploys Learning Analytics to deliver personalised learning; supporting learner empowerment, enhanced Quality-of-Experience, flexibility and mobility plus efficiency gains through workplace-based feedback and assessment. APPROACH • mobile, electronic portfolio-based system • LA and student models • tailored feedback • visualisation dashboard • empirically validated for its quality and contribution to trainees’ learning • professional environments (human medicine, veterinary medicine and teacher training) PARTNERS 1. Utrecht University, NL (www.uu.nl) GENERAL LEAD 2. University Medical Centre Utrecht, NL (www.umcutrecht.nl) 3. Szent Istvan University, Hungary (www.sziu.hu) 4. University of Tartu, Estonia (www.ut.ee) User partners 5. Universitätsmedizin Charité Berlin, Germany (www.charite.de) 6. University of California San Francisco, USA (www.ucsf.edu) 7. Maastricht University, NL (www.maastrichtuniversity.nl) TECHNICAL LEAD 8. Mateum, NL (www.mateum.nl) 9. University of Reading, UK (www.reading.ac.uk) 10. Jayway, Denmark (www.jayway.com) 11. NetRom, Rumania/NL (www.netrom.nl) Producer partners USER PARTNERS 1. Utrecht University Teacher education Veterinary medicine 2. University Medical Centre Utrecht Medicine (Anesthesiology) 3. Szent Istvan University Veterinary medicine 4. University of Tartu Teacher education 5. Universitätsmedizin Charité Berlin Medicine (Nephrology/dialysis) 6. University of California, San Francisco Medicine PRODUCER PARTNERS 1. Maastricht University, EDUC, FHML Design, technical coordination, Integration 2. Mateum BV EPASS development and support 3. University of Reading, Intelligent System Research Laboratory Student modelling 4. Jayway Visualization and feedback 5. NetRom Software SRL software development (6. Charité: Educational game) ARCHITECTURE Architecture Learning Analytics Engine Online Learning Student Model Database database Portfolio system (ePASS) Aggregated Visualisation Just in time Feedback WPB Assessment GAME Mobile device EPA Matrix E-PORTFOLIO STUDENT MODELLING Our context: • Many students • Online learning • Changing environment • Soft evidence (including narrative) Need for flexible and scalable student modelling MULTI-ENTITY BELIEF NETWORKS - MEBN • Probabilistic: deal with soft evidence and uncertainty • Online learning possible • Versatile: models adopt themselves to situation of the student • Scalable: shared fragments of knowledge • Semantically labelled ? Sensor data 100 80 60 40 20 0 Yes No VISUALIZATION OF AGGREGATED DATA Combine Countable data (students, assessments, relations) Information from knowledge fragments Combine with individual student model JUST IN TIME FEEDBACK Student model must indicate appropriateness of Type of feedback Content of feedback Moment of feedback Probabilistic FITTING ALL TOGETHER Interfaces between: Assessment tools and portfolio portfolio server and student model server Student model server and visualisation Student model server and feedback Integration of visualisation and feedback in portfolio WORK PACKAGES WP1 Project management (Utrecht University) WP2 Competency-based workplace definition with EPAs, for feedback and assessment (UMCU) WP3 System architecture and assessment tools (Maastricht University) WP4 Developing student models (University of Reading) WP5 Feedback and visualization modules (JAYWAY) WP6 Implementation and evaluation overall system (University of Tartu) WP7 Dissemination and exploitation (Charité Berlin) PLANNING