Contact person Nicolette de Keizer ([email protected]) Name of course Biomedical research and Evaluation methodology Audience Students Medical Informatics of the University of Amsterdam Level Master Number of participants 15-20 (although we expect this number will raise to 30-50) Duration of course 4 weeks course; 6 ECTS with lectures on Monday and Friday during three weeks 1. 2. 3. 4. 5. Learning objectives (e.g. Students should be able to assess quality of evaluation studies, should be able to define an adequate study design etc.) – normally described in the curriculum. 6. 7. 8. Structure and content (e.g. part 1: introduction, motivation for evaluation; part 2: evaluation methods, details on qualitative methods; part 3: evaluation design (RCT, quasi-experimental, observational); part 4. Case studies …); please be sufficiently specific. Week 1: motivation for evaluation; GEP-HI; details on qualitative methods; evaluation designs and outcome measures (learning objective 1-4) Week 2: health technology assessment : cost-minimisation, costeffectiveness, cost-utility analyses; QALYs and DALYs (learning objective 5) Week 3 Usability engineering and evaluation (learning objective 6-8) Teaching material (e.g. Brender et al 2006 Handbook; Han et al 2005 – please give complete reference) Is able to design an evaluation study; Can judge the completeness of an evaluation study report; Recognizes types of bias related to those different research designs and knows how to avoid them Is able to describe the meaning and value of triangulation; Knows and can apply the following Health Technology Assessment and cost studies concepts : QALYs and DALY's Quality of life measurement Cost-minimisation, cost-effectiveness, cost-utility analyses Understands human computer interaction models and the (strenghts and weaknesses of the) main usability evaluation methods for assessing the usability of interactive computer application Understands and can apply usability inspection: Heuristic Evaluation and Cognitive Walkthrough and Usability testing: Think aloud methodology and Beta testing Has skills in designing, performing and reporting on a usability study Syllabus with scientific journal papers (e.g. Harris 2007; STARE-HI; GEP-HI) Evaluation Methods in Medical Informatics (Computers and Medicine) Friedman, Charles P./ Wyatt, Jeremy C. (Edt) Second edition, 2006 Springer ISBN 10:0-387-25889-2 (chapters 1, 2, 3, 4 and 9). Dix A, Finlay J, Abowd G, Beale R. Human Computer Interaction. Third edition, Pearson Education, 2004- ISBN 0-13-046109-1 (parts of chapters 3, 5, 6, 7 and 9). Drummond M.F., Sculpher M.J., Torrance G.W., O'Brien B., Stoddart G.L., Methods for the Economic Evaluation of Health Care Programmes, third edition, Oxford 2005 (chapters 1, 2, 3, 4, 5 and 6). Assignments (number and type, e.g. presentation of one evaluation The first three weeks on Mondays the theoretical lectures with some papers and a written exam) small group work to exercise the theory. At the end of the day an exercise is explained on which the students have to work from Tuesday till Thursday. Exercises are presented and discussed on Friday. The last week is free for preparing the written exam on Friday. There are three assignments : 1. Design a quantitative evaluation study for a specific health informatics application (e.g. a DSS or self management application which is under evaluation in our department) 2. Judge an HTA study (a journal paper) 3. Design and execute a usability study on an existing medical app The module is finished with a written exam Remarks Assignments are group work. The written exam is individual.