Contact person
Nicolette de Keizer ([email protected])
Name of course
Biomedical research and Evaluation methodology
Students Medical Informatics of the University of Amsterdam
Number of participants
15-20 (although we expect this number will raise to 30-50)
Duration of course
4 weeks course; 6 ECTS with lectures on Monday and Friday during
three weeks
Learning objectives
(e.g. Students should be able
to assess quality of evaluation
studies, should be able to
define an adequate study
design etc.) – normally
described in the curriculum.
Structure and content
(e.g. part 1: introduction,
motivation for evaluation; part
2: evaluation methods, details
on qualitative methods; part 3:
evaluation design (RCT,
observational); part 4. Case
studies …); please be
sufficiently specific.
Week 1: motivation for evaluation; GEP-HI; details on qualitative
methods; evaluation designs and outcome measures (learning objective
Week 2: health technology assessment : cost-minimisation, costeffectiveness, cost-utility analyses; QALYs and DALYs (learning
objective 5)
Week 3 Usability engineering and evaluation (learning objective 6-8)
Teaching material
(e.g. Brender et al 2006
Handbook; Han et al 2005 –
please give complete
Is able to design an evaluation study;
Can judge the completeness of an evaluation study report;
Recognizes types of bias related to those different research designs
and knows how to avoid them
Is able to describe the meaning and value of triangulation;
Knows and can apply the following Health Technology Assessment and
cost studies concepts :
 QALYs and DALY's
 Quality of life measurement
 Cost-minimisation, cost-effectiveness, cost-utility analyses
Understands human computer interaction models and the (strenghts
and weaknesses of the) main usability evaluation methods for
assessing the usability of interactive computer application
Understands and can apply usability inspection: Heuristic Evaluation
and Cognitive Walkthrough and Usability testing: Think aloud
methodology and Beta testing
Has skills in designing, performing and reporting on a usability study
Syllabus with scientific journal papers (e.g. Harris 2007; STARE-HI;
Evaluation Methods in Medical Informatics (Computers and Medicine) Friedman, Charles P./ Wyatt, Jeremy C. (Edt) Second edition, 2006
Springer ISBN 10:0-387-25889-2 (chapters 1, 2, 3, 4 and 9).
Dix A, Finlay J, Abowd G, Beale R. Human Computer Interaction. Third
edition, Pearson Education, 2004- ISBN 0-13-046109-1 (parts of
chapters 3, 5, 6, 7 and 9).
Drummond M.F., Sculpher M.J., Torrance G.W., O'Brien B., Stoddart
G.L., Methods for the Economic Evaluation of Health Care
Programmes, third edition, Oxford 2005 (chapters 1, 2, 3, 4, 5 and 6).
(number and type, e.g.
presentation of one evaluation
The first three weeks on Mondays the theoretical lectures with some
papers and a written exam)
small group work to exercise the theory. At the end of the day an
exercise is explained on which the students have to work from Tuesday
till Thursday. Exercises are presented and discussed on Friday. The last
week is free for preparing the written exam on Friday.
There are three assignments :
1. Design a quantitative evaluation study for a specific health
informatics application (e.g. a DSS or self management
application which is under evaluation in our department)
2. Judge an HTA study (a journal paper)
3. Design and execute a usability study on an existing medical app
The module is finished with a written exam
Assignments are group work. The written exam is individual.

Course on Biomedical Research and Evaluation