WHAT MAKES A GOOD SUMMER PROJECT? MSc Control of Infectious Diseases Anna Foss and Michael Miles Based on material and slides provided by: Helen Hogan, Michael Miles, Doug Parkin, Rory Donnelly, Cathy Zimmerman, Jane Falconer and Stuart Anderson 1 Why do a Project Report? • To provide students with a crucial opportunity to gain personal experience of real world issues and problems with the control of infectious diseases • To be able to conduct research projects overseas in endemic areas, in developing or developed countries – However, some students may undertake their projects in the UK, focusing on UK public health or analysing literature or data sets generated through collaborative research elsewhere 2 The specific objectives of the Project Report are to: • Describe the research project and the experience gained • Demonstrate the ability to plan and organise time • Demonstrate understanding of relevant literature and summarise the context of the project in an introductory or background section to the report • Demonstrate the ability to understand and apply an appropriate range and selection of investigative and analytical methods • Demonstrate the ability to interpret rationally observations and data, while being aware of the limitations of the project 3 And to: • Demonstrate the ability to critically discuss and evaluate the outputs and applications of the research project in the context of previous relevant work, and to state clear conclusions and recommendations for future research • Demonstrate independent and original thinking • Where appropriate, reflect on social or ethical issues relating to the research • Demonstrate competent communication / presentational skills through the write-up a coherent and professional report, including accurate and systematic reference citations and accompanying bibliography 4 Project: Process and Product • The process – doing the work: • a literature review • study design/research proposal • data collection / analysis etc • The product (content that will be marked) – communicating the results: • project report (In an academic professional format, as defined by the School and for CID MSc) 5 Independent learning • Complex learning is messy, uncertain and ambiguous... The independent learner – • Can live with this • Enjoy this • Manage their reactions / show resilience • Arrive at results... • But know that the results are not fixed... • And that further questions arise from every ‘apparent’ answer Project Report Skills and Assessment 7 Project Report: Student skills and assessment task Assessment Task Student Skills Background, literature and theory elements Critical Thinking Data* collection and findings sections Independent research skills Data* analysis and conclusion sections Ability to analyse data and draw conclusions The entire written report Clear coherent writing Style, presentation and referencing Familiarity with written conventions * data may be either qualitative or quantitative 8 Questions to guide markers (1) • How clearly does the abstract represent the content and outcomes of the project? • How effectively does the introduction summarise context and relevant literature? • How clearly and coherently are the aim and objectives stated? • How appropriately were investigative and analytical methods applied and explained? • How rationally were the findings interpreted? • Does the student demonstrate sufficient understanding of the limitations of the current project work and show insights into ideas for future research? 9 Questions to guide markers (2) • How clearly were conclusions, implications and recommendations made and discussed? • Have the aims and objectives been met? • How well has the student sought and identified relevant references (e.g. to position project within context of broader research), and cited these appropriately? • How competent and accurate was the presentation of the report overall, including structure and the use of tables / figures / illustrations? • How much independent and original thought was displayed throughout the project? 10 Project Report assessment criteria: pass Marking is based on the following guidelines: • 5 (outstanding achievement, distinction level) - A comprehensive discussion of the topic giving all relevant information, showing in-depth critical understanding of the topic, going beyond conventional answers, and bringing in additional relevant ideas or material • 4 (very good pass) - A full discussion of the topic, including all relevant information and critical evaluation • 3 (good pass) - The major points are discussed, but relevant, though less important considerations, are omitted • 2 (satisfactory pass) - Sufficient relevant information is included but not all major points are discussed, and there may be some errors of interpretation 11 Project Report assessment criteria: fail • 1 (borderline fail) - A few points are included, but lack of understanding is shown together with use of irrelevant points • 0 (outright fail OR not submitted) - None of the major points present; many irrelevant points included and a serious lack of understanding, OR Not submitted NB The marking of the project report counts for 30% of the overall MSc 12 Project Approval Process: Key milestones and deadlines 13 CARE form • CARE form: The Combined Academic, Risk assessment and Ethics approval form • Intended as a way to comprehensively summarise the work you intend to do in your project, so that staff have sufficient information to give approval • It will also prompt you on a number of key points you need to think about • http://intra.lshtm.ac.uk/tpd/taughtcourses/studentforms/in dex.html • Form and Project Handbook on Blackboard under CID. 14 The CARE form consists of 5 sections: • Section 1 – Student and course information • Section 2 – Approval and submission status • Section 3 – Application for academic approval • Section 4 - Application for Risk assessment approval • Section 5 – Application for Ethics Approval Key milestones and deadlines (Jan – April) • End of Feb: decision about the likely project title and supervisor – see project topics list • Draft project outline / proposal / protocol • End of March: submission of draft CARE form and more detailed protocol (including budget) to supervisor • Ensure support from tutor / LSHTM staff member and an established means of regular contact, and adequate local support overseas • Travel preparations e.g. passport, visas, vaccinations, prophylactic medicines, insurance, flights, Trust Fund • End of April: submission of final CARE form, approved by supervisor and Course Director (and Safety signature 16 if required), to TSO (and to MScEthics if required) Key milestones and deadlines (May – Sept) • May/June: Further develop project protocol, especially Background section (literature review), proposed Methods, conceptual framework, plan for presentation of Results, structure of whole report, timetable, logistics, budget • July/August: Conduct project, write-up Results and Discussion sections, obtain supervisor feedback (e.g. on draft of complete report), and revise report with feedback • DEADLINE for final report is12 noon on Friday 03 September 2010 • Any extension to this deadline has to be approved in advance by the Taught Course Director, Graham Clark (ITD) / Hannah Babad (PHP), and will require supporting evidence 17 of medical issues etc Project Report Content 18 Project Report Content: Introduction Statement of the problem - Introduce the broad topic and its context - - State the problem - - e.g. disease, geographic setting, ‘historical’ or current relevance e.g. gap in knowledge on the subject area, an operational or an analytical ‘problem’ that deserves examination, a contested or debated issue for which there are different ‘solutions’ Justify the need for the project 19 Project Report Content: Background - What is known to date about the topic? - How has it been addressed? - e.g. conceptually, methodologically, politically/ policy, programmatically… - In which populations and settings? - What is not known? - Definition of terms 20 Project Report Content: Aim and objectives Aim • What aspect of the ‘problem’ will your project examine? • What is the overall contribution of the project? (e.g. to better understand…., to explore…., to review…., to inform) Note: please keep this modest ! • The overall aim which should be a clearly stated and answerable research question Objectives (what will the project do to meet aim) - Should emerge clearly from the background (what you know at this stage on the topic) - Should be in line with your overall aim - Should be stated as research objectives, not methodological objectives - Main objectives can be broken down into smaller subobjectives 21 Project Report Content: Methods Methodology (How will I fulfill my objectives) - Should suggest an appropriate and feasible study design given scope of topic, type of analysis and duration of study - Methods should be consistent with, and appropriate for addressing your objectives (or sub-objectives) and should include: – For the literature review: search terms, search strategy, exclusion criteria, databases used, etc – For interviews / questionnaires: sampling strategy, data collection methods, data analysis, etc – For monitoring data: sampling strategy, data collection methods and data analysis – For modelling: description of models and justification of tools used - Ethical considerations 22 Project Report Content: Results • The form will depend on the type of project • Look up past example of projects in library • Results should have emerged from the methods described • Overview of the quality and quantity of information / data • Summary of findings from literature that shows a reasonable understanding of the topic • Good description of qualitative / quantitative results • Appropriate use of tables / figures 23 Project Report Content: Discussion and Conclusions • In this you bring together your findings; often useful to summarise them briefly at the start of this section • Commentary on their value and applicability – Review the strengths and weaknesses of your work – Relate back to the original research questions - can you answer them? – Integration of theory into discussion – Bring in (more?) literature for comparative purposes • Make overall conclusions – Again, in relation to the original research questions – Implications and realistic / feasible recommendations of results for infectious disease research / policy / other audiences 24 Project Report Content: Appendices This should include: • The final CARE form and any addition forms (all anonymised!) The following information may also be included in separate appendices: • Table of studies reviewed including nature of the population studied and quality of the study • Copies of questionnaires / interview schedules. • Datasets, including detailed quality assurance information. (This may not be appropriate if the data set is large). • Mathematical description of models, statistical techniques, etc 25 Examples and further guidance resources 26 Example of aim Overall aim: • To determine the relationship between dengue fever incidence in Malaysia with social and cultural variables using statistical and geographic information systems analysis 27 Example of objectives Specific objectives: • To access incidence data on dengue fever from the Ministry of Health • To develop a geo-referenced map with incidence of dengue per region in Kuala Lumpur • To develop and conduct a questionnaire to determine social and cultural factors that may influence dengue incidence, including human dwellings, awareness/knowledge, mosquito protection patterns, sanitation, water collection and storage and waste disposal • To assess spatial social risks related to dengue incidence • To develop a model that can be used as a predictive tool to forecast the occurrence of dengue cases in metropolitan Kuala Lumpur for preparedness and control efforts 28 Searching and reviewing the literature, and good academic writing Library help pages on planning and conducting a literature search, and citing and referencing systems: http://www.lshtm.ac.uk/library/help.html A tutorial on critical appraisal and using the literature: http://www.shef.ac.uk/scharr/ir/units/critapp/index.htm Resources and advice on good academic writing practice: • http://resources.bmj.com/bmj/authors/bmj-house-style from the British Medical Journal – ‘gold standard’ • http://openlearn.open.ac.uk/course/view.php?id=3359 – from the Open University - a comprehensive set of online tutorials about planning, structuring and writing academic 29 assignments or reports. What makes a good report? Overall • Well written and well structured throughout • Abstract / Summary briefly summarizing key points from the methods, results and conclusions • Good choice of Headings and sub-Headings • List of abbreviations at the beginning (a glossary in the appendices may be necessary if there are lots of technical terms) • List of tables at the beginning • Conventional use of referencing • Any tables and charts well laid out and labelled 30 What makes a good literature review? (in addition to previous general points) Methods • Include detail on how the search was undertaken: search terms, search strategy, databases used, inclusion / exclusion criteria, how quality was assessed • Justification of the methods used (e.g. reasons for including or excluding specific studies) and consideration of the limits associated with the approach (e.g. confounding, emphasis on hypothesis generation) Results • Overview of the quantity and quality of the literature included • Present the results in a systematic way, including critical appraisal and a synthesis of the evidence (not just a description of findings from each study) – it is about ‘making the whole into something more than its parts’ Discussion / Conclusions • Demonstrate a clear understanding of the literature and discuss the implications of the findings for future research and policy / practice • Conclusions should be grounded in the evidence reviewed 31 What makes a good research project? (in addition to previous general points) Introduction • Give a brief description of the specific population, country or region, if applicable, e.g. location maps may be helpful Methodology • Literature review, focusing on current knowledge and identifying any research gaps • Description of statistical / modelling methods used (including software tools) • Description of datasets (existing datasets or new data appropriate to a pilot study): sampling strategy, data collection methods, data analysis, representativeness, QA/QC, etc Results • Good description of quantitative results, including tables & figures (with appropriate labels) where graphs (scatter plots, histograms, pie charts, etc.) should be readable and any units clearly indicated 32 Common problems • Poor report structure, inadequate headings/sub-headings • Confusion between aim / objectives and methods • Overambitious aim / too many objectives • Very broadly described literature review methodology (or not enough articles in lit review), statistical methods lacking detail • Not all objectives (sufficiently) addressed in results & discussion • Inconsistent datasets, figures / tables without appropriate labels, units, etc • Too general recommendations, not entirely justified by the results & discussion • Limitations, strengths & weaknesses of methodology not discussed • Data / information quality & quantity not discussed • Referencing style • Lack of proofreading 33 Further information about the Project Report • Recommended length 7000 words, with an absolute maximum of 10,000 words • Electronic and 2 paper copies • Further information in Project Handbook: – Page 9-10 describes what you can expect from your supervisor – Page 15-17 gives guidance on developing your protocol – Page 52-55 details how to reference appropriately and avoid plagiarism (see also quiz: www.ldu.leeds.ac.uk/plagiarism) – Page 46, and 57-61 contains key information about required format for project report and how to submit final report – Page 65-77 is CID-specific Part 2, including examples of more detailed project protocols to supplement CARE form section 3 – Pages 12-44 for detailed guidance on how to complete CARE form • See past examples of projects in library achieving pass grade or above: 34 http://www.lshtm.ac.uk/library/mscprojects.html