Academic Skills Advice MA and MSc: Research Design This workshop will: - Help you begin to understand the basics of research approaches - Offer hints and tips in getting to grips with quantitative and qualitative methods - Discuss basic ethical considerations that may need to be taken into account - Provide initial tips for those considering secondary, rather than primary, dissertations and projects Teaching points: 1. 2. 3. 4. 5. 6. 7. 8. 9. The research design process Philosophies and theories Research approaches Research methods Sampling Bias Ethical considerations Secondary research Reflection 1 www.brad.ac.uk/academic-skills Academic Skills Advice 1. The research design process Research design is a process, including the generation of a plan, with a number of stages all playing their part enabling you to find an answer to your research problem. Your research design involves both the way that you prepare and conduct your research to find the answer to your research question or test your hypothesis. Setting up a Master’s research project includes: Your methodology – the principles that inform the way you make choices and decisions in designing, undertaking and writing up your research Your choice of raw material – documents, data or characteristics for participant selection Your chosen methods – including any conditions you create for undertaking your research Your methods of recording information – at each stage of your research Analytical methods to employ – e.g. statistical approaches, formulae or analytical techniques you apply to your raw data or source materials Data storage and management – the conditions under how you maintain and store your data Conducting the research involves additional thought about: Ethical considerations – e.g. informed consent, confidentiality and anonymity, and many more aspects Bias – from sampling to analysis Although each of these will be discussed separately, many are connected. 2. Philosophies and theories Before we move onto the individual stages above, we will briefly look at two ideas that underpin all research: what exists in the world and how we know about what exists. Ontology and epistemology are terms which make many post-graduate students shudder, but don’t panic. They can be summed up as: Ontology relates to our perception of the world. It is whether we believe the world is knowable and measurable and that everyone shares in the same sense of reality OR the belief that the world is perceived differently by individuals. It is about what we are looking at. 2 www.brad.ac.uk/academic-skills Academic Skills Advice Epistemology explores ways of knowing and the difficulty of knowing. It asks questions, such as do we learn by being ‘told’ passively or do we come to know things through experience? This leads to further questions about how we might go about finding things out. It is about how we look and find out about something/s. These two concepts lead us to understand that nothing is certain, so it is wise not to be over-confident with your research conclusions. Coming to a decision about how we see the world and how we learn will lead you to down one of two paradigm paths. There’s another word post-graduates don’t like – paradigm. It is simply a word that describes the ways we think about and research the world. At one time, the two central paradigms, positivism and interpretivism, were dealt with as separate and competing explanations of how we see the world and learn about it, but philosophers and researchers accept they now happily coexist. Positivists believe that knowledge can be obtained objectively, i.e. what we see and hear is straightforwardly perceived and recordable; that we are able to observe, measure and study the world ‘scientifically’. This means the researcher is ‘distanced’ from the research subject to maintain objectivity. This forms the basis of the scientific methods, among others. Interpretivism reveals the world as a construct we perceive as individuals because we attach different meanings to everything. Therefore, we cannot use the same ‘scientific’ method of measurement, but need to consider people and how they interrelate, by looking at what they say and their behaviour to discover meaning. This means the researcher is ‘closer’ to the participants and may be subjective in their interpretation. So you can see how decisions relating to ontology and epistemology lead to different paradigms being adopted. Let’s sum up what we have covered in the research design process. Ontology: Perception of the world Epistemology: Ways of knowing Paradigm: PositivistStudy world in a detached and objective way Paradigm: InterpretivistStudy world close up and subjectively 3 www.brad.ac.uk/academic-skills Academic Skills Advice This will help you to make a decision about which research approach to take, and therefore which methods and tools to use, i.e. qualitative or quantitative. In short, qualitative methods aim to develop understandings of meanings, and usually work with ‘soft’ data such as words, images, sounds, etc. quantitative methods identify and make sense of patterns in ‘hard’ data in the form of numbers, such as measurements. So, in a very basic way, you could describe quantitative methods as following a positivistic paradigm and qualitative coming from interpretivism. (More on quantitative and qualitative approaches and methods later). Before we finish, a quick word about the ‘ologies’, paradigms, and the two ‘Qs’: they should not be your starting point when deciding on a research question or hypothesis, and it makes sense for them not to be. The focus should be on what you want to find out and the best way to obtain that information, and not the following scenario: ‘I believe we all see the world in the same way and learn through information being provided directly, so I will study from a detached and objective point using a method involving statistical data. Right, what research project could I choose to do that?’ So the model actually looks a bit more like this… Practical top down: What you want to find out and how Research question Methodology/ methods Methodology/ methods Quantitative approach Qualitative approach Paradigm Epistemology Ontology 4 www.brad.ac.uk/academic-skills Philosophical bottom up: The world, knowledge and approaches to research Academic Skills Advice On top of all this, is the use of theory, either to suggest or support your choices for your research project and activity, or to suggest explanations for your findings. It can be difficult for post-graduate students to know how to use theory, with many trying to ‘shoe horn’ it into their assignments and dissertations as they know their tutors/supervisors will expect to see it. A couple of examples of how theory could help are: My research project centred on why some students do not engage with the Academic Skills Advice Service, and their reasons for not using us, so that we can then improve our methods of publicity to raise awareness and hopefully attendance. I have no idea what the outcomes would be but my research of the literature presented some possible explanations of why students do not engage. One of these was a theory of practice by Bourdieu, which suggests people are unable to escape the status they have from birth. This is linked to another theory on how people’s actions are influenced by both the language and behaviour of others. Therefore, one possible reason for students not engaging is because their peers don’t, or their lecturers’ may not have suggested the Service, or they have low expectations of themselves due to their social background. So, theory could help me after my research activity. Alternatively, I could be unsure what research project to undertake within the field of student access and success. If I read Marx’s theory relating to the oppression of the working classes by the elite, this could lead to a research project regarding how Bradford University encourages students from nontraditional backgrounds to consider the institution as an option. So theory could help me before my research activity. Theory Research Question Insert theory here Data collection & analysis OR Findings Theory Insert theory here Above section adapted from Thomas (2013) 3. Research approaches Let’s get back to qualitative and quantitative approaches. To recap, qualitative methods are about interpretation of meaning from people using words, pictures, etc. and quantitative methods find patterns in numerical data. 5 www.brad.ac.uk/academic-skills Academic Skills Advice Activity 1: Q v Q Read the following statements and decide which are advantages or disadvantages for quantitative or qualitative approaches. Each is allocated a letter; please jot down the letter of the statement in the box under the appropriate heading. Quantitative Advantages Disadvantages Qualitative Advantages Disadvantages A. They are useful for in-depth analysis of individual people, businesses, events and occurrences. B. Projects that use quantitative approaches are generally easier to plan and to contain in size, making them ideal for student projects. C. They enable study on a broader scale, such as through online surveys, generating large amounts of data which can be analysed relatively easily using relevant software. D. The results can lack ecological validity (ie that methods, materials and setting must approximate the real-world that is being examined rather than external validity which relates to ability to generalise the research’s findings). E. They can be unpredictable, making them harder to manage and contain. F. They help establish patterns such as trends in behaviour, or in science, ‘universal laws’. G. The research questions or hypotheses tend to be very precisely articulated, allowing the possibility of precise answers. H. They tend to more open-ended, allowing a greater set of responses to emerge. I. Findings may be useful to the particular case but not more generally applicable. J. They have greater ecological validity. K. There is a risk of gaining rather banal results. L. The scale of the research makes it easier to draw reasonably valid generalisations in a relatively short timeframe. M. Not everything is easily measured. There is a risk of gaining skewed understanding of a phenomenon as a result of omitting those aspects that can’t be measured. 6 www.brad.ac.uk/academic-skills Academic Skills Advice 4. Research methods You may already be aware of the many data collection methods available to you as researchers, and you may have researched which could be most useful to you in your project. There are two different types of methods – primary and secondary with the first involving you undertaking empirical research, i.e. direct experience or observation to generate findings. The latter entails using previous research from others to find links, gaps and/or consensus between them to generate something new (Punch 2010). Activity 2: Data collection methods In pairs or small groups, identify appropriate methods of data collection based on the answers within the table above. Use of primary or/and secondary sources Quantitative methods Qualitative methods You do not have to stick to quantitative OR qualitative methods as it is acceptable to mix them to obtain fuller and richer detail. This is called a mixed methods approach. There are some frameworks where it is often expected methods will be combined, such as a case study. Don’t forget to… use the appropriate method to gain the type of data you want ensure it is ‘fit for purpose’, i.e. it is suitable for the intended purpose (questions are clear and understandable, or scales use appropriate measurements) Extract adapted from Dixon and Pearce (2010) 7 www.brad.ac.uk/academic-skills Academic Skills Advice Next, we will look at issues you should concern yourself with depending on whether you are carrying out primary or secondary research. We will start with those relating to primary research. 5. Sampling Whether you chose to undertake quantitative or qualitative research, you will have to make a decision about what or who you will be studying. However, how representative your sample is does depend on which approach you take. For quantitative research, you will want to generalise your results from your (relatively) small sample to a wider population. So, you could say that because research performed on 1000’s of cancer cells reveals feeding them custard inhibits growth, all cancer cells will be similarly affected. Whereas in qualitative research, it is less about broadening results outwards than looking at what individuals say or how they behave, etc., so fewer numbers are required. As you can see, each approach has sample group/s selected differently, and with different numbers of participants required. Remember, that the claims you can make from your data will be very different in each case – avoid making generalisations on the basis of a small, unrepresentative sample (Eve 2008). Another consideration is how you can access whatever makes up your sample: children, silver nitrate, students, false legs, etc. Who would you have to contact, how would you obtain permission, what is the financial cost of access, what are the ethical implications, and many other questions need to be answered and various procedures gone through before you can start. A final word on sampling and samples: if your research project has a qualitative approach, you may come across other terms for ‘sample’. These could include ‘respondent group’ or ‘participatory cohort.’ 6. Bias Bias is anything which stops an impartial and balanced research process from taking place. It can occur at any phase of research, from study design or data collection, to data analysis and publication. As a post-graduate student, you must consider the degree to which you can prevent bias, through proper study design and implementation, or consider how it might influence your study’s conclusions. In extreme cases, bias can cause readers to think one thing when the opposite is true. For example, before 1988, many studies showed that hormone replacement therapy (HRT) decreased the risk of heart disease among women who had gone through the menopause. However, more recent studies, rigorously designed to minimise bias, found the opposite, i.e. an increased risk of heart disease with HRT. (Pannucci and Wilkins 2010) 8 www.brad.ac.uk/academic-skills Academic Skills Advice In quantitative research, the researcher tries to eliminate bias completely: in qualitative research, it is all about understanding what will happen, acknowledging the bias and trying to compensate for it. There are many different ways in which bias can creep into research… Design bias happens when the researcher does not take into account the inherent or fundamental biases found in most experiments, and does not either try to lessen their impact or take them into account when analysing results. For example, ignoring or not compensating for the effect fluctuating Spring temperatures may have on the decomposition of a body. Selection or sampling bias: there are two types– omission and inclusive. In the first, certain groups are omitted from the sample, e.g. ethnic minorities are excluded or only ethnic minorities are studied. Of course, this can be a deliberate decision on the researcher’s part, but you are expected to explain why you have made your sampling choice (see below). The other occurs when samples are selected for convenience, e.g. enlisting students outside a bar for a psychological study. In both cases, the researcher must not generalise their results to a broader population. The following are all forms of data collection bias: Procedural bias: occurs when participants have pressure applied to them to complete their responses quickly, e.g. employees being asked to complete questionnaires during their break time. Measurement bias: arises from an error in data collection and the process of measurement. In quantitative research, this could be that an instrument has not been properly calibrated or set (a faulty scale). Or more generally, any research will have an unavoidable effect on a participant so the researcher must assess the extent to which this happens, such as, respondents providing more socially acceptable answers due to a fear of being judged, which could then skew the results. Interviewer or response bias (sometimes called researcher bias or participant bias): derives from the researcher giving subconscious clues in questionnaire or interview questions to attain the answer they hope for from the subjects. Researchers may make assumptions about how questions or key words will be interpreted or defined. Or the opposite – respondents provide the answers they think researchers want to receive (Shuttleworth 2014). 7. Ethical considerations You will find that many of your ethical considerations are connected, but let’s start with a basic principle: “Ethical practice requires the investigator to respect the individual’s freedom to decline to participate in research.” Faber and Beauchamp (1985: 185) 9 www.brad.ac.uk/academic-skills Academic Skills Advice It may seem odd to start with a statement about people not getting involved with research but it is important to remember that people participate on a voluntary basis. This places the burden on you to ensure they and their rights are respected, and they are provided with all the relevant information about your research project. Whilst obtaining consent is about people agreeing to be involved in a study, informed consent covers a much broader range of associated elements. Participants need to have some detail about the research project and how you intend to collect the data (will you be drawing blood or interviewing them?). They need to know if any harm may come to them whether physical, mental, emotional or even just by making them feel a little uncomfortable. For example… you may want to ask students why they do not attend tutorial sessions they have requested. The answer may be of a personal nature so embarrassment may be caused. Other information to provide participants includes how confidentiality will be maintained; what data storage solutions you have found, how long you will be holding the data for and how you intend to dispose of it; and your contact details. Most importantly, respondents must be made fully aware that they can withdraw or “discontinue participation AT ANY TIME” (my emphasis) (Faber and Beauchamp, 1986: 185). In turn, this may affect the level of anonymity you can employ: if you do not know who has supplied what, how can you withdraw their data? (Thomas 2013). We will look at some of these in more detail starting with anonymity and confidentiality. Many post-graduate students are unsure of the difference between the two, so let’s clear this up. Anonymity refers to concealing the identities of participants in all documents resulting from the research Confidentiality is concerned with who has the right of access to the data provided by the participants Extract adapted from Research Development Initiative (2014) Therefore, you need to consider the ‘level’ of anonymity. In effect, if you will be able to identify participants in the final dissertation and report, you cannot promise anonymity. Regarding confidentiality, it may be that someone will help you to analyse the data (e.g., if there are transcriptions of interviews or focus groups to perform, or many questionnaires to look at) or, as in my case, my colleagues will be reading a report on the findings. Your consent form and participation brief needs to reflect this to ensure participants can make an informed choice about whether or not to take part. 10 www.brad.ac.uk/academic-skills Academic Skills Advice Another aspect already mentioned, and relating to confidentiality, concerns data storage which is relevant to all forms of primary research. Consider where any raw data will be kept, the length of time you keep the raw data and how you intend to dispose of it. Is a locked filing cabinet sufficient to keep hard copies of observations, questionnaires, etc. at work? What if you work from home? Electronic data needs to be appropriately protected by encryption and/or passwords. You must also take into consideration that “personal data processed for any purpose…shall not be kept for longer than is necessary for that purpose” (Information Commissioner’s Office, 2014). Speak to your tutor/supervisor for advice on these and also methods of safely and thoroughly destroying data. It is possible that participants may be misled or not informed in full (i.e. they are victims of ‘deception’) as part of a research project, notably in psychology. However, this is unusual and generally any deception should be avoided as this affects the integrity of informed consent. What to avoid is… Misleading participants about the purpose or procedures of the research Providing incorrect information about the study Leaving information out about the research Observing participants when they do not know they are being watched Extract adapted from Thomas (2015) If you are unsure as to whether your research process could in any way deceive participants, discuss this with your dissertation or project supervisor. If you are asking someone to participate in research, you must consider the relative positions you hold and the influence you may exert over them both to initially be involved as well as during the data collection phase. This is the notion of power and authority. For example… you are a social worker on a lengthy work placement and want to interview regular clients about the other services they use. Even if you don’t, they may perceive that you hold a position of power and that not participating may adversely affect the level of service they receive from you and your colleagues in the future. This perception may also lead them to provide answers they think you want rather than honest replies, so there will be a negative effect on your research. This notion of power and authority can be difficult to negotiate. All participants must be treated with respect and provided with all relevant information but there are some that are particularly vulnerable: obvious categories include children and those with disabilities or mental health issues, but there are others, such as the example above, that also need to be treated with special care and thought. 11 www.brad.ac.uk/academic-skills Academic Skills Advice A quick mention of some of the documents you require if you are studying people: a participation briefing is (usually) written information that provides participants with all the information they need about the research from its aims and intentions to what they need to do and all the above relating to ethics. Your consent form will reiterate this information in such a way that participants can confirm their understanding (e.g. tick boxes at the end of statements) and sign to represent their willingness to be involved. Make sure you follow all the necessary guidelines and requirements of your course and the University as outlined in your handbooks and by your tutor/supervisor. Activity 3: Assessing sampling, bias and ethical considerations Below is an extract from an article: Undergraduate students perceptions of the role and utility of written assessment feedback. (Bailey, 2009) Read the extract and, in pairs or small groups, decide if sampling, bias and ethical considerations are adequately covered in the text. If so, explain how the author has done so; if not, state what is missing and what the author should have included to reveal the appropriate actions had been taken. Space is available overleaf. Abstract: Student dissatisfaction in higher education with written feedback on their assessed work is a topical issue given the publicised findings of the National Student Survey. This paper presents excerpts from interviews with students about their experience with written feedback together with analytical and interpretive commentary. The context of the research was a post-92 university with a wide range of higher education provision and a commitment to widening participation and student retention. The paper begins with an overview of feedback studies in higher education and a summary of current agendas. The data and analysis are presented in three sections. A final discussion section outlines some salient findings from the research. The research comprised semi-structured interviews with student respondents who came from a cross-section of disciplinary areas. Interviews were conducted with individuals and small groups of up to three students. Some students were approached directly through contact with their subject teachers while others were approached through the study skills centres. Participants were traditional and non-traditional (the latter often being mature-age and returnees to education in applied and vocational subject areas). All student participants were undergraduates and some studying one or two year diploma (represented by teaching staff in 12 www.brad.ac.uk/academic-skills Academic Skills Advice those curricular areas as equivalent to at least advanced degree level) courses in nursing and social work. Many of the sample were students following joint degrees or on modularised courses in applied and vocational areas. The departmental and disciplinary background of students is given in parenthesis following each of the data excerpts. Additional information is also included in some instances using square ([ ]) brackets. Questions asked by the interviewer are italicised in the excerpts. Initially the following questions were asked: What do you like/dislike about written feedback? What do find useful/less useful about written feedback? The emphasis was on open and exploratory talk to allow respondents to consider their experience and perceptions more reflectively and in depth. In the course of the interviews reference was made to the form and delivery of feedback. In some cases students were able to produce documentation in the form of structured feedback sheets and assessment guides. In disciplines that usually adopt quantitative research approaches, other ethical considerations come into play. For natural and human sciences, the health and safety of the researcher and others needs to be taken into account. This could relate to potential cross-contamination or infection from handling tissue samples. Within the computing sector, what is the ethical position regarding the use of people’s likenesses in 3D modelling? Whilst consent is normally pre-negotiated, these issues need to be mentioned within your final year project report or dissertation. 13 www.brad.ac.uk/academic-skills Academic Skills Advice For both quantitative and qualitative research, the ethical watchword is honesty: honesty in how you approach the problem or question, and honesty when you report your results. An open and objective attitude is vital when preparing and undertaking research coupled with a lack of ego or fear about changing a hypothesis when the evidence merits it. Also, your results must be accurately reported with no ‘massaging’ to achieve the desired outcome – do not succumb to pressure of time, or your own or others’ expectations and therefore provide untrue results (Fleddermann 1999). So, you have completed your data collection activity but before analysing your data, you need to manage it so it is ready to analyse. Sometimes, your data management drives the format a tool will take, e.g. you intend to undertake a large questionnairebased survey with potentially hundreds of responses. One way to speed up collation and analysis would be to enter your data automatically via a specific software programme. Therefore, you would have to structure your questionnaire in such a way that it can be read by the software. Depending on your research tool, you may have a lot of information that is not relevant to your research question. Therefore, the first thing you need to do is to ‘mine for the gold’. Whether reading through your transcripts or looking at your spreadsheets or databases, relevance is the key (Cohen et al. 2010) Once you have your reduced any relevant information, ask yourself the following analysis questions : a) b) c) d) e) Are there any clear themes? Can you claim any generalisations? Do you have any chunks of data to underpin your interpretations? Are there any quotations or vignettes representing an overarching theme? Is there any patterned data? What does not fit this/these pattern/s? Does that tell you anything? f) How does this/these case study/ies relate to others? g) What gaps or puzzles remain? Extract adapted from Cousin (2009) 8. Secondary research The secondary research methodology involves the summary, collation and synthesis of existing research rather than conducting your own primary research. Existing research could include use of conference papers, reports, censuses, patents, interview transcripts, etc. If this sounds like a literature review, then you are right there are many similarities between them. 14 www.brad.ac.uk/academic-skills Academic Skills Advice One of those is the process of reviewing the literature you will include in your research: Appraisal Quality of literature and findings/outcomes Analysing to identify details Evaluating the literature and how written up Comparison To find patterns or themes Selecting most useful literature Also, you need to employ different reading and note-taking skills at each of the above preliminary phases and for more focused in-depth work. What is different at post-graduate level is the sheer volume of literature you will be using, so it may be useful to update or learn new indexing and cross-referencing methods to help you to keep track of all the documents. Ensuring your notes are organised as you go along will also save time later when you come to the writing stages. Primary and secondary research do have commonalities including many of the elements discussed earlier in the booklet, such as the philosophies and theory/theories underpinning your project; bias in your choice of literature to use in your study and potential bias of the original researchers; and gaining any required permission to use the papers. We run a workshop for taught postgraduate students on appraising and choosing sources; please visit our website for further details. 9. Reflection You may be asked to keep reflective logs or journals during your research process, either as an assignment or as a tool to consider emotions, events and other experiences. These could simply be records of in lab books (scientific procedures) to refer to if you decide to repeat an experiment, or they could be basic descriptive diaries, or they may be full journals. Even if you are not required to do so, it can be a worthwhile exercise and increase the rigour of your research. Reflection is a valuable transferable skill to take into your professional life. It is seen as the method by which a professional grows, changes and adapts – by constantly thinking about the impact of their expertise and predispositions, its strengths and the areas that can be developed further given what they know about theory, method and practice in their field. 15 www.brad.ac.uk/academic-skills Academic Skills Advice The skills associated with stepping back and pausing to look, listen and reflect, are closely related to those concerned with critical thinking which also requires you to ‘unpack’ whatever you are focusing on, not simply accept what you read or hear at face value. Through this process you will probably identify things you would not otherwise notice. The key to reflecting is spotting the patterns and links which emerge as a result of your experiences. Sometimes this is difficult for students because the focus is on you and this might not feel comfortable – especially when you are usually encouraged to depersonalise your work in essays and reports. Remember, you try to avoid saying ‘I’ in essays? So, when writing reflectively, you need to find a way to be both academic and personal, and that is not always easy. You may be both referencing academic theory and, in the same piece of writing, describing an exciting learning experience you had during a tutorial. Becoming reflective is, in part, about feeling comfortable with this dual process – to do this takes practice (Learning Development 2010). It can help you to be reflective about your research process whilst you do it, rather than making notes and then reflecting at the end of your project. For example, when starting your review of the literature, you should keep notes and records on what key search terms you have used, what articles may be of interest and why. You can then reflect on how you have selected and critically analysed these sources to be more efficient and effective in the future by identifying what skills you need to improve on, whether you have a broad enough variety of sources, etc. Your Subject Librarian will be able to help you with most issues relating to accessing texts of all sorts, and there are many hard copy and internet sources available on research and planning (Charlesworth 2015). References Bailey, R. (2009) Undergraduate students perceptions of the role and utility of written assessment feedback. Journal of Learning Development in Higher Education. http://www.aldinhe.ac.uk/ojs/index.php?journal=jldhe&page=article&op=view&path %5B%5D=29&path%5B%5D=26 Accessed 9 January 2015. California State University. (2014) Use of deception in research. Hayward: California State University. http://www20.csueastbay.edu/orsp/forms-policies-procedures/irb/deception.html Accessed 4 December 2014. Charlesworth, A. (2015) Doing research: planning, risk and reflection. Bristol: University of Bristol. https://www.cs.bris.ac.uk/Teaching/learning/how-to-lectures/planning-riskreflection.pdf Accessed 7 January 2015. Cohen, L., Manion, L., and Morrison, K. (2010) Research methods in education. 6th ed. Abingdon: Routledge. 16 www.brad.ac.uk/academic-skills Academic Skills Advice Cousin, G. (2009) Researching learning in Higher Education. Abingdon: Routledge. Dixon, N. and Pearce, M. (2010) Guide to ensuring data quality in clinical audits. London: Healthcare Quality Improvement Partnership. http://www.hqip.org.uk/assets/LQIT-uploads/Guide-to-ensuring-data-quality-inclinical-audits-8-Sep-10.pdf Accessed 7 January 2015. Eve, J. (2008) Writing a research proposal: planning and communicating your research ideas effectively. Brighton: University of Brighton. http://about.brighton.ac.uk/ask/files/6813/7206/9880/Writing_a_Research_Proposal. pdf Accessed 7 January 2015. Faben, R and Beauchamp, T. (1986) A history and theory of informed consent. New York: OUP. Fleddermann, C. (1999) Engineering ethics. New Jersey: Prentice-Hall Inc. Information Commissioner’s Office. (2014) Data protection principals. Wilmslow: Information Commissioner’s Office. https://ico.org.uk/for_organisations/data_protection/the_guide/the_principles Accessed 4 December 2014. Learning Development. (2010). Reflection. Plymouth: Plymouth University. http://www.plymouth.ac.uk/uploads/production/document/path/1/1717/Reflection.p df Accessed 7 January 2015. Pannucci, C. and Wilkins, E. (2010) Identifying and avoiding bias in research. Plastic and Reconstructive Surgery. 126 (2) 619-625. http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2917255/ Accessed 7 January 2015. Punch, K. (2010) Developing effective research proposals. 2nd ed. London: Sage Publications Ltd. Research Development Initiative. (2014) Anonymity and confidentiality. Lancaster: Lancaster University. http://www.lancaster.ac.uk/researchethics/1-2-anonconf.html Accessed 4 December 2014. Shuttleworth, M. (2014). Research bias. : Explorable.com. https://explorable.com/research-bias Accessed 7 January 2015. Thomas, G. (2013) How to do Your research project. London: Sage Publications Ltd. Thomas, S. (2015) Deception: definition, meaning and quiz. Mountain View: Education Portal. http://education-portal.com/academy/lesson/deception-definitionmeaning-quiz.html#lesson Accessed 21 January 2015. 17 www.brad.ac.uk/academic-skills Academic Skills Advice Answers Activity 1: Q v Q Quantitative Advantages Disadvantages B,C,F,G,L D,K,M Qualitative Advantages Disadvantages A,H,J E,I Activity 2: Data collection methods Use of primary or/and secondary sources Primary Primary Primary Primary Secondary Primary Secondary Primary Quantitative methods Qualitative methods Structured detachedobserver non-participant involved observation Questionnaire: structured closed questions Experiment Structured interview closed questions Use of statistical data Involved observer and participant observation (ethnography) Questionnaire: less-structured open questions Less-structured interview openquestions Focus group Use of reports Close measurement Activity 3: Assessing sampling, bias and ethical considerations Informed consent – no mention of this in the extract so do not know if information about the research was given to students. Also, no mention of participation briefing and consent forms being understood and completed. Anonymity – again, no discussion about the level of this especially as have used tutors and student support centre to find students. Confidentiality – do tutors and support staff have access as helped to source students, and as the results could be of interest to the former. Deception – n/a although not properly explaining what the research is about could be deemed so. Power and authority – we have no information on who the researcher is so we cannot access the relationship. Location is also undisclosed which can affect the power dynamic. 18 www.brad.ac.uk/academic-skills